2024-04-26T23:29:07.484 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T23:29:07.484 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} --archive /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321 --name rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/orig.config.yaml 2024-04-26T23:29:07.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:29:07.622 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321 branch: wip-rishabh-testing-20240426.111959 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} email: null first_in_suite: false job_id: '7675321' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240426.111959 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240426.111959 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 816 sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 sleep_before_teardown: 0 subset: 166/512 suite: fs suite_branch: wip-rishabh-testing-20240426.111959 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5vUKWQ8EM5ek5xX7qF8OCwcBDasgoxa5f58E3+oBLCXkV+L3ZvQa0JTp2ryiFAaZcFdj9QYW8mrgys8vbpjoI= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKVTk0XfNVx/3OEdFjAImHOPYnztQmEpTyWSATIOhXbLMh6pw5RaOP6M+D4U0vpKxJZsPoqpRWhtRsEh1zWXb0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_19:30:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T23:29:07.622 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa; will attempt to use it 2024-04-26T23:29:07.623 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks 2024-04-26T23:29:07.623 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T23:29:07.625 INFO:teuthology.task.internal:Checking packages... 2024-04-26T23:29:07.649 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bc612ffb9c1d5bc27536bc917a705262a36d4387' 2024-04-26T23:29:07.649 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T23:29:07.649 INFO:teuthology.packaging:ref: None 2024-04-26T23:29:07.649 INFO:teuthology.packaging:tag: None 2024-04-26T23:29:07.649 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240426.111959 2024-04-26T23:29:07.650 INFO:teuthology.packaging:sha1: bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:29:07.650 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240426.111959 2024-04-26T23:29:07.869 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:29:07.871 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T23:29:07.883 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T23:29:07.883 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T23:29:08.113 INFO:teuthology.task.internal:Saving configuration 2024-04-26T23:29:08.136 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T23:29:08.311 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:29:08.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:23:09.524350', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIODISPEdI3Gs4EuzaFgF/SiW+NA4RShK6jZiaeVTcTi4'} 2024-04-26T23:29:08.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:23:09.525644', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIARCZNSM8rjxtXfs7KnLEDS/wV4+yom1KusZg9+9ff95'} 2024-04-26T23:29:08.356 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T23:29:08.529 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-26T23:29:08.529 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-26T23:29:08.529 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T23:29:08.662 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f55c01664c0>, signals=[15]) 2024-04-26T23:29:08.663 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T23:29:08.736 INFO:teuthology.task.internal:Opening connections... 2024-04-26T23:29:08.736 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:29:08.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:29:08.821 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:29:08.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:29:08.902 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T23:29:09.191 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-04-26T23:29:09.197 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-04-26T23:29:09.197 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-04-26T23:29:09.245 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T23:29:09.245 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2024-04-26T23:29:09.245 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="22.04" 2024-04-26T23:29:09.245 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=jammy 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T23:29:09.246 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=jammy 2024-04-26T23:29:09.247 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-04-26T23:29:09.266 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-04-26T23:29:09.272 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-04-26T23:29:09.272 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2024-04-26T23:29:09.320 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T23:29:09.321 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T23:29:09.321 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T23:29:09.321 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T23:29:09.321 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2024-04-26T23:29:09.321 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-04-26T23:29:09.341 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T23:29:09.389 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T23:29:09.619 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T23:29:09.620 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:29:09.622 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-04-26T23:29:09.627 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T23:29:09.830 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T23:29:09.830 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:29:09.832 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-04-26T23:29:09.850 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T23:29:10.071 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T23:29:10.241 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-26T23:29:10.241 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-04-26T23:29:10.241 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:29:10.242 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T23:29:10.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:29:10.247 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:10.247 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:29:10.247 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-26T23:29:10.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:29:10.248 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:10.248 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-26T23:29:10.248 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-04-26T23:29:10.293 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-56-generic 2024-04-26T23:29:10.293 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:10.294 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:29:10.294 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:10.298 INFO:teuthology.orchestra.run.smithi203.stdout:5.15.0-56-generic 2024-04-26T23:29:10.299 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:10.299 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-26T23:29:10.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:10.446 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-04-26T23:29:10.446 DEBUG:teuthology.orchestra.run.smithi203:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T23:29:10.478 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T23:29:10.513 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-04-26T23:29:10.513 DEBUG:teuthology.orchestra.run.smithi047:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-26T23:29:10.535 INFO:teuthology.orchestra.run.smithi047.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-26T23:29:10.639 INFO:teuthology.orchestra.run.smithi203.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T23:29:10.639 INFO:teuthology.orchestra.run.smithi203.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T23:29:10.639 INFO:teuthology.orchestra.run.smithi203.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T23:29:10.639 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 2024-04-26T23:29:10.640 INFO:teuthology.orchestra.run.smithi203.stderr:hint: git config --global init.defaultBranch 2024-04-26T23:29:10.640 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 2024-04-26T23:29:10.640 INFO:teuthology.orchestra.run.smithi203.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T23:29:10.640 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T23:29:10.640 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 2024-04-26T23:29:10.640 INFO:teuthology.orchestra.run.smithi203.stderr:hint: git branch -m 2024-04-26T23:29:10.641 INFO:teuthology.orchestra.run.smithi203.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T23:29:10.643 DEBUG:teuthology.orchestra.run.smithi203:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T23:29:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: git config --global init.defaultBranch 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: 2024-04-26T23:29:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:hint: git branch -m 2024-04-26T23:29:10.715 DEBUG:teuthology.orchestra.run.smithi203:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T23:29:10.747 INFO:teuthology.orchestra.run.smithi047.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-26T23:29:10.750 DEBUG:teuthology.orchestra.run.smithi047:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-26T23:29:10.773 DEBUG:teuthology.orchestra.run.smithi203:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T23:29:10.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-26T23:29:10.875 DEBUG:teuthology.orchestra.run.smithi047:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-26T23:29:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T23:29:48.130 INFO:teuthology.orchestra.run.smithi047.stderr: * [new branch] main -> origin/main 2024-04-26T23:29:48.165 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T23:29:48.166 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T23:29:48.169 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T23:29:48.169 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T23:29:48.169 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T23:29:48.169 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T23:29:48.169 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T23:29:48.169 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T23:29:48.170 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T23:29:48.171 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T23:29:48.171 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T23:29:48.171 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T23:29:48.171 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T23:29:48.173 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T23:29:48.174 INFO:teuthology.orchestra.run.smithi047.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T23:29:49.071 INFO:teuthology.orchestra.run.smithi203.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-26T23:29:49.071 INFO:teuthology.orchestra.run.smithi203.stderr: * [new branch] main -> origin/main 2024-04-26T23:29:49.099 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190312 -> 20190312 2024-04-26T23:29:49.099 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190416 -> 20190416 2024-04-26T23:29:49.099 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190514 -> 20190514 2024-04-26T23:29:49.100 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190618 -> 20190618 2024-04-26T23:29:49.100 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190717 -> 20190717 2024-04-26T23:29:49.100 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190815 -> 20190815 2024-04-26T23:29:49.100 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190923 -> 20190923 2024-04-26T23:29:49.100 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20191022 -> 20191022 2024-04-26T23:29:49.100 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20191215 -> 20191215 2024-04-26T23:29:49.105 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200122 -> 20200122 2024-04-26T23:29:49.105 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200316 -> 20200316 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200421 -> 20200421 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200519 -> 20200519 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200619 -> 20200619 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200721 -> 20200721 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200817 -> 20200817 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200918 -> 20200918 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20201022 -> 20201022 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20201118 -> 20201118 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20201218 -> 20201218 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210208 -> 20210208 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210315 -> 20210315 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210511 -> 20210511 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210716 -> 20210716 2024-04-26T23:29:49.106 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210818 -> 20210818 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210919 -> 20210919 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20211027 -> 20211027 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20211216 -> 20211216 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220209 -> 20220209 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220310 -> 20220310 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220411 -> 20220411 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220509 -> 20220509 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220610 -> 20220610 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220708 -> 20220708 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220815 -> 20220815 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220913 -> 20220913 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20221012 -> 20221012 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20221109 -> 20221109 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20221214 -> 20221214 2024-04-26T23:29:49.107 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230117 -> 20230117 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230210 -> 20230210 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230310 -> 20230310 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230404 -> 20230404 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230515 -> 20230515 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230625 -> 20230625 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230804 -> 20230804 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230919 -> 20230919 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20231030 -> 20231030 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20231111 -> 20231111 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20231211 -> 20231211 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20240115 -> 20240115 2024-04-26T23:29:49.108 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20240220 -> 20240220 2024-04-26T23:29:49.109 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20240312 -> 20240312 2024-04-26T23:29:49.109 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20240410 -> 20240410 2024-04-26T23:29:52.663 INFO:teuthology.orchestra.run.smithi047.stderr:Updating files: 44% (1510/3390) Updating files: 45% (1526/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 58% (1989/3390) Updating files: 59% (2001/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 82% (2792/3390) Updating files: 83% (2814/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T23:29:52.668 INFO:teuthology.orchestra.run.smithi047.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T23:29:52.691 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T23:29:52.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:52.926 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:29:52.926 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T23:29:52.928 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi047.front.sepia.ceph.com to complete... 2024-04-26T23:29:53.377 INFO:teuthology.orchestra.run.smithi203.stderr:Updating files: 45% (1536/3390) Updating files: 46% (1560/3390) Updating files: 47% (1594/3390) Updating files: 48% (1628/3390) Updating files: 49% (1662/3390) Updating files: 50% (1695/3390) Updating files: 51% (1729/3390) Updating files: 52% (1763/3390) Updating files: 53% (1797/3390) Updating files: 54% (1831/3390) Updating files: 55% (1865/3390) Updating files: 56% (1899/3390) Updating files: 57% (1933/3390) Updating files: 58% (1967/3390) Updating files: 59% (2001/3390) Updating files: 59% (2018/3390) Updating files: 60% (2034/3390) Updating files: 61% (2068/3390) Updating files: 62% (2102/3390) Updating files: 63% (2136/3390) Updating files: 64% (2170/3390) Updating files: 65% (2204/3390) Updating files: 66% (2238/3390) Updating files: 67% (2272/3390) Updating files: 68% (2306/3390) Updating files: 69% (2340/3390) Updating files: 69% (2371/3390) Updating files: 70% (2373/3390) Updating files: 71% (2407/3390) Updating files: 72% (2441/3390) Updating files: 73% (2475/3390) Updating files: 74% (2509/3390) Updating files: 75% (2543/3390) Updating files: 76% (2577/3390) Updating files: 77% (2611/3390) Updating files: 78% (2645/3390) Updating files: 79% (2679/3390) Updating files: 80% (2712/3390) Updating files: 81% (2746/3390) Updating files: 82% (2780/3390) Updating files: 83% (2814/3390) Updating files: 83% (2821/3390) Updating files: 84% (2848/3390) Updating files: 85% (2882/3390) Updating files: 86% (2916/3390) Updating files: 87% (2950/3390) Updating files: 88% (2984/3390) Updating files: 89% (3018/3390) Updating files: 90% (3051/3390) Updating files: 91% (3085/3390) Updating files: 92% (3119/3390) Updating files: 93% (3153/3390) Updating files: 94% (3187/3390) Updating files: 95% (3221/3390) Updating files: 96% (3255/3390) Updating files: 97% (3289/3390) Updating files: 98% (3323/3390) Updating files: 99% (3357/3390) Updating files: 100% (3390/3390) Updating files: 100% (3390/3390), done. 2024-04-26T23:29:53.382 INFO:teuthology.orchestra.run.smithi203.stdout:HEAD is now at fc21f475 Merge branch 'robot/pr-0-1714105941' into 'main' 2024-04-26T23:29:53.402 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T23:29:53.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-26T23:29:53.544 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:29:53.545 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-26T23:29:53.547 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi203.front.sepia.ceph.com to complete... 2024-04-26T23:29:54.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26 23:29:55 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T23:29:54.957 INFO:teuthology.orchestra.run.smithi047.stderr:FINISHED --2024-04-26 23:29:55-- 2024-04-26T23:29:54.957 INFO:teuthology.orchestra.run.smithi047.stderr:Total wall clock time: 2.0s 2024-04-26T23:29:54.957 INFO:teuthology.orchestra.run.smithi047.stderr:Downloaded: 1 files, 43M in 1.8s (23.8 MB/s) 2024-04-26T23:29:54.964 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-04-26T23:29:54.964 DEBUG:teuthology.orchestra.run.smithi047:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T23:29:55.244 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T23:29:56.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26 23:29:56 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-26T23:29:56.522 INFO:teuthology.orchestra.run.smithi203.stderr:FINISHED --2024-04-26 23:29:56-- 2024-04-26T23:29:56.523 INFO:teuthology.orchestra.run.smithi203.stderr:Total wall clock time: 2.9s 2024-04-26T23:29:56.523 INFO:teuthology.orchestra.run.smithi203.stderr:Downloaded: 1 files, 43M in 2.8s (15.5 MB/s) 2024-04-26T23:29:56.527 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-04-26T23:29:56.527 DEBUG:teuthology.orchestra.run.smithi203:> sudo dpkg -i /tmp/linux-image.deb 2024-04-26T23:29:56.803 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-26T23:29:57.318 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T23:29:57.322 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T23:29:57.483 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:29:58.814 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-26T23:29:58.819 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-26T23:29:58.926 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:30:01.345 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:30:01.444 INFO:teuthology.orchestra.run.smithi047.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:02.894 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-26T23:30:03.005 INFO:teuthology.orchestra.run.smithi203.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:24.303 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:30:24.311 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:30:24.332 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-04-26T23:30:24.650 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:24.670 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:30:24.993 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:30:25.054 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:30:25.060 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:30:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:30:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:30:25.218 INFO:teuthology.orchestra.run.smithi047.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:30:25.249 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-04-26T23:30:25.439 DEBUG:teuthology.orchestra.run.smithi047:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T23:30:25.447 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T23:30:25.447 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T23:30:25.447 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.466 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.466 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.489 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T23:30:25.489 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T23:30:25.489 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T23:30:25.489 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T23:30:25.489 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T23:30:25.489 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T23:30:25.490 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:30:25.493 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T23:30:25.494 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T23:30:25.495 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:30:25.495 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:30:25.495 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:30:25.511 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:30:25.512 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:30:25.513 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:30:25.514 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:30:25.515 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:30:25.516 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:30:25.517 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:30:25.518 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:30:25.519 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:30:25.520 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T23:30:25.521 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T23:30:25.522 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:30:25.522 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T23:30:25.522 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:30:25.523 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:30:25.523 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:30:25.553 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-04-26T23:30:25.562 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:30:25.562 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T23:30:25.563 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:30:25.564 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T23:30:25.565 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T23:30:25.566 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:30:25.567 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:30:25.568 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T23:30:25.569 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:30:25.570 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T23:30:25.571 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T23:30:25.572 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:30:25.573 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T23:30:25.574 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:30:25.575 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:30:25.576 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:30:25.577 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:30:25.578 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:30:25.579 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:30:25.580 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:30:25.581 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:30:25.582 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:30:25.583 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:30:25.584 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:30:25.585 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:30:25.586 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:30:25.587 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T23:30:25.588 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:30:25.589 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:30:25.590 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:30:25.591 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:30:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T23:30:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T23:30:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:30:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T23:30:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:30:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T23:30:25.593 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:30:25.618 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T23:30:25.618 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:30:25.618 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T23:30:25.618 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T23:30:25.618 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T23:30:25.619 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T23:30:25.620 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T23:30:25.621 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:30:25.622 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:30:25.623 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T23:30:25.624 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:30:25.625 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:30:25.626 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:30:25.627 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:30:25.628 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T23:30:25.629 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T23:30:25.630 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:30:25.631 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:30:25.632 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:30:25.633 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:30:25.634 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T23:30:25.635 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T23:30:25.636 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T23:30:25.637 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T23:30:25.638 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T23:30:25.639 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T23:30:25.640 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T23:30:25.641 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:30:25.648 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T23:30:25.648 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:30:25.648 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T23:30:25.648 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:30:25.648 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T23:30:25.648 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:30:25.648 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T23:30:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:30:25.650 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:30:25.651 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T23:30:25.652 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T23:30:25.653 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:30:25.654 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T23:30:25.675 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:30:25.676 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:30:25.677 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:30:25.678 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T23:30:25.679 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T23:30:25.680 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T23:30:25.681 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T23:30:25.682 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T23:30:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:30:25.684 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:30:25.685 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T23:30:25.686 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T23:30:25.687 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:30:25.688 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T23:30:25.689 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T23:30:25.690 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T23:30:25.691 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T23:30:25.692 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T23:30:25.693 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T23:30:25.694 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:30:25.699 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T23:30:25.699 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:30:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:30:25.701 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T23:30:25.702 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T23:30:25.703 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:30:25.704 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T23:30:25.705 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:30:25.706 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T23:30:25.706 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:30:25.706 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:30:25.707 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:30:25.707 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:30:25.707 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:30:25.708 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:30:25.708 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:30:25.708 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:30:25.708 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:30:25.708 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:30:25.709 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T23:30:25.709 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:30:25.709 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T23:30:25.710 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:30:25.712 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T23:30:25.712 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:30:25.712 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:30:25.712 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:30:25.712 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:30:25.714 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:30:25.714 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:30:25.714 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T23:30:25.714 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:30:25.718 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T23:30:25.718 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T23:30:25.718 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T23:30:25.718 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:30:25.718 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:30:25.718 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T23:30:25.719 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:30:25.720 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T23:30:25.721 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T23:30:25.728 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T23:30:25.729 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T23:30:25.730 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T23:30:25.731 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T23:30:25.732 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T23:30:25.733 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T23:30:25.734 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T23:30:25.752 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T23:30:25.752 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T23:30:25.753 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:30:25.754 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T23:30:25.755 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:30:25.756 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:30:25.757 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:30:25.758 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:30:25.759 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:30:25.760 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T23:30:25.761 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T23:30:25.762 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:30:25.763 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:30:25.764 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:30:25.765 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T23:30:25.766 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T23:30:25.767 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:30:25.768 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T23:30:25.769 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:30:25.771 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T23:30:25.771 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:30:25.771 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:30:25.772 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T23:30:25.773 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:30:25.773 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T23:30:25.773 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T23:30:25.773 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T23:30:25.773 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:30:25.773 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T23:30:25.773 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T23:30:25.774 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:30:25.775 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T23:30:25.775 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:30:25.775 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T23:30:25.775 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:30:25.775 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T23:30:25.776 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:30:25.777 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:30:25.779 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T23:30:25.779 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:30:25.780 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:30:25.784 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T23:30:25.784 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:30:25.784 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:30:25.784 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T23:30:25.784 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:30:25.787 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T23:30:25.787 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:30:25.791 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:30:25.792 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:30:25.793 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:30:25.793 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:30:25.793 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:30:25.793 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:30:25.793 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:30:25.793 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:30:25.793 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:30:25.795 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:30:25.796 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:30:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:30:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:30:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:30:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T23:30:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T23:30:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T23:30:25.799 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T23:30:25.801 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:30:25.802 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T23:30:25.802 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:30:25.802 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T23:30:25.802 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T23:30:25.802 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:30:25.808 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T23:30:25.808 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:30:25.808 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:30:25.808 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T23:30:25.808 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T23:30:25.809 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:30:25.820 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T23:30:25.820 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T23:30:25.820 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:30:25.821 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:30:25.822 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T23:30:25.823 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T23:30:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:30:25.827 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:30:25.828 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:30:25.829 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:30:25.829 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:30:25.829 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T23:30:25.829 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:30:25.831 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:30:25.833 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T23:30:25.834 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:30:25.854 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.860 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T23:30:25.861 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:30:25.862 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:30:25.863 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:30:25.864 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:30:25.865 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:30:25.866 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:30:25.867 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:30:25.868 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T23:30:25.869 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:30:25.870 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:30:25.871 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:30:25.872 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:30:25.873 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:30:25.874 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T23:30:25.875 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:30:25.876 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:30:25.877 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:30:25.878 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:30:25.879 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:30:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T23:30:25.881 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:30:25.882 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:30:25.883 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:30:25.884 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T23:30:25.885 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:30:25.886 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:30:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T23:30:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T23:30:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:30:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:30:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:30:25.890 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:30:25.891 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T23:30:25.892 INFO:teuthology.orchestra.run.smithi047.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T23:30:25.897 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.897 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.898 DEBUG:teuthology.orchestra.run.smithi047:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T23:30:25.938 INFO:teuthology.orchestra.run.smithi047.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:30:25.939 INFO:teuthology.orchestra.run.smithi047.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:30:25.939 INFO:teuthology.orchestra.run.smithi047.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:30:25.939 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T23:30:25.939 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:25.940 DEBUG:teuthology.orchestra.run.smithi047:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T23:30:25.981 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi047.front.sepia.ceph.com to complete... 2024-04-26T23:30:26.142 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:30:26.158 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:30:26.223 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:30:26.228 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:30:26.369 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:30:26.369 INFO:teuthology.orchestra.run.smithi203.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:30:26.369 INFO:teuthology.orchestra.run.smithi203.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:30:26.407 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-04-26T23:30:26.445 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:30:26.446 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:30:26.450 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-04-26T23:30:26.573 DEBUG:teuthology.orchestra.run.smithi203:> dpkg-deb -c /tmp/linux-image.deb 2024-04-26T23:30:26.580 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-26T23:30:26.580 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-26T23:30:26.580 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.618 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-26T23:30:26.618 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-26T23:30:26.618 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-26T23:30:26.618 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-26T23:30:26.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-26T23:30:26.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-26T23:30:26.623 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-26T23:30:26.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-26T23:30:26.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-26T23:30:26.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-26T23:30:26.624 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-26T23:30:26.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-26T23:30:26.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-26T23:30:26.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-26T23:30:26.640 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.647 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.683 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-26T23:30:26.683 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-26T23:30:26.683 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-26T23:30:26.683 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-26T23:30:26.683 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-26T23:30:26.683 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-26T23:30:26.684 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-26T23:30:26.685 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-26T23:30:26.686 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-26T23:30:26.687 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-26T23:30:26.688 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-26T23:30:26.689 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-26T23:30:26.690 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-26T23:30:26.691 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-26T23:30:26.692 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-26T23:30:26.693 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-26T23:30:26.694 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-26T23:30:26.695 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-26T23:30:26.696 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-26T23:30:26.697 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-26T23:30:26.698 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-26T23:30:26.699 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-26T23:30:26.700 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-26T23:30:26.701 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-26T23:30:26.702 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-26T23:30:26.703 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-26T23:30:26.704 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-26T23:30:26.705 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-26T23:30:26.706 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-26T23:30:26.707 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-26T23:30:26.708 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-26T23:30:26.709 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-26T23:30:26.710 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-26T23:30:26.711 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-26T23:30:26.712 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-26T23:30:26.713 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-26T23:30:26.713 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-26T23:30:26.714 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-26T23:30:26.715 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-26T23:30:26.716 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-26T23:30:26.717 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-26T23:30:26.718 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-26T23:30:26.719 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-26T23:30:26.720 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-26T23:30:26.721 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-26T23:30:26.722 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-26T23:30:26.723 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-26T23:30:26.724 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-26T23:30:26.725 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-26T23:30:26.725 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-26T23:30:26.725 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-26T23:30:26.777 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-26T23:30:26.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-26T23:30:26.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-26T23:30:26.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-26T23:30:26.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-26T23:30:26.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-26T23:30:26.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-26T23:30:26.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-26T23:30:26.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-26T23:30:26.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-26T23:30:26.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-26T23:30:26.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-26T23:30:26.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-26T23:30:26.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-26T23:30:26.791 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-26T23:30:26.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-26T23:30:26.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-26T23:30:26.794 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-26T23:30:26.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-26T23:30:26.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-26T23:30:26.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-26T23:30:26.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-26T23:30:26.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-26T23:30:26.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-26T23:30:26.801 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-26T23:30:26.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-26T23:30:26.803 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-26T23:30:26.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-26T23:30:26.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-26T23:30:26.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-26T23:30:26.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-26T23:30:26.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-26T23:30:26.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-26T23:30:26.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-26T23:30:26.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-26T23:30:26.812 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-26T23:30:26.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-26T23:30:26.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-26T23:30:26.815 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-26T23:30:26.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-26T23:30:26.817 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-26T23:30:26.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-26T23:30:26.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-26T23:30:26.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-26T23:30:26.821 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-26T23:30:26.822 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-26T23:30:26.823 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-26T23:30:26.824 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-26T23:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-26T23:30:26.826 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-26T23:30:26.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-26T23:30:26.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-26T23:30:26.870 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-26T23:30:26.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-26T23:30:26.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-26T23:30:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-26T23:30:26.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-26T23:30:26.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-26T23:30:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-26T23:30:26.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-26T23:30:26.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-26T23:30:26.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-26T23:30:26.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-26T23:30:26.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-26T23:30:26.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-26T23:30:26.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-26T23:30:26.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-26T23:30:26.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-26T23:30:26.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-26T23:30:26.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-26T23:30:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-26T23:30:26.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-26T23:30:26.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-26T23:30:26.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-26T23:30:26.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-26T23:30:26.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-26T23:30:26.892 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-26T23:30:26.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-26T23:30:26.894 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-26T23:30:26.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-26T23:30:26.896 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-26T23:30:26.897 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-26T23:30:26.898 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-26T23:30:26.899 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-26T23:30:26.900 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-26T23:30:26.901 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-26T23:30:26.902 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-26T23:30:26.903 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-26T23:30:26.904 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-26T23:30:26.905 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-26T23:30:26.906 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-26T23:30:26.907 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-26T23:30:26.908 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-26T23:30:26.922 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:30:26.929 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:30:26.947 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-26T23:30:26.948 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-26T23:30:26.949 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-26T23:30:26.950 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-26T23:30:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-26T23:30:26.952 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-26T23:30:26.953 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-26T23:30:26.954 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-26T23:30:26.955 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-26T23:30:26.956 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-26T23:30:26.957 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-26T23:30:26.958 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-26T23:30:26.959 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-26T23:30:26.960 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-26T23:30:26.961 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-26T23:30:26.962 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-26T23:30:26.963 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-26T23:30:26.964 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-26T23:30:26.965 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-26T23:30:26.966 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-26T23:30:26.967 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-26T23:30:26.968 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-26T23:30:26.969 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-26T23:30:26.970 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-26T23:30:26.971 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-26T23:30:26.972 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-26T23:30:26.973 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-26T23:30:26.974 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-26T23:30:26.975 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-26T23:30:26.976 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-26T23:30:26.977 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-26T23:30:26.978 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-26T23:30:26.979 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-26T23:30:26.980 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-26T23:30:26.981 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-26T23:30:26.982 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-26T23:30:26.983 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-26T23:30:26.984 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-26T23:30:26.984 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-26T23:30:26.984 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-26T23:30:26.988 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.989 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.989 DEBUG:teuthology.orchestra.run.smithi203:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-26T23:30:26.989 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:30:26.989 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:30:26.996 INFO:teuthology.orchestra.run.smithi203.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:30:26.996 INFO:teuthology.orchestra.run.smithi203.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:30:26.996 INFO:teuthology.orchestra.run.smithi203.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-26T23:30:26.996 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-26T23:30:26.996 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:26.997 DEBUG:teuthology.orchestra.run.smithi203:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-26T23:30:27.040 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi203.front.sepia.ceph.com to complete... 2024-04-26T23:30:27.089 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:30:27.090 INFO:teuthology.orchestra.run.smithi047.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:30:27.090 INFO:teuthology.orchestra.run.smithi047.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:30:27.098 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-04-26T23:30:27.415 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub' 2024-04-26T23:30:27.416 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T23:30:27.447 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-04-26T23:30:27.626 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:27.630 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-26T23:30:27.857 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T23:30:27.862 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T23:30:27.903 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T23:30:27.908 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T23:30:28.036 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T23:30:28.036 INFO:teuthology.orchestra.run.smithi203.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T23:30:28.036 INFO:teuthology.orchestra.run.smithi203.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T23:30:28.056 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-04-26T23:30:58.233 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T23:30:58.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-26T23:30:58.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:30:59.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T23:30:59.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-26T23:30:59.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:31:16.639 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-04-26T23:31:17.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-26T23:31:25.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-26T23:31:25.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:31:26.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-26T23:31:26.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:31:29.730 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-26T23:31:41.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-26T23:31:41.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:32:25.693 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T23:32:37.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-26T23:32:37.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:32:37.918 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-26T23:32:38.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-26T23:32:38.574 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:32:38.574 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-04-26T23:32:38.629 INFO:teuthology.orchestra.run.smithi047.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:32:38.629 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:32:38.629 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:32:38.629 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T23:32:39.630 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T23:32:39.630 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T23:32:39.720 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-04-26T23:32:39.788 DEBUG:teuthology.parallel:result is None 2024-04-26T23:32:41.735 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T23:32:56.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-26T23:32:56.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:32:56.943 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-04-26T23:32:57.631 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-26T23:32:57.632 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-04-26T23:32:57.632 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-04-26T23:32:57.681 INFO:teuthology.orchestra.run.smithi203.stdout:6.9.0-rc3-g806ec36b2112 2024-04-26T23:32:57.681 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-26T23:32:57.681 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T23:32:57.681 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T23:32:58.682 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T23:32:58.682 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T23:32:58.777 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-04-26T23:32:58.837 DEBUG:teuthology.parallel:result is None 2024-04-26T23:32:58.838 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T23:32:58.850 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T23:32:58.850 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:32:58.854 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T23:32:58.863 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T23:32:59.084 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T23:32:59.289 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T23:32:59.289 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:32:59.292 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T23:32:59.331 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T23:32:59.860 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T23:32:59.860 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:32:59.864 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T23:32:59.890 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:32:59.891 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:32:59.903 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:32:59.905 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T23:32:59.907 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T23:33:00.078 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T23:33:00.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:33:00.082 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T23:33:00.103 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T23:33:00.274 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T23:33:00.274 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:33:00.277 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T23:33:00.286 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:33:00.334 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:33:00.386 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:33:00.386 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:33:00.455 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T23:33:00.464 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T23:33:00.518 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:33:00.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T23:33:00.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-04-26T23:33:00.591 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-04-26T23:33:00.712 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T23:33:00.720 INFO:teuthology.task.internal:Starting timer... 2024-04-26T23:33:00.720 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T23:33:00.904 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T23:33:01.111 DEBUG:teuthology.task.selinux:Excluding smithi047: OS 'ubuntu' does not support SELinux 2024-04-26T23:33:01.111 DEBUG:teuthology.task.selinux:Excluding smithi203: OS 'ubuntu' does not support SELinux 2024-04-26T23:33:01.111 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T23:33:01.111 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T23:33:01.111 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T23:33:01.111 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T23:33:01.325 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-26T23:33:01.331 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-26T23:33:01.481 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T23:33:01.520 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T23:33:01.522 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T23:40:47.828 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-04-26T23:40:47.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-26T23:40:47.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:40:47.913 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-04-26T23:40:48.049 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-04-26T23:40:48.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-26T23:40:48.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T23:40:48.131 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-04-26T23:40:48.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-26T23:40:48.245 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T23:40:48.255 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T23:40:48.255 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:40:48.256 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:40:48.259 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T23:40:48.259 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Command line: ntpd -gq 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: ---------------------------------------------------- 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: corporation. Support and training for ntp-4 are 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: available at https://www.nwtime.org/support 2024-04-26T23:40:48.296 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: ---------------------------------------------------- 2024-04-26T23:40:48.297 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: proto: precision = 0.044 usec (-24) 2024-04-26T23:40:48.297 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: basedate set to 2022-02-04 2024-04-26T23:40:48.297 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:40:48.297 INFO:teuthology.orchestra.run.smithi047.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:40:48.298 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:40:48.298 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:40:48.298 INFO:teuthology.orchestra.run.smithi047.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:40:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:40:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:40:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:40:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Listen normally on 3 ens1f0 172.21.15.47:123 2024-04-26T23:40:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Listen normally on 4 lo [::1]:123 2024-04-26T23:40:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:148e%3]:123 2024-04-26T23:40:48.299 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:48 ntpd[17124]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:40:48.325 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T23:40:48.325 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Command line: ntpd -gq 2024-04-26T23:40:48.325 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: ---------------------------------------------------- 2024-04-26T23:40:48.326 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T23:40:48.326 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T23:40:48.326 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: corporation. Support and training for ntp-4 are 2024-04-26T23:40:48.326 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: available at https://www.nwtime.org/support 2024-04-26T23:40:48.326 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: ---------------------------------------------------- 2024-04-26T23:40:48.326 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: proto: precision = 0.042 usec (-24) 2024-04-26T23:40:48.327 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: basedate set to 2022-02-04 2024-04-26T23:40:48.327 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: gps base set to 2022-02-06 (week 2196) 2024-04-26T23:40:48.327 INFO:teuthology.orchestra.run.smithi203.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:40:48.327 INFO:teuthology.orchestra.run.smithi203.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:40:48.327 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T23:40:48.327 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T23:40:48.328 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T23:40:48.328 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T23:40:48.329 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T23:40:48.329 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Listen normally on 3 enp3s0f1 172.21.15.203:123 2024-04-26T23:40:48.329 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Listen normally on 4 lo [::1]:123 2024-04-26T23:40:48.329 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4a23%5]:123 2024-04-26T23:40:48.329 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:48 ntpd[17212]: Listening on routing socket on fd #22 for interface updates 2024-04-26T23:40:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:49.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:49.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:49 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:50.296 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:50 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:50 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:50 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:50 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:50 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:50.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:50 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:50.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:50 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:50.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:50 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:50.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:50 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:50.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:50 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:50.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:50 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:50.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:50 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:51.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:51.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:51.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:51.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:51 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:52.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:52 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:52.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:52 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:52.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:52 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:52.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:52 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:52.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:52 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:52.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:52 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:52.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:52 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.299 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:53.300 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:53 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:53.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:53.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:53.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:53.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:53 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:54.296 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:54 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:54.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:54 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:54.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:54 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:54.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:54 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:54.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:54 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:54.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:54 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:54.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:54.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:54 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:55.297 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:55.298 INFO:teuthology.orchestra.run.smithi047.stdout:26 Apr 23:40:55 ntpd[17124]: ntpd: time slew -0.000439 s 2024-04-26T23:40:55.298 INFO:teuthology.orchestra.run.smithi047.stdout:ntpd: time slew -0.000439s 2024-04-26T23:40:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:40:55.298 INFO:teuthology.orchestra.run.smithi047.stderr:26 Apr 23:40:55 ntpd[17124]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:40:55.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:55 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:55.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:55 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:55.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:55 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:55.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:55 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:55.326 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:55 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:55.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:55 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi047.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi047.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi047.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:55.393 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T23:40:56.327 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T23:40:56.328 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T23:40:56.328 INFO:teuthology.orchestra.run.smithi203.stdout:26 Apr 23:40:56 ntpd[17212]: ntpd: time slew -0.002573 s 2024-04-26T23:40:56.328 INFO:teuthology.orchestra.run.smithi203.stdout:ntpd: time slew -0.002573s 2024-04-26T23:40:56.328 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T23:40:56.328 INFO:teuthology.orchestra.run.smithi203.stderr:26 Apr 23:40:56 ntpd[17212]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T23:40:56.486 INFO:teuthology.orchestra.run.smithi203.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:40:56.487 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================== 2024-04-26T23:40:56.487 INFO:teuthology.orchestra.run.smithi203.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:56.487 INFO:teuthology.orchestra.run.smithi203.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:56.487 INFO:teuthology.orchestra.run.smithi203.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:56.487 INFO:teuthology.orchestra.run.smithi203.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T23:40:56.488 INFO:teuthology.run_tasks:Running task install... 2024-04-26T23:40:56.496 DEBUG:teuthology.task.install:project ceph 2024-04-26T23:40:56.496 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}} 2024-04-26T23:40:56.497 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'} 2024-04-26T23:40:56.497 INFO:teuthology.task.install:Using flavor: default 2024-04-26T23:40:56.502 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T23:40:56.503 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T23:40:56.503 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-key list | grep Ceph 2024-04-26T23:40:56.503 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-key list | grep Ceph 2024-04-26T23:40:56.611 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:40:56.639 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T23:40:56.664 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:40:56.664 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:40:56.665 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:40:56.665 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:40:56.665 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:40:56.690 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T23:40:56.690 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T23:40:56.691 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-26T23:40:56.691 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-26T23:40:56.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:40:56.880 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:40:56.880 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:56.911 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default/ 2024-04-26T23:40:56.911 INFO:teuthology.task.install.deb:Package version is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:56.995 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:40:56.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:40:57.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-04-26T23:40:57.083 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:40:57.083 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T23:40:57.102 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2024-04-26T23:40:57.214 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:40:57.223 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T23:40:57.224 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T23:40:57.244 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:40:57.257 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:40:57.277 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T23:40:57.278 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:40:57.289 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T23:40:57.300 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:40:57.300 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T23:40:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:40:57.332 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T23:40:57.353 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:40:57.353 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T23:40:57.376 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T23:40:57.395 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T23:40:57.397 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-04-26T23:40:57.430 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-26T23:40:57.820 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 140 kB in 1s (244 kB/s) 2024-04-26T23:40:57.882 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 258 kB in 1s (461 kB/s) 2024-04-26T23:40:58.840 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-26T23:40:58.855 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:58.889 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-04-26T23:40:58.905 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3306-gbc612ffb-1jammy cephadm=19.0.0-3306-gbc612ffb-1jammy ceph-mds=19.0.0-3306-gbc612ffb-1jammy ceph-mgr=19.0.0-3306-gbc612ffb-1jammy ceph-common=19.0.0-3306-gbc612ffb-1jammy ceph-fuse=19.0.0-3306-gbc612ffb-1jammy ceph-test=19.0.0-3306-gbc612ffb-1jammy ceph-volume=19.0.0-3306-gbc612ffb-1jammy radosgw=19.0.0-3306-gbc612ffb-1jammy python3-rados=19.0.0-3306-gbc612ffb-1jammy python3-rgw=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy python3-rbd=19.0.0-3306-gbc612ffb-1jammy libcephfs2=19.0.0-3306-gbc612ffb-1jammy libcephfs-dev=19.0.0-3306-gbc612ffb-1jammy librados2=19.0.0-3306-gbc612ffb-1jammy librbd1=19.0.0-3306-gbc612ffb-1jammy rbd-fuse=19.0.0-3306-gbc612ffb-1jammy python3-cephfs=19.0.0-3306-gbc612ffb-1jammy cephfs-shell=19.0.0-3306-gbc612ffb-1jammy cephfs-top=19.0.0-3306-gbc612ffb-1jammy cephfs-mirror=19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:40:58.931 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-26T23:40:58.979 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-04-26T23:40:59.110 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-04-26T23:40:59.111 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-04-26T23:40:59.153 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-04-26T23:40:59.153 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:40:59.291 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:40:59.292 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:40:59.292 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:40:59.292 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:40:59.294 INFO:teuthology.orchestra.run.smithi047.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:40:59.295 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:40:59.296 INFO:teuthology.orchestra.run.smithi047.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:40:59.297 INFO:teuthology.orchestra.run.smithi047.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:40:59.297 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-04-26T23:40:59.297 INFO:teuthology.orchestra.run.smithi047.stdout: btrfs-tools 2024-04-26T23:40:59.329 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:40:59.329 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:40:59.329 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:40:59.329 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:40:59.330 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:40:59.330 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:40:59.330 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:40:59.330 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-04-26T23:40:59.331 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T23:40:59.331 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T23:40:59.332 INFO:teuthology.orchestra.run.smithi203.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:40:59.332 INFO:teuthology.orchestra.run.smithi203.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T23:40:59.332 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T23:40:59.332 INFO:teuthology.orchestra.run.smithi203.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T23:40:59.333 INFO:teuthology.orchestra.run.smithi203.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T23:40:59.334 INFO:teuthology.orchestra.run.smithi203.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T23:40:59.335 INFO:teuthology.orchestra.run.smithi203.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T23:40:59.335 INFO:teuthology.orchestra.run.smithi203.stdout:Recommended packages: 2024-04-26T23:40:59.335 INFO:teuthology.orchestra.run.smithi203.stdout: btrfs-tools 2024-04-26T23:40:59.455 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-04-26T23:40:59.455 INFO:teuthology.orchestra.run.smithi047.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:40:59.455 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:40:59.455 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:40:59.455 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:40:59.456 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:40:59.456 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:40:59.456 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:40:59.456 INFO:teuthology.orchestra.run.smithi047.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:40:59.457 INFO:teuthology.orchestra.run.smithi047.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:40:59.457 INFO:teuthology.orchestra.run.smithi047.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:40:59.457 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:40:59.457 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:40:59.458 INFO:teuthology.orchestra.run.smithi047.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:40:59.459 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:40:59.459 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:40:59.459 INFO:teuthology.orchestra.run.smithi047.stdout: socat unzip xmlstarlet zip 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-04-26T23:40:59.483 INFO:teuthology.orchestra.run.smithi203.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T23:40:59.484 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T23:40:59.486 INFO:teuthology.orchestra.run.smithi203.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T23:40:59.487 INFO:teuthology.orchestra.run.smithi203.stdout: socat unzip xmlstarlet zip 2024-04-26T23:40:59.532 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:40:59.532 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 182 MB of archives. 2024-04-26T23:40:59.532 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:40:59.532 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:40:59.553 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:40:59.565 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:40:59.606 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:40:59.617 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:40:59.633 INFO:teuthology.orchestra.run.smithi203.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-26T23:40:59.633 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 182 MB of archives. 2024-04-26T23:40:59.633 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-26T23:40:59.633 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3306-gbc612ffb-1jammy [3,556 kB] 2024-04-26T23:40:59.643 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:40:59.646 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:40:59.659 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:40:59.681 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-26T23:40:59.709 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:40:59.712 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:40:59.722 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:40:59.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:40:59.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:40:59.733 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:40:59.735 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:40:59.737 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:40:59.738 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:40:59.739 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:40:59.760 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:40:59.762 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:40:59.763 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:40:59.764 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:40:59.764 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:40:59.765 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:40:59.766 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T23:40:59.766 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:40:59.766 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:40:59.767 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:40:59.783 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:40:59.794 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:40:59.794 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:40:59.797 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:40:59.797 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:40:59.798 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:40:59.798 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:40:59.799 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:40:59.799 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:40:59.804 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:40:59.812 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-26T23:40:59.821 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:40:59.822 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:40:59.822 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:40:59.828 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:40:59.828 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:40:59.828 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:40:59.829 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:40:59.830 INFO:teuthology.orchestra.run.smithi047.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:40:59.832 INFO:teuthology.orchestra.run.smithi047.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:40:59.837 INFO:teuthology.orchestra.run.smithi047.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:40:59.852 INFO:teuthology.orchestra.run.smithi047.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:40:59.854 INFO:teuthology.orchestra.run.smithi047.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:40:59.855 INFO:teuthology.orchestra.run.smithi047.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:40:59.857 INFO:teuthology.orchestra.run.smithi047.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:40:59.858 INFO:teuthology.orchestra.run.smithi047.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:40:59.859 INFO:teuthology.orchestra.run.smithi047.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:40:59.861 INFO:teuthology.orchestra.run.smithi047.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:40:59.923 INFO:teuthology.orchestra.run.smithi047.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:40:59.924 INFO:teuthology.orchestra.run.smithi047.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:40:59.925 INFO:teuthology.orchestra.run.smithi047.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:40:59.926 INFO:teuthology.orchestra.run.smithi047.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:40:59.927 INFO:teuthology.orchestra.run.smithi047.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:40:59.948 INFO:teuthology.orchestra.run.smithi047.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:40:59.951 INFO:teuthology.orchestra.run.smithi047.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:40:59.952 INFO:teuthology.orchestra.run.smithi047.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:40:59.965 INFO:teuthology.orchestra.run.smithi047.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:40:59.980 INFO:teuthology.orchestra.run.smithi047.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:40:59.981 INFO:teuthology.orchestra.run.smithi047.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:40:59.989 INFO:teuthology.orchestra.run.smithi047.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:40:59.995 INFO:teuthology.orchestra.run.smithi047.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:40:59.996 INFO:teuthology.orchestra.run.smithi047.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:40:59.996 INFO:teuthology.orchestra.run.smithi047.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:40:59.997 INFO:teuthology.orchestra.run.smithi047.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:40:59.997 INFO:teuthology.orchestra.run.smithi047.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:40:59.998 INFO:teuthology.orchestra.run.smithi047.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:41:00.001 INFO:teuthology.orchestra.run.smithi047.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:41:00.002 INFO:teuthology.orchestra.run.smithi047.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi047.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:41:00.014 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T23:41:00.016 INFO:teuthology.orchestra.run.smithi047.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:41:00.018 INFO:teuthology.orchestra.run.smithi047.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:41:00.018 INFO:teuthology.orchestra.run.smithi047.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:41:00.019 INFO:teuthology.orchestra.run.smithi047.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:41:00.022 INFO:teuthology.orchestra.run.smithi047.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:41:00.034 INFO:teuthology.orchestra.run.smithi047.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:41:00.036 INFO:teuthology.orchestra.run.smithi047.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:41:00.040 INFO:teuthology.orchestra.run.smithi047.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:41:00.040 INFO:teuthology.orchestra.run.smithi047.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:41:00.042 INFO:teuthology.orchestra.run.smithi047.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:41:00.042 INFO:teuthology.orchestra.run.smithi047.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:41:00.047 INFO:teuthology.orchestra.run.smithi047.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:41:00.048 INFO:teuthology.orchestra.run.smithi047.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:41:00.059 INFO:teuthology.orchestra.run.smithi047.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:41:00.059 INFO:teuthology.orchestra.run.smithi047.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:41:00.060 INFO:teuthology.orchestra.run.smithi047.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:41:00.079 INFO:teuthology.orchestra.run.smithi047.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:41:00.081 INFO:teuthology.orchestra.run.smithi047.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:41:00.082 INFO:teuthology.orchestra.run.smithi047.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:41:00.090 INFO:teuthology.orchestra.run.smithi047.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:41:00.090 INFO:teuthology.orchestra.run.smithi047.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:41:00.090 INFO:teuthology.orchestra.run.smithi047.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:41:00.093 INFO:teuthology.orchestra.run.smithi047.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:41:00.105 INFO:teuthology.orchestra.run.smithi047.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:41:00.107 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T23:41:00.121 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T23:41:00.172 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T23:41:00.227 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3306-gbc612ffb-1jammy [3,224 kB] 2024-04-26T23:41:00.318 INFO:teuthology.orchestra.run.smithi047.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:41:00.326 INFO:teuthology.orchestra.run.smithi047.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:41:00.341 INFO:teuthology.orchestra.run.smithi047.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:41:00.345 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T23:41:00.355 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T23:41:00.382 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T23:41:00.390 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T23:41:00.558 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T23:41:00.666 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3306-gbc612ffb-1jammy [712 kB] 2024-04-26T23:41:00.784 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3306-gbc612ffb-1jammy [356 kB] 2024-04-26T23:41:00.842 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3306-gbc612ffb-1jammy [32.8 kB] 2024-04-26T23:41:00.844 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3306-gbc612ffb-1jammy [180 kB] 2024-04-26T23:41:00.850 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3306-gbc612ffb-1jammy [67.1 kB] 2024-04-26T23:41:00.853 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3306-gbc612ffb-1jammy [330 kB] 2024-04-26T23:41:00.912 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3306-gbc612ffb-1jammy [6,892 kB] 2024-04-26T23:41:01.163 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T23:41:01.178 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T23:41:01.194 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T23:41:01.204 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T23:41:01.205 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T23:41:01.221 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T23:41:01.258 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T23:41:01.272 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T23:41:01.277 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T23:41:01.277 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T23:41:01.444 INFO:teuthology.orchestra.run.smithi047.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:41:01.447 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T23:41:01.533 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T23:41:01.539 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T23:41:01.615 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T23:41:01.643 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T23:41:01.647 INFO:teuthology.orchestra.run.smithi047.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:41:01.653 INFO:teuthology.orchestra.run.smithi047.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:41:01.654 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T23:41:01.658 INFO:teuthology.orchestra.run.smithi047.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:41:01.696 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T23:41:01.724 INFO:teuthology.orchestra.run.smithi047.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:41:01.871 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T23:41:01.885 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T23:41:01.891 INFO:teuthology.orchestra.run.smithi203.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T23:41:01.897 INFO:teuthology.orchestra.run.smithi203.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T23:41:01.960 INFO:teuthology.orchestra.run.smithi203.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3306-gbc612ffb-1jammy [112 kB] 2024-04-26T23:41:01.964 INFO:teuthology.orchestra.run.smithi203.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3306-gbc612ffb-1jammy [466 kB] 2024-04-26T23:41:01.995 INFO:teuthology.orchestra.run.smithi047.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:41:02.033 INFO:teuthology.orchestra.run.smithi203.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3306-gbc612ffb-1jammy [25.8 MB] 2024-04-26T23:41:02.081 INFO:teuthology.orchestra.run.smithi203.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T23:41:02.164 INFO:teuthology.orchestra.run.smithi203.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T23:41:02.180 INFO:teuthology.orchestra.run.smithi203.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T23:41:02.375 INFO:teuthology.orchestra.run.smithi203.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T23:41:02.438 INFO:teuthology.orchestra.run.smithi203.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T23:41:02.450 INFO:teuthology.orchestra.run.smithi203.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T23:41:02.956 INFO:teuthology.orchestra.run.smithi047.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:41:02.957 INFO:teuthology.orchestra.run.smithi047.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:41:02.991 INFO:teuthology.orchestra.run.smithi203.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T23:41:02.992 INFO:teuthology.orchestra.run.smithi047.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:41:02.999 INFO:teuthology.orchestra.run.smithi203.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T23:41:03.043 INFO:teuthology.orchestra.run.smithi203.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T23:41:03.089 INFO:teuthology.orchestra.run.smithi203.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T23:41:03.090 INFO:teuthology.orchestra.run.smithi047.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:41:03.131 INFO:teuthology.orchestra.run.smithi047.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:41:03.136 INFO:teuthology.orchestra.run.smithi047.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:41:03.192 INFO:teuthology.orchestra.run.smithi203.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T23:41:03.230 INFO:teuthology.orchestra.run.smithi047.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:41:03.548 INFO:teuthology.orchestra.run.smithi203.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T23:41:03.598 INFO:teuthology.orchestra.run.smithi047.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:41:03.598 INFO:teuthology.orchestra.run.smithi047.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:41:03.811 INFO:teuthology.orchestra.run.smithi203.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T23:41:03.944 INFO:teuthology.orchestra.run.smithi203.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T23:41:03.987 INFO:teuthology.orchestra.run.smithi203.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T23:41:04.077 INFO:teuthology.orchestra.run.smithi203.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T23:41:04.086 INFO:teuthology.orchestra.run.smithi203.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T23:41:04.099 INFO:teuthology.orchestra.run.smithi203.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T23:41:04.142 INFO:teuthology.orchestra.run.smithi203.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T23:41:04.403 INFO:teuthology.orchestra.run.smithi203.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T23:41:04.404 INFO:teuthology.orchestra.run.smithi203.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T23:41:04.405 INFO:teuthology.orchestra.run.smithi203.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T23:41:04.570 INFO:teuthology.orchestra.run.smithi203.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T23:41:04.913 INFO:teuthology.orchestra.run.smithi203.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T23:41:05.315 INFO:teuthology.orchestra.run.smithi203.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T23:41:05.325 INFO:teuthology.orchestra.run.smithi203.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T23:41:05.326 INFO:teuthology.orchestra.run.smithi203.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T23:41:05.394 INFO:teuthology.orchestra.run.smithi203.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T23:41:05.395 INFO:teuthology.orchestra.run.smithi203.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T23:41:05.396 INFO:teuthology.orchestra.run.smithi203.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T23:41:05.396 INFO:teuthology.orchestra.run.smithi203.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T23:41:05.397 INFO:teuthology.orchestra.run.smithi203.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T23:41:05.399 INFO:teuthology.orchestra.run.smithi203.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T23:41:05.563 INFO:teuthology.orchestra.run.smithi203.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T23:41:05.712 INFO:teuthology.orchestra.run.smithi047.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:41:05.713 INFO:teuthology.orchestra.run.smithi047.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:41:05.715 INFO:teuthology.orchestra.run.smithi047.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:41:05.716 INFO:teuthology.orchestra.run.smithi047.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:41:05.716 INFO:teuthology.orchestra.run.smithi047.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:41:05.717 INFO:teuthology.orchestra.run.smithi047.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:41:05.773 INFO:teuthology.orchestra.run.smithi203.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T23:41:06.127 INFO:teuthology.orchestra.run.smithi203.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T23:41:06.212 INFO:teuthology.orchestra.run.smithi203.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T23:41:06.213 INFO:teuthology.orchestra.run.smithi203.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3306-gbc612ffb-1jammy [5,094 kB] 2024-04-26T23:41:06.261 INFO:teuthology.orchestra.run.smithi047.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:41:06.491 INFO:teuthology.orchestra.run.smithi203.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3306-gbc612ffb-1jammy [244 kB] 2024-04-26T23:41:06.504 INFO:teuthology.orchestra.run.smithi203.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:41:06.508 INFO:teuthology.orchestra.run.smithi203.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3306-gbc612ffb-1jammy [1,544 kB] 2024-04-26T23:41:06.585 INFO:teuthology.orchestra.run.smithi203.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3306-gbc612ffb-1jammy [6,261 kB] 2024-04-26T23:41:06.634 INFO:teuthology.orchestra.run.smithi203.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T23:41:06.788 INFO:teuthology.orchestra.run.smithi203.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T23:41:06.880 INFO:teuthology.orchestra.run.smithi203.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3306-gbc612ffb-1jammy [22.8 MB] 2024-04-26T23:41:06.929 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 182 MB in 7s (26.7 MB/s) 2024-04-26T23:41:07.002 INFO:teuthology.orchestra.run.smithi203.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T23:41:07.080 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:41:07.125 INFO:teuthology.orchestra.run.smithi203.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-26T23:41:07.143 INFO:teuthology.orchestra.run.smithi203.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T23:41:07.149 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T23:41:07.152 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:41:07.179 INFO:teuthology.orchestra.run.smithi203.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T23:41:07.194 INFO:teuthology.orchestra.run.smithi203.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T23:41:07.195 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:41:07.531 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:41:07.545 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:41:07.561 INFO:teuthology.orchestra.run.smithi203.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T23:41:07.589 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:41:07.820 INFO:teuthology.orchestra.run.smithi203.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T23:41:07.926 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:41:07.935 INFO:teuthology.orchestra.run.smithi203.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3306-gbc612ffb-1jammy [14.1 kB] 2024-04-26T23:41:07.936 INFO:teuthology.orchestra.run.smithi203.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [870 kB] 2024-04-26T23:41:07.940 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:41:07.969 INFO:teuthology.orchestra.run.smithi203.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3306-gbc612ffb-1jammy [2,437 kB] 2024-04-26T23:41:07.984 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:41:08.082 INFO:teuthology.orchestra.run.smithi203.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3306-gbc612ffb-1jammy [791 kB] 2024-04-26T23:41:08.121 INFO:teuthology.orchestra.run.smithi203.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3306-gbc612ffb-1jammy [148 kB] 2024-04-26T23:41:08.122 INFO:teuthology.orchestra.run.smithi203.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3306-gbc612ffb-1jammy [2,297 kB] 2024-04-26T23:41:08.123 INFO:teuthology.orchestra.run.smithi203.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T23:41:08.127 INFO:teuthology.orchestra.run.smithi203.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T23:41:08.171 INFO:teuthology.orchestra.run.smithi203.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T23:41:08.178 INFO:teuthology.orchestra.run.smithi203.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T23:41:08.215 INFO:teuthology.orchestra.run.smithi203.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T23:41:08.226 INFO:teuthology.orchestra.run.smithi203.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3306-gbc612ffb-1jammy [8,625 kB] 2024-04-26T23:41:08.228 INFO:teuthology.orchestra.run.smithi203.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T23:41:08.370 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:41:08.385 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:41:08.462 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:41:08.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3306-gbc612ffb-1jammy [14.2 kB] 2024-04-26T23:41:08.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3306-gbc612ffb-1jammy [51.7 MB] 2024-04-26T23:41:08.815 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:41:08.830 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:41:08.873 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:41:09.152 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:41:09.167 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:41:09.173 INFO:teuthology.orchestra.run.smithi203.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T23:41:09.178 INFO:teuthology.orchestra.run.smithi203.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T23:41:09.182 INFO:teuthology.orchestra.run.smithi203.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T23:41:09.202 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:41:09.400 INFO:teuthology.orchestra.run.smithi203.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T23:41:09.673 INFO:teuthology.orchestra.run.smithi203.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T23:41:09.805 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:41:09.820 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:41:09.871 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:41:10.316 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:41:10.331 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:41:10.374 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:41:10.686 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:41:10.701 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:41:10.744 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:41:10.744 INFO:teuthology.orchestra.run.smithi203.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3306-gbc612ffb-1jammy [124 kB] 2024-04-26T23:41:10.745 INFO:teuthology.orchestra.run.smithi203.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3306-gbc612ffb-1jammy [232 kB] 2024-04-26T23:41:10.747 INFO:teuthology.orchestra.run.smithi203.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3306-gbc612ffb-1jammy [33.9 kB] 2024-04-26T23:41:10.748 INFO:teuthology.orchestra.run.smithi203.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3306-gbc612ffb-1jammy [23.4 kB] 2024-04-26T23:41:10.748 INFO:teuthology.orchestra.run.smithi203.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3306-gbc612ffb-1jammy [38.9 kB] 2024-04-26T23:41:10.748 INFO:teuthology.orchestra.run.smithi203.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3306-gbc612ffb-1jammy [13.6 MB] 2024-04-26T23:41:11.265 INFO:teuthology.orchestra.run.smithi203.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240426.111959/bc612ffb9c1d5bc27536bc917a705262a36d4387/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3306-gbc612ffb-1jammy [91.2 kB] 2024-04-26T23:41:11.322 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:41:11.338 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:41:11.416 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:41:11.708 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librados2. 2024-04-26T23:41:11.723 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:11.766 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:11.907 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 182 MB in 12s (15.4 MB/s) 2024-04-26T23:41:12.074 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-26T23:41:12.139 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-26T23:41:12.143 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-26T23:41:12.190 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-26T23:41:12.219 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:41:12.235 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:12.277 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:12.576 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T23:41:12.589 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T23:41:12.634 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:41:12.647 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:41:12.662 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:12.696 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:12.949 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:41:12.964 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:12.971 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cmd2. 2024-04-26T23:41:12.984 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-26T23:41:13.007 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:13.029 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-26T23:41:13.352 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:41:13.367 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:13.382 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T23:41:13.396 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T23:41:13.410 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:13.498 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:41:13.646 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:41:13.661 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:13.703 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:13.952 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T23:41:13.967 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T23:41:13.998 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:41:14.014 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:14.019 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:41:14.048 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:14.342 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:41:14.358 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:41:14.401 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:41:14.430 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T23:41:14.445 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T23:41:14.496 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:41:14.653 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:41:14.669 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:14.711 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:15.017 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T23:41:15.032 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:41:15.083 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:41:15.089 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:41:15.105 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:41:15.147 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:41:15.433 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:41:15.449 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:41:15.491 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:41:15.553 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T23:41:15.568 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:41:15.620 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:41:15.786 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:41:15.802 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:41:15.836 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:41:16.015 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T23:41:16.029 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T23:41:16.081 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:41:16.448 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:41:16.459 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T23:41:16.463 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:41:16.474 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T23:41:16.506 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:41:16.518 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:41:16.817 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:41:16.832 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:41:16.876 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:41:17.079 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librados2. 2024-04-26T23:41:17.093 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../010-librados2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:17.112 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package zip. 2024-04-26T23:41:17.127 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:41:17.145 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:17.161 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:41:17.440 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package unzip. 2024-04-26T23:41:17.455 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:41:17.498 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:41:17.682 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librbd1. 2024-04-26T23:41:17.696 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../011-librbd1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:17.748 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:17.878 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:41:17.894 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:41:17.937 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:41:18.234 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T23:41:18.248 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:18.301 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:18.302 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:41:18.317 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:18.352 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:18.595 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rados. 2024-04-26T23:41:18.609 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:18.662 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:18.855 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:41:18.870 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:18.913 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:19.031 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T23:41:19.046 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:19.089 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:19.307 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:41:19.323 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:41:19.334 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T23:41:19.348 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:19.365 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:41:19.383 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:19.660 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:41:19.676 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:19.686 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T23:41:19.701 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:19.710 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:19.744 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:20.081 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T23:41:20.096 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T23:41:20.096 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:41:20.112 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:20.139 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T23:41:20.146 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:20.408 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T23:41:20.423 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:20.466 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:20.780 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T23:41:20.795 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T23:41:20.830 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:41:21.133 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T23:41:21.147 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T23:41:21.191 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:41:21.260 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:41:21.276 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:21.327 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:21.519 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T23:41:21.534 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T23:41:21.577 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:41:21.881 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua5.1. 2024-04-26T23:41:21.896 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T23:41:21.931 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:41:21.932 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:41:21.945 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:41:21.989 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:41:22.226 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-any. 2024-04-26T23:41:22.241 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-26T23:41:22.284 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T23:41:22.291 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:41:22.307 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:41:22.342 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:41:22.557 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package zip. 2024-04-26T23:41:22.570 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-26T23:41:22.612 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T23:41:22.636 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:41:22.652 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:41:22.694 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:41:22.907 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package unzip. 2024-04-26T23:41:22.922 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T23:41:22.974 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:41:23.031 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:41:23.046 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:41:23.089 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:41:23.345 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package luarocks. 2024-04-26T23:41:23.359 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T23:41:23.392 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:41:23.403 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:41:23.407 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:41:23.450 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:41:23.694 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:41:23.710 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:41:23.744 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:41:23.786 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librgw2. 2024-04-26T23:41:23.800 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../027-librgw2_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:23.869 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:24.064 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:41:24.079 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:41:24.122 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:41:24.381 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T23:41:24.397 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:24.408 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:41:24.424 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:41:24.439 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:24.466 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:41:24.717 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T23:41:24.732 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T23:41:24.775 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:41:24.786 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:41:24.801 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:41:24.835 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:41:25.120 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T23:41:25.135 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:25.164 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:41:25.179 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:41:25.222 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:41:25.287 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:25.534 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:41:25.549 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:41:25.592 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:41:25.732 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-common. 2024-04-26T23:41:25.747 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:25.790 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:25.911 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:41:25.927 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:41:25.969 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:41:26.222 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:41:26.238 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:41:26.272 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:41:26.751 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:41:26.766 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:41:26.809 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:41:26.871 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-base. 2024-04-26T23:41:26.886 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:26.951 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:27.111 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:41:27.127 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:41:27.169 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:41:27.481 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:41:27.496 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:41:27.539 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:41:27.642 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T23:41:27.656 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T23:41:27.709 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:41:27.925 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:41:27.941 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:41:27.986 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:41:28.012 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T23:41:28.026 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T23:41:28.070 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:41:28.311 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:41:28.327 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:41:28.369 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:41:28.374 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T23:41:28.388 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T23:41:28.424 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:41:28.656 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:41:28.671 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:41:28.693 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T23:41:28.706 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:41:28.708 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T23:41:28.752 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:41:29.009 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:41:29.023 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:41:29.058 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:41:29.072 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T23:41:29.087 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T23:41:29.130 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:41:29.345 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:41:29.359 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:41:29.403 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:41:29.433 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T23:41:29.448 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T23:41:29.491 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T23:41:29.739 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:41:29.755 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:41:29.794 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-portend. 2024-04-26T23:41:29.797 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:41:29.809 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-26T23:41:29.853 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T23:41:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:41:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:41:30.123 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T23:41:30.138 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T23:41:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:41:30.198 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T23:41:30.563 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:41:30.567 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T23:41:30.579 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:41:30.582 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T23:41:30.621 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:41:30.625 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:41:30.933 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:41:30.938 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T23:41:30.948 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:41:30.952 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T23:41:30.982 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:41:30.996 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T23:41:31.244 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:41:31.259 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:41:31.301 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:41:31.325 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T23:41:31.340 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T23:41:31.424 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T23:41:31.727 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T23:41:31.743 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T23:41:31.786 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:41:32.039 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-mako. 2024-04-26T23:41:32.054 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T23:41:32.089 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:41:32.364 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:41:32.379 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:41:32.421 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:41:32.733 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:41:32.748 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:41:32.794 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:41:33.135 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:41:33.151 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:33.176 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T23:41:33.192 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T23:41:33.193 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:33.234 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:41:33.537 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T23:41:33.552 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T23:41:33.557 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:41:33.572 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:33.595 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:41:33.606 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:33.865 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webob. 2024-04-26T23:41:33.876 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:41:33.880 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T23:41:33.892 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:41:33.915 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:41:33.934 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:41:34.212 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:41:34.229 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:41:34.244 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T23:41:34.259 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T23:41:34.261 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:41:34.304 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:41:34.623 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:41:34.638 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T23:41:34.639 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:34.654 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T23:41:34.681 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:34.705 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:41:35.008 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-paste. 2024-04-26T23:41:35.023 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T23:41:35.066 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:41:35.110 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:41:35.125 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:35.159 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:35.403 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T23:41:35.417 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T23:41:35.462 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:41:35.738 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:41:35.748 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T23:41:35.750 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:35.762 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T23:41:35.788 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:35.798 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:41:36.077 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T23:41:36.091 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T23:41:36.134 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T23:41:36.446 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T23:41:36.461 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T23:41:36.504 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:41:36.566 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph. 2024-04-26T23:41:36.580 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:36.624 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:36.851 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T23:41:36.865 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T23:41:36.921 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T23:41:37.110 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:41:37.127 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:37.160 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:37.446 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-idna. 2024-04-26T23:41:37.461 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-26T23:41:37.504 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T23:41:37.522 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:41:37.536 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:37.588 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:37.816 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T23:41:37.831 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T23:41:37.874 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:41:37.999 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:41:38.014 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:38.057 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:38.219 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests. 2024-04-26T23:41:38.230 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T23:41:38.269 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:41:38.385 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:41:38.399 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:41:38.434 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:41:38.580 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T23:41:38.596 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T23:41:38.638 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:41:38.754 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:41:38.768 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:41:38.812 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:41:38.934 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T23:41:38.946 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:38.983 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:39.380 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T23:41:39.392 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:39.455 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:39.767 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T23:41:39.781 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T23:41:39.792 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:41:39.805 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:41:39.825 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:41:39.875 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:41:40.128 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T23:41:40.144 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T23:41:40.178 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:41:40.186 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T23:41:40.192 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:41:40.227 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:41:40.506 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T23:41:40.522 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:41:40.524 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:40.537 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:40.556 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:40.572 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:40.917 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:41:40.932 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:41:40.960 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T23:41:40.967 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:41:40.975 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:41.017 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:41.203 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:41:41.218 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:41:41.261 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:41:41.564 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:41:41.579 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:41.588 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T23:41:41.603 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:41.614 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:41.646 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:42.567 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph. 2024-04-26T23:41:42.582 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../068-ceph_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:42.617 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:42.886 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:41:42.900 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:41:42.911 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T23:41:42.926 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:42.944 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:41:42.969 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:43.356 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T23:41:43.371 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:43.414 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:43.456 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:41:43.471 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:41:43.514 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:41:43.826 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephadm. 2024-04-26T23:41:43.841 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../071-cephadm_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:43.884 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:43.884 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:41:43.899 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:41:44.028 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:41:44.154 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T23:41:44.169 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T23:41:44.211 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T23:41:44.322 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:41:44.340 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:41:44.372 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:41:44.573 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T23:41:44.588 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:41:44.623 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:41:45.089 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:41:45.104 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:45.147 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:45.595 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-babel. 2024-04-26T23:41:45.609 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T23:41:45.653 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:41:46.007 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T23:41:46.020 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T23:41:46.065 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:41:46.133 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:41:46.145 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:41:46.183 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:41:46.393 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T23:41:46.406 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:46.451 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:46.486 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:41:46.495 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:41:46.536 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:41:46.797 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T23:41:46.810 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T23:41:46.855 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T23:41:46.881 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:41:46.890 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:41:46.931 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:41:47.191 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-routes. 2024-04-26T23:41:47.205 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T23:41:47.249 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:41:47.434 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:41:47.443 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:41:47.484 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:41:47.595 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T23:41:47.610 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:47.653 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:47.754 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:41:47.763 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:41:47.829 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:41:48.132 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:41:48.141 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:41:48.182 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:41:48.518 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:41:48.527 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:41:48.568 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:41:48.917 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T23:41:48.929 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T23:41:48.930 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:41:48.939 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:41:48.966 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:41:48.979 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:41:49.479 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T23:41:49.490 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T23:41:49.529 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:41:49.610 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:41:49.618 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:49.660 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:49.916 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T23:41:49.927 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T23:41:50.012 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:41:50.021 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:41:50.060 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:41:50.062 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:41:50.363 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T23:41:50.373 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T23:41:50.413 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:41:50.415 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:41:50.424 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:41:50.465 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:41:50.759 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package jq. 2024-04-26T23:41:50.769 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:41:50.801 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:41:51.039 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T23:41:51.050 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:51.054 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package socat. 2024-04-26T23:41:51.066 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:41:51.081 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:51.103 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:41:51.424 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:41:51.434 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:41:51.473 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:41:51.861 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:41:51.870 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:51.910 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:52.093 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T23:41:52.105 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T23:41:52.143 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T23:41:52.471 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T23:41:52.483 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T23:41:52.521 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:41:53.050 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T23:41:53.062 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T23:41:53.099 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:41:53.411 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T23:41:53.423 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-26T23:41:53.461 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T23:41:53.774 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T23:41:53.786 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T23:41:53.815 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T23:41:54.032 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:41:54.042 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:54.081 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:54.085 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T23:41:54.097 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T23:41:54.135 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:41:54.435 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:41:54.446 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:54.447 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T23:41:54.459 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T23:41:54.485 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:54.496 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T23:41:54.805 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:41:54.815 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:41:54.834 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T23:41:54.846 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T23:41:54.854 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:41:54.917 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:41:55.124 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:41:55.134 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:55.173 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:55.418 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:41:55.428 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:55.468 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:55.581 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T23:41:55.592 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:41:55.631 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:55.753 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:41:55.764 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:55.803 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:55.927 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T23:41:55.938 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T23:41:55.977 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:41:56.081 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:41:56.091 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:41:56.131 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:41:56.297 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T23:41:56.309 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:41:56.347 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:41:56.452 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:41:56.465 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:41:56.510 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:41:56.617 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package jq. 2024-04-26T23:41:56.631 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T23:41:56.684 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T23:41:56.914 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:41:56.925 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:41:56.936 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package socat. 2024-04-26T23:41:56.949 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T23:41:56.963 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:41:56.986 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:41:57.298 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T23:41:57.311 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T23:41:57.348 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:41:57.421 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:41:57.432 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:41:57.479 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:41:57.736 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-test. 2024-04-26T23:41:57.748 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:41:57.773 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:41:57.785 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:41:57.786 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:41:57.823 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:41:58.343 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:41:58.355 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:41:58.401 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:41:58.696 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:41:58.707 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:41:58.745 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:41:59.074 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:41:59.085 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:41:59.123 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:41:59.443 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:41:59.455 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:41:59.518 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:41:59.846 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:41:59.857 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:41:59.895 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:41:59.957 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T23:41:59.970 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:42:00.015 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:00.207 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:42:00.222 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:42:00.265 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:42:00.412 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-26T23:42:00.425 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:42:00.470 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:00.790 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-colorama. 2024-04-26T23:42:00.802 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:42:00.803 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-26T23:42:00.814 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:42:00.848 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-26T23:42:00.852 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:42:01.109 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephfs-shell. 2024-04-26T23:42:01.121 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:42:01.122 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:42:01.134 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:42:01.163 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:42:01.175 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:01.412 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephfs-top. 2024-04-26T23:42:01.425 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3306-gbc612ffb-1jammy_all.deb ... 2024-04-26T23:42:01.499 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:42:01.512 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:42:01.553 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:01.557 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:42:01.790 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T23:42:01.803 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:42:01.847 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:01.944 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:42:01.957 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:42:02.002 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:42:02.167 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T23:42:02.183 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T23:42:02.234 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:42:02.288 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:42:02.301 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:42:02.555 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T23:42:02.569 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T23:42:02.613 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:42:02.647 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:42:02.993 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T23:42:03.007 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T23:42:03.051 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:42:03.351 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:42:03.362 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:42:03.401 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:03.456 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package pkg-config. 2024-04-26T23:42:03.470 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T23:42:03.514 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:42:03.776 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T23:42:03.790 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T23:42:03.834 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:42:04.003 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:42:04.015 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:42:04.053 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:04.280 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T23:42:04.293 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T23:42:04.338 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T23:42:04.363 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:42:04.641 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T23:42:04.655 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T23:42:04.699 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T23:42:04.700 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:42:04.826 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:42:05.003 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T23:42:05.016 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T23:42:05.061 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:42:05.095 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:42:05.397 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T23:42:05.411 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T23:42:05.455 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T23:42:05.491 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:42:05.825 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-py. 2024-04-26T23:42:05.838 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-26T23:42:05.875 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T23:42:06.122 INFO:teuthology.orchestra.run.smithi047.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:42:06.180 INFO:teuthology.orchestra.run.smithi047.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T23:42:06.204 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T23:42:06.217 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T23:42:06.220 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:06.262 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:42:06.766 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T23:42:06.780 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T23:42:06.825 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:42:07.073 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user cephadm....done 2024-04-26T23:42:07.086 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-toml. 2024-04-26T23:42:07.100 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-26T23:42:07.136 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T23:42:07.234 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:42:07.422 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T23:42:07.435 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T23:42:07.480 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:42:07.552 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:42:07.795 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:42:07.817 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T23:42:07.831 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T23:42:07.867 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:42:07.921 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:42:08.121 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T23:42:08.134 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T23:42:08.189 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:42:08.440 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:42:08.498 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:42:08.624 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:42:08.943 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:42:09.150 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package radosgw. 2024-04-26T23:42:09.162 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../122-radosgw_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:42:09.208 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:09.320 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:42:09.579 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:42:09.847 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:42:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T23:42:09.892 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3306-gbc612ffb-1jammy_amd64.deb ... 2024-04-26T23:42:09.928 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:10.160 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:42:10.204 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T23:42:10.425 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:42:10.466 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T23:42:10.678 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T23:42:10.692 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:42:10.960 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:42:11.019 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T23:42:11.228 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:11.424 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T23:42:11.496 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:42:11.621 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:42:11.747 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:42:12.015 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:42:12.069 INFO:teuthology.orchestra.run.smithi203.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T23:42:12.115 INFO:teuthology.orchestra.run.smithi203.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-26T23:42:12.162 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:12.166 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:42:12.434 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:42:12.689 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user cephadm....done 2024-04-26T23:42:12.843 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:42:12.860 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T23:42:12.872 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:42:12.928 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:42:13.071 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:42:13.136 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T23:42:13.396 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T23:42:13.455 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:42:13.522 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T23:42:13.581 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:42:13.765 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T23:42:13.857 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:42:14.041 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T23:42:14.150 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:42:14.192 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T23:42:14.468 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:42:14.503 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T23:42:14.569 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:42:14.871 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T23:42:15.114 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-26T23:42:15.279 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:42:15.366 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T23:42:15.555 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:42:15.650 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T23:42:15.681 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:42:15.807 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:42:15.919 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T23:42:16.167 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:42:16.178 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T23:42:16.454 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T23:42:16.576 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:42:16.706 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-argparse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:16.819 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:42:16.957 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T23:42:17.083 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T23:42:17.209 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-26T23:42:17.229 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:42:17.486 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T23:42:17.538 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:42:17.611 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T23:42:17.873 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:42:17.879 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T23:42:18.291 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T23:42:18.402 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T23:42:18.466 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T23:42:18.474 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:42:18.592 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T23:42:18.759 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:42:18.893 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:18.986 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T23:42:19.137 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T23:42:19.177 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:42:19.413 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T23:42:19.512 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:42:19.681 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T23:42:19.982 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T23:42:20.108 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T23:42:20.793 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:42:20.794 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T23:42:21.010 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:42:21.070 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T23:42:21.145 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:42:21.196 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T23:42:21.297 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T23:42:21.421 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:42:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:42:21.598 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T23:42:21.698 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:42:22.007 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:42:22.016 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T23:42:22.259 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:42:22.276 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T23:42:22.502 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:42:22.602 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:42:22.678 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T23:42:22.937 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:42:22.987 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-26T23:42:23.205 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:42:23.289 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T23:42:23.481 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:42:23.632 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T23:42:23.757 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:42:24.024 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:42:24.091 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T23:42:24.251 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:24.309 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:42:24.410 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:42:24.561 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T23:42:24.695 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:42:24.812 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:42:24.904 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T23:42:25.113 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:42:25.431 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:42:25.723 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:42:25.849 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:42:25.975 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:42:26.047 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:42:26.119 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T23:42:26.286 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:42:26.370 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:42:26.386 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:42:26.497 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T23:42:26.748 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T23:42:26.813 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:42:26.874 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T23:42:27.002 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T23:42:27.089 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:42:27.215 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:42:27.302 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T23:42:27.499 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:42:27.578 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T23:42:27.634 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:42:27.846 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:42:27.968 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:42:27.971 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T23:42:28.265 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T23:42:28.269 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:42:28.525 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T23:42:28.537 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:42:28.748 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:42:28.800 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T23:42:29.058 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:42:29.069 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T23:42:29.362 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T23:42:29.376 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:42:29.635 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:42:29.646 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T23:42:29.755 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T23:42:30.029 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:42:30.031 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T23:42:30.158 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T23:42:30.339 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:42:30.460 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T23:42:30.699 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:42:30.769 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T23:42:30.833 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:30.951 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:31.029 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T23:42:31.061 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:42:31.154 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T23:42:31.280 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T23:42:31.369 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T23:42:31.380 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:31.506 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:31.616 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T23:42:31.632 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:42:31.767 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T23:42:31.925 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:32.035 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:32.160 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:32.177 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T23:42:32.384 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:42:32.384 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:42:32.445 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T23:42:32.571 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T23:42:32.830 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T23:42:32.973 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T23:42:33.020 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:33.189 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:33.299 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T23:42:33.322 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:33.465 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:33.566 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:42:33.625 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T23:42:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T23:42:34.105 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T23:42:34.398 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T23:42:34.683 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T23:42:34.899 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:34.951 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T23:42:35.025 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:35.185 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:35.311 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:35.344 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T23:42:35.436 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:35.563 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:35.654 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T23:42:36.007 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T23:42:36.133 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librados2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:36.148 INFO:teuthology.orchestra.run.smithi047.stdout:Adding group ceph....done 2024-04-26T23:42:36.251 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:36.361 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T23:42:36.516 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user ceph....done 2024-04-26T23:42:36.694 INFO:teuthology.orchestra.run.smithi047.stdout:Setting system user ceph properties....done 2024-04-26T23:42:36.705 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:36.713 INFO:teuthology.orchestra.run.smithi047.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:42:36.831 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libradosstriper1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:36.864 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:42:36.957 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T23:42:37.258 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:42:37.259 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librbd1 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:37.385 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-modules-core (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:37.512 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:37.708 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:42:37.708 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T23:42:37.921 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:38.162 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:42:38.162 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:42:38.372 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs-dev (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:38.498 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rados (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:39.016 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librgw2 (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:39.027 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:39.117 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephfs-top (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:39.128 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:39.277 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T23:42:39.675 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:42:39.675 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:42:40.305 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:40.573 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rbd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:40.674 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:42:40.698 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up rbd-fuse (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:40.816 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:40.926 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cephfs (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:41.054 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephfs-shell (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:41.180 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-common (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:41.340 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:41.561 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:42:41.561 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:42:41.716 INFO:teuthology.orchestra.run.smithi203.stdout:Adding group ceph....done 2024-04-26T23:42:42.092 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user ceph....done 2024-04-26T23:42:42.183 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:42.261 INFO:teuthology.orchestra.run.smithi203.stdout:Setting system user ceph properties....done 2024-04-26T23:42:42.281 INFO:teuthology.orchestra.run.smithi203.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T23:42:42.422 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:42:42.422 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:42:42.425 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T23:42:42.815 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T23:42:43.068 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:43.382 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:42:43.382 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:42:43.489 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephfs-mirror (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:43.698 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:42:43.699 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-26T23:42:43.986 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:44.103 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:44.462 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:42:44.462 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:42:44.672 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-test (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:44.779 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up radosgw (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:45.206 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:45.305 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:42:45.305 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T23:42:45.348 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:45.449 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:45.567 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:45.936 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:42:45.939 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-base (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:46.038 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:42:46.189 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:42:46.277 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T23:42:46.922 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:42:46.991 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mds (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:47.214 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:42:47.214 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T23:42:47.611 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:42:47.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:42:47.691 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-04-26T23:42:47.834 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:47.869 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-04-26T23:42:47.870 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-04-26T23:42:48.047 INFO:teuthology.orchestra.run.smithi047.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:42:48.047 INFO:teuthology.orchestra.run.smithi047.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:42:48.047 INFO:teuthology.orchestra.run.smithi047.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:42:48.048 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:42:48.048 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:42:48.048 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:42:48.048 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:42:48.048 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:42:48.048 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T23:42:48.049 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:42:48.049 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:42:48.050 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:42:48.050 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-04-26T23:42:48.050 INFO:teuthology.orchestra.run.smithi047.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:42:48.050 INFO:teuthology.orchestra.run.smithi047.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:42:48.050 INFO:teuthology.orchestra.run.smithi047.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:42:48.050 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:42:48.050 INFO:teuthology.orchestra.run.smithi047.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:42:48.051 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-04-26T23:42:48.051 INFO:teuthology.orchestra.run.smithi047.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:42:48.051 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:42:48.051 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:42:48.107 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-04-26T23:42:48.107 INFO:teuthology.orchestra.run.smithi047.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:42:48.107 INFO:teuthology.orchestra.run.smithi047.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:42:48.108 INFO:teuthology.orchestra.run.smithi047.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:42:48.108 INFO:teuthology.orchestra.run.smithi047.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:42:48.108 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:42:48.108 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:42:48.108 INFO:teuthology.orchestra.run.smithi047.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:42:48.109 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2024-04-26T23:42:48.110 INFO:teuthology.orchestra.run.smithi047.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:42:48.339 INFO:teuthology.orchestra.run.smithi047.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:42:48.339 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:42:48.340 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:42:48.340 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:42:48.677 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-osd (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:48.997 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:42:48.997 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T23:42:49.604 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:49.721 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:49.864 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mon (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:50.080 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:42:50.080 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T23:42:50.323 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:42:50.707 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-cephadm (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:50.833 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:50.975 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-dashboard (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:51.045 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:42:51.118 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-volume (19.0.0-3306-gbc612ffb-1jammy) ... 2024-04-26T23:42:51.488 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:42:51.605 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:42:51.790 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:42:53.083 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:42:53.782 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:42:53.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-26T23:42:53.861 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2024-04-26T23:42:54.041 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2024-04-26T23:42:54.042 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2024-04-26T23:42:54.215 INFO:teuthology.orchestra.run.smithi203.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-26T23:42:54.215 INFO:teuthology.orchestra.run.smithi203.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T23:42:54.215 INFO:teuthology.orchestra.run.smithi203.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T23:42:54.215 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T23:42:54.215 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T23:42:54.215 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T23:42:54.215 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T23:42:54.216 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T23:42:54.216 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T23:42:54.216 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T23:42:54.217 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2024-04-26T23:42:54.217 INFO:teuthology.orchestra.run.smithi203.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-26T23:42:54.217 INFO:teuthology.orchestra.run.smithi203.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-26T23:42:54.217 INFO:teuthology.orchestra.run.smithi203.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-26T23:42:54.217 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-26T23:42:54.218 INFO:teuthology.orchestra.run.smithi203.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:42:54.218 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2024-04-26T23:42:54.218 INFO:teuthology.orchestra.run.smithi203.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-26T23:42:54.218 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-26T23:42:54.219 INFO:teuthology.orchestra.run.smithi203.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-26T23:42:54.274 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2024-04-26T23:42:54.274 INFO:teuthology.orchestra.run.smithi203.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-26T23:42:54.274 INFO:teuthology.orchestra.run.smithi203.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-26T23:42:54.275 INFO:teuthology.orchestra.run.smithi203.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-26T23:42:54.275 INFO:teuthology.orchestra.run.smithi203.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-26T23:42:54.275 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-26T23:42:54.275 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-26T23:42:54.275 INFO:teuthology.orchestra.run.smithi203.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-26T23:42:54.276 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages will be upgraded: 2024-04-26T23:42:54.277 INFO:teuthology.orchestra.run.smithi203.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-26T23:42:54.467 INFO:teuthology.orchestra.run.smithi203.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-26T23:42:54.467 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 55.7 MB of archives. 2024-04-26T23:42:54.467 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-26T23:42:54.467 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-26T23:42:55.130 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T23:42:55.147 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T23:42:55.253 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:42:55.276 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T23:42:55.278 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:42:55.278 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:42:55.307 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:42:55.308 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:42:55.312 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:42:55.315 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:42:55.315 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:42:55.353 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T23:42:55.423 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T23:42:55.489 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:42:55.811 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:42:55.823 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:42:55.830 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:42:55.922 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:42:57.255 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-26T23:42:57.379 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-26T23:42:57.629 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-26T23:42:57.829 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T23:42:57.886 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-26T23:42:58.247 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T23:42:58.549 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T23:42:58.557 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T23:42:58.562 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-26T23:42:58.657 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-26T23:42:59.635 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:42:59.637 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:42:59.637 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:42:59.640 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:42:59.640 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:42:59.645 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:42:59.811 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:43:00.418 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:43:00.419 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:43:00.599 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:43:00.600 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:43:00.639 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:43:00.696 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:43:00.702 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:43:00.703 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:43:00.703 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:43:00.704 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:43:00.911 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:43:01.332 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:43:02.091 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:43:02.091 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:43:02.091 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:43:02.091 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:43:02.092 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:43:02.092 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:43:02.134 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:43:02.135 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:43:02.529 INFO:teuthology.orchestra.run.smithi047.stdout:Preconfiguring packages ... 2024-04-26T23:43:02.679 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 55.7 MB in 14s (3,976 kB/s) 2024-04-26T23:43:02.926 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:43:02.930 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:43:03.086 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:43:03.805 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:43:04.941 INFO:teuthology.orchestra.run.smithi047.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:43:05.217 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package flex. 2024-04-26T23:43:05.291 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:43:05.295 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:43:05.333 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:43:05.869 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:43:06.072 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:43:06.472 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:43:07.070 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:43:07.074 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:43:07.221 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:43:07.684 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:43:07.853 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:43:08.244 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:43:08.587 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package bison. 2024-04-26T23:43:08.665 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:43:08.669 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:43:08.714 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:43:09.140 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:43:09.155 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:43:09.198 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:43:09.885 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package dump. 2024-04-26T23:43:09.901 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:43:09.944 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:43:10.239 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package indent. 2024-04-26T23:43:10.255 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:10.297 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:43:10.600 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:43:10.616 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:43:10.666 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:43:11.104 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:43:11.120 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:43:11.170 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:43:11.448 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:43:11.464 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:43:11.506 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:43:11.951 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:43:11.968 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:43:12.018 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:43:12.321 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:43:12.337 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:43:12.387 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:43:12.690 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:43:12.706 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:43:12.748 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:43:13.110 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:43:13.126 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:43:13.176 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:43:14.638 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:43:14.654 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:43:14.705 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:43:14.999 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:43:15.015 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:43:15.057 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:43:15.368 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:43:15.384 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:43:15.427 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:43:15.780 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:43:15.796 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:43:15.829 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:43:16.091 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:43:16.107 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:43:16.149 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:43:16.535 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:43:16.551 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:16.602 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:43:16.947 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:43:16.963 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:16.996 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:43:17.333 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:43:17.349 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:17.391 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:43:17.660 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:43:17.676 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:43:17.718 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:43:18.138 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:43:18.154 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:43:18.188 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:43:18.542 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:43:18.558 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:43:18.600 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:43:19.273 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:43:19.290 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:43:19.340 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:43:20.498 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ppp. 2024-04-26T23:43:20.514 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:43:20.869 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:43:21.194 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:43:21.209 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:43:21.252 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:43:21.489 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:43:21.503 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:43:21.547 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:43:21.866 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:43:21.881 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:43:21.924 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:43:22.237 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:43:22.252 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:22.312 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:43:22.950 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:43:22.965 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:43:23.035 INFO:teuthology.orchestra.run.smithi047.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:43:23.065 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:43:23.524 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:43:23.539 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:23.576 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:43:24.728 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:43:24.742 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:43:24.777 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:43:24.996 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:43:25.011 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:43:25.046 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:43:25.307 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:43:25.321 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:43:25.365 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:43:25.683 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:43:25.700 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:43:25.741 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:43:26.028 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package tcl. 2024-04-26T23:43:26.044 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:43:26.091 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:43:26.397 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:43:26.414 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:43:26.447 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:43:26.785 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:43:26.801 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:43:26.843 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:43:27.246 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:43:27.263 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:43:27.312 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:43:27.590 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:43:27.802 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:43:27.928 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:43:28.029 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:43:28.172 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:43:28.298 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:43:28.424 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:43:29.388 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:43:29.488 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:43:29.847 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:43:29.849 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:43:30.532 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:43:30.658 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:43:30.784 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:43:30.910 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:43:31.078 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:43:31.187 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:43:31.288 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:43:31.414 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:43:32.103 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:43:32.204 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:43:32.283 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:43:32.356 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:43:32.482 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:43:32.608 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:43:32.734 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:43:32.859 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:43:32.966 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:43:33.028 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:43:33.154 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:43:33.305 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:43:33.406 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:43:33.516 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:43:33.683 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:43:33.809 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:43:34.544 INFO:teuthology.orchestra.run.smithi047.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout:- ens1f0 2024-04-26T23:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:43:34.545 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:43:34.683 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:43:35.091 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:43:35.508 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:43:36.220 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:43:36.347 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:43:36.473 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:43:36.599 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:43:37.577 INFO:teuthology.orchestra.run.smithi047.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:43:37.830 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:43:37.831 INFO:teuthology.orchestra.run.smithi047.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:43:38.093 INFO:teuthology.orchestra.run.smithi047.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:43:38.094 INFO:teuthology.orchestra.run.smithi047.stdout:Removing obsolete dictionary files: 2024-04-26T23:43:38.820 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:43:39.300 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:43:39.679 INFO:teuthology.orchestra.run.smithi047.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:43:39.696 INFO:teuthology.orchestra.run.smithi047.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:43:39.756 INFO:teuthology.orchestra.run.smithi047.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:43:39.756 INFO:teuthology.orchestra.run.smithi047.stdout:This user must also own the server process. 2024-04-26T23:43:39.756 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:43:39.757 INFO:teuthology.orchestra.run.smithi047.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:43:39.757 INFO:teuthology.orchestra.run.smithi047.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:43:39.757 INFO:teuthology.orchestra.run.smithi047.stdout:The default text search configuration will be set to "english". 2024-04-26T23:43:39.757 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:43:39.757 INFO:teuthology.orchestra.run.smithi047.stdout:Data page checksums are disabled. 2024-04-26T23:43:39.757 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:43:39.758 INFO:teuthology.orchestra.run.smithi047.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:43:39.759 INFO:teuthology.orchestra.run.smithi047.stdout:creating subdirectories ... ok 2024-04-26T23:43:39.759 INFO:teuthology.orchestra.run.smithi047.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:43:39.782 INFO:teuthology.orchestra.run.smithi047.stdout:selecting default max_connections ... 100 2024-04-26T23:43:39.816 INFO:teuthology.orchestra.run.smithi047.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:43:39.831 INFO:teuthology.orchestra.run.smithi047.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:43:39.831 INFO:teuthology.orchestra.run.smithi047.stdout:creating configuration files ... ok 2024-04-26T23:43:40.006 INFO:teuthology.orchestra.run.smithi047.stdout:running bootstrap script ... ok 2024-04-26T23:43:40.197 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-26T23:43:40.513 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-26T23:43:40.518 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-26T23:43:40.876 INFO:teuthology.orchestra.run.smithi047.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:43:40.997 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-26T23:43:41.038 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-26T23:43:41.509 INFO:teuthology.orchestra.run.smithi047.stdout:syncing data to disk ... ok 2024-04-26T23:43:41.917 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-26T23:43:42.043 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:43:42.353 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-26T23:43:42.978 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-26T23:43:42.979 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T23:43:43.161 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-26T23:43:43.161 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-26T23:43:43.200 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-26T23:43:43.263 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-26T23:43:43.268 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-26T23:43:43.269 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-26T23:43:43.269 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-26T23:43:43.270 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-26T23:43:43.477 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-26T23:43:43.898 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-26T23:43:44.632 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-26T23:43:44.632 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-26T23:43:44.633 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-26T23:43:44.633 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-26T23:43:44.633 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-26T23:43:44.633 INFO:teuthology.orchestra.run.smithi203.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-26T23:43:44.664 INFO:teuthology.orchestra.run.smithi203.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-26T23:43:44.668 INFO:teuthology.orchestra.run.smithi203.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-26T23:43:45.024 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:43:45.047 INFO:teuthology.orchestra.run.smithi203.stdout:Preconfiguring packages ... 2024-04-26T23:43:45.150 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:43:45.209 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 55.7 MB in 50s (1,106 kB/s) 2024-04-26T23:43:45.293 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:43:45.444 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:43:45.445 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:43:45.449 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:43:45.555 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:43:45.584 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:43:45.824 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:43:45.824 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:43:46.225 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-26T23:43:46.574 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:43:46.666 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:43:46.977 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:43:47.137 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:43:47.295 INFO:teuthology.orchestra.run.smithi203.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-26T23:43:47.572 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package flex. 2024-04-26T23:43:47.642 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-26T23:43:47.646 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T23:43:47.687 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T23:43:48.223 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:43:48.434 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T23:43:48.573 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:43:48.673 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:43:48.849 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:43:49.222 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:43:49.230 DEBUG:teuthology.parallel:result is None 2024-04-26T23:43:49.363 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:43:49.367 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:43:49.483 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:43:49.921 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T23:43:50.056 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T23:43:50.387 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:43:50.790 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package bison. 2024-04-26T23:43:50.866 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-26T23:43:50.869 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T23:43:51.093 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:43:51.552 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-26T23:43:51.566 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-26T23:43:51.618 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:43:52.064 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package dump. 2024-04-26T23:43:52.078 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-26T23:43:52.130 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking dump (0.4b47-3) ... 2024-04-26T23:43:52.467 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package indent. 2024-04-26T23:43:52.483 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:52.534 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:43:52.794 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T23:43:52.810 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T23:43:52.861 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:43:53.216 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-26T23:43:53.231 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-26T23:43:53.265 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:43:53.551 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T23:43:53.567 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T23:43:53.609 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:43:53.955 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T23:43:53.971 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T23:43:54.013 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:43:54.257 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T23:43:54.273 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T23:43:54.307 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:43:54.546 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjson-perl. 2024-04-26T23:43:54.562 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-26T23:43:54.601 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-26T23:43:54.930 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-26T23:43:54.946 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-26T23:43:54.988 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:43:56.382 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-26T23:43:56.398 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:43:56.440 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:43:56.703 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-26T23:43:56.718 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-26T23:43:56.751 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:43:57.054 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-26T23:43:57.070 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:43:57.113 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:43:57.491 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-26T23:43:57.506 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-26T23:43:57.549 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:43:57.868 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-26T23:43:57.884 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:43:57.918 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:43:58.255 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-26T23:43:58.270 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:58.313 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:43:58.691 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-26T23:43:58.706 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:58.749 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:43:59.043 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-26T23:43:59.059 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:43:59.101 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:43:59.313 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T23:43:59.328 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T23:43:59.379 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:43:59.933 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-26T23:43:59.949 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-26T23:43:59.991 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:44:00.319 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package modemmanager. 2024-04-26T23:44:00.335 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-26T23:44:00.377 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:44:00.959 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package network-manager. 2024-04-26T23:44:00.974 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-26T23:44:01.025 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:44:01.783 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ppp. 2024-04-26T23:44:01.799 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-26T23:44:02.151 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:44:02.521 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package pptp-linux. 2024-04-26T23:44:02.535 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-26T23:44:02.588 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-26T23:44:02.832 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-26T23:44:02.847 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-26T23:44:02.882 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-26T23:44:03.126 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-26T23:44:03.141 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-26T23:44:03.176 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-client-common (238) ... 2024-04-26T23:44:03.480 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-26T23:44:03.495 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:44:03.538 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:44:04.135 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-common. 2024-04-26T23:44:04.150 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-26T23:44:04.210 INFO:teuthology.orchestra.run.smithi203.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-26T23:44:04.242 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-common (238) ... 2024-04-26T23:44:04.708 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-14. 2024-04-26T23:44:04.724 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-26T23:44:04.769 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:44:05.894 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql. 2024-04-26T23:44:05.909 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-26T23:44:05.953 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql (14+238) ... 2024-04-26T23:44:06.198 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-client. 2024-04-26T23:44:06.212 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-26T23:44:06.316 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-client (14+238) ... 2024-04-26T23:44:06.516 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-26T23:44:06.531 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-26T23:44:06.574 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-26T23:44:06.893 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package tcl8.6. 2024-04-26T23:44:06.909 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-26T23:44:06.951 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:44:07.204 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package tcl. 2024-04-26T23:44:07.220 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-26T23:44:07.258 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-26T23:44:07.632 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package wpasupplicant. 2024-04-26T23:44:07.648 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-26T23:44:07.690 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:44:08.053 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-26T23:44:08.069 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-26T23:44:08.111 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-26T23:44:08.523 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-26T23:44:08.539 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-26T23:44:08.589 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:44:08.891 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-client-common (238) ... 2024-04-26T23:44:09.120 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T23:44:09.271 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-26T23:44:09.430 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:44:09.582 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-26T23:44:09.733 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T23:44:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:44:10.843 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-26T23:44:10.939 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-26T23:44:11.318 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:44:11.318 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-26T23:44:12.009 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T23:44:12.134 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-26T23:44:12.260 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T23:44:12.386 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-26T23:44:12.521 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T23:44:12.630 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T23:44:12.756 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-26T23:44:12.882 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-26T23:44:13.554 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-26T23:44:13.724 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up dump (0.4b47-3) ... 2024-04-26T23:44:13.827 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-26T23:44:13.900 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:44:14.043 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-26T23:44:14.169 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-26T23:44:14.295 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-26T23:44:14.405 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T23:44:14.478 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T23:44:14.540 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-26T23:44:14.674 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-26T23:44:14.851 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-26T23:44:14.994 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:44:15.120 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-26T23:44:15.271 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-client (14+238) ... 2024-04-26T23:44:15.380 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-26T23:44:15.993 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:15.994 INFO:teuthology.orchestra.run.smithi203.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-26T23:44:15.994 INFO:teuthology.orchestra.run.smithi203.stdout:which means they are currently configured by ifupdown: 2024-04-26T23:44:15.994 INFO:teuthology.orchestra.run.smithi203.stdout:- enp3s0f1 2024-04-26T23:44:15.994 INFO:teuthology.orchestra.run.smithi203.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-26T23:44:15.994 INFO:teuthology.orchestra.run.smithi203.stdout:remove their configuration from /etc/network/interfaces. 2024-04-26T23:44:15.994 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:16.126 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-26T23:44:16.539 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-26T23:44:16.950 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-26T23:44:17.701 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-26T23:44:17.844 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T23:44:17.979 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-26T23:44:18.088 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-common (238) ... 2024-04-26T23:44:19.015 INFO:teuthology.orchestra.run.smithi203.stdout:Adding user postgres to group ssl-cert 2024-04-26T23:44:19.269 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:19.269 INFO:teuthology.orchestra.run.smithi203.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-26T23:44:19.534 INFO:teuthology.orchestra.run.smithi203.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-26T23:44:19.534 INFO:teuthology.orchestra.run.smithi203.stdout:Removing obsolete dictionary files: 2024-04-26T23:44:20.252 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-26T23:44:20.757 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-26T23:44:21.094 INFO:teuthology.orchestra.run.smithi203.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-26T23:44:21.122 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-26T23:44:21.181 INFO:teuthology.orchestra.run.smithi203.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout:This user must also own the server process. 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout:The database cluster will be initialized with locale "en_US". 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout:The default text search configuration will be set to "english". 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout:Data page checksums are disabled. 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:21.182 INFO:teuthology.orchestra.run.smithi203.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-26T23:44:21.183 INFO:teuthology.orchestra.run.smithi203.stdout:creating subdirectories ... ok 2024-04-26T23:44:21.183 INFO:teuthology.orchestra.run.smithi203.stdout:selecting dynamic shared memory implementation ... posix 2024-04-26T23:44:21.207 INFO:teuthology.orchestra.run.smithi203.stdout:selecting default max_connections ... 100 2024-04-26T23:44:21.242 INFO:teuthology.orchestra.run.smithi203.stdout:selecting default shared_buffers ... 128MB 2024-04-26T23:44:21.255 INFO:teuthology.orchestra.run.smithi203.stdout:selecting default time zone ... Etc/UTC 2024-04-26T23:44:21.256 INFO:teuthology.orchestra.run.smithi203.stdout:creating configuration files ... ok 2024-04-26T23:44:21.421 INFO:teuthology.orchestra.run.smithi203.stdout:running bootstrap script ... ok 2024-04-26T23:44:22.123 INFO:teuthology.orchestra.run.smithi203.stdout:performing post-bootstrap initialization ... ok 2024-04-26T23:44:22.830 INFO:teuthology.orchestra.run.smithi203.stdout:syncing data to disk ... ok 2024-04-26T23:44:23.335 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-26T23:44:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:44:26.483 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-26T23:44:26.609 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql (14+238) ... 2024-04-26T23:44:26.735 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-26T23:44:26.861 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-26T23:44:27.114 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:44:27.114 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-26T23:44:27.856 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T23:44:27.948 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-26T23:44:28.284 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T23:44:28.452 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T23:44:29.815 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-26T23:44:29.916 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T23:44:30.492 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T23:44:30.499 DEBUG:teuthology.parallel:result is None 2024-04-26T23:44:30.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:44:30.722 DEBUG:teuthology.orchestra.run.smithi047:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:44:30.747 INFO:teuthology.orchestra.run.smithi047.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:44:30.747 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:44:30.748 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:44:30.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bc612ffb9c1d5bc27536bc917a705262a36d4387 2024-04-26T23:44:30.885 DEBUG:teuthology.orchestra.run.smithi203:> dpkg-query -W -f '${Version}' ceph 2024-04-26T23:44:30.907 INFO:teuthology.orchestra.run.smithi203.stdout:19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:44:30.908 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3306-gbc612ffb-1jammy 2024-04-26T23:44:30.908 INFO:teuthology.task.install:The correct ceph version 19.0.0-3306-gbc612ffb-1jammy is installed. 2024-04-26T23:44:30.910 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T23:44:30.910 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:30.910 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:44:30.932 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:30.932 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T23:44:30.971 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T23:44:30.971 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:30.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:44:30.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:44:31.058 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:31.058 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T23:44:31.077 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T23:44:31.138 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T23:44:31.138 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:31.138 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:44:31.160 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:44:31.222 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:31.222 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T23:44:31.241 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T23:44:31.306 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T23:44:31.306 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:31.307 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:44:31.328 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:44:31.394 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:31.394 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T23:44:31.413 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T23:44:31.474 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T23:44:31.563 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T23:44:31.563 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-04-26T23:44:31.566 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /var/log/ceph 2024-04-26T23:44:31.585 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T23:44:31.586 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:44:31.632 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T23:44:31.651 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T23:44:31.651 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:44:31.696 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T23:44:31.724 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T23:44:31.725 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T23:44:31.725 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T23:44:31.725 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:31.725 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:44:31.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:31.865 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:31.865 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T23:44:31.878 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T23:44:31.976 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T23:44:31.976 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T23:44:31.976 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321', 'branch': 'wip-rishabh-testing-20240426.111959', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}}', 'email': None, 'first_in_suite': False, 'job_id': '7675321', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240426.111959'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240426.111959', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 816, 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'sleep_before_teardown': 0, 'subset': '166/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240426.111959', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5vUKWQ8EM5ek5xX7qF8OCwcBDasgoxa5f58E3+oBLCXkV+L3ZvQa0JTp2ryiFAaZcFdj9QYW8mrgys8vbpjoI=', 'smithi203.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKVTk0XfNVx/3OEdFjAImHOPYnztQmEpTyWSATIOhXbLMh6pw5RaOP6M+D4U0vpKxJZsPoqpRWhtRsEh1zWXb0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'bc612ffb9c1d5bc27536bc917a705262a36d4387', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_19:30:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T23:44:31.977 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:44:31.981 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T23:44:32.029 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:44:32.040 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T23:44:32.099 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:32.099 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:44:32.114 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:44:32.114 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-04-26T23:44:32.169 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:44:32.170 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:32.170 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 899 Links: 1 2024-04-26T23:44:32.170 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:32.170 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-26 23:37:17.847189649 +0000 2024-04-26T23:44:32.170 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-26 23:37:17.543192361 +0000 2024-04-26T23:44:32.170 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-26 23:37:17.543192361 +0000 2024-04-26T23:44:32.170 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-26 23:37:17.543192361 +0000 2024-04-26T23:44:32.171 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:44:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:44:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:44:32.233 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000267558 s, 1.9 MB/s 2024-04-26T23:44:32.234 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:44:32.288 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 918 Links: 1 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-26 23:37:18.431184439 +0000 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-26 23:37:18.155186901 +0000 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-26 23:37:18.155186901 +0000 2024-04-26T23:44:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-26 23:37:18.155186901 +0000 2024-04-26T23:44:32.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:44:32.406 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:44:32.406 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:44:32.406 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000259243 s, 2.0 MB/s 2024-04-26T23:44:32.408 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:44:32.461 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-04-26T23:44:32.515 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:44:32.515 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:32.515 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-04-26T23:44:32.515 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:32.515 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-26 23:37:19.011179266 +0000 2024-04-26T23:44:32.515 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-26 23:37:18.739181692 +0000 2024-04-26T23:44:32.515 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-26 23:37:18.739181692 +0000 2024-04-26T23:44:32.516 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-26 23:37:18.739181692 +0000 2024-04-26T23:44:32.516 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:44:32.576 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000258748 s, 2.0 MB/s 2024-04-26T23:44:32.578 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:44:32.636 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-04-26T23:44:32.686 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:44:32.686 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:32.686 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 950 Links: 1 2024-04-26T23:44:32.686 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:32.686 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-04-26 23:37:19.307176625 +0000 2024-04-26T23:44:32.687 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-04-26 23:37:19.303176661 +0000 2024-04-26T23:44:32.687 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-04-26 23:37:19.303176661 +0000 2024-04-26T23:44:32.687 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-04-26 23:37:19.303176661 +0000 2024-04-26T23:44:32.687 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:44:32.748 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:44:32.749 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:44:32.749 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000262631 s, 1.9 MB/s 2024-04-26T23:44:32.750 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:44:32.804 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:32.804 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:32.804 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T23:44:32.813 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T23:44:32.813 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 897 Links: 1 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-26 23:37:09.924210962 +0000 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-26 23:37:09.640213497 +0000 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-26 23:37:09.640213497 +0000 2024-04-26T23:44:32.864 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-26 23:37:09.640213497 +0000 2024-04-26T23:44:32.864 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T23:44:32.926 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-26T23:44:32.926 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-26T23:44:32.926 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000417295 s, 1.2 MB/s 2024-04-26T23:44:32.928 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T23:44:32.982 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-26 23:37:10.224208287 +0000 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-26 23:37:10.220208323 +0000 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-26 23:37:10.220208323 +0000 2024-04-26T23:44:33.032 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-26 23:37:10.220208323 +0000 2024-04-26T23:44:33.033 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T23:44:33.094 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-26T23:44:33.094 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-26T23:44:33.094 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000383745 s, 1.3 MB/s 2024-04-26T23:44:33.096 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T23:44:33.154 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-26 23:37:11.100200473 +0000 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-26 23:37:10.832202863 +0000 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-26 23:37:10.832202863 +0000 2024-04-26T23:44:33.204 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-26 23:37:10.832202863 +0000 2024-04-26T23:44:33.205 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T23:44:33.266 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-26T23:44:33.266 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-26T23:44:33.266 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000381535 s, 1.3 MB/s 2024-04-26T23:44:33.268 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T23:44:33.322 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-04-26T23:44:33.372 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T23:44:33.372 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T23:44:33.372 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 949 Links: 1 2024-04-26T23:44:33.372 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T23:44:33.372 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-04-26 23:37:11.688195227 +0000 2024-04-26T23:44:33.373 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-04-26 23:37:11.408197725 +0000 2024-04-26T23:44:33.373 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-04-26 23:37:11.408197725 +0000 2024-04-26T23:44:33.373 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-04-26 23:37:11.408197725 +0000 2024-04-26T23:44:33.373 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T23:44:33.434 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-04-26T23:44:33.434 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-04-26T23:44:33.434 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000386747 s, 1.3 MB/s 2024-04-26T23:44:33.436 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T23:44:33.490 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:33.490 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:44:33.490 INFO:tasks.ceph:Generating config... 2024-04-26T23:44:33.491 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T23:44:33.491 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T23:44:33.491 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T23:44:33.492 INFO:tasks.ceph:[client] pid file = 2024-04-26T23:44:33.492 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T23:44:33.492 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-04-26T23:44:33.492 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T23:44:33.493 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T23:44:33.493 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T23:44:33.493 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T23:44:33.493 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T23:44:33.493 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T23:44:33.493 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T23:44:33.493 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T23:44:33.494 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T23:44:33.494 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T23:44:33.494 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T23:44:33.494 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T23:44:33.494 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T23:44:33.494 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T23:44:33.494 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T23:44:33.494 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T23:44:33.494 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T23:44:33.542 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T23:44:33.558 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T23:44:33.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:44:33.627 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.47'), ('mon.b', '172.21.15.203'), ('mon.c', '[v2:172.21.15.203:3301,v1:172.21.15.203:6790]')] 2024-04-26T23:44:33.628 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T23:44:33.628 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:33.629 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:44:33.677 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --add b 172.21.15.203 --addv c '[v2:172.21.15.203:3301,v1:172.21.15.203:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:33.769 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:33.769 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid b64830b3-1e32-4049-b582-6f8b5018205b 2024-04-26T23:44:33.769 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = quincy 2024-04-26T23:44:33.769 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-04-26T23:44:33.769 INFO:teuthology.orchestra.run.smithi047.stdout:fsid b64830b3-1e32-4049-b582-6f8b5018205b 2024-04-26T23:44:33.769 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-04-26T23:44:33.767636+0000 2024-04-26T23:44:33.770 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-04-26T23:44:33.767636+0000 2024-04-26T23:44:33.770 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 17 (quincy) 2024-04-26T23:44:33.770 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-04-26T23:44:33.770 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-04-26T23:44:33.770 INFO:teuthology.orchestra.run.smithi047.stdout:1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.b 2024-04-26T23:44:33.770 INFO:teuthology.orchestra.run.smithi047.stdout:2: [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] mon.c 2024-04-26T23:44:33.770 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T23:44:33.772 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T23:44:33.781 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b64830b3-1e32-4049-b582-6f8b5018205b... 2024-04-26T23:44:33.781 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:44:33.824 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T23:44:33.864 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-04-26T23:44:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-04-26T23:44:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:44:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-04-26T23:44:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-04-26T23:44:33.865 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-04-26T23:44:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-04-26T23:44:33.866 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:44:33.867 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-04-26T23:44:33.868 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.869 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.47,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]" 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = b64830b3-1e32-4049-b582-6f8b5018205b 2024-04-26T23:44:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.871 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-04-26T23:44:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-04-26T23:44:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-04-26T23:44:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-04-26T23:44:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-04-26T23:44:33.872 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-04-26T23:44:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-04-26T23:44:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-04-26T23:44:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:44:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.873 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-04-26T23:44:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-04-26T23:44:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:44:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-04-26T23:44:33.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: bdev async discard = True 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: bdev enable discard = True 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore allocator = bitmap 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-04-26T23:44:33.875 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 1/20 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 1/20 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 4/10 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:44:33.876 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:44:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-04-26T23:44:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-04-26T23:44:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.877 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-04-26T23:44:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-26T23:44:33.877 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-04-26T23:44:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-26T23:44:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-26T23:44:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-04-26T23:44:33.878 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-04-26T23:44:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: debug finisher = 20 2024-04-26T23:44:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.879 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-04-26T23:44:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-26T23:44:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-04-26T23:44:33.879 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-04-26T23:44:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-04-26T23:44:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-04-26T23:44:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-04-26T23:44:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-04-26T23:44:33.880 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-04-26T23:44:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:44:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:44:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:44:33.881 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:44:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:44:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:44:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-04-26T23:44:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:44:33.882 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: mon down mkfs grace = 300 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-04-26T23:44:33.883 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-04-26T23:44:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:44:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:44:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-04-26T23:44:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-04-26T23:44:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-26T23:44:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = "" 2024-04-26T23:44:33.884 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-04-26T23:44:33.885 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-04-26T23:44:33.885 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-04-26T23:44:33.885 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-04-26T23:44:33.885 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-04-26T23:44:33.885 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-04-26T23:44:33.885 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-04-26T23:44:33.885 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-04-26T23:44:33.886 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-04-26T23:44:33.886 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-04-26T23:44:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-04-26T23:44:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-04-26T23:44:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-04-26T23:44:33.886 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-04-26T23:44:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-04-26T23:44:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-04-26T23:44:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-04-26T23:44:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-04-26T23:44:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-04-26T23:44:33.887 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-04-26T23:44:33.890 INFO:teuthology.orchestra.run.smithi203.stdout:[global] 2024-04-26T23:44:33.890 INFO:teuthology.orchestra.run.smithi203.stdout: chdir = "" 2024-04-26T23:44:33.890 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T23:44:33.890 INFO:teuthology.orchestra.run.smithi203.stdout: auth supported = cephx 2024-04-26T23:44:33.890 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.890 INFO:teuthology.orchestra.run.smithi203.stdout: filestore xattr use omap = true 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: mon clock drift allowed = 1.000 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: osd crush chooseleaf type = 0 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: auth debug = true 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on old message = true 2024-04-26T23:44:33.891 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on bug = true 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn max object skew = 0 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.892 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default size = 2 2024-04-26T23:44:33.893 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.893 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow primary affinity = true 2024-04-26T23:44:33.893 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow pg remap = true 2024-04-26T23:44:33.893 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on legacy crush tunables = false 2024-04-26T23:44:33.893 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on crush straw calc version zero = false 2024-04-26T23:44:33.893 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on no sortbitwise = false 2024-04-26T23:44:33.894 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on osd down out interval zero = false 2024-04-26T23:44:33.894 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on too few osds = false 2024-04-26T23:44:33.894 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T23:44:33.894 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T23:44:33.894 INFO:teuthology.orchestra.run.smithi203.stdout: mon_allow_pool_size_one = true 2024-04-26T23:44:33.894 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.895 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T23:44:33.895 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.895 INFO:teuthology.orchestra.run.smithi203.stdout: osd default data pool replay window = 5 2024-04-26T23:44:33.895 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.895 INFO:teuthology.orchestra.run.smithi203.stdout: mon allow pool delete = true 2024-04-26T23:44:33.895 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.896 INFO:teuthology.orchestra.run.smithi203.stdout: mon cluster log file level = debug 2024-04-26T23:44:33.896 INFO:teuthology.orchestra.run.smithi203.stdout: debug asserts on shutdown = true 2024-04-26T23:44:33.896 INFO:teuthology.orchestra.run.smithi203.stdout: mon health detail to clog = false 2024-04-26T23:44:33.896 INFO:teuthology.orchestra.run.smithi203.stdout: mon host = "172.21.15.47,172.21.15.203,[v2:172.21.15.203:3301,v1:172.21.15.203:6790]" 2024-04-26T23:44:33.896 INFO:teuthology.orchestra.run.smithi203.stdout: fsid = b64830b3-1e32-4049-b582-6f8b5018205b 2024-04-26T23:44:33.896 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.897 INFO:teuthology.orchestra.run.smithi203.stdout:[osd] 2024-04-26T23:44:33.897 INFO:teuthology.orchestra.run.smithi203.stdout: osd journal size = 100 2024-04-26T23:44:33.897 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.897 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub load threshold = 5.0 2024-04-26T23:44:33.897 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub max interval = 600 2024-04-26T23:44:33.897 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock profile = high_recovery_ops 2024-04-26T23:44:33.898 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.898 INFO:teuthology.orchestra.run.smithi203.stdout: osd recover clone overlap = true 2024-04-26T23:44:33.898 INFO:teuthology.orchestra.run.smithi203.stdout: osd recovery max chunk = 1048576 2024-04-26T23:44:33.898 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.898 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug shutdown = true 2024-04-26T23:44:33.898 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug op order = true 2024-04-26T23:44:33.898 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify stray on activate = true 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug trim objects = true 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: osd open classes on start = true 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug pg log writeout = true 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: osd deep scrub update digest min age = 30 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: osd map max advance = 10 2024-04-26T23:44:33.899 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: journal zero on create = true 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: filestore ondisk finisher threads = 3 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: filestore apply finisher threads = 3 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: bdev debug aio = true 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug misdirected ops = true 2024-04-26T23:44:33.900 INFO:teuthology.orchestra.run.smithi203.stdout: bdev async discard = True 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: bdev enable discard = True 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore allocator = bitmap 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore block size = 96636764160 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore fsck on mount = True 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluefs = 1/20 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluestore = 1/20 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-26T23:44:33.901 INFO:teuthology.orchestra.run.smithi203.stdout: debug osd = 20 2024-04-26T23:44:33.902 INFO:teuthology.orchestra.run.smithi203.stdout: debug rocksdb = 4/10 2024-04-26T23:44:33.902 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T23:44:33.902 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd full ratio = 0.9 2024-04-26T23:44:33.902 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd nearfull ratio = 0.8 2024-04-26T23:44:33.902 INFO:teuthology.orchestra.run.smithi203.stdout: osd failsafe full ratio = 0.95 2024-04-26T23:44:33.902 INFO:teuthology.orchestra.run.smithi203.stdout: osd objectstore = bluestore 2024-04-26T23:44:33.903 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2024-04-26T23:44:33.903 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.903 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr] 2024-04-26T23:44:33.903 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-26T23:44:33.903 INFO:teuthology.orchestra.run.smithi203.stdout: debug mgr = 20 2024-04-26T23:44:33.903 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-04-26T23:44:33.903 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-04-26T23:44:33.904 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:33.904 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:33.904 INFO:teuthology.orchestra.run.smithi203.stdout: mgr/telemetry/nag = false 2024-04-26T23:44:33.904 INFO:teuthology.orchestra.run.smithi203.stdout: debug client = 20 2024-04-26T23:44:33.904 INFO:teuthology.orchestra.run.smithi203.stdout: debug finisher = 20 2024-04-26T23:44:33.904 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.905 INFO:teuthology.orchestra.run.smithi203.stdout:[mon] 2024-04-26T23:44:33.905 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-26T23:44:33.905 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2024-04-26T23:44:33.905 INFO:teuthology.orchestra.run.smithi203.stdout: debug paxos = 20 2024-04-26T23:44:33.905 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2024-04-26T23:44:33.905 INFO:teuthology.orchestra.run.smithi203.stdout: mon data avail warn = 5 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: mon mgr mkfs grace = 240 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd reporter subtree level = osd 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd prime pg temp = true 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T23:44:33.906 INFO:teuthology.orchestra.run.smithi203.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: # 1m isn't quite enough 2024-04-26T23:44:33.907 INFO:teuthology.orchestra.run.smithi203.stdout: mon_down_mkfs_grace = 2m 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_filestore_osds = false 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: mon down mkfs grace = 300 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: mon op complaint time = 120 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout:[client] 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: rgw cache enabled = true 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable ops log = true 2024-04-26T23:44:33.908 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable usage log = true 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: client mount timeout = 600 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: debug client = 20 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = "" 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2024-04-26T23:44:33.909 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.a] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.b] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.c] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.c] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.b] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.d] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout:[mds] 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds = 20 2024-04-26T23:44:33.910 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds balancer = 20 2024-04-26T23:44:33.911 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2024-04-26T23:44:33.911 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug frag = True 2024-04-26T23:44:33.911 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug scatterstat = True 2024-04-26T23:44:33.911 INFO:teuthology.orchestra.run.smithi203.stdout: mds op complaint time = 180 2024-04-26T23:44:33.911 INFO:teuthology.orchestra.run.smithi203.stdout: mds verify scatter = True 2024-04-26T23:44:33.911 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2024-04-26T23:44:33.911 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2024-04-26T23:44:33.912 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2024-04-26T23:44:33.912 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T23:44:33.912 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T23:44:33.991 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T23:44:33.991 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:33.991 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T23:44:33.999 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:33.999 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T23:44:34.052 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:44:34.052 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:34.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:44:34.053 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:44:34.129 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:44:34.129 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:34.177 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:44:34.177 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:34.177 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T23:44:34.177 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T23:44:34.212 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:44:34.212 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:34.263 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T23:44:34.264 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T23:44:34.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:44:34.320 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T23:44:34.326 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:44:34.386 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T23:44:34.400 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T23:44:34.400 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:44:34.456 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T23:44:34.460 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T23:44:34.480 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:44:34.576 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T23:44:34.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T23:44:34.600 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:44:34.660 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T23:44:34.664 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T23:44:34.685 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:44:34.783 INFO:teuthology.orchestra.run.smithi203.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T23:44:34.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T23:44:34.807 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T23:44:34.807 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T23:44:34.850 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T23:44:34.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-26T23:44:34.955 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-26T23:44:34.972 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-26T23:44:35.014 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-26T23:44:35.031 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-26T23:44:35.117 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-26T23:44:35.135 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T23:44:35.135 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi203.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T23:44:35.136 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T23:44:35.156 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:35.156 INFO:tasks.ceph:role: osd.0 2024-04-26T23:44:35.156 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:44:35.156 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:44:35.216 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:35.216 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:35.217 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:35.217 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:35.217 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:35.217 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:35.217 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:35.241 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-26T23:44:35.243 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-26T23:44:35.243 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T23:44:35.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T23:44:35.377 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:35.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:35.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T23:44:35.444 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:35.444 INFO:tasks.ceph:role: osd.1 2024-04-26T23:44:35.444 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:44:35.444 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:35.509 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:35.534 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-26T23:44:35.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-26T23:44:35.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T23:44:35.604 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T23:44:35.661 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:35.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:35.663 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T23:44:35.728 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:35.728 INFO:tasks.ceph:role: osd.2 2024-04-26T23:44:35.728 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:44:35.729 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:44:35.793 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:35.793 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:35.794 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:35.794 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:35.794 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:35.794 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:35.795 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:35.817 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-26T23:44:35.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-26T23:44:35.820 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T23:44:35.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T23:44:35.948 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:35.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:35.949 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T23:44:36.012 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:36.012 INFO:tasks.ceph:role: osd.3 2024-04-26T23:44:36.013 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:44:36.013 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:36.076 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:36.100 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-04-26T23:44:36.102 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-04-26T23:44:36.102 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T23:44:36.174 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T23:44:36.232 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:36.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:36.234 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:36.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:36.347+0000 7f70c15a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T23:44:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:36.347+0000 7f70c15a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T23:44:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:36.347+0000 7f70c15a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:44:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:36.347+0000 7f70c15a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:44:36.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:36.347+0000 7f70c15a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T23:44:36.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:36.351+0000 7f70c15a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T23:44:39.386 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T23:44:39.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:39.503+0000 7f7b0f8a97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T23:44:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:39.503+0000 7f7b0f8a97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T23:44:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:39.503+0000 7f7b0f8a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:44:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:39.503+0000 7f7b0f8a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:44:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:39.503+0000 7f7b0f8a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T23:44:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:39.503+0000 7f7b0f8a97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T23:44:42.557 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T23:44:42.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:42.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:42.675+0000 7f46a537c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T23:44:42.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:42.675+0000 7f46a537c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T23:44:42.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:42.675+0000 7f46a537c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:44:42.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:42.675+0000 7f46a537c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:44:42.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:42.675+0000 7f46a537c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T23:44:42.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:42.679+0000 7f46a537c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T23:44:45.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T23:44:45.727 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:45.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:45.819+0000 7fab76a7e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T23:44:45.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:45.819+0000 7fab76a7e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T23:44:45.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:45.819+0000 7fab76a7e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:44:45.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:45.819+0000 7fab76a7e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:44:45.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:45.819+0000 7fab76a7e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T23:44:45.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:44:45.823+0000 7fab76a7e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T23:44:48.844 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T23:44:48.865 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T23:44:48.887 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:48.887 INFO:tasks.ceph:role: osd.4 2024-04-26T23:44:48.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:44:48.888 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T23:44:48.960 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:48.960 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:48.960 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:48.960 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:48.960 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:48.961 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:48.961 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:48.961 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:48.961 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:48.961 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:49.363 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-26T23:44:49.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-26T23:44:49.367 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T23:44:49.463 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T23:44:49.479 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:49.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:49.480 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T23:44:49.544 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:49.544 INFO:tasks.ceph:role: osd.5 2024-04-26T23:44:49.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:44:49.544 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:49.616 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:49.617 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:50.017 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-26T23:44:50.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-26T23:44:50.020 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T23:44:50.144 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T23:44:50.161 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:50.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:50.162 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T23:44:50.223 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:50.223 INFO:tasks.ceph:role: osd.6 2024-04-26T23:44:50.223 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:44:50.223 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:50.294 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:50.715 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-26T23:44:50.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-26T23:44:50.718 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T23:44:50.842 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T23:44:50.858 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:50.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:50.860 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T23:44:50.927 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T23:44:50.927 INFO:tasks.ceph:role: osd.7 2024-04-26T23:44:50.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:44:50.927 DEBUG:teuthology.orchestra.run.smithi203:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T23:44:50.998 INFO:teuthology.orchestra.run.smithi203.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout: = sunit=0 swidth=0 blks 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T23:44:50.999 INFO:teuthology.orchestra.run.smithi203.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T23:44:51.364 INFO:teuthology.orchestra.run.smithi203.stdout:Discarding blocks...Done. 2024-04-26T23:44:51.367 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi203.front.sepia.ceph.com -o noatime 2024-04-26T23:44:51.367 DEBUG:teuthology.orchestra.run.smithi203:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T23:44:51.442 DEBUG:teuthology.orchestra.run.smithi203:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T23:44:51.504 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T23:44:51.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:44:51.505 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:51.625 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:51.620+0000 7f740d42b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T23:44:51.626 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:51.620+0000 7f740d42b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T23:44:51.626 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:51.620+0000 7f740d42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:44:51.626 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:51.620+0000 7f740d42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:44:51.626 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:51.620+0000 7f740d42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T23:44:51.629 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:51.624+0000 7f740d42b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T23:44:54.684 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T23:44:54.704 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:54.798 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:54.792+0000 7fdf29e957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T23:44:54.799 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:54.792+0000 7fdf29e957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T23:44:54.799 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:54.792+0000 7fdf29e957c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:44:54.799 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:54.792+0000 7fdf29e957c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:44:54.799 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:54.792+0000 7fdf29e957c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T23:44:54.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:54.796+0000 7fdf29e957c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T23:44:57.848 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T23:44:57.870 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:44:57.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:57.960+0000 7f0ee22547c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T23:44:57.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:57.960+0000 7f0ee22547c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T23:44:57.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:57.960+0000 7f0ee22547c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:44:57.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:57.960+0000 7f0ee22547c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:44:57.967 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:57.960+0000 7f0ee22547c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T23:44:57.968 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:44:57.960+0000 7f0ee22547c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T23:45:00.993 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T23:45:01.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:45:01.106 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:01.100+0000 7f970859b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T23:45:01.107 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:01.100+0000 7f970859b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T23:45:01.107 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:01.100+0000 7f970859b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:45:01.107 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:01.100+0000 7f970859b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:45:01.107 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:01.100+0000 7f970859b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T23:45:01.108 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:01.104+0000 7f970859b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T23:45:01.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:01.982 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:04.142 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T23:45:04.163 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T23:45:04.163 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T23:45:04.186 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.186 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T23:45:04.251 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T23:45:04.319 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T23:45:04.383 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.383 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T23:45:04.447 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T23:45:04.511 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.511 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T23:45:04.575 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:04.575 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T23:45:04.596 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:04.596 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T23:45:04.660 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:04.660 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T23:45:04.720 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:04.721 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T23:45:04.784 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:04.784 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T23:45:04.843 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:04.843 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T23:45:04.903 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:04.903 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T23:45:04.963 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.963 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T23:45:04.973 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:04.974 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-26T23:45:05.026 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:05.026 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-26T23:45:05.035 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:05.035 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-26T23:45:05.084 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T23:45:05.084 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:45:05.087 DEBUG:teuthology.orchestra.run.smithi203:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T23:45:05.134 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-04-26T23:45:05.134 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmOXIBExAAAvRWdTqgQoTBjJINIP8Axw== 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmPvgWGxAAiYQ2zUX0ozNfqhRyoqklbA== 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmJQ08IhAA+Pq7378EpZhTk027ykb25Q== 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBkPCxmlALuFBAALtrCma5B3PGPr4wwo9MHsQ== 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBnPCxms/UlHhAAqYSWMKwMrWVB4fAaks2ouw== 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBqPCxmL2dpKBAAoLK+/xVyjawGaNzqnJKfsA== 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-04-26T23:45:05.135 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBtPCxmvmoNMRAAZIRxIBrJHZ4Zf8L6w3C7dg== 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmzWLtFhAAQralpGU4KTBxBggcgaIHZA== 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxm0ms+JxAA/yzvj5fwb8ubsCaa8RPulA== 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmqVSULhAA4u/dlOjp5dvwF7dCSEzBjQ== 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBzPCxmuAseJRAAFY67ni0LWB3q0kgi5MdGMA== 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB2PCxmLy55LxAAQ1LcwQkn4tgpBOBAAVGPmw== 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB5PCxmk2xtORAAUD/E0hWuBjAzQzLWViuGwQ== 2024-04-26T23:45:05.136 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQB9PCxmHWQvBhAAqMiM2MHF9YUbdt0wrrJKZw== 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmSs+fMhAAi6eSRSyhcIwg3ckGbNdS9Q== 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout:[client.2] 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmnAndOBAARbPEFhWyxpORFk++YkeIZw== 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBjPCxmwgTIABAAoqIgP1MTeUjPZz0fFI/QZA== 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout:[client.3] 2024-04-26T23:45:05.137 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBjPCxmnBTmBhAAzw4PpzWsqCroEIeyjApSPg== 2024-04-26T23:45:05.145 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.y] 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxmOXIBExAAAvRWdTqgQoTBjJINIP8Axw== 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxmPvgWGxAAiYQ2zUX0ozNfqhRyoqklbA== 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.c] 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxmJQ08IhAA+Pq7378EpZhTk027ykb25Q== 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.0] 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBkPCxmlALuFBAALtrCma5B3PGPr4wwo9MHsQ== 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.1] 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBnPCxms/UlHhAAqYSWMKwMrWVB4fAaks2ouw== 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.2] 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBqPCxmL2dpKBAAoLK+/xVyjawGaNzqnJKfsA== 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.3] 2024-04-26T23:45:05.146 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBtPCxmvmoNMRAAZIRxIBrJHZ4Zf8L6w3C7dg== 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr.x] 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxmzWLtFhAAQralpGU4KTBxBggcgaIHZA== 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.b] 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxm0ms+JxAA/yzvj5fwb8ubsCaa8RPulA== 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.d] 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxmqVSULhAA4u/dlOjp5dvwF7dCSEzBjQ== 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.4] 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBzPCxmuAseJRAAFY67ni0LWB3q0kgi5MdGMA== 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.5] 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQB2PCxmLy55LxAAQ1LcwQkn4tgpBOBAAVGPmw== 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.6] 2024-04-26T23:45:05.147 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQB5PCxmk2xtORAAUD/E0hWuBjAzQzLWViuGwQ== 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout:[osd.7] 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQB9PCxmHWQvBhAAqMiM2MHF9YUbdt0wrrJKZw== 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout:[client.0] 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxmSs+fMhAAi6eSRSyhcIwg3ckGbNdS9Q== 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout:[client.2] 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBiPCxmnAndOBAARbPEFhWyxpORFk++YkeIZw== 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout:[client.1] 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBjPCxmwgTIABAAoqIgP1MTeUjPZz0fFI/QZA== 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout:[client.3] 2024-04-26T23:45:05.148 INFO:teuthology.orchestra.run.smithi203.stdout: key = AQBjPCxmnBTmBhAAzw4PpzWsqCroEIeyjApSPg== 2024-04-26T23:45:05.149 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:45:05.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:45:05.247 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.251 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.308 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.311 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.371 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.423 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.427 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.483 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.539 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.593 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:45:05.597 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T23:45:05.651 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.654 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.714 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T23:45:05.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.773 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.829 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.885 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T23:45:05.994 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:05.997 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:06.052 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:06.056 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:06.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:06.115 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:06.170 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:06.173 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T23:45:06.230 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T23:45:06.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T23:45:06.250 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:45:06.363 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T23:45:06.383 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T23:45:06.402 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:45:06.514 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T23:45:06.534 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T23:45:06.594 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T23:45:06.701 DEBUG:teuthology.orchestra.run.smithi203:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T23:45:06.721 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:45:06.724 DEBUG:teuthology.orchestra.run.smithi203:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T23:45:06.771 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T23:45:06.772 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T23:45:06.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T23:45:06.775 INFO:tasks.ceph.mon.a:Started 2024-04-26T23:45:06.775 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T23:45:06.775 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T23:45:06.814 INFO:tasks.ceph.mon.b:Started 2024-04-26T23:45:06.815 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T23:45:06.815 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T23:45:06.817 INFO:tasks.ceph.mon.c:Started 2024-04-26T23:45:06.817 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T23:45:06.818 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T23:45:06.818 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T23:45:06.821 INFO:tasks.ceph.mgr.y:Started 2024-04-26T23:45:06.821 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T23:45:06.821 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T23:45:06.824 INFO:tasks.ceph.mgr.x:Started 2024-04-26T23:45:06.824 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T23:45:06.824 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T23:45:06.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1737c00640 1 Processor -- start 2024-04-26T23:45:06.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1737c00640 1 -- start start 2024-04-26T23:45:06.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1737c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 0x7f173009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1737c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 0x7f173009bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1737c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1730071620 con 0x7f17300704d0 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1737c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1730162e90 con 0x7f1730162ab0 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1737c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f17300d2d40 con 0x7f17300b56f0 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1735c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f17300704d0 0x7f17300708e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35362/0 (socket says 172.21.15.47:35362) 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1735c00640 1 -- 172.21.15.47:0/1068490921 learned_addr learned my addr 172.21.15.47:0/1068490921 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1735200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 0x7f173009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1727e00640 1 --2- 172.21.15.47:0/1068490921 >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 0x7f173009bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1727e00640 1 -- 172.21.15.47:0/1068490921 >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 msgr2=0x7f173009bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1727e00640 1 -- 172.21.15.47:0/1068490921 >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 msgr2=0x7f173009bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1727e00640 1 --2- 172.21.15.47:0/1068490921 >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 0x7f173009bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1727e00640 1 --2- 172.21.15.47:0/1068490921 >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 0x7f173009bfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:06.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1735200640 1 -- 172.21.15.47:0/1068490921 >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 msgr2=0x7f173009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-26T23:45:06.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1735200640 1 -- 172.21.15.47:0/1068490921 >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 msgr2=0x7f173009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T23:45:06.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1735200640 1 --2- 172.21.15.47:0/1068490921 >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 0x7f173009ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T23:45:06.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:06.962+0000 7f1735200640 1 --2- 172.21.15.47:0/1068490921 >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 0x7f173009ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T23:45:07.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419104175 0 0) 0x7f1730071620 con 0x7f17300704d0 2024-04-26T23:45:07.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1714003530 con 0x7f17300704d0 2024-04-26T23:45:07.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1495975379 0 0) 0x7f1714003530 con 0x7f17300704d0 2024-04-26T23:45:07.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 msgr2=0x7f173009bfa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:07.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 --2- 172.21.15.47:0/1068490921 >> v2:172.21.15.203:3300/0 conn(0x7f17300b56f0 0x7f173009bfa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 msgr2=0x7f173009ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T23:45:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 --2- 172.21.15.47:0/1068490921 >> v2:172.21.15.47:3300/0 conn(0x7f1730162ab0 0x7f173009ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173006dfc0 con 0x7f17300704d0 2024-04-26T23:45:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f1728001a00 con 0x7f17300704d0 2024-04-26T23:45:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 >> v1:172.21.15.47:6789/0 conn(0x7f17300704d0 legacy=0x7f17300708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1714003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1714004810 0x7f1714004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17140051d0 0x7f171400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1730162e90 con 0x7f17140039c0 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17300d2d40 con 0x7f1714004810 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f171400c180 con 0x7f17140051d0 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735200640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1714003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1727e00640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1714004810 0x7f1714004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735c00640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17140051d0 0x7f171400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735200640 1 -- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17140051d0 msgr2=0x7f171400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:07.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735200640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f17140051d0 0x7f171400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735200640 1 -- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1714004810 msgr2=0x7f1714004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735200640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1714004810 0x7f1714004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735200640 1 -- 172.21.15.47:0/1068490921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1714003530 con 0x7f17140039c0 2024-04-26T23:45:07.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.106+0000 7f1735c00640 1 -- 172.21.15.47:0/1068490921 reap_dead start 2024-04-26T23:45:07.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.110+0000 7f1735200640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1714003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f172000c820 tx=0x7f172001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d416729ecb2afcd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.110+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172000f040 con 0x7f17140039c0 2024-04-26T23:45:07.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.110+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17200b0070 con 0x7f17140039c0 2024-04-26T23:45:07.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.110+0000 7f172fe00640 1 -- 172.21.15.47:0/1068490921 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17200ab830 con 0x7f17140039c0 2024-04-26T23:45:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- 172.21.15.47:0/1068490921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 msgr2=0x7f1714003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1714003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f172000c820 tx=0x7f172001c510 comp rx=0 tx=0).stop 2024-04-26T23:45:07.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- 172.21.15.47:0/1068490921 shutdown_connections 2024-04-26T23:45:07.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 --2- 172.21.15.47:0/1068490921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1714003de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- 172.21.15.47:0/1068490921 >> 172.21.15.47:0/1068490921 conn(0x7f17300b4c00 msgr2=0x7f17300b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- 172.21.15.47:0/1068490921 shutdown_connections 2024-04-26T23:45:07.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- 172.21.15.47:0/1068490921 wait complete. 2024-04-26T23:45:07.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 Processor -- start 2024-04-26T23:45:07.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- start start 2024-04-26T23:45:07.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1730161900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f173015a160 0x7f173014b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17301607e0 0x7f1730160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1730072330 con 0x7f17140039c0 2024-04-26T23:45:07.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17300721b0 con 0x7f17301607e0 2024-04-26T23:45:07.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1737c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1730071be0 con 0x7f173015a160 2024-04-26T23:45:07.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.114+0000 7f1735200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1730161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1727e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f173015a160 0x7f173014b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1730161900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59518/0 (socket says 172.21.15.47:59518) 2024-04-26T23:45:07.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1727e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f173015a160 0x7f173014b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:56302/0 (socket says 172.21.15.47:56302) 2024-04-26T23:45:07.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 -- 172.21.15.47:0/457453927 learned_addr learned my addr 172.21.15.47:0/457453927 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:07.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735c00640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17301607e0 0x7f1730160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 -- 172.21.15.47:0/457453927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f173015a160 msgr2=0x7f173014b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f173015a160 0x7f173014b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 -- 172.21.15.47:0/457453927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17301607e0 msgr2=0x7f1730160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17301607e0 0x7f1730160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 -- 172.21.15.47:0/457453927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173014c400 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1735200640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1730161900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17200ad040 tx=0x7f1714005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f172d600640 1 -- 172.21.15.47:0/457453927 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17200b5780 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f172d600640 1 -- 172.21.15.47:0/457453927 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17200b5920 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f172d600640 1 -- 172.21.15.47:0/457453927 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17200b5cf0 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173015bd30 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173015c2f0 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f172d600640 1 -- 172.21.15.47:0/457453927 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f17200c07e0 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f172d600640 1 -- 172.21.15.47:0/457453927 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f17200c9990 con 0x7f17140039c0 2024-04-26T23:45:07.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.118+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1730069700 con 0x7f17140039c0 2024-04-26T23:45:07.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.134+0000 7f172d600640 1 -- 172.21.15.47:0/457453927 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1720016220 con 0x7f17140039c0 2024-04-26T23:45:07.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.198+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1730071620 con 0x7f17140039c0 2024-04-26T23:45:07.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f172d600640 1 -- 172.21.15.47:0/457453927 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f17200c93f0 con 0x7f17140039c0 2024-04-26T23:45:07.208 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 msgr2=0x7f1730161900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1730161900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f17200ad040 tx=0x7f1714005840 comp rx=0 tx=0).stop 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 shutdown_connections 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17301607e0 0x7f1730160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f173015a160 0x7f173014b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 --2- 172.21.15.47:0/457453927 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140039c0 0x7f1730161900 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 >> 172.21.15.47:0/457453927 conn(0x7f17300b4c00 msgr2=0x7f17300b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 shutdown_connections 2024-04-26T23:45:07.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:07.202+0000 7f1737c00640 1 -- 172.21.15.47:0/457453927 wait complete. 2024-04-26T23:45:07.228 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T23:45:07.228 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T23:45:07.228 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:07.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T23:45:07.249 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:07.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T23:45:07.309 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:07.310 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T23:45:07.314 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:07.308+0000 7f5e9cb5f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:45:07.333 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:07.326+0000 7fe5094bb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T23:45:07.353 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:45:07.354 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T23:45:07.417 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:07.417 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T23:45:07.436 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:07.437 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T23:45:07.499 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:07.499 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T23:45:07.559 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:45:07.559 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T23:45:07.619 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new ad4a8333-f9c9-4097-a99a-04750e467fc0 0 2024-04-26T23:45:07.795 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b4ca00640 1 Processor -- start 2024-04-26T23:45:07.795 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b4ca00640 1 -- start start 2024-04-26T23:45:07.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b4ca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0b48162ab0 0x7f0b4809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b4ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0b4809bfa0 0x7f0b48070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b4ca00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4809c3b0 con 0x7f0b480b56f0 2024-04-26T23:45:07.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b4ca00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0b48071620 con 0x7f0b4809bfa0 2024-04-26T23:45:07.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b4ca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0b48162e90 con 0x7f0b48162ab0 2024-04-26T23:45:07.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b45e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0b48162ab0 0x7f0b4809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.796 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b45e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0b48162ab0 0x7f0b4809ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41718/0 (socket says 172.21.15.203:41718) 2024-04-26T23:45:07.797 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b3d400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f0b480b56f0 0x7f0b480704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52954/0 (socket says 172.21.15.203:52954) 2024-04-26T23:45:07.797 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.788+0000 7f0b45e00640 1 -- 172.21.15.203:0/4136227733 learned_addr learned my addr 172.21.15.203:0/4136227733 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:07.797 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b46800640 1 --2- 172.21.15.203:0/4136227733 >> v2:172.21.15.47:3300/0 conn(0x7f0b4809bfa0 0x7f0b48070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.797 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45e00640 1 -- 172.21.15.203:0/4136227733 >> v2:172.21.15.47:3300/0 conn(0x7f0b4809bfa0 msgr2=0x7f0b48070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:07.797 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45e00640 1 --2- 172.21.15.203:0/4136227733 >> v2:172.21.15.47:3300/0 conn(0x7f0b4809bfa0 0x7f0b48070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.798 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45e00640 1 -- 172.21.15.203:0/4136227733 >> v1:172.21.15.203:6789/0 conn(0x7f0b480b56f0 legacy=0x7f0b480704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.798 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45e00640 1 -- 172.21.15.203:0/4136227733 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b480d2d40 con 0x7f0b48162ab0 2024-04-26T23:45:07.798 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45400640 1 -- 172.21.15.203:0/4136227733 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233479184 0 0) 0x7f0b38001120 con 0x7f0b480b56f0 2024-04-26T23:45:07.799 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45e00640 1 --2- 172.21.15.203:0/4136227733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b48162ab0 0x7f0b4809ba60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b48074ac0 tx=0x7f0b3001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f077bb494776888b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.800 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45400640 1 -- 172.21.15.203:0/4136227733 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b300b2070 con 0x7f0b48162ab0 2024-04-26T23:45:07.800 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45400640 1 -- 172.21.15.203:0/4136227733 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b300ad680 con 0x7f0b48162ab0 2024-04-26T23:45:07.800 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.792+0000 7f0b45400640 1 -- 172.21.15.203:0/4136227733 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b300ada50 con 0x7f0b48162ab0 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- 172.21.15.203:0/4136227733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b48162ab0 msgr2=0x7f0b4809ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 --2- 172.21.15.203:0/4136227733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b48162ab0 0x7f0b4809ba60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0b48074ac0 tx=0x7f0b3001c490 comp rx=0 tx=0).stop 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- 172.21.15.203:0/4136227733 shutdown_connections 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 --2- 172.21.15.203:0/4136227733 >> v2:172.21.15.47:3300/0 conn(0x7f0b4809bfa0 0x7f0b48070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 --2- 172.21.15.203:0/4136227733 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b48162ab0 0x7f0b4809ba60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- 172.21.15.203:0/4136227733 >> 172.21.15.203:0/4136227733 conn(0x7f0b480b4c00 msgr2=0x7f0b480b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- 172.21.15.203:0/4136227733 shutdown_connections 2024-04-26T23:45:07.801 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- 172.21.15.203:0/4136227733 wait complete. 2024-04-26T23:45:07.802 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 Processor -- start 2024-04-26T23:45:07.802 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- start start 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b4809bfa0 0x7f0b4814ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b480b56f0 0x7f0b48161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b48162ab0 0x7f0b48161780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0b480d2320 con 0x7f0b48162ab0 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0b480718e0 con 0x7f0b480b56f0 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b4ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0b480d24a0 con 0x7f0b4809bfa0 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b480b56f0 0x7f0b48161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.804 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b45e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b4809bfa0 0x7f0b4814ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b45e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b4809bfa0 0x7f0b4814ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41384/0 (socket says 172.21.15.203:41384) 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b480b56f0 0x7f0b48161240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41728/0 (socket says 172.21.15.203:41728) 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b45e00640 1 -- 172.21.15.203:0/2333285063 learned_addr learned my addr 172.21.15.203:0/2333285063 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b46800640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b48162ab0 0x7f0b48161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 -- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b4809bfa0 msgr2=0x7f0b4814ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b4809bfa0 0x7f0b4814ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 -- 172.21.15.203:0/2333285063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b48162ab0 msgr2=0x7f0b48161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b48162ab0 0x7f0b48161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 -- 172.21.15.203:0/2333285063 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b480d20f0 con 0x7f0b480b56f0 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b45e00640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b4809bfa0 0x7f0b4814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:07.805 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.796+0000 7f0b3d400640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b480b56f0 0x7f0b48161240 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c3e0 tx=0x7f0b3800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:07.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b3ea00640 1 -- 172.21.15.203:0/2333285063 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b380074e0 con 0x7f0b480b56f0 2024-04-26T23:45:07.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b3ea00640 1 -- 172.21.15.203:0/2333285063 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b380047f0 con 0x7f0b480b56f0 2024-04-26T23:45:07.806 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b480b0d40 con 0x7f0b480b56f0 2024-04-26T23:45:07.806 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f5e9cb5f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:45:07.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b3ea00640 1 -- 172.21.15.203:0/2333285063 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38004be0 con 0x7f0b480b56f0 2024-04-26T23:45:07.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b480b1300 con 0x7f0b480b56f0 2024-04-26T23:45:07.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b3ea00640 1 -- 172.21.15.203:0/2333285063 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b38011070 con 0x7f0b480b56f0 2024-04-26T23:45:07.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b3ea00640 1 -- 172.21.15.203:0/2333285063 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0b38013700 con 0x7f0b480b56f0 2024-04-26T23:45:07.807 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.800+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b48069700 con 0x7f0b480b56f0 2024-04-26T23:45:07.812 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.804+0000 7f0b3ea00640 1 -- 172.21.15.203:0/2333285063 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0b4809c3b0 con 0x7f0b480b56f0 2024-04-26T23:45:07.852 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:07.846+0000 7fe5094bb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T23:45:07.874 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.868+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad4a8333-f9c9-4097-a99a-04750e467fc0", "id": 0} v 0) -- 0x7f0b481620d0 con 0x7f0b480b56f0 2024-04-26T23:45:07.881 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b3ea00640 1 -- 172.21.15.203:0/2333285063 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad4a8333-f9c9-4097-a99a-04750e467fc0", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0b38013900 con 0x7f0b480b56f0 2024-04-26T23:45:07.881 INFO:teuthology.orchestra.run.smithi203.stdout:0 2024-04-26T23:45:07.882 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b480b56f0 msgr2=0x7f0b48161240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:07.882 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b480b56f0 0x7f0b48161240 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c3e0 tx=0x7f0b3800c8a0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.882 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 shutdown_connections 2024-04-26T23:45:07.882 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0b48162ab0 0x7f0b48161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0b480b56f0 0x7f0b48161240 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 --2- 172.21.15.203:0/2333285063 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0b4809bfa0 0x7f0b4814ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:07.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 >> 172.21.15.203:0/2333285063 conn(0x7f0b480b4c00 msgr2=0x7f0b480b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:07.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 shutdown_connections 2024-04-26T23:45:07.883 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:07.876+0000 7f0b4ca00640 1 -- 172.21.15.203:0/2333285063 wait complete. 2024-04-26T23:45:07.900 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9 1 2024-04-26T23:45:08.030 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:08.024+0000 7f5e9cb5f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:45:08.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.028+0000 7f7de8000640 1 Processor -- start 2024-04-26T23:45:08.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de8000640 1 -- start start 2024-04-26T23:45:08.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de8000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7de0162ab0 0x7f7de009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de8000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de0070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de8000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de009c3b0 con 0x7f7de00b56f0 2024-04-26T23:45:08.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de8000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7de0071620 con 0x7f7de0162ab0 2024-04-26T23:45:08.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de8000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7de0162e90 con 0x7f7de009bfa0 2024-04-26T23:45:08.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de4c00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f7de00b56f0 0x7f7de00704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52958/0 (socket says 172.21.15.203:52958) 2024-04-26T23:45:08.038 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de4c00640 1 -- 172.21.15.203:0/168136270 learned_addr learned my addr 172.21.15.203:0/168136270 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-26T23:45:08.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de6000640 1 --2- 172.21.15.203:0/168136270 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de0070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de5600640 1 --2- 172.21.15.203:0/168136270 >> v2:172.21.15.47:3300/0 conn(0x7f7de0162ab0 0x7f7de009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7ddfe00640 1 -- 172.21.15.203:0/168136270 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874947501 0 0) 0x7f7dcc001120 con 0x7f7de00b56f0 2024-04-26T23:45:08.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de6000640 1 -- 172.21.15.203:0/168136270 >> v2:172.21.15.47:3300/0 conn(0x7f7de0162ab0 msgr2=0x7f7de009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:08.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de6000640 1 --2- 172.21.15.203:0/168136270 >> v2:172.21.15.47:3300/0 conn(0x7f7de0162ab0 0x7f7de009ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de6000640 1 -- 172.21.15.203:0/168136270 >> v1:172.21.15.203:6789/0 conn(0x7f7de00b56f0 legacy=0x7f7de00704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.039 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.032+0000 7f7de6000640 1 -- 172.21.15.203:0/168136270 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de00d2d40 con 0x7f7de009bfa0 2024-04-26T23:45:08.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de6000640 1 --2- 172.21.15.203:0/168136270 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de0070be0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009d90 tx=0x7f7dd801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeef148a68a1902a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7ddfe00640 1 -- 172.21.15.203:0/168136270 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80b2070 con 0x7f7de009bfa0 2024-04-26T23:45:08.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7ddfe00640 1 -- 172.21.15.203:0/168136270 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd80a5890 con 0x7f7de009bfa0 2024-04-26T23:45:08.041 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7ddfe00640 1 -- 172.21.15.203:0/168136270 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80a5c60 con 0x7f7de009bfa0 2024-04-26T23:45:08.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 -- 172.21.15.203:0/168136270 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 msgr2=0x7f7de0070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 --2- 172.21.15.203:0/168136270 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de0070be0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009d90 tx=0x7f7dd801c8e0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 -- 172.21.15.203:0/168136270 shutdown_connections 2024-04-26T23:45:08.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 --2- 172.21.15.203:0/168136270 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de0070be0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.042 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 --2- 172.21.15.203:0/168136270 >> v2:172.21.15.47:3300/0 conn(0x7f7de0162ab0 0x7f7de009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 -- 172.21.15.203:0/168136270 >> 172.21.15.203:0/168136270 conn(0x7f7de00b4c00 msgr2=0x7f7de00b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 -- 172.21.15.203:0/168136270 shutdown_connections 2024-04-26T23:45:08.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 -- 172.21.15.203:0/168136270 wait complete. 2024-04-26T23:45:08.043 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 Processor -- start 2024-04-26T23:45:08.044 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.036+0000 7f7de8000640 1 -- start start 2024-04-26T23:45:08.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.045 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7de00b56f0 0x7f7de014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7de0162ab0 0x7f7de015e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00d2320 con 0x7f7de00b56f0 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00718e0 con 0x7f7de0162ab0 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7de00d24a0 con 0x7f7de009bfa0 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7de0162ab0 0x7f7de015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de5600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de5600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de014e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41396/0 (socket says 172.21.15.203:41396) 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7de0162ab0 0x7f7de015e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41734/0 (socket says 172.21.15.203:41734) 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de5600640 1 -- 172.21.15.203:0/1381158216 learned_addr learned my addr 172.21.15.203:0/1381158216 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de4c00640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7de00b56f0 0x7f7de014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 -- 172.21.15.203:0/1381158216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 msgr2=0x7f7de014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de014e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 -- 172.21.15.203:0/1381158216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7de00b56f0 msgr2=0x7f7de014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.046 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7de00b56f0 0x7f7de014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 -- 172.21.15.203:0/1381158216 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de014f9d0 con 0x7f7de0162ab0 2024-04-26T23:45:08.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de4c00640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7de00b56f0 0x7f7de014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:08.047 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de6000640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7de0162ab0 0x7f7de015e550 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80ac000 tx=0x7f7dd8019680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7ddd600640 1 -- 172.21.15.203:0/1381158216 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80b2050 con 0x7f7de0162ab0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7ddd600640 1 -- 172.21.15.203:0/1381158216 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd80b3040 con 0x7f7de0162ab0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7ddd600640 1 -- 172.21.15.203:0/1381158216 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8003da0 con 0x7f7de0162ab0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de014fcb0 con 0x7f7de0162ab0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de00b70b0 con 0x7f7de0162ab0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7ddd600640 1 -- 172.21.15.203:0/1381158216 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7dd80a5750 con 0x7f7de0162ab0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7ddd600640 1 -- 172.21.15.203:0/1381158216 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f7dd80045a0 con 0x7f7de0162ab0 2024-04-26T23:45:08.048 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.040+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de00b7280 con 0x7f7de0162ab0 2024-04-26T23:45:08.049 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.044+0000 7f7ddd600640 1 -- 172.21.15.203:0/1381158216 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7dd8016560 con 0x7f7de0162ab0 2024-04-26T23:45:08.072 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:08.066+0000 7fe5094bb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T23:45:08.119 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.112+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9", "id": 1} v 0) -- 0x7f7de00b6e80 con 0x7f7de0162ab0 2024-04-26T23:45:08.122 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7ddd600640 1 -- 172.21.15.203:0/1381158216 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f7dd80047a0 con 0x7f7de0162ab0 2024-04-26T23:45:08.122 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-26T23:45:08.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7de0162ab0 msgr2=0x7f7de015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7de0162ab0 0x7f7de015e550 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80ac000 tx=0x7f7dd8019680 comp rx=0 tx=0).stop 2024-04-26T23:45:08.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 shutdown_connections 2024-04-26T23:45:08.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7de0162ab0 0x7f7de015e550 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.123 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7de00b56f0 0x7f7de014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 --2- 172.21.15.203:0/1381158216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7de009bfa0 0x7f7de014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 >> 172.21.15.203:0/1381158216 conn(0x7f7de00b4c00 msgr2=0x7f7de00d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 shutdown_connections 2024-04-26T23:45:08.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.116+0000 7f7de8000640 1 -- 172.21.15.203:0/1381158216 wait complete. 2024-04-26T23:45:08.142 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 9db64f29-1ae8-4866-bdd2-a4fdbdf49a28 2 2024-04-26T23:45:08.276 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.268+0000 7fc27d000640 1 Processor -- start 2024-04-26T23:45:08.276 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.268+0000 7fc27d000640 1 -- start start 2024-04-26T23:45:08.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc27d000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc27806d580 0x7fc2780b3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc27d000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc2780d32e0 0x7fc2780d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc27d000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc27806e740 con 0x7fc2780d2f00 2024-04-26T23:45:08.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc27d000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc27806e460 con 0x7fc2780d32e0 2024-04-26T23:45:08.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc27d000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2780b2e20 con 0x7fc27806d580 2024-04-26T23:45:08.277 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc277e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc2780d32e0 0x7fc2780d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.278 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc277400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fc2780d2f00 0x7fc27806dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52962/0 (socket says 172.21.15.203:52962) 2024-04-26T23:45:08.278 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc277400640 1 -- 172.21.15.203:0/3392967381 learned_addr learned my addr 172.21.15.203:0/3392967381 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-26T23:45:08.278 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc276a00640 1 --2- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc27806d580 0x7fc2780b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.278 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc276000640 1 -- 172.21.15.203:0/3392967381 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850869049 0 0) 0x7fc27806e740 con 0x7fc2780d2f00 2024-04-26T23:45:08.278 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc277e00640 1 -- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc27806d580 msgr2=0x7fc2780b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:08.278 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc277e00640 1 --2- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc27806d580 0x7fc2780b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.278 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc277e00640 1 -- 172.21.15.203:0/3392967381 >> v1:172.21.15.203:6789/0 conn(0x7fc2780d2f00 legacy=0x7fc27806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc277e00640 1 -- 172.21.15.203:0/3392967381 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2780b3100 con 0x7fc2780d32e0 2024-04-26T23:45:08.279 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.272+0000 7fc276a00640 1 --2- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc27806d580 0x7fc2780b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:08.280 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc277e00640 1 --2- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc2780d0ee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc270009d90 tx=0x7fc27001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b87e80ea1092fa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc276000640 1 -- 172.21.15.203:0/3392967381 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2700b2070 con 0x7fc2780d32e0 2024-04-26T23:45:08.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc276000640 1 -- 172.21.15.203:0/3392967381 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2700a5990 con 0x7fc2780d32e0 2024-04-26T23:45:08.281 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc276000640 1 -- 172.21.15.203:0/3392967381 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2700a5d60 con 0x7fc2780d32e0 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 -- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 msgr2=0x7fc2780d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 --2- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc2780d0ee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc270009d90 tx=0x7fc27001c8b0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 -- 172.21.15.203:0/3392967381 shutdown_connections 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 --2- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc2780d0ee0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 --2- 172.21.15.203:0/3392967381 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc27806d580 0x7fc2780b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 -- 172.21.15.203:0/3392967381 >> 172.21.15.203:0/3392967381 conn(0x7fc27809ba60 msgr2=0x7fc27809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 -- 172.21.15.203:0/3392967381 shutdown_connections 2024-04-26T23:45:08.282 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 -- 172.21.15.203:0/3392967381 wait complete. 2024-04-26T23:45:08.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 Processor -- start 2024-04-26T23:45:08.283 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.276+0000 7fc27d000640 1 -- start start 2024-04-26T23:45:08.285 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27806d580 0x7fc27815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.285 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2780d2f00 0x7fc27809ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.285 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc27809f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc278163930 con 0x7fc27806d580 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2780d1a40 con 0x7fc2780d32e0 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc278163ab0 con 0x7fc2780d2f00 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2780d2f00 0x7fc27809ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2780d2f00 0x7fc27809ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41428/0 (socket says 172.21.15.203:41428) 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc277e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc27809f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 -- 172.21.15.203:0/1731053330 learned_addr learned my addr 172.21.15.203:0/1731053330 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc277400640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27806d580 0x7fc27815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 -- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 msgr2=0x7fc27809f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc27809f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 -- 172.21.15.203:0/1731053330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27806d580 msgr2=0x7fc27815aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27806d580 0x7fc27815aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 -- 172.21.15.203:0/1731053330 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27809f830 con 0x7fc2780d2f00 2024-04-26T23:45:08.286 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc277e00640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc27809f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:08.287 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc276a00640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2780d2f00 0x7fc27809ece0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc26400ebe0 tx=0x7fc26400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc26f400640 1 -- 172.21.15.203:0/1731053330 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264017070 con 0x7fc2780d2f00 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc26f400640 1 -- 172.21.15.203:0/1731053330 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26400cc30 con 0x7fc2780d2f00 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc26f400640 1 -- 172.21.15.203:0/1731053330 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc264013470 con 0x7fc2780d2f00 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27809fb10 con 0x7fc2780d2f00 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2780a03b0 con 0x7fc2780d2f00 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc26f400640 1 -- 172.21.15.203:0/1731053330 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc26401a070 con 0x7fc2780d2f00 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc26f400640 1 -- 172.21.15.203:0/1731053330 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc264013df0 con 0x7fc2780d2f00 2024-04-26T23:45:08.288 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.280+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27809fce0 con 0x7fc2780d2f00 2024-04-26T23:45:08.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.284+0000 7fc26f400640 1 -- 172.21.15.203:0/1731053330 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fc2640139d0 con 0x7fc2780d2f00 2024-04-26T23:45:08.356 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.348+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9db64f29-1ae8-4866-bdd2-a4fdbdf49a28", "id": 2} v 0) -- 0x7fc278069b80 con 0x7fc2780d2f00 2024-04-26T23:45:08.359 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.352+0000 7fc26f400640 1 -- 172.21.15.203:0/1731053330 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9db64f29-1ae8-4866-bdd2-a4fdbdf49a28", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc2640059a0 con 0x7fc2780d2f00 2024-04-26T23:45:08.359 INFO:teuthology.orchestra.run.smithi203.stdout:2 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2780d2f00 msgr2=0x7fc27809ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2780d2f00 0x7fc27809ece0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc26400ebe0 tx=0x7fc26400c520 comp rx=0 tx=0).stop 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 shutdown_connections 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2780d32e0 0x7fc27809f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2780d2f00 0x7fc27809ece0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 --2- 172.21.15.203:0/1731053330 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc27806d580 0x7fc27815aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 >> 172.21.15.203:0/1731053330 conn(0x7fc27809ba60 msgr2=0x7fc27809be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 shutdown_connections 2024-04-26T23:45:08.361 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.356+0000 7fc27d000640 1 -- 172.21.15.203:0/1731053330 wait complete. 2024-04-26T23:45:08.379 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 7cf1e791-21a1-45ef-a793-773140236972 3 2024-04-26T23:45:08.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e7200640 1 Processor -- start 2024-04-26T23:45:08.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e7200640 1 -- start start 2024-04-26T23:45:08.516 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e7200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f01e8146a00 0x7f01e80ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.516 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e806c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.516 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e7200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e8070680 con 0x7f01e8073040 2024-04-26T23:45:08.516 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e7200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f01e80d0070 con 0x7f01e8146a00 2024-04-26T23:45:08.516 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f01e806cda0 con 0x7f01e806c400 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e5e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f01e8146a00 0x7f01e80ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01dfe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e806c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01dfe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e806c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41440/0 (socket says 172.21.15.203:41440) 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01e5e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f01e8146a00 0x7f01e80ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41768/0 (socket says 172.21.15.203:41768) 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.508+0000 7f01dfe00640 1 -- 172.21.15.203:0/3903791873 learned_addr learned my addr 172.21.15.203:0/3903791873 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01dfe00640 1 -- 172.21.15.203:0/3903791873 >> v2:172.21.15.203:3300/0 conn(0x7f01e8146a00 msgr2=0x7f01e80ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01dfe00640 1 --2- 172.21.15.203:0/3903791873 >> v2:172.21.15.203:3300/0 conn(0x7f01e8146a00 0x7f01e80ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01dfe00640 1 -- 172.21.15.203:0/3903791873 >> v1:172.21.15.47:6789/0 conn(0x7f01e8073040 legacy=0x7f01e8073450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01dfe00640 1 -- 172.21.15.203:0/3903791873 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e80d02a0 con 0x7f01e806c400 2024-04-26T23:45:08.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01e5e00640 1 --2- 172.21.15.203:0/3903791873 >> v2:172.21.15.203:3300/0 conn(0x7f01e8146a00 0x7f01e80ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:08.519 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01dfe00640 1 --2- 172.21.15.203:0/3903791873 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e806c860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009870 tx=0x7f01d001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cca4fe6195ecdc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.520 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01e5400640 1 -- 172.21.15.203:0/3903791873 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00b1070 con 0x7f01e806c400 2024-04-26T23:45:08.520 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01e5400640 1 -- 172.21.15.203:0/3903791873 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d00ac620 con 0x7f01e806c400 2024-04-26T23:45:08.520 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.512+0000 7f01e5400640 1 -- 172.21.15.203:0/3903791873 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00ac9f0 con 0x7f01e806c400 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- 172.21.15.203:0/3903791873 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 msgr2=0x7f01e806c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 --2- 172.21.15.203:0/3903791873 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e806c860 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009870 tx=0x7f01d001c4d0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- 172.21.15.203:0/3903791873 shutdown_connections 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 --2- 172.21.15.203:0/3903791873 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e806c860 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 --2- 172.21.15.203:0/3903791873 >> v2:172.21.15.203:3300/0 conn(0x7f01e8146a00 0x7f01e80ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- 172.21.15.203:0/3903791873 >> 172.21.15.203:0/3903791873 conn(0x7f01e80b38b0 msgr2=0x7f01e80b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- 172.21.15.203:0/3903791873 shutdown_connections 2024-04-26T23:45:08.521 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- 172.21.15.203:0/3903791873 wait complete. 2024-04-26T23:45:08.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 Processor -- start 2024-04-26T23:45:08.522 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- start start 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e813ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e8073040 0x7f01e8140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01e8146a00 0x7f01e813d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f01e8070c30 con 0x7f01e8073040 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f01e80703a0 con 0x7f01e8146a00 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e7200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f01e806fa70 con 0x7f01e806c400 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e5e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e813ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e6800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01e8146a00 0x7f01e813d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.525 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e5e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e813ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41456/0 (socket says 172.21.15.203:41456) 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01dfe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e8073040 0x7f01e8140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e5e00640 1 -- 172.21.15.203:0/1961196684 learned_addr learned my addr 172.21.15.203:0/1961196684 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e6800640 1 -- 172.21.15.203:0/1961196684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 msgr2=0x7f01e813ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e6800640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e813ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e6800640 1 -- 172.21.15.203:0/1961196684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e8073040 msgr2=0x7f01e8140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e6800640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e8073040 0x7f01e8140a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01e6800640 1 -- 172.21.15.203:0/1961196684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e813ada0 con 0x7f01e8146a00 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.516+0000 7f01dfe00640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e8073040 0x7f01e8140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01e6800640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01e8146a00 0x7f01e813d310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c700 tx=0x7f01e000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01de000640 1 -- 172.21.15.203:0/1961196684 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e0003b80 con 0x7f01e8146a00 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01de000640 1 -- 172.21.15.203:0/1961196684 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e0003d20 con 0x7f01e8146a00 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e813f9d0 con 0x7f01e8146a00 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01de000640 1 -- 172.21.15.203:0/1961196684 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e000aa30 con 0x7f01e8146a00 2024-04-26T23:45:08.526 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e813ff90 con 0x7f01e8146a00 2024-04-26T23:45:08.527 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01de000640 1 -- 172.21.15.203:0/1961196684 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f01e000abd0 con 0x7f01e8146a00 2024-04-26T23:45:08.527 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01de000640 1 -- 172.21.15.203:0/1961196684 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f01e0005560 con 0x7f01e8146a00 2024-04-26T23:45:08.527 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e8069b80 con 0x7f01e8146a00 2024-04-26T23:45:08.528 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.520+0000 7f01de000640 1 -- 172.21.15.203:0/1961196684 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f01e00050d0 con 0x7f01e8146a00 2024-04-26T23:45:08.594 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.588+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7cf1e791-21a1-45ef-a793-773140236972", "id": 3} v 0) -- 0x7f01e80b4a90 con 0x7f01e8146a00 2024-04-26T23:45:08.598 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01de000640 1 -- 172.21.15.203:0/1961196684 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cf1e791-21a1-45ef-a793-773140236972", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f01e0012510 con 0x7f01e8146a00 2024-04-26T23:45:08.599 INFO:teuthology.orchestra.run.smithi203.stdout:3 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01e8146a00 msgr2=0x7f01e813d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01e8146a00 0x7f01e813d310 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c700 tx=0x7f01e000cbc0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 shutdown_connections 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01e8146a00 0x7f01e813d310 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f01e8073040 0x7f01e8140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 --2- 172.21.15.203:0/1961196684 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f01e806c400 0x7f01e813ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 >> 172.21.15.203:0/1961196684 conn(0x7f01e80b38b0 msgr2=0x7f01e80b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 shutdown_connections 2024-04-26T23:45:08.600 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.592+0000 7f01e7200640 1 -- 172.21.15.203:0/1961196684 wait complete. 2024-04-26T23:45:08.618 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new d6609f82-1275-458c-a608-4fe759d5dc46 4 2024-04-26T23:45:08.675 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:08.668+0000 7f5e9cb5f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:45:08.724 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:08.718+0000 7fe5094bb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T23:45:08.739 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:08.732+0000 7f5e9cb5f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:45:08.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f996e400640 1 Processor -- start 2024-04-26T23:45:08.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f996e400640 1 -- start start 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f996e400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9968162ab0 0x7f996809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f996e400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99680b56f0 0x7f996809bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f996e400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9968071620 con 0x7f99680704d0 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f996e400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9968162e90 con 0x7f9968162ab0 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f996e400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f99680d2d40 con 0x7f99680b56f0 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f9967e00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f99680704d0 0x7f9968070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52974/0 (socket says 172.21.15.203:52974) 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f9967e00640 1 -- 172.21.15.203:0/2776960488 learned_addr learned my addr 172.21.15.203:0/2776960488 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f995fe00640 1 --2- 172.21.15.203:0/2776960488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99680b56f0 0x7f996809bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f9967400640 1 --2- 172.21.15.203:0/2776960488 >> v2:172.21.15.47:3300/0 conn(0x7f9968162ab0 0x7f996809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.756 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f9966a00640 1 -- 172.21.15.203:0/2776960488 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897014384 0 0) 0x7f9968071620 con 0x7f99680704d0 2024-04-26T23:45:08.756 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f9966a00640 1 -- 172.21.15.203:0/2776960488 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f994c003530 con 0x7f99680704d0 2024-04-26T23:45:08.756 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f995fe00640 1 -- 172.21.15.203:0/2776960488 >> v2:172.21.15.47:3300/0 conn(0x7f9968162ab0 msgr2=0x7f996809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:08.756 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f995fe00640 1 --2- 172.21.15.203:0/2776960488 >> v2:172.21.15.47:3300/0 conn(0x7f9968162ab0 0x7f996809ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.756 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f995fe00640 1 -- 172.21.15.203:0/2776960488 >> v1:172.21.15.203:6789/0 conn(0x7f99680704d0 legacy=0x7f9968070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.757 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.748+0000 7f995fe00640 1 -- 172.21.15.203:0/2776960488 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996806dfc0 con 0x7f99680b56f0 2024-04-26T23:45:08.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f995fe00640 1 --2- 172.21.15.203:0/2776960488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99680b56f0 0x7f996809bfa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f99500097c0 tx=0x7f995001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=790fdea51d86d0c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.758 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f9966a00640 1 -- 172.21.15.203:0/2776960488 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99500b0070 con 0x7f99680b56f0 2024-04-26T23:45:08.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f9966a00640 1 -- 172.21.15.203:0/2776960488 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99500ab600 con 0x7f99680b56f0 2024-04-26T23:45:08.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f9966a00640 1 -- 172.21.15.203:0/2776960488 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99500ab9d0 con 0x7f99680b56f0 2024-04-26T23:45:08.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 -- 172.21.15.203:0/2776960488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99680b56f0 msgr2=0x7f996809bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 --2- 172.21.15.203:0/2776960488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99680b56f0 0x7f996809bfa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f99500097c0 tx=0x7f995001c410 comp rx=0 tx=0).stop 2024-04-26T23:45:08.759 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 -- 172.21.15.203:0/2776960488 shutdown_connections 2024-04-26T23:45:08.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 --2- 172.21.15.203:0/2776960488 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99680b56f0 0x7f996809bfa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 --2- 172.21.15.203:0/2776960488 >> v2:172.21.15.47:3300/0 conn(0x7f9968162ab0 0x7f996809ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 -- 172.21.15.203:0/2776960488 >> 172.21.15.203:0/2776960488 conn(0x7f99680b4c00 msgr2=0x7f99680b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 -- 172.21.15.203:0/2776960488 shutdown_connections 2024-04-26T23:45:08.760 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.752+0000 7f996e400640 1 -- 172.21.15.203:0/2776960488 wait complete. 2024-04-26T23:45:08.761 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 Processor -- start 2024-04-26T23:45:08.761 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 -- start start 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99680704d0 0x7f99681519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99680b56f0 0x7f9968159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9968162ab0 0x7f996815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99680d24a0 con 0x7f99680b56f0 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99680d2320 con 0x7f99680704d0 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f99680721b0 con 0x7f9968162ab0 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99680704d0 0x7f99681519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9968162ab0 0x7f996815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99680704d0 0x7f99681519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41784/0 (socket says 172.21.15.203:41784) 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 -- 172.21.15.203:0/1294934231 learned_addr learned my addr 172.21.15.203:0/1294934231 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f995fe00640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99680b56f0 0x7f9968159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.763 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 -- 172.21.15.203:0/1294934231 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9968162ab0 msgr2=0x7f996815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9968162ab0 0x7f996815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 -- 172.21.15.203:0/1294934231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99680b56f0 msgr2=0x7f9968159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99680b56f0 0x7f9968159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 -- 172.21.15.203:0/1294934231 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99680b46c0 con 0x7f99680704d0 2024-04-26T23:45:08.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f995fe00640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99680b56f0 0x7f9968159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:08.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f9967400640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99680704d0 0x7f99681519a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f995800e870 tx=0x7f995800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f995f400640 1 -- 172.21.15.203:0/1294934231 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9958017070 con 0x7f99680704d0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f995f400640 1 -- 172.21.15.203:0/1294934231 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995800c8e0 con 0x7f99680704d0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996815c1b0 con 0x7f99680704d0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f995f400640 1 -- 172.21.15.203:0/1294934231 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995800cc90 con 0x7f99680704d0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996815c770 con 0x7f99680704d0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f995f400640 1 -- 172.21.15.203:0/1294934231 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f995801a070 con 0x7f99680704d0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.756+0000 7f995f400640 1 -- 172.21.15.203:0/1294934231 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9958006020 con 0x7f99680704d0 2024-04-26T23:45:08.765 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.760+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9968069700 con 0x7f99680704d0 2024-04-26T23:45:08.766 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.760+0000 7f995f400640 1 -- 172.21.15.203:0/1294934231 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9958006480 con 0x7f99680704d0 2024-04-26T23:45:08.790 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:08.786+0000 7fe5094bb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T23:45:08.805 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:08.800+0000 7f5e9cb5f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:45:08.834 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.828+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6609f82-1275-458c-a608-4fe759d5dc46", "id": 4} v 0) -- 0x7f99680008e0 con 0x7f99680704d0 2024-04-26T23:45:08.837 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f995f400640 1 -- 172.21.15.203:0/1294934231 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6609f82-1275-458c-a608-4fe759d5dc46", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9958006660 con 0x7f99680704d0 2024-04-26T23:45:08.838 INFO:teuthology.orchestra.run.smithi203.stdout:4 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99680704d0 msgr2=0x7f99681519a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99680704d0 0x7f99681519a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f995800e870 tx=0x7f995800ec70 comp rx=0 tx=0).stop 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 shutdown_connections 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9968162ab0 0x7f996815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99680b56f0 0x7f9968159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 --2- 172.21.15.203:0/1294934231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99680704d0 0x7f99681519a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 >> 172.21.15.203:0/1294934231 conn(0x7f99680b4c00 msgr2=0x7f99680b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 shutdown_connections 2024-04-26T23:45:08.839 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.832+0000 7f996e400640 1 -- 172.21.15.203:0/1294934231 wait complete. 2024-04-26T23:45:08.856 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:08.850+0000 7fe5094bb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T23:45:08.857 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 0c1d2340-ded0-4cf4-b77c-905bc0bb563c 5 2024-04-26T23:45:08.898 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:08.892+0000 7f5e9cb5f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:45:08.948 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:08.942+0000 7fe5094bb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T23:45:08.960 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:08.956+0000 7f5e9cb5f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:45:08.992 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.984+0000 7f0ea4e00640 1 Processor -- start 2024-04-26T23:45:08.992 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.984+0000 7f0ea4e00640 1 -- start start 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0ea4e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea009c170 0x7f0ea00cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0ea4e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0ea0160a50 0x7f0ea00ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0ea4e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea0071f90 con 0x7f0ea0160670 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0ea4e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea0070ee0 con 0x7f0ea0160a50 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0ea4e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea0072230 con 0x7f0ea009c170 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9de00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f0ea0160670 0x7f0ea009ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:52988/0 (socket says 172.21.15.203:52988) 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9de00640 1 -- 172.21.15.203:0/3603278817 learned_addr learned my addr 172.21.15.203:0/3603278817 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-26T23:45:08.994 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e97e00640 1 --2- 172.21.15.203:0/3603278817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea009c170 0x7f0ea00cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9e800640 1 --2- 172.21.15.203:0/3603278817 >> v2:172.21.15.47:3300/0 conn(0x7f0ea0160a50 0x7f0ea00ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9d400640 1 -- 172.21.15.203:0/3603278817 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4875577 0 0) 0x7f0ea0071f90 con 0x7f0ea0160670 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9d400640 1 -- 172.21.15.203:0/3603278817 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e84003530 con 0x7f0ea0160670 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9e800640 1 -- 172.21.15.203:0/3603278817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea009c170 msgr2=0x7f0ea00cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9e800640 1 --2- 172.21.15.203:0/3603278817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea009c170 0x7f0ea00cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9e800640 1 -- 172.21.15.203:0/3603278817 >> v1:172.21.15.203:6789/0 conn(0x7f0ea0160670 legacy=0x7f0ea009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e9e800640 1 -- 172.21.15.203:0/3603278817 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea0071130 con 0x7f0ea0160a50 2024-04-26T23:45:08.995 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.988+0000 7f0e97e00640 1 --2- 172.21.15.203:0/3603278817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea009c170 0x7f0ea00cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:08.997 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0e9e800640 1 --2- 172.21.15.203:0/3603278817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea00ce0f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009d90 tx=0x7f0e9801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24e13647e81d33b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:08.997 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0e9d400640 1 -- 172.21.15.203:0/3603278817 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980b2070 con 0x7f0ea0160a50 2024-04-26T23:45:08.997 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0e9d400640 1 -- 172.21.15.203:0/3603278817 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e980a5980 con 0x7f0ea0160a50 2024-04-26T23:45:08.997 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0e9d400640 1 -- 172.21.15.203:0/3603278817 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e980a5d50 con 0x7f0ea0160a50 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 -- 172.21.15.203:0/3603278817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 msgr2=0x7f0ea00ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 --2- 172.21.15.203:0/3603278817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea00ce0f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e98009d90 tx=0x7f0e9801c8e0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 -- 172.21.15.203:0/3603278817 shutdown_connections 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 --2- 172.21.15.203:0/3603278817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea00ce0f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 --2- 172.21.15.203:0/3603278817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea009c170 0x7f0ea00cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 -- 172.21.15.203:0/3603278817 >> 172.21.15.203:0/3603278817 conn(0x7f0ea00b4c00 msgr2=0x7f0ea00b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 -- 172.21.15.203:0/3603278817 shutdown_connections 2024-04-26T23:45:08.998 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 -- 172.21.15.203:0/3603278817 wait complete. 2024-04-26T23:45:08.999 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 Processor -- start 2024-04-26T23:45:08.999 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.992+0000 7f0ea4e00640 1 -- start start 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ea009c170 0x7f0ea0166520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea0160670 0x7f0ea01fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea01fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00cebc0 con 0x7f0ea0160a50 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00cea40 con 0x7f0ea009c170 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea00719a0 con 0x7f0ea0160670 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ea009c170 0x7f0ea0166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e97e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea0160670 0x7f0ea01fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ea009c170 0x7f0ea0166520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41786/0 (socket says 172.21.15.203:41786) 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 -- 172.21.15.203:0/1931336550 learned_addr learned my addr 172.21.15.203:0/1931336550 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:09.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9e800640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea01fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 -- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea0160670 msgr2=0x7f0ea01fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea0160670 0x7f0ea01fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 -- 172.21.15.203:0/1931336550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 msgr2=0x7f0ea01fc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea01fc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 -- 172.21.15.203:0/1931336550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea015a4b0 con 0x7f0ea009c170 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e97e00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea0160670 0x7f0ea01fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9e800640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea01fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e9de00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ea009c170 0x7f0ea0166520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c400 tx=0x7f0e9000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e96000640 1 -- 172.21.15.203:0/1931336550 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90017070 con 0x7f0ea009c170 2024-04-26T23:45:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e96000640 1 -- 172.21.15.203:0/1931336550 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90005d10 con 0x7f0ea009c170 2024-04-26T23:45:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e96000640 1 -- 172.21.15.203:0/1931336550 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90007310 con 0x7f0ea009c170 2024-04-26T23:45:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea015a720 con 0x7f0ea009c170 2024-04-26T23:45:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea00c8f60 con 0x7f0ea009c170 2024-04-26T23:45:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e96000640 1 -- 172.21.15.203:0/1931336550 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e9001a070 con 0x7f0ea009c170 2024-04-26T23:45:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0e96000640 1 -- 172.21.15.203:0/1931336550 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0e900074b0 con 0x7f0ea009c170 2024-04-26T23:45:09.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:08.996+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea0069700 con 0x7f0ea009c170 2024-04-26T23:45:09.007 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.000+0000 7f0e96000640 1 -- 172.21.15.203:0/1931336550 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f0e90021020 con 0x7f0ea009c170 2024-04-26T23:45:09.012 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:09.006+0000 7fe5094bb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T23:45:09.055 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:09.048+0000 7f5e9cb5f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:45:09.073 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.068+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0c1d2340-ded0-4cf4-b77c-905bc0bb563c", "id": 5} v 0) -- 0x7f0ea009be20 con 0x7f0ea009c170 2024-04-26T23:45:09.077 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0e96000640 1 -- 172.21.15.203:0/1931336550 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c1d2340-ded0-4cf4-b77c-905bc0bb563c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0e9001c440 con 0x7f0ea009c170 2024-04-26T23:45:09.077 INFO:teuthology.orchestra.run.smithi203.stdout:5 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ea009c170 msgr2=0x7f0ea0166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ea009c170 0x7f0ea0166520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000c400 tx=0x7f0e9000c8c0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 shutdown_connections 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ea0160a50 0x7f0ea01fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0ea0160670 0x7f0ea01fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 --2- 172.21.15.203:0/1931336550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ea009c170 0x7f0ea0166520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 >> 172.21.15.203:0/1931336550 conn(0x7f0ea00b4c00 msgr2=0x7f0ea00b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 shutdown_connections 2024-04-26T23:45:09.079 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.072+0000 7f0ea4e00640 1 -- 172.21.15.203:0/1931336550 wait complete. 2024-04-26T23:45:09.098 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 3e4a341a-9eda-496b-b2d4-0dbceabafe52 6 2024-04-26T23:45:09.107 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:09.102+0000 7fe5094bb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T23:45:09.124 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:09.116+0000 7f5e9cb5f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:45:09.175 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:09.170+0000 7fe5094bb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T23:45:09.258 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f343b400640 1 Processor -- start 2024-04-26T23:45:09.259 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f343b400640 1 -- start start 2024-04-26T23:45:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f343b400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f34340b56f0 0x7f34340d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f343b400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3434071620 con 0x7f343409c170 2024-04-26T23:45:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f343b400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3434162e90 con 0x7f3434162ab0 2024-04-26T23:45:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f343b400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f34340d2d40 con 0x7f34340b56f0 2024-04-26T23:45:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f3438a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f3434162ab0 0x7f343409ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.203:53002/0 (socket says 172.21.15.203:53002) 2024-04-26T23:45:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f3438a00640 1 -- 172.21.15.203:0/3541463409 learned_addr learned my addr 172.21.15.203:0/3541463409 (peer_addr_for_me v1:172.21.15.203:0/0) 2024-04-26T23:45:09.260 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.252+0000 7f3439400640 1 --2- 172.21.15.203:0/3541463409 >> v2:172.21.15.203:3300/0 conn(0x7f34340b56f0 0x7f34340d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.256+0000 7f3433400640 1 -- 172.21.15.203:0/3541463409 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651948252 0 0) 0x7f3434162e90 con 0x7f3434162ab0 2024-04-26T23:45:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.256+0000 7f3433400640 1 -- 172.21.15.203:0/3541463409 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f341c003530 con 0x7f3434162ab0 2024-04-26T23:45:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.256+0000 7f3439400640 1 -- 172.21.15.203:0/3541463409 >> v1:172.21.15.203:6789/0 conn(0x7f3434162ab0 legacy=0x7f343409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.256+0000 7f3439400640 1 -- 172.21.15.203:0/3541463409 >> v1:172.21.15.47:6789/0 conn(0x7f343409c170 legacy=0x7f34340d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:09.261 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.256+0000 7f3439400640 1 -- 172.21.15.203:0/3541463409 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343406dfc0 con 0x7f34340b56f0 2024-04-26T23:45:09.265 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f3439400640 1 --2- 172.21.15.203:0/3541463409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34340b56f0 0x7f34340d1a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f342c009d90 tx=0x7f342c01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b59e51e183acd72b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.265 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f3433400640 1 -- 172.21.15.203:0/3541463409 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0b2070 con 0x7f34340b56f0 2024-04-26T23:45:09.266 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f3433400640 1 -- 172.21.15.203:0/3541463409 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c0a5810 con 0x7f34340b56f0 2024-04-26T23:45:09.266 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f3433400640 1 -- 172.21.15.203:0/3541463409 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0a5be0 con 0x7f34340b56f0 2024-04-26T23:45:09.266 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 -- 172.21.15.203:0/3541463409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34340b56f0 msgr2=0x7f34340d1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.266 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 --2- 172.21.15.203:0/3541463409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34340b56f0 0x7f34340d1a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f342c009d90 tx=0x7f342c01c8a0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.266 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 -- 172.21.15.203:0/3541463409 shutdown_connections 2024-04-26T23:45:09.266 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 --2- 172.21.15.203:0/3541463409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f34340b56f0 0x7f34340d1a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.267 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 -- 172.21.15.203:0/3541463409 >> 172.21.15.203:0/3541463409 conn(0x7f34340b4c00 msgr2=0x7f34340b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.267 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 -- 172.21.15.203:0/3541463409 shutdown_connections 2024-04-26T23:45:09.267 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 -- 172.21.15.203:0/3541463409 wait complete. 2024-04-26T23:45:09.268 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.260+0000 7f343b400640 1 Processor -- start 2024-04-26T23:45:09.268 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 -- start start 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f343409c170 0x7f3434070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34340b56f0 0x7f34340c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3434162ab0 0x7f3434159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f34340721b0 con 0x7f34340b56f0 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34340718e0 con 0x7f3434162ab0 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3434072330 con 0x7f343409c170 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f343409c170 0x7f3434070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f343409c170 0x7f3434070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41506/0 (socket says 172.21.15.203:41506) 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 -- 172.21.15.203:0/2431170258 learned_addr learned my addr 172.21.15.203:0/2431170258 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3439400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3434162ab0 0x7f3434159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3433e00640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34340b56f0 0x7f34340c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.271 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 -- 172.21.15.203:0/2431170258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3434162ab0 msgr2=0x7f3434159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3434162ab0 0x7f3434159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 -- 172.21.15.203:0/2431170258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34340b56f0 msgr2=0x7f34340c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34340b56f0 0x7f34340c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 -- 172.21.15.203:0/2431170258 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34340c93e0 con 0x7f343409c170 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3433e00640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34340b56f0 0x7f34340c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3438a00640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f343409c170 0x7f3434070630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f342800c3c0 tx=0x7f342800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3430c00640 1 -- 172.21.15.203:0/2431170258 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3428017070 con 0x7f343409c170 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3430c00640 1 -- 172.21.15.203:0/2431170258 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3428005cf0 con 0x7f343409c170 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3430c00640 1 -- 172.21.15.203:0/2431170258 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34280072f0 con 0x7f343409c170 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34340c96c0 con 0x7f343409c170 2024-04-26T23:45:09.272 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34340c9c80 con 0x7f343409c170 2024-04-26T23:45:09.273 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3430c00640 1 -- 172.21.15.203:0/2431170258 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f342801a070 con 0x7f343409c170 2024-04-26T23:45:09.273 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f3430c00640 1 -- 172.21.15.203:0/2431170258 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3428007490 con 0x7f343409c170 2024-04-26T23:45:09.274 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.264+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3434069700 con 0x7f343409c170 2024-04-26T23:45:09.274 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.268+0000 7f3430c00640 1 -- 172.21.15.203:0/2431170258 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3428021020 con 0x7f343409c170 2024-04-26T23:45:09.298 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:09.292+0000 7f5e9cb5f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:45:09.340 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.336+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3e4a341a-9eda-496b-b2d4-0dbceabafe52", "id": 6} v 0) -- 0x7f34340710a0 con 0x7f343409c170 2024-04-26T23:45:09.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f3430c00640 1 -- 172.21.15.203:0/2431170258 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e4a341a-9eda-496b-b2d4-0dbceabafe52", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f342801c440 con 0x7f343409c170 2024-04-26T23:45:09.347 INFO:teuthology.orchestra.run.smithi203.stdout:6 2024-04-26T23:45:09.348 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f343409c170 msgr2=0x7f3434070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.348 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f343409c170 0x7f3434070630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f342800c3c0 tx=0x7f342800c880 comp rx=0 tx=0).stop 2024-04-26T23:45:09.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 shutdown_connections 2024-04-26T23:45:09.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3434162ab0 0x7f3434159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f34340b56f0 0x7f34340c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 --2- 172.21.15.203:0/2431170258 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f343409c170 0x7f3434070630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 >> 172.21.15.203:0/2431170258 conn(0x7f34340b4c00 msgr2=0x7f34340b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.340+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 shutdown_connections 2024-04-26T23:45:09.349 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.344+0000 7f343b400640 1 -- 172.21.15.203:0/2431170258 wait complete. 2024-04-26T23:45:09.350 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:09.346+0000 7fe5094bb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T23:45:09.366 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --cluster ceph osd new 9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9 7 2024-04-26T23:45:09.373 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:09.368+0000 7f5e9cb5f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:45:09.425 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:09.418+0000 7fe5094bb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T23:45:09.502 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f855cc00640 1 Processor -- start 2024-04-26T23:45:09.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f855cc00640 1 -- start start 2024-04-26T23:45:09.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f855cc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8558162ab0 0x7f855809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f855cc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f855809bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f855cc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8558071620 con 0x7f85580704d0 2024-04-26T23:45:09.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f855cc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8558162e90 con 0x7f8558162ab0 2024-04-26T23:45:09.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f855cc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f85580d2d40 con 0x7f85580b56f0 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f8555e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8558162ab0 0x7f855809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f854fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f855809bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f854fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f855809bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41522/0 (socket says 172.21.15.203:41522) 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f8555e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8558162ab0 0x7f855809ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41798/0 (socket says 172.21.15.203:41798) 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f854fe00640 1 -- 172.21.15.203:0/4272820085 learned_addr learned my addr 172.21.15.203:0/4272820085 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f854fe00640 1 -- 172.21.15.203:0/4272820085 >> v2:172.21.15.203:3300/0 conn(0x7f8558162ab0 msgr2=0x7f855809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f854fe00640 1 --2- 172.21.15.203:0/4272820085 >> v2:172.21.15.203:3300/0 conn(0x7f8558162ab0 0x7f855809ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f854fe00640 1 -- 172.21.15.203:0/4272820085 >> v1:172.21.15.47:6789/0 conn(0x7f85580704d0 legacy=0x7f8558070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f854fe00640 1 -- 172.21.15.203:0/4272820085 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855806dfc0 con 0x7f85580b56f0 2024-04-26T23:45:09.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.496+0000 7f8555e00640 1 --2- 172.21.15.203:0/4272820085 >> v2:172.21.15.203:3300/0 conn(0x7f8558162ab0 0x7f855809ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:09.506 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f854fe00640 1 --2- 172.21.15.203:0/4272820085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f855809bfa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8540009870 tx=0x7f854001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2d0a903171784 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f8555400640 1 -- 172.21.15.203:0/4272820085 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400b2070 con 0x7f85580b56f0 2024-04-26T23:45:09.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f8555400640 1 -- 172.21.15.203:0/4272820085 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85400ad680 con 0x7f85580b56f0 2024-04-26T23:45:09.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f8555400640 1 -- 172.21.15.203:0/4272820085 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400ada50 con 0x7f85580b56f0 2024-04-26T23:45:09.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 -- 172.21.15.203:0/4272820085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 msgr2=0x7f855809bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 --2- 172.21.15.203:0/4272820085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f855809bfa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8540009870 tx=0x7f854001c4d0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 -- 172.21.15.203:0/4272820085 shutdown_connections 2024-04-26T23:45:09.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 --2- 172.21.15.203:0/4272820085 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f855809bfa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 --2- 172.21.15.203:0/4272820085 >> v2:172.21.15.203:3300/0 conn(0x7f8558162ab0 0x7f855809ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 -- 172.21.15.203:0/4272820085 >> 172.21.15.203:0/4272820085 conn(0x7f85580b4c00 msgr2=0x7f85580b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.509 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 -- 172.21.15.203:0/4272820085 shutdown_connections 2024-04-26T23:45:09.509 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.500+0000 7f855cc00640 1 -- 172.21.15.203:0/4272820085 wait complete. 2024-04-26T23:45:09.509 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 Processor -- start 2024-04-26T23:45:09.509 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 -- start start 2024-04-26T23:45:09.512 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85580704d0 0x7f85581595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.512 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f85580b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.512 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8558162ab0 0x7f85580b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d24a0 con 0x7f8558162ab0 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d2320 con 0x7f85580704d0 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f85580721b0 con 0x7f85580b56f0 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f85580b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f8555e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85580704d0 0x7f85581595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f85580b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.203:41524/0 (socket says 172.21.15.203:41524) 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 -- 172.21.15.203:0/3738808322 learned_addr learned my addr 172.21.15.203:0/3738808322 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f8556800640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8558162ab0 0x7f85580b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 -- 172.21.15.203:0/3738808322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85580704d0 msgr2=0x7f85581595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.513 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85580704d0 0x7f85581595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 -- 172.21.15.203:0/3738808322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8558162ab0 msgr2=0x7f85580b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8558162ab0 0x7f85580b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 -- 172.21.15.203:0/3738808322 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85581f8e20 con 0x7f85580b56f0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854fe00640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f85580b7b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f854001a100 tx=0x7f854001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854e000640 1 -- 172.21.15.203:0/3738808322 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400b2040 con 0x7f85580b56f0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854e000640 1 -- 172.21.15.203:0/3738808322 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85400ad9b0 con 0x7f85580b56f0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8558156ee0 con 0x7f85580b56f0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854e000640 1 -- 172.21.15.203:0/3738808322 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85400add60 con 0x7f85580b56f0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85581574a0 con 0x7f85580b56f0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.504+0000 7f854e000640 1 -- 172.21.15.203:0/3738808322 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f85400bf030 con 0x7f85580b56f0 2024-04-26T23:45:09.514 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.508+0000 7f854e000640 1 -- 172.21.15.203:0/3738808322 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f85400c14b0 con 0x7f85580b56f0 2024-04-26T23:45:09.515 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.508+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8558156cf0 con 0x7f85580b56f0 2024-04-26T23:45:09.515 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.508+0000 7f854e000640 1 -- 172.21.15.203:0/3738808322 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f85400c6020 con 0x7f85580b56f0 2024-04-26T23:45:09.581 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.576+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9", "id": 7} v 0) -- 0x7f8558069700 con 0x7f85580b56f0 2024-04-26T23:45:09.587 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.580+0000 7f854e000640 1 -- 172.21.15.203:0/3738808322 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f8540016150 con 0x7f85580b56f0 2024-04-26T23:45:09.587 INFO:teuthology.orchestra.run.smithi203.stdout:7 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 msgr2=0x7f85580b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f85580b7b00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f854001a100 tx=0x7f854001ad10 comp rx=0 tx=0).stop 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 shutdown_connections 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8558162ab0 0x7f85580b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f85580b56f0 0x7f85580b7b00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 --2- 172.21.15.203:0/3738808322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85580704d0 0x7f85581595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 >> 172.21.15.203:0/3738808322 conn(0x7f85580b4c00 msgr2=0x7f85580d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 shutdown_connections 2024-04-26T23:45:09.589 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:09.584+0000 7f855cc00640 1 -- 172.21.15.203:0/3738808322 wait complete. 2024-04-26T23:45:09.606 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T23:45:09.606 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T23:45:09.609 INFO:tasks.ceph.osd.0:Started 2024-04-26T23:45:09.610 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T23:45:09.610 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T23:45:09.613 INFO:tasks.ceph.osd.1:Started 2024-04-26T23:45:09.613 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T23:45:09.613 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T23:45:09.616 INFO:tasks.ceph.osd.2:Started 2024-04-26T23:45:09.616 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T23:45:09.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T23:45:09.619 INFO:tasks.ceph.osd.3:Started 2024-04-26T23:45:09.620 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T23:45:09.620 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T23:45:09.651 INFO:tasks.ceph.osd.4:Started 2024-04-26T23:45:09.651 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T23:45:09.651 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T23:45:09.654 INFO:tasks.ceph.osd.5:Started 2024-04-26T23:45:09.654 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T23:45:09.654 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T23:45:09.658 INFO:tasks.ceph.osd.6:Started 2024-04-26T23:45:09.658 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T23:45:09.659 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T23:45:09.663 INFO:tasks.ceph.osd.7:Started 2024-04-26T23:45:09.663 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:09.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.838+0000 7fa77e800640 1 Processor -- start 2024-04-26T23:45:09.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.838+0000 7fa77e800640 1 -- start start 2024-04-26T23:45:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa77e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa77806f0a0 0x7fa7780d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa77e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa7780713a0 0x7fa77809bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa77e800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7780d2340 con 0x7fa77809ba60 2024-04-26T23:45:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa77e800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa7780cd580 con 0x7fa7780713a0 2024-04-26T23:45:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa77e800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa7780cd860 con 0x7fa77806f0a0 2024-04-26T23:45:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa777e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa7780713a0 0x7fa77809bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa76fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa77809ba60 0x7fa7780ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46866/0 (socket says 172.21.15.47:46866) 2024-04-26T23:45:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa76fe00640 1 -- 172.21.15.47:0/627466613 learned_addr learned my addr 172.21.15.47:0/627466613 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa777400640 1 --2- 172.21.15.47:0/627466613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa77806f0a0 0x7fa7780d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa777e00640 1 -- 172.21.15.47:0/627466613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa77806f0a0 msgr2=0x7fa7780d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:09.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa777e00640 1 --2- 172.21.15.47:0/627466613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa77806f0a0 0x7fa7780d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa777e00640 1 -- 172.21.15.47:0/627466613 >> v1:172.21.15.47:6789/0 conn(0x7fa77809ba60 legacy=0x7fa7780ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa777e00640 1 -- 172.21.15.47:0/627466613 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7780cdb40 con 0x7fa7780713a0 2024-04-26T23:45:09.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.842+0000 7fa777400640 1 --2- 172.21.15.47:0/627466613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa77806f0a0 0x7fa7780d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:09.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa777e00640 1 --2- 172.21.15.47:0/627466613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7780713a0 0x7fa77809bee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa770009dc0 tx=0x7fa77001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510410bb7fbe2266 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa776a00640 1 -- 172.21.15.47:0/627466613 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7700b2070 con 0x7fa7780713a0 2024-04-26T23:45:09.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa776a00640 1 -- 172.21.15.47:0/627466613 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7700a5810 con 0x7fa7780713a0 2024-04-26T23:45:09.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa776a00640 1 -- 172.21.15.47:0/627466613 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7700a5be0 con 0x7fa7780713a0 2024-04-26T23:45:09.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 -- 172.21.15.47:0/627466613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7780713a0 msgr2=0x7fa77809bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 --2- 172.21.15.47:0/627466613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7780713a0 0x7fa77809bee0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa770009dc0 tx=0x7fa77001c950 comp rx=0 tx=0).stop 2024-04-26T23:45:09.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 -- 172.21.15.47:0/627466613 shutdown_connections 2024-04-26T23:45:09.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 --2- 172.21.15.47:0/627466613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7780713a0 0x7fa77809bee0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 --2- 172.21.15.47:0/627466613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa77806f0a0 0x7fa7780d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 -- 172.21.15.47:0/627466613 >> 172.21.15.47:0/627466613 conn(0x7fa7780d2e90 msgr2=0x7fa7780d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 -- 172.21.15.47:0/627466613 shutdown_connections 2024-04-26T23:45:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 -- 172.21.15.47:0/627466613 wait complete. 2024-04-26T23:45:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 Processor -- start 2024-04-26T23:45:09.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.846+0000 7fa77e800640 1 -- start start 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa77806f0a0 0x7fa7780b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7780713a0 0x7fa7780b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77809ba60 0x7fa77815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa77806d510 con 0x7fa77806f0a0 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa77816c140 con 0x7fa77809ba60 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa77815ae80 con 0x7fa7780713a0 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa77806f0a0 0x7fa7780b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa77806f0a0 0x7fa7780b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55268/0 (socket says 172.21.15.47:55268) 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 -- 172.21.15.47:0/1511864386 learned_addr learned my addr 172.21.15.47:0/1511864386 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa76fe00640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7780713a0 0x7fa7780b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777e00640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77809ba60 0x7fa77815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 -- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7780713a0 msgr2=0x7fa7780b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7780713a0 0x7fa7780b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 -- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77809ba60 msgr2=0x7fa77815bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77809ba60 0x7fa77815bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 -- 172.21.15.47:0/1511864386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77815b160 con 0x7fa77806f0a0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa777400640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa77806f0a0 0x7fa7780b5b50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c7f0 tx=0x7fa76800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa76f400640 1 -- 172.21.15.47:0/1511864386 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768015070 con 0x7fa77806f0a0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa76f400640 1 -- 172.21.15.47:0/1511864386 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa768007820 con 0x7fa77806f0a0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa76f400640 1 -- 172.21.15.47:0/1511864386 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768007c10 con 0x7fa77806f0a0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77815b440 con 0x7fa77806f0a0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77815ba00 con 0x7fa77806f0a0 2024-04-26T23:45:09.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa76f400640 1 -- 172.21.15.47:0/1511864386 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa768018070 con 0x7fa77806f0a0 2024-04-26T23:45:09.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa76f400640 1 -- 172.21.15.47:0/1511864386 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa768011ca0 con 0x7fa77806f0a0 2024-04-26T23:45:09.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.850+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa778069700 con 0x7fa77806f0a0 2024-04-26T23:45:09.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.854+0000 7fa76f400640 1 -- 172.21.15.47:0/1511864386 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa7680115d0 con 0x7fa77806f0a0 2024-04-26T23:45:09.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.910+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa778072390 con 0x7fa77806f0a0 2024-04-26T23:45:09.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa76f400640 1 -- 172.21.15.47:0/1511864386 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa7680117b0 con 0x7fa77806f0a0 2024-04-26T23:45:09.918 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:09.918 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:09.580607+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:09.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa77806f0a0 msgr2=0x7fa7780b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:09.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa77806f0a0 0x7fa7780b5b50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa76800c7f0 tx=0x7fa76800ccb0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 shutdown_connections 2024-04-26T23:45:09.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77809ba60 0x7fa77815bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa7780713a0 0x7fa7780b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 --2- 172.21.15.47:0/1511864386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa77806f0a0 0x7fa7780b5b50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 >> 172.21.15.47:0/1511864386 conn(0x7fa7780d2e90 msgr2=0x7fa77815f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 shutdown_connections 2024-04-26T23:45:09.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:09.914+0000 7fa77e800640 1 -- 172.21.15.47:0/1511864386 wait complete. 2024-04-26T23:45:09.938 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T23:45:09.939 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T23:45:10.052 INFO:tasks.ceph.mgr.x.smithi203.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:45:10.052 INFO:tasks.ceph.mgr.x.smithi203.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:45:10.052 INFO:tasks.ceph.mgr.x.smithi203.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:45:10.099 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:10.092+0000 7f5e9cb5f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:45:10.134 INFO:tasks.ceph.mgr.y.smithi047.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T23:45:10.135 INFO:tasks.ceph.mgr.y.smithi047.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T23:45:10.135 INFO:tasks.ceph.mgr.y.smithi047.stderr: from numpy import show_config as show_numpy_config 2024-04-26T23:45:10.174 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:10.170+0000 7fe5094bb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T23:45:10.247 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:10.240+0000 7f5e9cb5f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:45:10.259 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-26T23:45:10.254+0000 7f7ab5f827c0 -1 Falling back to public interface 2024-04-26T23:45:10.279 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-26T23:45:10.274+0000 7fc29e0857c0 -1 Falling back to public interface 2024-04-26T23:45:10.283 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-26T23:45:10.278+0000 7ff85aacf7c0 -1 Falling back to public interface 2024-04-26T23:45:10.295 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-26T23:45:10.290+0000 7ff85eccb7c0 -1 Falling back to public interface 2024-04-26T23:45:10.329 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-26T23:45:10.324+0000 7f4f83a707c0 -1 Falling back to public interface 2024-04-26T23:45:10.330 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-26T23:45:10.324+0000 7f47cd2937c0 -1 Falling back to public interface 2024-04-26T23:45:10.333 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:10.326+0000 7fe5094bb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:45:10.353 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-26T23:45:10.348+0000 7f687a9ab7c0 -1 Falling back to public interface 2024-04-26T23:45:10.354 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-26T23:45:10.348+0000 7fd5512857c0 -1 Falling back to public interface 2024-04-26T23:45:10.436 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:10.432+0000 7f5e9cb5f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:45:10.509 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:10.504+0000 7f5e9cb5f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:45:10.510 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:10.502+0000 7fe5094bb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T23:45:10.586 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:10.582+0000 7fe5094bb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T23:45:10.659 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:10.652+0000 7f5e9cb5f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:45:10.743 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:10.747 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:10.742+0000 7fe5094bb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T23:45:10.875 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887f600640 1 Processor -- start 2024-04-26T23:45:10.875 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887f600640 1 -- start start 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887f600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88781611f0 0x7f88780cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887f600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f88780cfae0 0x7f887806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887f600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88780d0360 con 0x7f8878146820 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887f600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f88780d0640 con 0x7f88780cfae0 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887f600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f88780d0920 con 0x7f88781611f0 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887cc00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8878146820 0x7f8878160ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46872/0 (socket says 172.21.15.47:46872) 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887cc00640 1 -- 172.21.15.47:0/2673076797 learned_addr learned my addr 172.21.15.47:0/2673076797 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887d600640 1 --2- 172.21.15.47:0/2673076797 >> v2:172.21.15.47:3300/0 conn(0x7f88780cfae0 0x7f887806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.877 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f8877e00640 1 --2- 172.21.15.47:0/2673076797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88781611f0 0x7f88780cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.878 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f8877400640 1 -- 172.21.15.47:0/2673076797 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640941752 0 0) 0x7f88780d0360 con 0x7f8878146820 2024-04-26T23:45:10.878 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887d600640 1 -- 172.21.15.47:0/2673076797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88781611f0 msgr2=0x7f88780cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:10.878 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887d600640 1 --2- 172.21.15.47:0/2673076797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88781611f0 0x7f88780cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.878 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887d600640 1 -- 172.21.15.47:0/2673076797 >> v1:172.21.15.47:6789/0 conn(0x7f8878146820 legacy=0x7f8878160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.878 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.870+0000 7f887d600640 1 -- 172.21.15.47:0/2673076797 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887806e2d0 con 0x7f88780cfae0 2024-04-26T23:45:10.882 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887d600640 1 --2- 172.21.15.47:0/2673076797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887806e7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c270201395223f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.883 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f8877400640 1 -- 172.21.15.47:0/2673076797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700b2070 con 0x7f88780cfae0 2024-04-26T23:45:10.883 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f8877400640 1 -- 172.21.15.47:0/2673076797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88700a5940 con 0x7f88780cfae0 2024-04-26T23:45:10.883 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f8877400640 1 -- 172.21.15.47:0/2673076797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88780d0120 con 0x7f88780cfae0 2024-04-26T23:45:10.883 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- 172.21.15.47:0/2673076797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 msgr2=0x7f887806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 --2- 172.21.15.47:0/2673076797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887806e7f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887001c970 comp rx=0 tx=0).stop 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- 172.21.15.47:0/2673076797 shutdown_connections 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 --2- 172.21.15.47:0/2673076797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887806e7f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 --2- 172.21.15.47:0/2673076797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f88781611f0 0x7f88780cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- 172.21.15.47:0/2673076797 >> 172.21.15.47:0/2673076797 conn(0x7f88780d0cd0 msgr2=0x7f88780d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- 172.21.15.47:0/2673076797 shutdown_connections 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- 172.21.15.47:0/2673076797 wait complete. 2024-04-26T23:45:10.884 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 Processor -- start 2024-04-26T23:45:10.885 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- start start 2024-04-26T23:45:10.886 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.886 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8878146820 0x7f8878072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.886 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88781611f0 0x7f8878072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:10.886 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f887806f8d0 con 0x7f88780cfae0 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f887806f750 con 0x7f88781611f0 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.878+0000 7f887f600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f887806fa50 con 0x7f8878146820 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887815c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55290/0 (socket says 172.21.15.47:55290) 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 -- 172.21.15.47:0/916612905 learned_addr learned my addr 172.21.15.47:0/916612905 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f8877e00640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8878146820 0x7f8878072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887d600640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88781611f0 0x7f8878072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 -- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8878146820 msgr2=0x7f8878072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8878146820 0x7f8878072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 -- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88781611f0 msgr2=0x7f8878072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88781611f0 0x7f8878072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.887 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 -- 172.21.15.47:0/916612905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887813e240 con 0x7f88780cfae0 2024-04-26T23:45:10.889 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887cc00640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887815c9a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f886c00c520 tx=0x7f886c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:10.889 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f8874c00640 1 -- 172.21.15.47:0/916612905 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c018070 con 0x7f88780cfae0 2024-04-26T23:45:10.889 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f8874c00640 1 -- 172.21.15.47:0/916612905 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886c0074e0 con 0x7f88780cfae0 2024-04-26T23:45:10.889 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887813e520 con 0x7f88780cfae0 2024-04-26T23:45:10.889 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f8874c00640 1 -- 172.21.15.47:0/916612905 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886c0049f0 con 0x7f88780cfae0 2024-04-26T23:45:10.889 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887813eae0 con 0x7f88780cfae0 2024-04-26T23:45:10.890 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f8874c00640 1 -- 172.21.15.47:0/916612905 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f886c01b070 con 0x7f88780cfae0 2024-04-26T23:45:10.890 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f8874c00640 1 -- 172.21.15.47:0/916612905 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f886c004b90 con 0x7f88780cfae0 2024-04-26T23:45:10.890 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.882+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8878069f20 con 0x7f88780cfae0 2024-04-26T23:45:10.892 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.886+0000 7f8874c00640 1 -- 172.21.15.47:0/916612905 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f886c022020 con 0x7f88780cfae0 2024-04-26T23:45:10.952 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.946+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f887806ff80 con 0x7f88780cfae0 2024-04-26T23:45:10.953 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.946+0000 7f8874c00640 1 -- 172.21.15.47:0/916612905 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f886c01d440 con 0x7f88780cfae0 2024-04-26T23:45:10.953 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-26T23:45:10.953 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":10,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:09.580607+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:10.954 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.946+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 msgr2=0x7f887815c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:10.954 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.946+0000 7f887f600640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887815c9a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f886c00c520 tx=0x7f886c00c9e0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.954 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.946+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 shutdown_connections 2024-04-26T23:45:10.955 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.950+0000 7f887f600640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88781611f0 0x7f8878072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.955 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.950+0000 7f887f600640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8878146820 0x7f8878072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.955 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.950+0000 7f887f600640 1 --2- 172.21.15.47:0/916612905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f88780cfae0 0x7f887815c9a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:10.955 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.950+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 >> 172.21.15.47:0/916612905 conn(0x7f88780d0cd0 msgr2=0x7f887815e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:10.955 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.950+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 shutdown_connections 2024-04-26T23:45:10.955 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:10.950+0000 7f887f600640 1 -- 172.21.15.47:0/916612905 wait complete. 2024-04-26T23:45:10.970 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T23:45:11.363 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:11.356+0000 7f5e9cb5f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:45:11.450 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:11.444+0000 7f5e9cb5f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:45:11.491 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:11.486+0000 7fe5094bb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T23:45:11.584 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:11.578+0000 7fe5094bb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T23:45:11.653 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:11.648+0000 7f5e9cb5f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:45:11.738 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:11.732+0000 7f5e9cb5f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:45:11.797 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:11.790+0000 7fe5094bb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T23:45:11.887 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:11.882+0000 7fe5094bb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T23:45:12.067 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:12.060+0000 7f5e9cb5f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:45:12.138 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:12.132+0000 7f5e9cb5f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:45:12.241 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:12.234+0000 7fe5094bb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T23:45:12.315 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-04-26T23:45:12.310+0000 7fe5094bb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T23:45:13.167 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:13.160+0000 7f5e42200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T23:45:13.169 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:45:13.164+0000 7f5e42200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T23:45:14.108 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-26T23:45:14.102+0000 7f7ab5f827c0 -1 osd.0 0 log_to_monitors true 2024-04-26T23:45:14.235 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-26T23:45:14.230+0000 7fc29e0857c0 -1 osd.2 0 log_to_monitors true 2024-04-26T23:45:14.239 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-26T23:45:14.234+0000 7ff85aacf7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T23:45:14.278 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-26T23:45:14.272+0000 7f47cd2937c0 -1 osd.5 0 log_to_monitors true 2024-04-26T23:45:14.285 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-26T23:45:14.278+0000 7ff85eccb7c0 -1 osd.3 0 log_to_monitors true 2024-04-26T23:45:14.350 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-26T23:45:14.344+0000 7f4f83a707c0 -1 osd.4 0 log_to_monitors true 2024-04-26T23:45:14.566 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-26T23:45:14.560+0000 7fd5512857c0 -1 osd.7 0 log_to_monitors true 2024-04-26T23:45:14.631 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-26T23:45:14.624+0000 7f687a9ab7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T23:45:16.200 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-26T23:45:16.194+0000 7f7ab0e00640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T23:45:16.231 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-04-26T23:45:16.226+0000 7f7aa6e00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:17.581 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-26T23:45:17.574+0000 7ff855a00640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T23:45:17.605 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-26T23:45:17.598+0000 7fc299000640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T23:45:17.611 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-04-26T23:45:17.606+0000 7ff84ba00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:17.627 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-04-26T23:45:17.622+0000 7fc28f000640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:17.637 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-26T23:45:17.630+0000 7ff859c00640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T23:45:17.675 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-04-26T23:45:17.670+0000 7ff84fc00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:17.776 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:17.908 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec6e00640 1 Processor -- start 2024-04-26T23:45:17.908 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec6e00640 1 -- start start 2024-04-26T23:45:17.909 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec6e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcec0146820 0x7fcec0160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec6e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec00cfcb0 0x7fcec006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec6e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec00d00d0 con 0x7fcec0161020 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec6e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcec0161490 con 0x7fcec0146820 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec6e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcec00d0360 con 0x7fcec00cfcb0 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcebfe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcec0146820 0x7fcec0160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fceb7e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcec0161020 0x7fcec00cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46886/0 (socket says 172.21.15.47:46886) 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fceb7e00640 1 -- 172.21.15.47:0/1434917495 learned_addr learned my addr 172.21.15.47:0/1434917495 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:17.910 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.902+0000 7fcec4e00640 1 --2- 172.21.15.47:0/1434917495 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec00cfcb0 0x7fcec006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.911 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebf400640 1 -- 172.21.15.47:0/1434917495 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131623644 0 0) 0x7fcec00d00d0 con 0x7fcec0161020 2024-04-26T23:45:17.911 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebfe00640 1 -- 172.21.15.47:0/1434917495 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec00cfcb0 msgr2=0x7fcec006e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:17.911 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebfe00640 1 --2- 172.21.15.47:0/1434917495 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec00cfcb0 0x7fcec006e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.911 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebfe00640 1 -- 172.21.15.47:0/1434917495 >> v1:172.21.15.47:6789/0 conn(0x7fcec0161020 legacy=0x7fcec00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:17.911 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebfe00640 1 -- 172.21.15.47:0/1434917495 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec00d0640 con 0x7fcec0146820 2024-04-26T23:45:17.911 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcec4e00640 1 --2- 172.21.15.47:0/1434917495 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec00cfcb0 0x7fcec006e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:17.913 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebfe00640 1 --2- 172.21.15.47:0/1434917495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec0160ae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fceb00097c0 tx=0x7fceb001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9441c19d0117b200 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebf400640 1 -- 172.21.15.47:0/1434917495 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb00b2070 con 0x7fcec0146820 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebf400640 1 -- 172.21.15.47:0/1434917495 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb00ad640 con 0x7fcec0146820 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcebf400640 1 -- 172.21.15.47:0/1434917495 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb00ada10 con 0x7fcec0146820 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcec6e00640 1 -- 172.21.15.47:0/1434917495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 msgr2=0x7fcec0160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1434917495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec0160ae0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fceb00097c0 tx=0x7fceb001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcec6e00640 1 -- 172.21.15.47:0/1434917495 shutdown_connections 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1434917495 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec00cfcb0 0x7fcec006e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1434917495 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec0160ae0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.906+0000 7fcec6e00640 1 -- 172.21.15.47:0/1434917495 >> 172.21.15.47:0/1434917495 conn(0x7fcec00d0cd0 msgr2=0x7fcec00d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 -- 172.21.15.47:0/1434917495 shutdown_connections 2024-04-26T23:45:17.914 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 -- 172.21.15.47:0/1434917495 wait complete. 2024-04-26T23:45:17.915 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 Processor -- start 2024-04-26T23:45:17.915 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 -- start start 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec00cfcb0 0x7fcec0162660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec01fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec0161020 0x7fcec00b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcec006f6c0 con 0x7fcec0146820 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcec006f540 con 0x7fcec00cfcb0 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcec006f840 con 0x7fcec0161020 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec01fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec01fb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55350/0 (socket says 172.21.15.47:55350) 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 -- 172.21.15.47:0/1135882958 learned_addr learned my addr 172.21.15.47:0/1135882958 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec4e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec0161020 0x7fcec00b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.918 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcebfe00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec00cfcb0 0x7fcec0162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 -- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec0161020 msgr2=0x7fcec00b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec0161020 0x7fcec00b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 -- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec00cfcb0 msgr2=0x7fcec0162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec00cfcb0 0x7fcec0162660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 -- 172.21.15.47:0/1135882958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec01fc290 con 0x7fcec0146820 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fceb7e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec01fb7d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcea800c480 tx=0x7fcea800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcebcc00640 1 -- 172.21.15.47:0/1135882958 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8018070 con 0x7fcec0146820 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcebcc00640 1 -- 172.21.15.47:0/1135882958 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea8007500 con 0x7fcec0146820 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcebcc00640 1 -- 172.21.15.47:0/1135882958 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea8004a30 con 0x7fcec0146820 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.910+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec01fc570 con 0x7fcec0146820 2024-04-26T23:45:17.919 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.914+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01f9290 con 0x7fcec0146820 2024-04-26T23:45:17.920 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.914+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec01f96c0 con 0x7fcec0146820 2024-04-26T23:45:17.920 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.914+0000 7fcebcc00640 1 -- 172.21.15.47:0/1135882958 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fcea801b070 con 0x7fcec0146820 2024-04-26T23:45:17.920 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.914+0000 7fcebcc00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce9c068320 0x7fce9c06a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:17.920 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.914+0000 7fcebcc00640 1 -- 172.21.15.47:0/1135882958 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7fcea8084f10 con 0x7fcec0146820 2024-04-26T23:45:17.921 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.914+0000 7fcebfe00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce9c068320 0x7fce9c06a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:17.921 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.914+0000 7fcebfe00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce9c068320 0x7fce9c06a7e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fceb00af000 tx=0x7fceb0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:17.925 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:17.918+0000 7fcebcc00640 1 -- 172.21.15.47:0/1135882958 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcea80562a0 con 0x7fcec0146820 2024-04-26T23:45:18.092 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.086+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcec0069f20 con 0x7fcec0146820 2024-04-26T23:45:18.093 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.086+0000 7fcebcc00640 1 -- 172.21.15.47:0/1135882958 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7555 (secure 0 0 0) 0x7fcea8055ba0 con 0x7fcec0146820 2024-04-26T23:45:18.093 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-26T23:45:18.093 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":14,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:17.219483+0000","last_up_change":"2024-04-26T23:45:17.219483+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce9c068320 msgr2=0x7fce9c06a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce9c068320 0x7fce9c06a7e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fceb00af000 tx=0x7fceb0008040 comp rx=0 tx=0).stop 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 msgr2=0x7fcec01fb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec01fb7d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcea800c480 tx=0x7fcea800c940 comp rx=0 tx=0).stop 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 shutdown_connections 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce9c068320 0x7fce9c06a7e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcec0161020 0x7fcec00b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcec0146820 0x7fcec01fb7d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 --2- 172.21.15.47:0/1135882958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcec00cfcb0 0x7fcec0162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 >> 172.21.15.47:0/1135882958 conn(0x7fcec00d0cd0 msgr2=0x7fcec0073c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:18.095 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 shutdown_connections 2024-04-26T23:45:18.096 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:18.090+0000 7fcec6e00640 1 -- 172.21.15.47:0/1135882958 wait complete. 2024-04-26T23:45:18.111 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-26T23:45:18.456 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-26T23:45:18.447+0000 7f47c8200640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T23:45:18.482 INFO:tasks.ceph.osd.5.smithi203.stderr:2024-04-26T23:45:18.475+0000 7f47be200640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:18.527 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-26T23:45:18.519+0000 7f4f7ea00640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T23:45:18.539 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-26T23:45:18.531+0000 7fd54c200640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T23:45:18.544 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-26T23:45:18.539+0000 7f6876200640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T23:45:18.558 INFO:tasks.ceph.osd.4.smithi203.stderr:2024-04-26T23:45:18.551+0000 7f4f74a00640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:18.577 INFO:tasks.ceph.osd.7.smithi203.stderr:2024-04-26T23:45:18.571+0000 7fd542200640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:18.585 INFO:tasks.ceph.osd.6.smithi203.stderr:2024-04-26T23:45:18.579+0000 7f686b800640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T23:45:24.920 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:25.061 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.054+0000 7f282d800640 1 Processor -- start 2024-04-26T23:45:25.062 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.054+0000 7f282d800640 1 -- start start 2024-04-26T23:45:25.063 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f282d800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828146820 0x7f2828160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.063 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f282d800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2828161020 0x7f28280cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.063 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f282d800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28280d0360 con 0x7f28280cfae0 2024-04-26T23:45:25.063 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f282d800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2828161460 con 0x7f2828161020 2024-04-26T23:45:25.063 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f282d800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f28280d0640 con 0x7f2828146820 2024-04-26T23:45:25.063 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f2827400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f28280cfae0 0x7f282815d4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55282/0 (socket says 172.21.15.47:55282) 2024-04-26T23:45:25.063 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f2827400640 1 -- 172.21.15.47:0/1024681936 learned_addr learned my addr 172.21.15.47:0/1024681936 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:25.064 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f281e000640 1 --2- 172.21.15.47:0/1024681936 >> v2:172.21.15.203:3300/0 conn(0x7f2828161020 0x7f28280cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.064 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f2826a00640 1 --2- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828146820 0x7f2828160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.064 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f2826000640 1 -- 172.21.15.47:0/1024681936 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128612840 0 0) 0x7f28280d0360 con 0x7f28280cfae0 2024-04-26T23:45:25.064 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f2826000640 1 -- 172.21.15.47:0/1024681936 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f280c003530 con 0x7f28280cfae0 2024-04-26T23:45:25.064 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f281e000640 1 -- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828146820 msgr2=0x7f2828160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:25.065 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f281e000640 1 --2- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828146820 0x7f2828160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.065 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f281e000640 1 -- 172.21.15.47:0/1024681936 >> v1:172.21.15.47:6789/0 conn(0x7f28280cfae0 legacy=0x7f282815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.065 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f281e000640 1 -- 172.21.15.47:0/1024681936 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28280d0920 con 0x7f2828161020 2024-04-26T23:45:25.065 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.058+0000 7f2826a00640 1 --2- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828146820 0x7f2828160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:25.067 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f281e000640 1 --2- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828161020 0x7f28280cf5a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f28100097c0 tx=0x7f281001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce652e777009f93e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f2826000640 1 -- 172.21.15.47:0/1024681936 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28100b0070 con 0x7f2828161020 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f2826000640 1 -- 172.21.15.47:0/1024681936 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2810004230 con 0x7f2828161020 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f2826000640 1 -- 172.21.15.47:0/1024681936 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810003620 con 0x7f2828161020 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 -- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828161020 msgr2=0x7f28280cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 --2- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828161020 0x7f28280cf5a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f28100097c0 tx=0x7f281001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 -- 172.21.15.47:0/1024681936 shutdown_connections 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 --2- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828161020 0x7f28280cf5a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 --2- 172.21.15.47:0/1024681936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828146820 0x7f2828160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 -- 172.21.15.47:0/1024681936 >> 172.21.15.47:0/1024681936 conn(0x7f28280d0cd0 msgr2=0x7f28280d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:25.068 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 -- 172.21.15.47:0/1024681936 shutdown_connections 2024-04-26T23:45:25.069 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 -- 172.21.15.47:0/1024681936 wait complete. 2024-04-26T23:45:25.069 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 Processor -- start 2024-04-26T23:45:25.069 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.062+0000 7f282d800640 1 -- start start 2024-04-26T23:45:25.071 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280cfae0 0x7f2828072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.071 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828146820 0x7f282815e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828161020 0x7f28280b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2828169e80 con 0x7f28280cfae0 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f28280d0140 con 0x7f2828146820 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f282816a000 con 0x7f2828161020 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280cfae0 0x7f2828072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280cfae0 0x7f2828072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54714/0 (socket says 172.21.15.47:54714) 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 -- 172.21.15.47:0/3957076201 learned_addr learned my addr 172.21.15.47:0/3957076201 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f281e000640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828146820 0x7f282815e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2827400640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828161020 0x7f28280b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 -- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828161020 msgr2=0x7f28280b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828161020 0x7f28280b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 -- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828146820 msgr2=0x7f282815e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828146820 0x7f282815e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.072 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 -- 172.21.15.47:0/3957076201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2828141760 con 0x7f28280cfae0 2024-04-26T23:45:25.073 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2827400640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828161020 0x7f28280b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:25.073 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f2826a00640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280cfae0 0x7f2828072f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f281800ebe0 tx=0x7f281800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.073 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f281f400640 1 -- 172.21.15.47:0/3957076201 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818017070 con 0x7f28280cfae0 2024-04-26T23:45:25.073 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f281f400640 1 -- 172.21.15.47:0/3957076201 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281800cc30 con 0x7f28280cfae0 2024-04-26T23:45:25.074 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f281f400640 1 -- 172.21.15.47:0/3957076201 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818013470 con 0x7f28280cfae0 2024-04-26T23:45:25.074 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28280b2400 con 0x7f28280cfae0 2024-04-26T23:45:25.074 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28280b0b80 con 0x7f28280cfae0 2024-04-26T23:45:25.074 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.066+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2828069f20 con 0x7f28280cfae0 2024-04-26T23:45:25.074 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.070+0000 7f281f400640 1 -- 172.21.15.47:0/3957076201 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f281801a070 con 0x7f28280cfae0 2024-04-26T23:45:25.075 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.070+0000 7f281f400640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2804068380 0x7f280406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.075 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.070+0000 7f281f400640 1 -- 172.21.15.47:0/3957076201 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f28180868e0 con 0x7f28280cfae0 2024-04-26T23:45:25.075 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.070+0000 7f281e000640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2804068380 0x7f280406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.076 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.070+0000 7f281e000640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2804068380 0x7f280406a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28100ad000 tx=0x7f28100a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.080 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.074+0000 7f281f400640 1 -- 172.21.15.47:0/3957076201 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2818056b90 con 0x7f28280cfae0 2024-04-26T23:45:25.245 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.238+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28281603f0 con 0x7f28280cfae0 2024-04-26T23:45:25.246 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f281f400640 1 -- 172.21.15.47:0/3957076201 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7f281805ae90 con 0x7f28280cfae0 2024-04-26T23:45:25.246 INFO:teuthology.misc.health.smithi047.stdout: 2024-04-26T23:45:25.246 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":19,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:22.624577+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:25.248 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2804068380 msgr2=0x7f280406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.248 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2804068380 0x7f280406a840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28100ad000 tx=0x7f28100a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:25.248 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280cfae0 msgr2=0x7f2828072f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.248 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280cfae0 0x7f2828072f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f281800ebe0 tx=0x7f281800c520 comp rx=0 tx=0).stop 2024-04-26T23:45:25.248 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 shutdown_connections 2024-04-26T23:45:25.248 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2804068380 0x7f280406a840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.249 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2828161020 0x7f28280b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.249 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828146820 0x7f282815e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.249 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 --2- 172.21.15.47:0/3957076201 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280cfae0 0x7f2828072f40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.249 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 >> 172.21.15.47:0/3957076201 conn(0x7f28280d0cd0 msgr2=0x7f28280d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:25.249 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 shutdown_connections 2024-04-26T23:45:25.249 INFO:teuthology.misc.health.smithi047.stderr:2024-04-26T23:45:25.242+0000 7f282d800640 1 -- 172.21.15.47:0/3957076201 wait complete. 2024-04-26T23:45:25.265 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T23:45:25.265 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T23:45:25.265 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:45:25.265 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:45:25.268 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:45:25.269 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:45:25.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:45:25.272 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:45:25.272 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:45:25.272 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:45:25.278 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:45:25.278 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:45:25.278 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:45:25.281 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:45:25.282 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T23:45:25.282 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:25.364 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-26T23:45:25.365 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-04-26T23:45:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.422+0000 7ff8d1a00640 1 Processor -- start 2024-04-26T23:45:25.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.422+0000 7ff8d1a00640 1 -- start start 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8d1a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc0d2100 0x7ff8cc0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8d1a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff8cc0b3f80 0x7ff8cc0d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8d1a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8cc0d5960 con 0x7ff8cc162c60 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8d1a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff8cc0d5f20 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8d1a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d5c40 con 0x7ff8cc0d2100 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8caa00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff8cc162c60 0x7ff8cc0d19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55296/0 (socket says 172.21.15.47:55296) 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8caa00640 1 -- 172.21.15.47:0/3897798686 learned_addr learned my addr 172.21.15.47:0/3897798686 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8cb400640 1 --2- 172.21.15.47:0/3897798686 >> v2:172.21.15.47:3300/0 conn(0x7ff8cc0b3f80 0x7ff8cc0d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8c3e00640 1 --2- 172.21.15.47:0/3897798686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc0d2100 0x7ff8cc0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8ca000640 1 -- 172.21.15.47:0/3897798686 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660994348 0 0) 0x7ff8cc0d5960 con 0x7ff8cc162c60 2024-04-26T23:45:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8ca000640 1 -- 172.21.15.47:0/3897798686 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8b0003530 con 0x7ff8cc162c60 2024-04-26T23:45:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8cb400640 1 -- 172.21.15.47:0/3897798686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc0d2100 msgr2=0x7ff8cc0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8cb400640 1 --2- 172.21.15.47:0/3897798686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc0d2100 0x7ff8cc0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8cb400640 1 -- 172.21.15.47:0/3897798686 >> v1:172.21.15.47:6789/0 conn(0x7ff8cc162c60 legacy=0x7ff8cc0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8cb400640 1 -- 172.21.15.47:0/3897798686 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc0b4ae0 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8cb400640 1 --2- 172.21.15.47:0/3897798686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0d0200 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009d90 tx=0x7ff8c401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18594a32baf2366 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.426+0000 7ff8ca000640 1 -- 172.21.15.47:0/3897798686 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40b2070 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8ca000640 1 -- 172.21.15.47:0/3897798686 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c40a5990 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8ca000640 1 -- 172.21.15.47:0/3897798686 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40a5d40 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- 172.21.15.47:0/3897798686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 msgr2=0x7ff8cc0d0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/3897798686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0d0200 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8c4009d90 tx=0x7ff8c401c8b0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- 172.21.15.47:0/3897798686 shutdown_connections 2024-04-26T23:45:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/3897798686 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0d0200 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/3897798686 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc0d2100 0x7ff8cc0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- 172.21.15.47:0/3897798686 >> 172.21.15.47:0/3897798686 conn(0x7ff8cc09e3e0 msgr2=0x7ff8cc0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- 172.21.15.47:0/3897798686 shutdown_connections 2024-04-26T23:45:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- 172.21.15.47:0/3897798686 wait complete. 2024-04-26T23:45:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 Processor -- start 2024-04-26T23:45:25.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- start start 2024-04-26T23:45:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8cc0d2100 0x7ff8cc14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc162c60 0x7ff8cc0ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d12e0 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d1160 con 0x7ff8cc0d2100 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8d1a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc16c180 con 0x7ff8cc162c60 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54748/0 (socket says 172.21.15.47:54748) 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 -- 172.21.15.47:0/1973845170 learned_addr learned my addr 172.21.15.47:0/1973845170 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8cb400640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc162c60 0x7ff8cc0ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8c3e00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8cc0d2100 0x7ff8cc14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 -- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc162c60 msgr2=0x7ff8cc0ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc162c60 0x7ff8cc0ba0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 -- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8cc0d2100 msgr2=0x7ff8cc14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8cc0d2100 0x7ff8cc14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.430+0000 7ff8caa00640 1 -- 172.21.15.47:0/1973845170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc0c8c80 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8caa00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0cc180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c3c0 tx=0x7ff8bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8c2a00640 1 -- 172.21.15.47:0/1973845170 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc017070 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8c2a00640 1 -- 172.21.15.47:0/1973845170 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc005cf0 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8c2a00640 1 -- 172.21.15.47:0/1973845170 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0072f0 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc0c8f60 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc0c9520 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc069700 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8c2a00640 1 -- 172.21.15.47:0/1973845170 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff8bc01a070 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8c2a00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff8a8068380 0x7ff8a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8c2a00640 1 -- 172.21.15.47:0/1973845170 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ff8bc085ac0 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.434+0000 7ff8c3e00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff8a8068380 0x7ff8a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.438+0000 7ff8c3e00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff8a8068380 0x7ff8a806a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0b2d10 tx=0x7ff8b4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.438+0000 7ff8c2a00640 1 -- 172.21.15.47:0/1973845170 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff8bc056330 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.602+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8cc159bc0 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8c2a00640 1 -- 172.21.15.47:0/1973845170 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7ff8bc055c30 con 0x7ff8cc0b3f80 2024-04-26T23:45:25.610 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:25.610 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:22.624577+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff8a8068380 msgr2=0x7ff8a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff8a8068380 0x7ff8a806a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0b2d10 tx=0x7ff8b4008040 comp rx=0 tx=0).stop 2024-04-26T23:45:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 msgr2=0x7ff8cc0cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0cc180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00c3c0 tx=0x7ff8bc00c880 comp rx=0 tx=0).stop 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 shutdown_connections 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff8a8068380 0x7ff8a806a840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff8cc162c60 0x7ff8cc0ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8cc0d2100 0x7ff8cc14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 --2- 172.21.15.47:0/1973845170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff8cc0b3f80 0x7ff8cc0cc180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 >> 172.21.15.47:0/1973845170 conn(0x7ff8cc09e3e0 msgr2=0x7ff8cc0b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 shutdown_connections 2024-04-26T23:45:25.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.606+0000 7ff8d1a00640 1 -- 172.21.15.47:0/1973845170 wait complete. 2024-04-26T23:45:25.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:45:25.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:45:25.643 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-26T23:45:25.643 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-26T23:45:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee96e00640 1 Processor -- start 2024-04-26T23:45:25.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee96e00640 1 -- start start 2024-04-26T23:45:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee96e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fee90160a50 0x7fee900ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee96e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee90071f90 con 0x7fee90160670 2024-04-26T23:45:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee96e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee90072230 con 0x7fee9009c170 2024-04-26T23:45:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee96e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fee90070ee0 con 0x7fee90160a50 2024-04-26T23:45:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee8fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fee90160670 0x7fee9009ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55310/0 (socket says 172.21.15.47:55310) 2024-04-26T23:45:25.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee8fe00640 1 -- 172.21.15.47:0/2047968736 learned_addr learned my addr 172.21.15.47:0/2047968736 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee94e00640 1 --2- 172.21.15.47:0/2047968736 >> v2:172.21.15.203:3300/0 conn(0x7fee90160a50 0x7fee900ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee8f400640 1 -- 172.21.15.47:0/2047968736 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811338764 0 0) 0x7fee90071f90 con 0x7fee90160670 2024-04-26T23:45:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee8f400640 1 -- 172.21.15.47:0/2047968736 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee74003530 con 0x7fee90160670 2024-04-26T23:45:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee94e00640 1 -- 172.21.15.47:0/2047968736 >> v1:172.21.15.203:6789/0 conn(0x7fee9009c170 legacy=0x7fee900cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee8f400640 1 -- 172.21.15.47:0/2047968736 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 814173813 0 0) 0x7fee74003530 con 0x7fee90160670 2024-04-26T23:45:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee94e00640 1 -- 172.21.15.47:0/2047968736 >> v1:172.21.15.47:6789/0 conn(0x7fee90160670 legacy=0x7fee9009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.770+0000 7fee94e00640 1 -- 172.21.15.47:0/2047968736 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee90071130 con 0x7fee90160a50 2024-04-26T23:45:25.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee94e00640 1 --2- 172.21.15.47:0/2047968736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160a50 0x7fee900ce2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee88009d90 tx=0x7fee8801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43b76f06710ed9e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee8f400640 1 -- 172.21.15.47:0/2047968736 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee880b2070 con 0x7fee90160a50 2024-04-26T23:45:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee8f400640 1 -- 172.21.15.47:0/2047968736 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee880a5660 con 0x7fee90160a50 2024-04-26T23:45:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee8f400640 1 -- 172.21.15.47:0/2047968736 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee800016a0 con 0x7fee90160a50 2024-04-26T23:45:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee96e00640 1 -- 172.21.15.47:0/2047968736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160a50 msgr2=0x7fee900ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee96e00640 1 --2- 172.21.15.47:0/2047968736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160a50 0x7fee900ce2c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee88009d90 tx=0x7fee8801c800 comp rx=0 tx=0).stop 2024-04-26T23:45:25.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee96e00640 1 -- 172.21.15.47:0/2047968736 shutdown_connections 2024-04-26T23:45:25.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee96e00640 1 --2- 172.21.15.47:0/2047968736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160a50 0x7fee900ce2c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee96e00640 1 -- 172.21.15.47:0/2047968736 >> 172.21.15.47:0/2047968736 conn(0x7fee900b4c00 msgr2=0x7fee900b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:25.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee96e00640 1 -- 172.21.15.47:0/2047968736 shutdown_connections 2024-04-26T23:45:25.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.774+0000 7fee96e00640 1 -- 172.21.15.47:0/2047968736 wait complete. 2024-04-26T23:45:25.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 Processor -- start 2024-04-26T23:45:25.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 -- start start 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee9009c170 0x7fee900b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160670 0x7fee90153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee90160a50 0x7fee900b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee900719a0 con 0x7fee9009c170 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee900cec10 con 0x7fee90160670 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee90071b20 con 0x7fee90160a50 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee9009c170 0x7fee900b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee9009c170 0x7fee900b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54764/0 (socket says 172.21.15.47:54764) 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 -- 172.21.15.47:0/690196293 learned_addr learned my addr 172.21.15.47:0/690196293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee87400640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160670 0x7fee90153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee94e00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee90160a50 0x7fee900b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 -- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee90160a50 msgr2=0x7fee900b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee90160a50 0x7fee900b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 -- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160670 msgr2=0x7fee90153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160670 0x7fee90153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 -- 172.21.15.47:0/690196293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee900b6270 con 0x7fee9009c170 2024-04-26T23:45:25.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8fe00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee9009c170 0x7fee900b5d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c4e0 tx=0x7fee8000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8cc00640 1 -- 172.21.15.47:0/690196293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80018070 con 0x7fee9009c170 2024-04-26T23:45:25.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8cc00640 1 -- 172.21.15.47:0/690196293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee800074e0 con 0x7fee9009c170 2024-04-26T23:45:25.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee900b6520 con 0x7fee9009c170 2024-04-26T23:45:25.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee8cc00640 1 -- 172.21.15.47:0/690196293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80004a30 con 0x7fee9009c170 2024-04-26T23:45:25.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.778+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee900c7880 con 0x7fee9009c170 2024-04-26T23:45:25.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.782+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee90069700 con 0x7fee9009c170 2024-04-26T23:45:25.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.782+0000 7fee8cc00640 1 -- 172.21.15.47:0/690196293 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fee8001b070 con 0x7fee9009c170 2024-04-26T23:45:25.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.782+0000 7fee8cc00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee6c068380 0x7fee6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:25.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.782+0000 7fee8cc00640 1 -- 172.21.15.47:0/690196293 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fee800859f0 con 0x7fee9009c170 2024-04-26T23:45:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.782+0000 7fee87400640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee6c068380 0x7fee6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:25.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.782+0000 7fee87400640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee6c068380 0x7fee6c06a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee900c76d0 tx=0x7fee78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:25.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.786+0000 7fee8cc00640 1 -- 172.21.15.47:0/690196293 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fee80055ca0 con 0x7fee9009c170 2024-04-26T23:45:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.950+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fee900b8f90 con 0x7fee9009c170 2024-04-26T23:45:25.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.950+0000 7fee8cc00640 1 -- 172.21.15.47:0/690196293 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7fee80059fa0 con 0x7fee9009c170 2024-04-26T23:45:25.957 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:45:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee6c068380 msgr2=0x7fee6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee6c068380 0x7fee6c06a840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fee900c76d0 tx=0x7fee78009040 comp rx=0 tx=0).stop 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee9009c170 msgr2=0x7fee900b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee9009c170 0x7fee900b5d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c4e0 tx=0x7fee8000c9a0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 shutdown_connections 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee6c068380 0x7fee6c06a840 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee90160a50 0x7fee900b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee90160670 0x7fee90153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 --2- 172.21.15.47:0/690196293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee9009c170 0x7fee900b5d30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 >> 172.21.15.47:0/690196293 conn(0x7fee900b4c00 msgr2=0x7fee900b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 shutdown_connections 2024-04-26T23:45:25.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:25.954+0000 7fee96e00640 1 -- 172.21.15.47:0/690196293 wait complete. 2024-04-26T23:45:25.978 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:26.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1b200640 1 Processor -- start 2024-04-26T23:45:26.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1b200640 1 -- start start 2024-04-26T23:45:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1b200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3e1c0d1860 0x7f3e1c0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1b200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c071770 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1b200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1c0afa50 con 0x7f3e1c0d1860 2024-04-26T23:45:26.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c071a50 con 0x7f3e1c15cde0 2024-04-26T23:45:26.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:26.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0d3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:42740/0 (socket says 172.21.15.47:42740) 2024-04-26T23:45:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f3e1c15d1c0 0x7f3e1c0d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:42092/0 (socket says 172.21.15.47:42092) 2024-04-26T23:45:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19e00640 1 -- 172.21.15.47:0/148938584 learned_addr learned my addr 172.21.15.47:0/148938584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e1a800640 1 --2- 172.21.15.47:0/148938584 >> v2:172.21.15.203:3300/0 conn(0x7f3e1c0d1860 0x7f3e1c0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19e00640 1 -- 172.21.15.47:0/148938584 >> v2:172.21.15.203:3300/0 conn(0x7f3e1c0d1860 msgr2=0x7f3e1c0afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19e00640 1 --2- 172.21.15.47:0/148938584 >> v2:172.21.15.203:3300/0 conn(0x7f3e1c0d1860 0x7f3e1c0afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19e00640 1 -- 172.21.15.47:0/148938584 >> v1:172.21.15.203:6789/0 conn(0x7f3e1c15d1c0 legacy=0x7f3e1c0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:26.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.114+0000 7f3e19e00640 1 -- 172.21.15.47:0/148938584 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c071d30 con 0x7f3e1c15cde0 2024-04-26T23:45:26.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e19e00640 1 --2- 172.21.15.47:0/148938584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0d3290 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0afbd0 tx=0x7f3e0c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db96e384300e0389 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:26.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e18a00640 1 -- 172.21.15.47:0/148938584 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0b1070 con 0x7f3e1c15cde0 2024-04-26T23:45:26.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e18a00640 1 -- 172.21.15.47:0/148938584 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0ac620 con 0x7f3e1c15cde0 2024-04-26T23:45:26.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e18a00640 1 -- 172.21.15.47:0/148938584 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0ac9f0 con 0x7f3e1c15cde0 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 -- 172.21.15.47:0/148938584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 msgr2=0x7f3e1c0d3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 --2- 172.21.15.47:0/148938584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0d3290 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0afbd0 tx=0x7f3e0c01c460 comp rx=0 tx=0).stop 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 -- 172.21.15.47:0/148938584 shutdown_connections 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 --2- 172.21.15.47:0/148938584 >> v2:172.21.15.203:3300/0 conn(0x7f3e1c0d1860 0x7f3e1c0afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 --2- 172.21.15.47:0/148938584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0d3290 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 -- 172.21.15.47:0/148938584 >> 172.21.15.47:0/148938584 conn(0x7f3e1c09ba60 msgr2=0x7f3e1c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 -- 172.21.15.47:0/148938584 shutdown_connections 2024-04-26T23:45:26.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.118+0000 7f3e1b200640 1 -- 172.21.15.47:0/148938584 wait complete. 2024-04-26T23:45:26.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 Processor -- start 2024-04-26T23:45:26.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 -- start start 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e1c0d1860 0x7f3e1c0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e1c15d1c0 0x7f3e1c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0711f0 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0d37d0 con 0x7f3e1c0d1860 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c071370 con 0x7f3e1c15cde0 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e1c15d1c0 0x7f3e1c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e1c15d1c0 0x7f3e1c0b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54772/0 (socket says 172.21.15.47:54772) 2024-04-26T23:45:26.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e19e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e1c0d1860 0x7f3e1c0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 -- 172.21.15.47:0/4029164303 learned_addr learned my addr 172.21.15.47:0/4029164303 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e19400640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 -- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 msgr2=0x7f3e1c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 -- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e1c0d1860 msgr2=0x7f3e1c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e1c0d1860 0x7f3e1c0cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 -- 172.21.15.47:0/4029164303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c1f7340 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e19e00640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e1c0d1860 0x7f3e1c0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1a800640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e1c15d1c0 0x7f3e1c0b3720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400efc0 tx=0x7f3e1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e12000640 1 -- 172.21.15.47:0/4029164303 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14018020 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e12000640 1 -- 172.21.15.47:0/4029164303 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14014480 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e12000640 1 -- 172.21.15.47:0/4029164303 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14014870 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c14a8a0 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c14ae60 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.122+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c069470 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.126+0000 7f3e12000640 1 -- 172.21.15.47:0/4029164303 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e1401b020 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.126+0000 7f3e12000640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dfc068380 0x7f3dfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:26.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.126+0000 7f3e12000640 1 -- 172.21.15.47:0/4029164303 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f3e14086ff0 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.126+0000 7f3e19e00640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dfc068380 0x7f3dfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:26.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.126+0000 7f3e19e00640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dfc068380 0x7f3dfc06a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0ae000 tx=0x7f3e0c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:26.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.130+0000 7f3e12000640 1 -- 172.21.15.47:0/4029164303 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e14022070 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e1c070d10 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e12000640 1 -- 172.21.15.47:0/4029164303 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f3e14010040 con 0x7f3e1c15d1c0 2024-04-26T23:45:26.340 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:26.340 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T23:45:26.341 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dfc068380 msgr2=0x7f3dfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dfc068380 0x7f3dfc06a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0ae000 tx=0x7f3e0c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e1c15d1c0 msgr2=0x7f3e1c0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e1c15d1c0 0x7f3e1c0b3720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400efc0 tx=0x7f3e1400c490 comp rx=0 tx=0).stop 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 shutdown_connections 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dfc068380 0x7f3dfc06a840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e1c15d1c0 0x7f3e1c0b3720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e1c15cde0 0x7f3e1c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 --2- 172.21.15.47:0/4029164303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e1c0d1860 0x7f3e1c0cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 >> 172.21.15.47:0/4029164303 conn(0x7f3e1c09ba60 msgr2=0x7f3e1c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 shutdown_connections 2024-04-26T23:45:26.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:26.334+0000 7f3e1b200640 1 -- 172.21.15.47:0/4029164303 wait complete. 2024-04-26T23:45:28.361 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:28.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.506+0000 7f7b1d200640 1 Processor -- start 2024-04-26T23:45:28.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b1d200640 1 -- start start 2024-04-26T23:45:28.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b1d200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7b181599e0 0x7f7b1815f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b1d200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7b1806fa80 0x7f7b180cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b1d200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b1815fe60 con 0x7f7b180ce140 2024-04-26T23:45:28.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b1d200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1806df90 con 0x7f7b181599e0 2024-04-26T23:45:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b1d200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7b180ce570 con 0x7f7b1806fa80 2024-04-26T23:45:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b15e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7b181599e0 0x7f7b1815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b16800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7b180ce140 0x7f7b180cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55318/0 (socket says 172.21.15.47:55318) 2024-04-26T23:45:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b16800640 1 -- 172.21.15.47:0/529039387 learned_addr learned my addr 172.21.15.47:0/529039387 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b15400640 1 --2- 172.21.15.47:0/529039387 >> v2:172.21.15.203:3300/0 conn(0x7f7b1806fa80 0x7f7b180cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b15e00640 1 -- 172.21.15.47:0/529039387 >> v2:172.21.15.203:3300/0 conn(0x7f7b1806fa80 msgr2=0x7f7b180cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:28.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b15e00640 1 --2- 172.21.15.47:0/529039387 >> v2:172.21.15.203:3300/0 conn(0x7f7b1806fa80 0x7f7b180cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b15e00640 1 -- 172.21.15.47:0/529039387 >> v1:172.21.15.47:6789/0 conn(0x7f7b180ce140 legacy=0x7f7b180cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b15e00640 1 -- 172.21.15.47:0/529039387 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b18160140 con 0x7f7b181599e0 2024-04-26T23:45:28.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.510+0000 7f7b14a00640 1 -- 172.21.15.47:0/529039387 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160355134 0 0) 0x7f7b1815fe60 con 0x7f7b180ce140 2024-04-26T23:45:28.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b15e00640 1 --2- 172.21.15.47:0/529039387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b181599e0 0x7f7b1815f810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b180739d0 tx=0x7f7b0801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102f9bad0a6cd943 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b14a00640 1 -- 172.21.15.47:0/529039387 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080b2070 con 0x7f7b181599e0 2024-04-26T23:45:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b14a00640 1 -- 172.21.15.47:0/529039387 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b080a5820 con 0x7f7b181599e0 2024-04-26T23:45:28.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b14a00640 1 -- 172.21.15.47:0/529039387 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080a5bf0 con 0x7f7b181599e0 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 -- 172.21.15.47:0/529039387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b181599e0 msgr2=0x7f7b1815f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 --2- 172.21.15.47:0/529039387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b181599e0 0x7f7b1815f810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b180739d0 tx=0x7f7b0801c930 comp rx=0 tx=0).stop 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 -- 172.21.15.47:0/529039387 shutdown_connections 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 --2- 172.21.15.47:0/529039387 >> v2:172.21.15.203:3300/0 conn(0x7f7b1806fa80 0x7f7b180cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 --2- 172.21.15.47:0/529039387 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b181599e0 0x7f7b1815f810 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 -- 172.21.15.47:0/529039387 >> 172.21.15.47:0/529039387 conn(0x7f7b1806c800 msgr2=0x7f7b1806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 -- 172.21.15.47:0/529039387 shutdown_connections 2024-04-26T23:45:28.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 -- 172.21.15.47:0/529039387 wait complete. 2024-04-26T23:45:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 Processor -- start 2024-04-26T23:45:28.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.514+0000 7f7b1d200640 1 -- start start 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1806fa80 0x7f7b1809ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b180ce140 0x7f7b18152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b1809ba60 0x7f7b1809bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1806ffe0 con 0x7f7b1809ba60 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1806fe60 con 0x7f7b1806fa80 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1816be50 con 0x7f7b180ce140 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b1809ba60 0x7f7b1809bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b1809ba60 0x7f7b1809bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54778/0 (socket says 172.21.15.47:54778) 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 -- 172.21.15.47:0/2483219809 learned_addr learned my addr 172.21.15.47:0/2483219809 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b15400640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b180ce140 0x7f7b18152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b15e00640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1806fa80 0x7f7b1809ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 -- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b180ce140 msgr2=0x7f7b18152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b180ce140 0x7f7b18152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 -- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1806fa80 msgr2=0x7f7b1809ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1806fa80 0x7f7b1809ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 -- 172.21.15.47:0/2483219809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1809d7b0 con 0x7f7b1809ba60 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b15e00640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1806fa80 0x7f7b1809ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:28.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b16800640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b1809ba60 0x7f7b1809bed0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c3e0 tx=0x7f7b1000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b0e000640 1 -- 172.21.15.47:0/2483219809 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100074e0 con 0x7f7b1809ba60 2024-04-26T23:45:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b0e000640 1 -- 172.21.15.47:0/2483219809 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b100047f0 con 0x7f7b1809ba60 2024-04-26T23:45:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b0e000640 1 -- 172.21.15.47:0/2483219809 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10004be0 con 0x7f7b1809ba60 2024-04-26T23:45:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1809da90 con 0x7f7b1809ba60 2024-04-26T23:45:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1809e050 con 0x7f7b1809ba60 2024-04-26T23:45:28.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b18069700 con 0x7f7b1809ba60 2024-04-26T23:45:28.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.518+0000 7f7b0e000640 1 -- 172.21.15.47:0/2483219809 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b10011070 con 0x7f7b1809ba60 2024-04-26T23:45:28.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.522+0000 7f7b0e000640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7af8068380 0x7f7af806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.522+0000 7f7b0e000640 1 -- 172.21.15.47:0/2483219809 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f7b10086280 con 0x7f7b1809ba60 2024-04-26T23:45:28.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.522+0000 7f7b15e00640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7af8068380 0x7f7af806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.522+0000 7f7b15e00640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7af8068380 0x7f7af806a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b080af000 tx=0x7f7b080a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:28.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.526+0000 7f7b0e000640 1 -- 172.21.15.47:0/2483219809 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7b10056af0 con 0x7f7b1809ba60 2024-04-26T23:45:28.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.722+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b18069d90 con 0x7f7b1809ba60 2024-04-26T23:45:28.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b0e000640 1 -- 172.21.15.47:0/2483219809 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f7b10086080 con 0x7f7b1809ba60 2024-04-26T23:45:28.730 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:28.730 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T23:45:28.731 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-04-26T23:45:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7af8068380 msgr2=0x7f7af806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7af8068380 0x7f7af806a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b080af000 tx=0x7f7b080a7070 comp rx=0 tx=0).stop 2024-04-26T23:45:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b1809ba60 msgr2=0x7f7b1809bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b1809ba60 0x7f7b1809bed0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c3e0 tx=0x7f7b1000c8a0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 shutdown_connections 2024-04-26T23:45:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7af8068380 0x7f7af806a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b1809ba60 0x7f7b1809bed0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b180ce140 0x7f7b18152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 --2- 172.21.15.47:0/2483219809 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1806fa80 0x7f7b1809ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 >> 172.21.15.47:0/2483219809 conn(0x7f7b1806c800 msgr2=0x7f7b180adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:28.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 shutdown_connections 2024-04-26T23:45:28.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.726+0000 7f7b1d200640 1 -- 172.21.15.47:0/2483219809 wait complete. 2024-04-26T23:45:28.751 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:28.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d65800640 1 Processor -- start 2024-04-26T23:45:28.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d65800640 1 -- start start 2024-04-26T23:45:28.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d65800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d600cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d65800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9d600ce310 0x7f9d6015da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d65800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6015e050 con 0x7f9d6015d5b0 2024-04-26T23:45:28.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d65800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9d6015e330 con 0x7f9d600ce310 2024-04-26T23:45:28.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d65800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9d600ceda0 con 0x7f9d600b4360 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d56000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9d6015d5b0 0x7f9d600cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55330/0 (socket says 172.21.15.47:55330) 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d56000640 1 -- 172.21.15.47:0/4078014799 learned_addr learned my addr 172.21.15.47:0/4078014799 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5f400640 1 --2- 172.21.15.47:0/4078014799 >> v2:172.21.15.203:3300/0 conn(0x7f9d600ce310 0x7f9d6015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5ea00640 1 --2- 172.21.15.47:0/4078014799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d600cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5e000640 1 -- 172.21.15.47:0/4078014799 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3441993023 0 0) 0x7f9d6015e050 con 0x7f9d6015d5b0 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5e000640 1 -- 172.21.15.47:0/4078014799 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d44003530 con 0x7f9d6015d5b0 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5ea00640 1 -- 172.21.15.47:0/4078014799 >> v2:172.21.15.203:3300/0 conn(0x7f9d600ce310 msgr2=0x7f9d6015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:28.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5ea00640 1 --2- 172.21.15.47:0/4078014799 >> v2:172.21.15.203:3300/0 conn(0x7f9d600ce310 0x7f9d6015da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5ea00640 1 -- 172.21.15.47:0/4078014799 >> v1:172.21.15.47:6789/0 conn(0x7f9d6015d5b0 legacy=0x7f9d600cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5ea00640 1 -- 172.21.15.47:0/4078014799 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d600cf080 con 0x7f9d600b4360 2024-04-26T23:45:28.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.886+0000 7f9d5f400640 1 --2- 172.21.15.47:0/4078014799 >> v2:172.21.15.203:3300/0 conn(0x7f9d600ce310 0x7f9d6015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:28.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d5ea00640 1 --2- 172.21.15.47:0/4078014799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d600cf5a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d500097c0 tx=0x7f9d5001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d10d5844c20a39df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:28.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d5e000640 1 -- 172.21.15.47:0/4078014799 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d500b1070 con 0x7f9d600b4360 2024-04-26T23:45:28.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d5e000640 1 -- 172.21.15.47:0/4078014799 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d500ac410 con 0x7f9d600b4360 2024-04-26T23:45:28.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d5e000640 1 -- 172.21.15.47:0/4078014799 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d500ac7c0 con 0x7f9d600b4360 2024-04-26T23:45:28.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 -- 172.21.15.47:0/4078014799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 msgr2=0x7f9d600cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 --2- 172.21.15.47:0/4078014799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d600cf5a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d500097c0 tx=0x7f9d5001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 -- 172.21.15.47:0/4078014799 shutdown_connections 2024-04-26T23:45:28.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 --2- 172.21.15.47:0/4078014799 >> v2:172.21.15.203:3300/0 conn(0x7f9d600ce310 0x7f9d6015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 --2- 172.21.15.47:0/4078014799 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d600cf5a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 -- 172.21.15.47:0/4078014799 >> 172.21.15.47:0/4078014799 conn(0x7f9d6006c800 msgr2=0x7f9d6006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:28.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 -- 172.21.15.47:0/4078014799 shutdown_connections 2024-04-26T23:45:28.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.890+0000 7f9d65800640 1 -- 172.21.15.47:0/4078014799 wait complete. 2024-04-26T23:45:28.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 Processor -- start 2024-04-26T23:45:28.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 -- start start 2024-04-26T23:45:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d60159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d600ce310 0x7f9d6014ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d6015d5b0 0x7f9d6006f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6015f100 con 0x7f9d600ce310 2024-04-26T23:45:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6015ef80 con 0x7f9d6015d5b0 2024-04-26T23:45:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9d6015f280 con 0x7f9d600b4360 2024-04-26T23:45:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d600ce310 0x7f9d6014ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d600ce310 0x7f9d6014ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:54790/0 (socket says 172.21.15.47:54790) 2024-04-26T23:45:28.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 -- 172.21.15.47:0/3967889865 learned_addr learned my addr 172.21.15.47:0/3967889865 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d5ea00640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d60159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 -- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 msgr2=0x7f9d60159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d60159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 -- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d6015d5b0 msgr2=0x7f9d6006f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:28.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d6015d5b0 0x7f9d6006f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 -- 172.21.15.47:0/3967889865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d600b38f0 con 0x7f9d600ce310 2024-04-26T23:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d56000640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d600ce310 0x7f9d6014ccd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c700 tx=0x7f9d4800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d57400640 1 -- 172.21.15.47:0/3967889865 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48017070 con 0x7f9d600ce310 2024-04-26T23:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d57400640 1 -- 172.21.15.47:0/3967889865 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d48007270 con 0x7f9d600ce310 2024-04-26T23:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6015d3e0 con 0x7f9d600ce310 2024-04-26T23:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d57400640 1 -- 172.21.15.47:0/3967889865 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48001d50 con 0x7f9d600ce310 2024-04-26T23:45:28.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.894+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601fb6e0 con 0x7f9d600ce310 2024-04-26T23:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.898+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d60069700 con 0x7f9d600ce310 2024-04-26T23:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.898+0000 7f9d57400640 1 -- 172.21.15.47:0/3967889865 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d4801a070 con 0x7f9d600ce310 2024-04-26T23:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.898+0000 7f9d57400640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9d3c068380 0x7f9d3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.898+0000 7f9d57400640 1 -- 172.21.15.47:0/3967889865 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f9d48085960 con 0x7f9d600ce310 2024-04-26T23:45:28.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.898+0000 7f9d5ea00640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9d3c068380 0x7f9d3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:28.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.898+0000 7f9d5ea00640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9d3c068380 0x7f9d3c06a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d500ae000 tx=0x7f9d50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:28.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:28.902+0000 7f9d57400640 1 -- 172.21.15.47:0/3967889865 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9d48056260 con 0x7f9d600ce310 2024-04-26T23:45:29.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.070+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d600d06a0 con 0x7f9d600ce310 2024-04-26T23:45:29.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.070+0000 7f9d57400640 1 -- 172.21.15.47:0/3967889865 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7f9d48055b60 con 0x7f9d600ce310 2024-04-26T23:45:29.077 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:29.077 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":19,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:22.624577+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:29.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9d3c068380 msgr2=0x7f9d3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9d3c068380 0x7f9d3c06a840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9d500ae000 tx=0x7f9d50008040 comp rx=0 tx=0).stop 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d600ce310 msgr2=0x7f9d6014ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d600ce310 0x7f9d6014ccd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c700 tx=0x7f9d4800cbc0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 shutdown_connections 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9d3c068380 0x7f9d3c06a840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d6015d5b0 0x7f9d6006f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d600ce310 0x7f9d6014ccd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 --2- 172.21.15.47:0/3967889865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9d600b4360 0x7f9d60159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 >> 172.21.15.47:0/3967889865 conn(0x7f9d6006c800 msgr2=0x7f9d600b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 shutdown_connections 2024-04-26T23:45:29.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.074+0000 7f9d65800640 1 -- 172.21.15.47:0/3967889865 wait complete. 2024-04-26T23:45:29.098 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:45:29.099 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:45:29.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.238+0000 7f493e800640 1 Processor -- start 2024-04-26T23:45:29.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.238+0000 7f493e800640 1 -- start start 2024-04-26T23:45:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f493e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49380d0390 0x7f49380af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f493e800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f49381603e0 0x7f493806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f493e800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49380ae6a0 con 0x7f493806c630 2024-04-26T23:45:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f493e800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f49380ae920 con 0x7f49380d0390 2024-04-26T23:45:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f493e800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f49380aec00 con 0x7f49381603e0 2024-04-26T23:45:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49380d0390 0x7f49380af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49380d0390 0x7f49380af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49062/0 (socket says 172.21.15.47:49062) 2024-04-26T23:45:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937400640 1 -- 172.21.15.47:0/3129415344 learned_addr learned my addr 172.21.15.47:0/3129415344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937e00640 1 --2- 172.21.15.47:0/3129415344 >> v2:172.21.15.203:3300/0 conn(0x7f49381603e0 0x7f493806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937400640 1 -- 172.21.15.47:0/3129415344 >> v2:172.21.15.203:3300/0 conn(0x7f49381603e0 msgr2=0x7f493806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937400640 1 --2- 172.21.15.47:0/3129415344 >> v2:172.21.15.203:3300/0 conn(0x7f49381603e0 0x7f493806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937400640 1 -- 172.21.15.47:0/3129415344 >> v1:172.21.15.203:6789/0 conn(0x7f493806c630 legacy=0x7f493815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937400640 1 -- 172.21.15.47:0/3129415344 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49380aeee0 con 0x7f49380d0390 2024-04-26T23:45:29.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.242+0000 7f4937e00640 1 --2- 172.21.15.47:0/3129415344 >> v2:172.21.15.203:3300/0 conn(0x7f49381603e0 0x7f493806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:29.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f4937400640 1 --2- 172.21.15.47:0/3129415344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49380af6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4938159f90 tx=0x7f492801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748aa58122c69a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f4936a00640 1 -- 172.21.15.47:0/3129415344 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280b0070 con 0x7f49380d0390 2024-04-26T23:45:29.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f4936a00640 1 -- 172.21.15.47:0/3129415344 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49280ab600 con 0x7f49380d0390 2024-04-26T23:45:29.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f4936a00640 1 -- 172.21.15.47:0/3129415344 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280ab9d0 con 0x7f49380d0390 2024-04-26T23:45:29.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- 172.21.15.47:0/3129415344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 msgr2=0x7f49380af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 --2- 172.21.15.47:0/3129415344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49380af6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4938159f90 tx=0x7f492801c270 comp rx=0 tx=0).stop 2024-04-26T23:45:29.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- 172.21.15.47:0/3129415344 shutdown_connections 2024-04-26T23:45:29.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 --2- 172.21.15.47:0/3129415344 >> v2:172.21.15.203:3300/0 conn(0x7f49381603e0 0x7f493806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 --2- 172.21.15.47:0/3129415344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49380af6e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- 172.21.15.47:0/3129415344 >> 172.21.15.47:0/3129415344 conn(0x7f49380b2b70 msgr2=0x7f49380b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:29.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- 172.21.15.47:0/3129415344 shutdown_connections 2024-04-26T23:45:29.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- 172.21.15.47:0/3129415344 wait complete. 2024-04-26T23:45:29.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 Processor -- start 2024-04-26T23:45:29.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- start start 2024-04-26T23:45:29.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f493806c630 0x7f4938151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49381654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49381603e0 0x7f49381533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f493806faf0 con 0x7f49380d0390 2024-04-26T23:45:29.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f493806f970 con 0x7f49381603e0 2024-04-26T23:45:29.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.246+0000 7f493e800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f493806fc70 con 0x7f493806c630 2024-04-26T23:45:29.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49381654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49381654c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49076/0 (socket says 172.21.15.47:49076) 2024-04-26T23:45:29.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 -- 172.21.15.47:0/3809614739 learned_addr learned my addr 172.21.15.47:0/3809614739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:29.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f4937e00640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49381603e0 0x7f49381533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f4937400640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f493806c630 0x7f4938151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 -- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f493806c630 msgr2=0x7f4938151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f493806c630 0x7f4938151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 -- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49381603e0 msgr2=0x7f49381533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49381603e0 0x7f49381533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 -- 172.21.15.47:0/3809614739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49381550a0 con 0x7f49380d0390 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492ea00640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49381654c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f492000b440 tx=0x7f492000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492fe00640 1 -- 172.21.15.47:0/3809614739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920015020 con 0x7f49380d0390 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492fe00640 1 -- 172.21.15.47:0/3809614739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4920011890 con 0x7f49380d0390 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492fe00640 1 -- 172.21.15.47:0/3809614739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920011c80 con 0x7f49380d0390 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4938155380 con 0x7f49380d0390 2024-04-26T23:45:29.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4938155940 con 0x7f49380d0390 2024-04-26T23:45:29.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4938069700 con 0x7f49380d0390 2024-04-26T23:45:29.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.250+0000 7f492fe00640 1 -- 172.21.15.47:0/3809614739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4920018020 con 0x7f49380d0390 2024-04-26T23:45:29.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.254+0000 7f492fe00640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4914068380 0x7f491406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.254+0000 7f492fe00640 1 -- 172.21.15.47:0/3809614739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f4920086550 con 0x7f49380d0390 2024-04-26T23:45:29.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.254+0000 7f4937400640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4914068380 0x7f491406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.254+0000 7f4937400640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4914068380 0x7f491406a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49280ad000 tx=0x7f49280a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.258+0000 7f492fe00640 1 -- 172.21.15.47:0/3809614739 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f492001f030 con 0x7f49380d0390 2024-04-26T23:45:29.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f49380b5d00 con 0x7f49380d0390 2024-04-26T23:45:29.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f492fe00640 1 -- 172.21.15.47:0/3809614739 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f492000d040 con 0x7f49380d0390 2024-04-26T23:45:29.431 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:45:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4914068380 msgr2=0x7f491406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4914068380 0x7f491406a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49280ad000 tx=0x7f49280a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 msgr2=0x7f49381654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49381654c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f492000b440 tx=0x7f492000b900 comp rx=0 tx=0).stop 2024-04-26T23:45:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 shutdown_connections 2024-04-26T23:45:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4914068380 0x7f491406a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49381603e0 0x7f49381533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49380d0390 0x7f49381654c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 --2- 172.21.15.47:0/3809614739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f493806c630 0x7f4938151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 >> 172.21.15.47:0/3809614739 conn(0x7f49380b2b70 msgr2=0x7f49380b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:29.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 shutdown_connections 2024-04-26T23:45:29.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.426+0000 7f493e800640 1 -- 172.21.15.47:0/3809614739 wait complete. 2024-04-26T23:45:29.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:45:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d59e00640 1 Processor -- start 2024-04-26T23:45:29.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d59e00640 1 -- start start 2024-04-26T23:45:29.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d59e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7d5409c170 0x7f7d540d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d59e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d54070390 0x7f7d54070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d59e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d540d2340 con 0x7f7d5406f0a0 2024-04-26T23:45:29.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d59e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7d540cf350 con 0x7f7d54070390 2024-04-26T23:45:29.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d59e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7d540cd580 con 0x7f7d5409c170 2024-04-26T23:45:29.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d53400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d54070390 0x7f7d54070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d53400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7d54070390 0x7f7d54070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49084/0 (socket says 172.21.15.47:49084) 2024-04-26T23:45:29.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d53400640 1 -- 172.21.15.47:0/2030925044 learned_addr learned my addr 172.21.15.47:0/2030925044 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d4a000640 1 --2- 172.21.15.47:0/2030925044 >> v2:172.21.15.203:3300/0 conn(0x7f7d5409c170 0x7f7d540d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d53400640 1 -- 172.21.15.47:0/2030925044 >> v2:172.21.15.203:3300/0 conn(0x7f7d5409c170 msgr2=0x7f7d540d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d53400640 1 --2- 172.21.15.47:0/2030925044 >> v2:172.21.15.203:3300/0 conn(0x7f7d5409c170 0x7f7d540d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d53400640 1 -- 172.21.15.47:0/2030925044 >> v1:172.21.15.203:6789/0 conn(0x7f7d5406f0a0 legacy=0x7f7d5409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d53400640 1 -- 172.21.15.47:0/2030925044 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d540cd860 con 0x7f7d54070390 2024-04-26T23:45:29.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.586+0000 7f7d4a000640 1 --2- 172.21.15.47:0/2030925044 >> v2:172.21.15.203:3300/0 conn(0x7f7d5409c170 0x7f7d540d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d53400640 1 --2- 172.21.15.47:0/2030925044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54070840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d540a1090 tx=0x7f7d4c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611d2547fc824aac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d52000640 1 -- 172.21.15.47:0/2030925044 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0a5760 con 0x7f7d54070390 2024-04-26T23:45:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d52000640 1 -- 172.21.15.47:0/2030925044 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0a5900 con 0x7f7d54070390 2024-04-26T23:45:29.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d52000640 1 -- 172.21.15.47:0/2030925044 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c0a5cd0 con 0x7f7d54070390 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 -- 172.21.15.47:0/2030925044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 msgr2=0x7f7d54070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 --2- 172.21.15.47:0/2030925044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54070840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d540a1090 tx=0x7f7d4c01c9b0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 -- 172.21.15.47:0/2030925044 shutdown_connections 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 --2- 172.21.15.47:0/2030925044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54070840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 --2- 172.21.15.47:0/2030925044 >> v2:172.21.15.203:3300/0 conn(0x7f7d5409c170 0x7f7d540d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 -- 172.21.15.47:0/2030925044 >> 172.21.15.47:0/2030925044 conn(0x7f7d540d2e90 msgr2=0x7f7d540d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 -- 172.21.15.47:0/2030925044 shutdown_connections 2024-04-26T23:45:29.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.590+0000 7f7d59e00640 1 -- 172.21.15.47:0/2030925044 wait complete. 2024-04-26T23:45:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 Processor -- start 2024-04-26T23:45:29.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 -- start start 2024-04-26T23:45:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d5406f0a0 0x7f7d540c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54165570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d5409c170 0x7f7d54165ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7d540d2120 con 0x7f7d54070390 2024-04-26T23:45:29.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d540d1fa0 con 0x7f7d5409c170 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5406d510 con 0x7f7d5406f0a0 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54165570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54165570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49096/0 (socket says 172.21.15.47:49096) 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 -- 172.21.15.47:0/1437802175 learned_addr learned my addr 172.21.15.47:0/1437802175 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 -- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d5406f0a0 msgr2=0x7f7d540c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d5406f0a0 0x7f7d540c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 -- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d5409c170 msgr2=0x7f7d54165ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d5409c170 0x7f7d54165ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 -- 172.21.15.47:0/1437802175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d54147f00 con 0x7f7d54070390 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4a000640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54165570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c7c0 tx=0x7f7d3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4be00640 1 -- 172.21.15.47:0/1437802175 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c007a30 con 0x7f7d54070390 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4be00640 1 -- 172.21.15.47:0/1437802175 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d3c007bd0 con 0x7f7d54070390 2024-04-26T23:45:29.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d4be00640 1 -- 172.21.15.47:0/1437802175 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0113f0 con 0x7f7d54070390 2024-04-26T23:45:29.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5415cf90 con 0x7f7d54070390 2024-04-26T23:45:29.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.594+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d54167a70 con 0x7f7d54070390 2024-04-26T23:45:29.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.598+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d54069700 con 0x7f7d54070390 2024-04-26T23:45:29.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.598+0000 7f7d4be00640 1 -- 172.21.15.47:0/1437802175 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d3c011590 con 0x7f7d54070390 2024-04-26T23:45:29.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.598+0000 7f7d4be00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d300683b0 0x7f7d3006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.598+0000 7f7d4be00640 1 -- 172.21.15.47:0/1437802175 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f7d3c086890 con 0x7f7d54070390 2024-04-26T23:45:29.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.598+0000 7f7d52a00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d300683b0 0x7f7d3006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.598+0000 7f7d52a00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d300683b0 0x7f7d3006a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009670 tx=0x7f7d44006bd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.602+0000 7f7d4be00640 1 -- 172.21.15.47:0/1437802175 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7d3c015020 con 0x7f7d54070390 2024-04-26T23:45:29.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.770+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7d5409bc00 con 0x7f7d54070390 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.770+0000 7f7d4be00640 1 -- 172.21.15.47:0/1437802175 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f7d3c057100 con 0x7f7d54070390 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:45:29.777 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d300683b0 msgr2=0x7f7d3006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d300683b0 0x7f7d3006a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009670 tx=0x7f7d44006bd0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 msgr2=0x7f7d54165570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54165570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c7c0 tx=0x7f7d3c00cc80 comp rx=0 tx=0).stop 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 shutdown_connections 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d300683b0 0x7f7d3006a870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d5409c170 0x7f7d54165ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d54070390 0x7f7d54165570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 --2- 172.21.15.47:0/1437802175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d5406f0a0 0x7f7d540c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 >> 172.21.15.47:0/1437802175 conn(0x7f7d540d2e90 msgr2=0x7f7d540cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:29.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 shutdown_connections 2024-04-26T23:45:29.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.774+0000 7f7d59e00640 1 -- 172.21.15.47:0/1437802175 wait complete. 2024-04-26T23:45:29.797 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:45:29.797 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:45:29.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.934+0000 7f6c40400640 1 Processor -- start 2024-04-26T23:45:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.934+0000 7f6c40400640 1 -- start start 2024-04-26T23:45:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c40400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3815f630 0x7f6c380b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c40400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6c3806d720 0x7f6c3806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c40400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c380d1db0 con 0x7f6c3806e0e0 2024-04-26T23:45:29.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c40400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6c380cd5a0 con 0x7f6c3806d720 2024-04-26T23:45:29.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c40400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6c380cd880 con 0x7f6c3815f630 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3815f630 0x7f6c380b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3d000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6c3806d720 0x7f6c3806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3e400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f6c3806e0e0 0x7f6c380cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57172/0 (socket says 172.21.15.47:57172) 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3e400640 1 -- 172.21.15.47:0/1545691384 learned_addr learned my addr 172.21.15.47:0/1545691384 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3815f630 0x7f6c380b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37176/0 (socket says 172.21.15.47:37176) 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3da00640 1 -- 172.21.15.47:0/1545691384 >> v2:172.21.15.203:3300/0 conn(0x7f6c3806d720 msgr2=0x7f6c3806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3da00640 1 --2- 172.21.15.47:0/1545691384 >> v2:172.21.15.203:3300/0 conn(0x7f6c3806d720 0x7f6c3806dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3da00640 1 -- 172.21.15.47:0/1545691384 >> v1:172.21.15.203:6789/0 conn(0x7f6c3806e0e0 legacy=0x7f6c380cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3da00640 1 -- 172.21.15.47:0/1545691384 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380d2090 con 0x7f6c3815f630 2024-04-26T23:45:29.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.938+0000 7f6c3d000640 1 --2- 172.21.15.47:0/1545691384 >> v2:172.21.15.203:3300/0 conn(0x7f6c3806d720 0x7f6c3806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c3da00640 1 --2- 172.21.15.47:0/1545691384 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3815f630 0x7f6c380b40c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0097c0 tx=0x7f6c2c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba29fed54da79ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c37e00640 1 -- 172.21.15.47:0/1545691384 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0b0070 con 0x7f6c3815f630 2024-04-26T23:45:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c37e00640 1 -- 172.21.15.47:0/1545691384 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0ab600 con 0x7f6c3815f630 2024-04-26T23:45:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c37e00640 1 -- 172.21.15.47:0/1545691384 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ab9d0 con 0x7f6c3815f630 2024-04-26T23:45:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 -- 172.21.15.47:0/1545691384 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3815f630 msgr2=0x7f6c380b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 --2- 172.21.15.47:0/1545691384 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3815f630 0x7f6c380b40c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0097c0 tx=0x7f6c2c01c380 comp rx=0 tx=0).stop 2024-04-26T23:45:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 -- 172.21.15.47:0/1545691384 shutdown_connections 2024-04-26T23:45:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 --2- 172.21.15.47:0/1545691384 >> v2:172.21.15.203:3300/0 conn(0x7f6c3806d720 0x7f6c3806dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 --2- 172.21.15.47:0/1545691384 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3815f630 0x7f6c380b40c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 -- 172.21.15.47:0/1545691384 >> 172.21.15.47:0/1545691384 conn(0x7f6c380d2f50 msgr2=0x7f6c380d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 -- 172.21.15.47:0/1545691384 shutdown_connections 2024-04-26T23:45:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 -- 172.21.15.47:0/1545691384 wait complete. 2024-04-26T23:45:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 Processor -- start 2024-04-26T23:45:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.942+0000 7f6c40400640 1 -- start start 2024-04-26T23:45:29.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3806d720 0x7f6c38156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3806e0e0 0x7f6c380c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3815f630 0x7f6c38157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3816c590 con 0x7f6c3815f630 2024-04-26T23:45:29.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3816c410 con 0x7f6c3806d720 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3816c710 con 0x7f6c3806e0e0 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3815f630 0x7f6c38157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3815f630 0x7f6c38157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49106/0 (socket says 172.21.15.47:49106) 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3da00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3806d720 0x7f6c38156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 -- 172.21.15.47:0/749190470 learned_addr learned my addr 172.21.15.47:0/749190470 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3d000640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3806e0e0 0x7f6c380c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 -- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3806e0e0 msgr2=0x7f6c380c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3806e0e0 0x7f6c380c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 -- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3806d720 msgr2=0x7f6c38156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3806d720 0x7f6c38156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 -- 172.21.15.47:0/749190470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c380b7660 con 0x7f6c3815f630 2024-04-26T23:45:29.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c3e400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3815f630 0x7f6c38157580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000ca80 tx=0x7f6c3000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c35600640 1 -- 172.21.15.47:0/749190470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30017070 con 0x7f6c3815f630 2024-04-26T23:45:29.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c35600640 1 -- 172.21.15.47:0/749190470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3000ac30 con 0x7f6c3815f630 2024-04-26T23:45:29.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c35600640 1 -- 172.21.15.47:0/749190470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30012400 con 0x7f6c3815f630 2024-04-26T23:45:29.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c38070e70 con 0x7f6c3815f630 2024-04-26T23:45:29.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c38071430 con 0x7f6c3815f630 2024-04-26T23:45:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c380695f0 con 0x7f6c3815f630 2024-04-26T23:45:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.946+0000 7f6c35600640 1 -- 172.21.15.47:0/749190470 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c3001a070 con 0x7f6c3815f630 2024-04-26T23:45:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.950+0000 7f6c35600640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c18068380 0x7f6c1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.950+0000 7f6c35600640 1 -- 172.21.15.47:0/749190470 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f6c30086220 con 0x7f6c3815f630 2024-04-26T23:45:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.950+0000 7f6c3da00640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c18068380 0x7f6c1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:29.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.950+0000 7f6c3da00640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c18068380 0x7f6c1806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0ad000 tx=0x7f6c2c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:29.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:29.954+0000 7f6c35600640 1 -- 172.21.15.47:0/749190470 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c300564d0 con 0x7f6c3815f630 2024-04-26T23:45:30.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.122+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6c380cf970 con 0x7f6c3815f630 2024-04-26T23:45:30.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.654+0000 7f6c35600640 1 -- 172.21.15.47:0/749190470 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f6c30084e20 con 0x7f6c3815f630 2024-04-26T23:45:30.659 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c18068380 msgr2=0x7f6c1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c18068380 0x7f6c1806a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0ad000 tx=0x7f6c2c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3815f630 msgr2=0x7f6c38157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3815f630 0x7f6c38157580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000ca80 tx=0x7f6c3000cf40 comp rx=0 tx=0).stop 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 shutdown_connections 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c18068380 0x7f6c1806a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c3815f630 0x7f6c38157580 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c3806e0e0 0x7f6c380c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 --2- 172.21.15.47:0/749190470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3806d720 0x7f6c38156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 >> 172.21.15.47:0/749190470 conn(0x7f6c380d2f50 msgr2=0x7f6c380b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:30.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 shutdown_connections 2024-04-26T23:45:30.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.658+0000 7f6c40400640 1 -- 172.21.15.47:0/749190470 wait complete. 2024-04-26T23:45:30.690 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:45:30.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf42a00640 1 Processor -- start 2024-04-26T23:45:30.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf42a00640 1 -- start start 2024-04-26T23:45:30.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c0cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf42a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcf3c0d1750 0x7fcf3c0d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf42a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3c070e40 con 0x7fcf3c162610 2024-04-26T23:45:30.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf42a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcf3c0d0120 con 0x7fcf3c0d1750 2024-04-26T23:45:30.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf42a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3c071120 con 0x7fcf3c0cf780 2024-04-26T23:45:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf40a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcf3c0d1750 0x7fcf3c0d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf40a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcf3c0d1750 0x7fcf3c0d1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49114/0 (socket says 172.21.15.47:49114) 2024-04-26T23:45:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf3be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcf3c162610 0x7fcf3c0703c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41178/0 (socket says 172.21.15.47:41178) 2024-04-26T23:45:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf40a00640 1 -- 172.21.15.47:0/1703788293 learned_addr learned my addr 172.21.15.47:0/1703788293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf33400640 1 --2- 172.21.15.47:0/1703788293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c0cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf40a00640 1 -- 172.21.15.47:0/1703788293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 msgr2=0x7fcf3c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:30.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf40a00640 1 --2- 172.21.15.47:0/1703788293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c0cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf40a00640 1 -- 172.21.15.47:0/1703788293 >> v1:172.21.15.47:6789/0 conn(0x7fcf3c162610 legacy=0x7fcf3c0703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf40a00640 1 -- 172.21.15.47:0/1703788293 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c071400 con 0x7fcf3c0d1750 2024-04-26T23:45:30.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf33400640 1 --2- 172.21.15.47:0/1703788293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:30.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.834+0000 7fcf3b400640 1 -- 172.21.15.47:0/1703788293 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928886812 0 0) 0x7fcf3c070e40 con 0x7fcf3c162610 2024-04-26T23:45:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf40a00640 1 --2- 172.21.15.47:0/1703788293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0d1bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009e50 tx=0x7fcf3401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe30a2c5dd5e361b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf3b400640 1 -- 172.21.15.47:0/1703788293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf340a5830 con 0x7fcf3c0d1750 2024-04-26T23:45:30.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf3b400640 1 -- 172.21.15.47:0/1703788293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf340a59d0 con 0x7fcf3c0d1750 2024-04-26T23:45:30.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf3b400640 1 -- 172.21.15.47:0/1703788293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf340a5da0 con 0x7fcf3c0d1750 2024-04-26T23:45:30.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 -- 172.21.15.47:0/1703788293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 msgr2=0x7fcf3c0d1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1703788293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0d1bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009e50 tx=0x7fcf3401ca00 comp rx=0 tx=0).stop 2024-04-26T23:45:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 -- 172.21.15.47:0/1703788293 shutdown_connections 2024-04-26T23:45:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1703788293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0d1bc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1703788293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 -- 172.21.15.47:0/1703788293 >> 172.21.15.47:0/1703788293 conn(0x7fcf3c076030 msgr2=0x7fcf3c0d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 -- 172.21.15.47:0/1703788293 shutdown_connections 2024-04-26T23:45:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.838+0000 7fcf42a00640 1 -- 172.21.15.47:0/1703788293 wait complete. 2024-04-26T23:45:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 Processor -- start 2024-04-26T23:45:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 -- start start 2024-04-26T23:45:30.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c1481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf3c162610 0x7fcf3c0b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c1629f0 con 0x7fcf3c0d1750 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c06dc00 con 0x7fcf3c162610 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3c162b70 con 0x7fcf3c0cf780 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49130/0 (socket says 172.21.15.47:49130) 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 -- 172.21.15.47:0/1182745402 learned_addr learned my addr 172.21.15.47:0/1182745402 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf3be00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c1481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf40a00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf3c162610 0x7fcf3c0b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 -- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 msgr2=0x7fcf3c1481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c1481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 -- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf3c162610 msgr2=0x7fcf3c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf3c162610 0x7fcf3c0b4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 -- 172.21.15.47:0/1182745402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c0b3730 con 0x7fcf3c0d1750 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf33400640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0cc710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400e810 tx=0x7fcf2400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf38c00640 1 -- 172.21.15.47:0/1182745402 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24017070 con 0x7fcf3c0d1750 2024-04-26T23:45:30.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf38c00640 1 -- 172.21.15.47:0/1182745402 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2400c8d0 con 0x7fcf3c0d1750 2024-04-26T23:45:30.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf38c00640 1 -- 172.21.15.47:0/1182745402 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400f040 con 0x7fcf3c0d1750 2024-04-26T23:45:30.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3c0b3a10 con 0x7fcf3c0d1750 2024-04-26T23:45:30.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf3c0ca220 con 0x7fcf3c0d1750 2024-04-26T23:45:30.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.842+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf3c069700 con 0x7fcf3c0d1750 2024-04-26T23:45:30.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.846+0000 7fcf38c00640 1 -- 172.21.15.47:0/1182745402 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcf2401a070 con 0x7fcf3c0d1750 2024-04-26T23:45:30.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.846+0000 7fcf38c00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcf18068380 0x7fcf1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:30.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.846+0000 7fcf38c00640 1 -- 172.21.15.47:0/1182745402 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fcf240868e0 con 0x7fcf3c0d1750 2024-04-26T23:45:30.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.846+0000 7fcf3be00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcf18068380 0x7fcf1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:30.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.846+0000 7fcf3be00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcf18068380 0x7fcf1806a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f70 tx=0x7fcf2c007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:30.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:30.850+0000 7fcf38c00640 1 -- 172.21.15.47:0/1182745402 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcf24057060 con 0x7fcf3c0d1750 2024-04-26T23:45:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.014+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcf3c06f120 con 0x7fcf3c0d1750 2024-04-26T23:45:31.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.658+0000 7fcf38c00640 1 -- 172.21.15.47:0/1182745402 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7fcf24056960 con 0x7fcf3c0d1750 2024-04-26T23:45:31.665 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-04-26T23:45:31.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcf18068380 msgr2=0x7fcf1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcf18068380 0x7fcf1806a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f70 tx=0x7fcf2c007c10 comp rx=0 tx=0).stop 2024-04-26T23:45:31.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 msgr2=0x7fcf3c0cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0cc710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400e810 tx=0x7fcf2400ecd0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 shutdown_connections 2024-04-26T23:45:31.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcf18068380 0x7fcf1806a840 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c000f70 tx=0x7fcf2c007c10 comp rx=0 tx=0).stop 2024-04-26T23:45:31.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcf3c162610 0x7fcf3c0b4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcf3c0d1750 0x7fcf3c0cc710 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400e810 tx=0x7fcf2400ecd0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 --2- 172.21.15.47:0/1182745402 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcf3c0cf780 0x7fcf3c1481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.662+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 >> 172.21.15.47:0/1182745402 conn(0x7fcf3c076030 msgr2=0x7fcf3c158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:31.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.666+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 shutdown_connections 2024-04-26T23:45:31.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.666+0000 7fcf42a00640 1 -- 172.21.15.47:0/1182745402 wait complete. 2024-04-26T23:45:31.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:45:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9668c00640 1 Processor -- start 2024-04-26T23:45:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9668c00640 1 -- start start 2024-04-26T23:45:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9668c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f966415cf10 0x7f96640b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9668c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96640b3e30 con 0x7f96640d32a0 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9668c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96640b4110 con 0x7f96640d1310 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9668c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f96640b43f0 con 0x7f966415cf10 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9663400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f966415cf10 0x7f96640b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9663e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f96640d32a0 0x7f9664166ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41186/0 (socket says 172.21.15.47:41186) 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9663e00640 1 -- 172.21.15.47:0/3715998784 learned_addr learned my addr 172.21.15.47:0/3715998784 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.846+0000 7f9663400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f966415cf10 0x7f96640b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49140/0 (socket says 172.21.15.47:49140) 2024-04-26T23:45:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9663400640 1 -- 172.21.15.47:0/3715998784 >> v1:172.21.15.203:6789/0 conn(0x7f96640d1310 legacy=0x7f96640d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9663400640 1 -- 172.21.15.47:0/3715998784 >> v1:172.21.15.47:6789/0 conn(0x7f96640d32a0 legacy=0x7f9664166ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9663400640 1 -- 172.21.15.47:0/3715998784 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96640afc60 con 0x7f966415cf10 2024-04-26T23:45:31.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9663400640 1 --2- 172.21.15.47:0/3715998784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f96640b35e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f96540097c0 tx=0x7f965401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de620242ef8064f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9662a00640 1 -- 172.21.15.47:0/3715998784 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540b1070 con 0x7f966415cf10 2024-04-26T23:45:31.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9662a00640 1 -- 172.21.15.47:0/3715998784 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96540ac410 con 0x7f966415cf10 2024-04-26T23:45:31.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9662a00640 1 -- 172.21.15.47:0/3715998784 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540ac7e0 con 0x7f966415cf10 2024-04-26T23:45:31.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9668c00640 1 -- 172.21.15.47:0/3715998784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 msgr2=0x7f96640b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9668c00640 1 --2- 172.21.15.47:0/3715998784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f96640b35e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f96540097c0 tx=0x7f965401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9668c00640 1 -- 172.21.15.47:0/3715998784 shutdown_connections 2024-04-26T23:45:31.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9668c00640 1 --2- 172.21.15.47:0/3715998784 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f96640b35e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.850+0000 7f9668c00640 1 -- 172.21.15.47:0/3715998784 >> 172.21.15.47:0/3715998784 conn(0x7f966409ba60 msgr2=0x7f966409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:31.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 -- 172.21.15.47:0/3715998784 shutdown_connections 2024-04-26T23:45:31.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 -- 172.21.15.47:0/3715998784 wait complete. 2024-04-26T23:45:31.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 Processor -- start 2024-04-26T23:45:31.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 -- start start 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96640d1310 0x7f96640cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96640d32a0 0x7f9664153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f9664154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f966416ada0 con 0x7f966415cf10 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f966416ac20 con 0x7f96640d1310 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f966416af20 con 0x7f96640d32a0 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f9664154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f9664154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49152/0 (socket says 172.21.15.47:49152) 2024-04-26T23:45:31.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 -- 172.21.15.47:0/320003284 learned_addr learned my addr 172.21.15.47:0/320003284 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663400640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96640d1310 0x7f96640cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f965aa00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96640d32a0 0x7f9664153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 -- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96640d32a0 msgr2=0x7f9664153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96640d32a0 0x7f9664153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 -- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96640d1310 msgr2=0x7f96640cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96640d1310 0x7f96640cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 -- 172.21.15.47:0/320003284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96640cb750 con 0x7f966415cf10 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9663e00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f9664154a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f965c00caa0 tx=0x7f965c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f965be00640 1 -- 172.21.15.47:0/320003284 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c017070 con 0x7f966415cf10 2024-04-26T23:45:31.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f965be00640 1 -- 172.21.15.47:0/320003284 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c00ac00 con 0x7f966415cf10 2024-04-26T23:45:31.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f965be00640 1 -- 172.21.15.47:0/320003284 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c012400 con 0x7f966415cf10 2024-04-26T23:45:31.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.854+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96640ca990 con 0x7f966415cf10 2024-04-26T23:45:31.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.858+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96640caf50 con 0x7f966415cf10 2024-04-26T23:45:31.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.858+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9664069470 con 0x7f966415cf10 2024-04-26T23:45:31.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.858+0000 7f965be00640 1 -- 172.21.15.47:0/320003284 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f965c01a070 con 0x7f966415cf10 2024-04-26T23:45:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.858+0000 7f965be00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9640068380 0x7f964006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.858+0000 7f965be00640 1 -- 172.21.15.47:0/320003284 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f965c086a50 con 0x7f966415cf10 2024-04-26T23:45:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.858+0000 7f9663400640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9640068380 0x7f964006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:31.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.862+0000 7f9663400640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9640068380 0x7f964006a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96540ae000 tx=0x7f9654008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:31.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:31.862+0000 7f965be00640 1 -- 172.21.15.47:0/320003284 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f965c056a00 con 0x7f966415cf10 2024-04-26T23:45:32.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:32.064 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:45:32.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.062+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f96641542c0 con 0x7f966415cf10 2024-04-26T23:45:32.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.674+0000 7f965be00640 1 -- 172.21.15.47:0/320003284 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f965c05ad00 con 0x7f966415cf10 2024-04-26T23:45:32.683 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T23:45:32.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9640068380 msgr2=0x7f964006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:32.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9640068380 0x7f964006a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96540ae000 tx=0x7f9654008040 comp rx=0 tx=0).stop 2024-04-26T23:45:32.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 msgr2=0x7f9664154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f9664154a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f965c00caa0 tx=0x7f965c00cf60 comp rx=0 tx=0).stop 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 shutdown_connections 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9640068380 0x7f964006a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f966415cf10 0x7f9664154a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f96640d32a0 0x7f9664153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 --2- 172.21.15.47:0/320003284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96640d1310 0x7f96640cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 >> 172.21.15.47:0/320003284 conn(0x7f966409ba60 msgr2=0x7f96640ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.682+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 shutdown_connections 2024-04-26T23:45:32.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.686+0000 7f9668c00640 1 -- 172.21.15.47:0/320003284 wait complete. 2024-04-26T23:45:32.728 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c9800640 1 Processor -- start 2024-04-26T23:45:32.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c9800640 1 -- start start 2024-04-26T23:45:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c9800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f66c40ae050 0x7f66c40b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c9800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40b1920 0x7f66c40aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:32.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c9800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66c40b0430 con 0x7f66c40743e0 2024-04-26T23:45:32.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c9800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f66c415f850 con 0x7f66c40ae050 2024-04-26T23:45:32.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c9800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f66c40af3d0 con 0x7f66c40b1920 2024-04-26T23:45:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c3400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40b1920 0x7f66c40aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.862+0000 7f66c2a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f66c40ae050 0x7f66c40b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:32.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c3400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40b1920 0x7f66c40aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37218/0 (socket says 172.21.15.47:37218) 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66ba000640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f66c40743e0 0x7f66c40ae430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57178/0 (socket says 172.21.15.47:57178) 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c3400640 1 -- 172.21.15.47:0/2789801853 learned_addr learned my addr 172.21.15.47:0/2789801853 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2a00640 1 -- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40b1920 msgr2=0x7f66c40aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2a00640 1 --2- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40b1920 0x7f66c40aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2a00640 1 -- 172.21.15.47:0/2789801853 >> v1:172.21.15.203:6789/0 conn(0x7f66c40743e0 legacy=0x7f66c40ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2a00640 1 -- 172.21.15.47:0/2789801853 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c40af6b0 con 0x7f66c40ae050 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c3400640 1 --2- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40b1920 0x7f66c40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:32.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2000640 1 -- 172.21.15.47:0/2789801853 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2583495319 0 0) 0x7f66c40b0430 con 0x7f66c40743e0 2024-04-26T23:45:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2a00640 1 --2- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40ae050 0x7f66c40b5e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0097c0 tx=0x7f66ac01ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5144df8fbffc42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2000640 1 -- 172.21.15.47:0/2789801853 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac0aa5f0 con 0x7f66c40ae050 2024-04-26T23:45:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2000640 1 -- 172.21.15.47:0/2789801853 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ac0af070 con 0x7f66c40ae050 2024-04-26T23:45:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.866+0000 7f66c2000640 1 -- 172.21.15.47:0/2789801853 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ac0aa9b0 con 0x7f66c40ae050 2024-04-26T23:45:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40ae050 msgr2=0x7f66c40b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 --2- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40ae050 0x7f66c40b5e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f66ac0097c0 tx=0x7f66ac01ced0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- 172.21.15.47:0/2789801853 shutdown_connections 2024-04-26T23:45:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 --2- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40b1920 0x7f66c40aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 --2- 172.21.15.47:0/2789801853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40ae050 0x7f66c40b5e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- 172.21.15.47:0/2789801853 >> 172.21.15.47:0/2789801853 conn(0x7f66c40738f0 msgr2=0x7f66c4073cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- 172.21.15.47:0/2789801853 shutdown_connections 2024-04-26T23:45:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- 172.21.15.47:0/2789801853 wait complete. 2024-04-26T23:45:32.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 Processor -- start 2024-04-26T23:45:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- start start 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c40743e0 0x7f66c41516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40ae050 0x7f66c41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40b1920 0x7f66c4151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f66c416b8b0 con 0x7f66c40743e0 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f66c416b730 con 0x7f66c40b1920 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c9800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f66c416ba30 con 0x7f66c40ae050 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c40743e0 0x7f66c41516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c40743e0 0x7f66c41516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49166/0 (socket says 172.21.15.47:49166) 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c2a00640 1 -- 172.21.15.47:0/4190864048 learned_addr learned my addr 172.21.15.47:0/4190864048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c3400640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40b1920 0x7f66c4151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66ba000640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40ae050 0x7f66c41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c3400640 1 -- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40ae050 msgr2=0x7f66c41530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c3400640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40ae050 0x7f66c41530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c3400640 1 -- 172.21.15.47:0/4190864048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c40743e0 msgr2=0x7f66c41516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.870+0000 7f66c3400640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c40743e0 0x7f66c41516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66c3400640 1 -- 172.21.15.47:0/4190864048 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c40d1340 con 0x7f66c40b1920 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66c2a00640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c40743e0 0x7f66c41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66c3400640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40b1920 0x7f66c4151df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009db0 tx=0x7f66bc00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66bb400640 1 -- 172.21.15.47:0/4190864048 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc00cd20 con 0x7f66c40b1920 2024-04-26T23:45:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66bb400640 1 -- 172.21.15.47:0/4190864048 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66bc019070 con 0x7f66c40b1920 2024-04-26T23:45:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c40ccb60 con 0x7f66c40b1920 2024-04-26T23:45:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66bb400640 1 -- 172.21.15.47:0/4190864048 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66bc0146c0 con 0x7f66c40b1920 2024-04-26T23:45:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c41535e0 con 0x7f66c40b1920 2024-04-26T23:45:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c4069700 con 0x7f66c40b1920 2024-04-26T23:45:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66bb400640 1 -- 172.21.15.47:0/4190864048 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66bc012050 con 0x7f66c40b1920 2024-04-26T23:45:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66bb400640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f66a0068380 0x7f66a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.874+0000 7f66bb400640 1 -- 172.21.15.47:0/4190864048 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f66bc087710 con 0x7f66c40b1920 2024-04-26T23:45:32.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.878+0000 7f66c2a00640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f66a0068380 0x7f66a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:32.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.878+0000 7f66c2a00640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f66a0068380 0x7f66a006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66ac01cf10 tx=0x7f66ac004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:32.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:32.878+0000 7f66bb400640 1 -- 172.21.15.47:0/4190864048 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f66bc010040 con 0x7f66c40b1920 2024-04-26T23:45:33.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.046+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66c406d4c0 con 0x7f66c40b1920 2024-04-26T23:45:33.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66bb400640 1 -- 172.21.15.47:0/4190864048 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16606 (secure 0 0 0) 0x7f66bc057660 con 0x7f66c40b1920 2024-04-26T23:45:33.054 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:33.054 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:32.065121+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f66a0068380 msgr2=0x7f66a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f66a0068380 0x7f66a006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f66ac01cf10 tx=0x7f66ac004740 comp rx=0 tx=0).stop 2024-04-26T23:45:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40b1920 msgr2=0x7f66c4151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40b1920 0x7f66c4151df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f66bc009db0 tx=0x7f66bc00c490 comp rx=0 tx=0).stop 2024-04-26T23:45:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 shutdown_connections 2024-04-26T23:45:33.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f66a0068380 0x7f66a006a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f66c40b1920 0x7f66c4151df0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f66c40ae050 0x7f66c41530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 --2- 172.21.15.47:0/4190864048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66c40743e0 0x7f66c41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 >> 172.21.15.47:0/4190864048 conn(0x7f66c40738f0 msgr2=0x7f66c40d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:33.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 shutdown_connections 2024-04-26T23:45:33.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.050+0000 7f66c9800640 1 -- 172.21.15.47:0/4190864048 wait complete. 2024-04-26T23:45:33.076 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:33.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.210+0000 7efd88a00640 1 Processor -- start 2024-04-26T23:45:33.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.210+0000 7efd88a00640 1 -- start start 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.210+0000 7efd88a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efd8415c100 0x7efd8415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd88a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd840ce310 0x7efd840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd88a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8415fc50 con 0x7efd8406fcd0 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd88a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efd84160860 con 0x7efd8415c100 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd88a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd8415d4a0 con 0x7efd840ce310 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efd8415c100 0x7efd8415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd7be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efd8406fcd0 0x7efd840cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41196/0 (socket says 172.21.15.47:41196) 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd7be00640 1 -- 172.21.15.47:0/2406619471 learned_addr learned my addr 172.21.15.47:0/2406619471 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd82800640 1 --2- 172.21.15.47:0/2406619471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd840ce310 0x7efd840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81e00640 1 -- 172.21.15.47:0/2406619471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd840ce310 msgr2=0x7efd840b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81e00640 1 --2- 172.21.15.47:0/2406619471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd840ce310 0x7efd840b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81e00640 1 -- 172.21.15.47:0/2406619471 >> v1:172.21.15.47:6789/0 conn(0x7efd8406fcd0 legacy=0x7efd840cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81e00640 1 -- 172.21.15.47:0/2406619471 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8415ff30 con 0x7efd8415c100 2024-04-26T23:45:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd82800640 1 --2- 172.21.15.47:0/2406619471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd840ce310 0x7efd840b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:33.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81400640 1 -- 172.21.15.47:0/2406619471 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109263627 0 0) 0x7efd8415fc50 con 0x7efd8406fcd0 2024-04-26T23:45:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81e00640 1 --2- 172.21.15.47:0/2406619471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd8415cf60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd740097c0 tx=0x7efd7401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b743cc2cabfc17 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81400640 1 -- 172.21.15.47:0/2406619471 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd740aa600 con 0x7efd8415c100 2024-04-26T23:45:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81400640 1 -- 172.21.15.47:0/2406619471 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd740af070 con 0x7efd8415c100 2024-04-26T23:45:33.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.214+0000 7efd81400640 1 -- 172.21.15.47:0/2406619471 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd740aa9c0 con 0x7efd8415c100 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- 172.21.15.47:0/2406619471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 msgr2=0x7efd8415cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 --2- 172.21.15.47:0/2406619471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd8415cf60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efd740097c0 tx=0x7efd7401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- 172.21.15.47:0/2406619471 shutdown_connections 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 --2- 172.21.15.47:0/2406619471 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd840ce310 0x7efd840b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 --2- 172.21.15.47:0/2406619471 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd8415cf60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- 172.21.15.47:0/2406619471 >> 172.21.15.47:0/2406619471 conn(0x7efd8406c800 msgr2=0x7efd8406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- 172.21.15.47:0/2406619471 shutdown_connections 2024-04-26T23:45:33.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- 172.21.15.47:0/2406619471 wait complete. 2024-04-26T23:45:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 Processor -- start 2024-04-26T23:45:33.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- start start 2024-04-26T23:45:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd8406fcd0 0x7efd8414ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd840ce310 0x7efd841659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd84155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efd840b5f30 con 0x7efd8415c100 2024-04-26T23:45:33.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd840b5db0 con 0x7efd840ce310 2024-04-26T23:45:33.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd88a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efd840b60b0 con 0x7efd8406fcd0 2024-04-26T23:45:33.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd84155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd84155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49192/0 (socket says 172.21.15.47:49192) 2024-04-26T23:45:33.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 -- 172.21.15.47:0/2592701921 learned_addr learned my addr 172.21.15.47:0/2592701921 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 -- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd8406fcd0 msgr2=0x7efd8414ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd8406fcd0 0x7efd8414ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 -- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd840ce310 msgr2=0x7efd841659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd840ce310 0x7efd841659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.218+0000 7efd82800640 1 -- 172.21.15.47:0/2592701921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd840ae470 con 0x7efd8415c100 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd82800640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd84155fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00ce70 tx=0x7efd7c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd7a000640 1 -- 172.21.15.47:0/2592701921 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c003ba0 con 0x7efd8415c100 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd7a000640 1 -- 172.21.15.47:0/2592701921 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c003d60 con 0x7efd8415c100 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd7a000640 1 -- 172.21.15.47:0/2592701921 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00d880 con 0x7efd8415c100 2024-04-26T23:45:33.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd840ae750 con 0x7efd8415c100 2024-04-26T23:45:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd840aed10 con 0x7efd8415c100 2024-04-26T23:45:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd84069700 con 0x7efd8415c100 2024-04-26T23:45:33.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd7a000640 1 -- 172.21.15.47:0/2592701921 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd7c00da20 con 0x7efd8415c100 2024-04-26T23:45:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd7a000640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efd60068380 0x7efd6006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd7a000640 1 -- 172.21.15.47:0/2592701921 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efd7c087330 con 0x7efd8415c100 2024-04-26T23:45:33.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.222+0000 7efd81e00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efd60068380 0x7efd6006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.226+0000 7efd81e00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efd60068380 0x7efd6006a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd740ae000 tx=0x7efd74008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.226+0000 7efd7a000640 1 -- 172.21.15.47:0/2592701921 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efd7c0578e0 con 0x7efd8415c100 2024-04-26T23:45:33.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.394+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd840d08b0 con 0x7efd8415c100 2024-04-26T23:45:33.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd7a000640 1 -- 172.21.15.47:0/2592701921 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16606 (secure 0 0 0) 0x7efd7c0840f0 con 0x7efd8415c100 2024-04-26T23:45:33.402 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:33.402 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":22,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:32.065121+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efd60068380 msgr2=0x7efd6006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efd60068380 0x7efd6006a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efd740ae000 tx=0x7efd74008040 comp rx=0 tx=0).stop 2024-04-26T23:45:33.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 msgr2=0x7efd84155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd84155fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00ce70 tx=0x7efd7c00a710 comp rx=0 tx=0).stop 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 shutdown_connections 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efd60068380 0x7efd6006a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efd8415c100 0x7efd84155fb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd840ce310 0x7efd841659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 --2- 172.21.15.47:0/2592701921 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efd8406fcd0 0x7efd8414ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 >> 172.21.15.47:0/2592701921 conn(0x7efd8406c800 msgr2=0x7efd84072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 shutdown_connections 2024-04-26T23:45:33.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.398+0000 7efd88a00640 1 -- 172.21.15.47:0/2592701921 wait complete. 2024-04-26T23:45:33.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:45:33.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d4200640 1 Processor -- start 2024-04-26T23:45:33.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d4200640 1 -- start start 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d4200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67cc06cd40 0x7f67cc0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d4200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d4200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67cc0ae6a0 con 0x7f67cc0d0390 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d4200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f67cc0ae920 con 0x7f67cc06cd40 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d4200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f67cc0aec00 con 0x7f67cc15fcd0 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d0e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67cc06cd40 0x7f67cc0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d0e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f67cc06cd40 0x7f67cc0af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49194/0 (socket says 172.21.15.47:49194) 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d0e00640 1 -- 172.21.15.47:0/4278145294 learned_addr learned my addr 172.21.15.47:0/4278145294 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d2200640 1 --2- 172.21.15.47:0/4278145294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d0e00640 1 -- 172.21.15.47:0/4278145294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 msgr2=0x7f67cc160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d0e00640 1 --2- 172.21.15.47:0/4278145294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d0e00640 1 -- 172.21.15.47:0/4278145294 >> v1:172.21.15.203:6789/0 conn(0x7f67cc0d0390 legacy=0x7f67cc06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:33.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.562+0000 7f67d0e00640 1 -- 172.21.15.47:0/4278145294 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67cc0aeee0 con 0x7f67cc06cd40 2024-04-26T23:45:33.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d0e00640 1 --2- 172.21.15.47:0/4278145294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc06cd40 0x7f67cc0af6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67b8009870 tx=0x7f67b801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792594e9401459c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67cbe00640 1 -- 172.21.15.47:0/4278145294 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b80ab430 con 0x7f67cc06cd40 2024-04-26T23:45:33.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67cbe00640 1 -- 172.21.15.47:0/4278145294 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b80b0070 con 0x7f67cc06cd40 2024-04-26T23:45:33.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67cbe00640 1 -- 172.21.15.47:0/4278145294 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b80ab7f0 con 0x7f67cc06cd40 2024-04-26T23:45:33.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 -- 172.21.15.47:0/4278145294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc06cd40 msgr2=0x7f67cc0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 --2- 172.21.15.47:0/4278145294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc06cd40 0x7f67cc0af6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f67b8009870 tx=0x7f67b801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 -- 172.21.15.47:0/4278145294 shutdown_connections 2024-04-26T23:45:33.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 --2- 172.21.15.47:0/4278145294 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 --2- 172.21.15.47:0/4278145294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc06cd40 0x7f67cc0af6e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 -- 172.21.15.47:0/4278145294 >> 172.21.15.47:0/4278145294 conn(0x7f67cc0b2b70 msgr2=0x7f67cc0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:33.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 -- 172.21.15.47:0/4278145294 shutdown_connections 2024-04-26T23:45:33.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 -- 172.21.15.47:0/4278145294 wait complete. 2024-04-26T23:45:33.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.566+0000 7f67d4200640 1 Processor -- start 2024-04-26T23:45:33.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 -- start start 2024-04-26T23:45:33.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67cc06cd40 0x7f67cc156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc0d0390 0x7f67cc15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc06f860 con 0x7f67cc0d0390 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67cc06f6e0 con 0x7f67cc06cd40 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f67cc06f9e0 con 0x7f67cc15fcd0 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc0d0390 0x7f67cc15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc0d0390 0x7f67cc15afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49200/0 (socket says 172.21.15.47:49200) 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 -- 172.21.15.47:0/3680748172 learned_addr learned my addr 172.21.15.47:0/3680748172 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d1800640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67cc06cd40 0x7f67cc156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d2200640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 -- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 msgr2=0x7f67cc153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 -- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67cc06cd40 msgr2=0x7f67cc156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67cc06cd40 0x7f67cc156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 -- 172.21.15.47:0/3680748172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67cc1f8540 con 0x7f67cc0d0390 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d1800640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67cc06cd40 0x7f67cc156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:33.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d0e00640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc0d0390 0x7f67cc15afc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67b801ab50 tx=0x7f67b8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67c9600640 1 -- 172.21.15.47:0/3680748172 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b80b4420 con 0x7f67cc0d0390 2024-04-26T23:45:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67c9600640 1 -- 172.21.15.47:0/3680748172 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b80bb070 con 0x7f67cc0d0390 2024-04-26T23:45:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67cc1f8820 con 0x7f67cc0d0390 2024-04-26T23:45:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67c9600640 1 -- 172.21.15.47:0/3680748172 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b80b4800 con 0x7f67cc0d0390 2024-04-26T23:45:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67cc1f81f0 con 0x7f67cc0d0390 2024-04-26T23:45:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.570+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67cc069700 con 0x7f67cc0d0390 2024-04-26T23:45:33.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.574+0000 7f67c9600640 1 -- 172.21.15.47:0/3680748172 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67b80b49a0 con 0x7f67cc0d0390 2024-04-26T23:45:33.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.574+0000 7f67c9600640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f67ac068380 0x7f67ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:33.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.574+0000 7f67c9600640 1 -- 172.21.15.47:0/3680748172 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f67b81209c0 con 0x7f67cc0d0390 2024-04-26T23:45:33.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.574+0000 7f67d1800640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f67ac068380 0x7f67ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:33.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.574+0000 7f67d1800640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f67ac068380 0x7f67ac06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67c0000f70 tx=0x7f67c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:33.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.578+0000 7f67c9600640 1 -- 172.21.15.47:0/3680748172 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f67b8016150 con 0x7f67cc0d0390 2024-04-26T23:45:33.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:33.782+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f67cc15b500 con 0x7f67cc0d0390 2024-04-26T23:45:34.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.685+0000 7f67c9600640 1 -- 172.21.15.47:0/3680748172 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f67b80f0ee0 con 0x7f67cc0d0390 2024-04-26T23:45:34.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f67ac068380 msgr2=0x7f67ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f67ac068380 0x7f67ac06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67c0000f70 tx=0x7f67c0009040 comp rx=0 tx=0).stop 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc0d0390 msgr2=0x7f67cc15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc0d0390 0x7f67cc15afc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67b801ab50 tx=0x7f67b8019240 comp rx=0 tx=0).stop 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 shutdown_connections 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f67ac068380 0x7f67ac06a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67cc15fcd0 0x7f67cc153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67cc0d0390 0x7f67cc15afc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 --2- 172.21.15.47:0/3680748172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67cc06cd40 0x7f67cc156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 >> 172.21.15.47:0/3680748172 conn(0x7f67cc0b2b70 msgr2=0x7f67cc0d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 shutdown_connections 2024-04-26T23:45:34.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.689+0000 7f67d4200640 1 -- 172.21.15.47:0/3680748172 wait complete. 2024-04-26T23:45:34.719 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:45:34.719 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:45:34.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.857+0000 7f6b2a200640 1 Processor -- start 2024-04-26T23:45:34.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.857+0000 7f6b2a200640 1 -- start start 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.857+0000 7f6b2a200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b2415cf50 0x7f6b240cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.857+0000 7f6b2a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2406cd40 0x7f6b24160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.857+0000 7f6b2a200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b240ae030 con 0x7f6b240d04b0 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.857+0000 7f6b2a200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6b240af7a0 con 0x7f6b2415cf50 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b2a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6b240d0ae0 con 0x7f6b2406cd40 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b2415cf50 0x7f6b240cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6b2415cf50 0x7f6b240cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49206/0 (socket says 172.21.15.47:49206) 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 -- 172.21.15.47:0/566288947 learned_addr learned my addr 172.21.15.47:0/566288947 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b1aa00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6b240d04b0 0x7f6b2406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41210/0 (socket says 172.21.15.47:41210) 2024-04-26T23:45:34.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23e00640 1 --2- 172.21.15.47:0/566288947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2406cd40 0x7f6b24160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 -- 172.21.15.47:0/566288947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2406cd40 msgr2=0x7f6b24160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:34.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 --2- 172.21.15.47:0/566288947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2406cd40 0x7f6b24160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 -- 172.21.15.47:0/566288947 >> v1:172.21.15.47:6789/0 conn(0x7f6b240d04b0 legacy=0x7f6b2406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 -- 172.21.15.47:0/566288947 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b240af9d0 con 0x7f6b2415cf50 2024-04-26T23:45:34.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b22a00640 1 -- 172.21.15.47:0/566288947 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447531316 0 0) 0x7f6b240ae030 con 0x7f6b240d04b0 2024-04-26T23:45:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b23400640 1 --2- 172.21.15.47:0/566288947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b2415cf50 0x7f6b240cff70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009870 tx=0x7f6b1401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c065ce3fb61c05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b22a00640 1 -- 172.21.15.47:0/566288947 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b140ab640 con 0x7f6b2415cf50 2024-04-26T23:45:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b22a00640 1 -- 172.21.15.47:0/566288947 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b140b0070 con 0x7f6b2415cf50 2024-04-26T23:45:34.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.861+0000 7f6b22a00640 1 -- 172.21.15.47:0/566288947 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b140aba00 con 0x7f6b2415cf50 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- 172.21.15.47:0/566288947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b2415cf50 msgr2=0x7f6b240cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 --2- 172.21.15.47:0/566288947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b2415cf50 0x7f6b240cff70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b14009870 tx=0x7f6b1401c530 comp rx=0 tx=0).stop 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- 172.21.15.47:0/566288947 shutdown_connections 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 --2- 172.21.15.47:0/566288947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2406cd40 0x7f6b24160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 --2- 172.21.15.47:0/566288947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b2415cf50 0x7f6b240cff70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- 172.21.15.47:0/566288947 >> 172.21.15.47:0/566288947 conn(0x7f6b240b2b70 msgr2=0x7f6b240b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- 172.21.15.47:0/566288947 shutdown_connections 2024-04-26T23:45:34.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- 172.21.15.47:0/566288947 wait complete. 2024-04-26T23:45:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 Processor -- start 2024-04-26T23:45:34.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- start start 2024-04-26T23:45:34.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b2406cd40 0x7f6b24152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b240d04b0 0x7f6b240b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2415cf50 0x7f6b24145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b240b3c40 con 0x7f6b240d04b0 2024-04-26T23:45:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2415d330 con 0x7f6b2406cd40 2024-04-26T23:45:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b2a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6b240b3dc0 con 0x7f6b2415cf50 2024-04-26T23:45:34.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b240d04b0 0x7f6b240b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b240d04b0 0x7f6b240b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49222/0 (socket says 172.21.15.47:49222) 2024-04-26T23:45:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 -- 172.21.15.47:0/1446615622 learned_addr learned my addr 172.21.15.47:0/1446615622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b23400640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b2406cd40 0x7f6b24152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b23e00640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2415cf50 0x7f6b24145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 -- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2415cf50 msgr2=0x7f6b24145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2415cf50 0x7f6b24145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 -- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b2406cd40 msgr2=0x7f6b24152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b2406cd40 0x7f6b24152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b1aa00640 1 -- 172.21.15.47:0/1446615622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b24152fc0 con 0x7f6b240d04b0 2024-04-26T23:45:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.865+0000 7f6b23400640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b2406cd40 0x7f6b24152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b1aa00640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b240d04b0 0x7f6b240b1bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c520 tx=0x7f6b0c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b1be00640 1 -- 172.21.15.47:0/1446615622 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c018070 con 0x7f6b240d04b0 2024-04-26T23:45:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b1be00640 1 -- 172.21.15.47:0/1446615622 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b0c0074e0 con 0x7f6b240d04b0 2024-04-26T23:45:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2406e1f0 con 0x7f6b240d04b0 2024-04-26T23:45:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b1be00640 1 -- 172.21.15.47:0/1446615622 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0049f0 con 0x7f6b240d04b0 2024-04-26T23:45:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b24152c40 con 0x7f6b240d04b0 2024-04-26T23:45:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b24069700 con 0x7f6b240d04b0 2024-04-26T23:45:34.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b1be00640 1 -- 172.21.15.47:0/1446615622 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b0c01b070 con 0x7f6b240d04b0 2024-04-26T23:45:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b1be00640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.869+0000 7f6b1be00640 1 -- 172.21.15.47:0/1446615622 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6b0c085e00 con 0x7f6b240d04b0 2024-04-26T23:45:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.873+0000 7f6b23400640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:34.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.873+0000 7f6b23400640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b00068380 0x7f6b0006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b140af000 tx=0x7f6b140a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:34.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:34.877+0000 7f6b1be00640 1 -- 172.21.15.47:0/1446615622 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6b0c0563b0 con 0x7f6b240d04b0 2024-04-26T23:45:35.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.077+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6b24073d50 con 0x7f6b240d04b0 2024-04-26T23:45:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.689+0000 7f6b1be00640 1 -- 172.21.15.47:0/1446615622 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f6b0c055cb0 con 0x7f6b240d04b0 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.689+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b00068380 msgr2=0x7f6b0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.689+0000 7f6b2a200640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b00068380 0x7f6b0006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b140af000 tx=0x7f6b140a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.689+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b240d04b0 msgr2=0x7f6b240b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.689+0000 7f6b2a200640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b240d04b0 0x7f6b240b1bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c520 tx=0x7f6b0c00c9e0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 shutdown_connections 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b00068380 0x7f6b0006a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b2415cf50 0x7f6b24145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b240d04b0 0x7f6b240b1bd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 --2- 172.21.15.47:0/1446615622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b2406cd40 0x7f6b24152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 >> 172.21.15.47:0/1446615622 conn(0x7f6b240b2b70 msgr2=0x7f6b240b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 shutdown_connections 2024-04-26T23:45:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.693+0000 7f6b2a200640 1 -- 172.21.15.47:0/1446615622 wait complete. 2024-04-26T23:45:35.721 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:45:35.721 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39ea200640 1 Processor -- start 2024-04-26T23:45:35.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39ea200640 1 -- start start 2024-04-26T23:45:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39ea200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39e415c100 0x7f39e415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39ea200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e415fc50 con 0x7f39e40ce310 2024-04-26T23:45:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39ea200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e415ff30 con 0x7f39e406fcd0 2024-04-26T23:45:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39ea200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f39e4160860 con 0x7f39e415c100 2024-04-26T23:45:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39e3400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39e415c100 0x7f39e415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39e3400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39e415c100 0x7f39e415cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49230/0 (socket says 172.21.15.47:49230) 2024-04-26T23:45:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39e3400640 1 -- 172.21.15.47:0/1974812688 learned_addr learned my addr 172.21.15.47:0/1974812688 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39e3400640 1 -- 172.21.15.47:0/1974812688 >> v1:172.21.15.203:6789/0 conn(0x7f39e406fcd0 legacy=0x7f39e40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39e3400640 1 -- 172.21.15.47:0/1974812688 >> v1:172.21.15.47:6789/0 conn(0x7f39e40ce310 legacy=0x7f39e40b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39e3400640 1 -- 172.21.15.47:0/1974812688 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e4160210 con 0x7f39e415c100 2024-04-26T23:45:35.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.857+0000 7f39e2a00640 1 -- 172.21.15.47:0/1974812688 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719089608 0 0) 0x7f39e415fc50 con 0x7f39e40ce310 2024-04-26T23:45:35.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39e3400640 1 --2- 172.21.15.47:0/1974812688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e415c100 0x7f39e415cf60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39e41609e0 tx=0x7f39d401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645a4f4438ac64d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39e2a00640 1 -- 172.21.15.47:0/1974812688 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d40ab650 con 0x7f39e415c100 2024-04-26T23:45:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39e2a00640 1 -- 172.21.15.47:0/1974812688 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d40b0070 con 0x7f39e415c100 2024-04-26T23:45:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39e2a00640 1 -- 172.21.15.47:0/1974812688 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d40aba10 con 0x7f39e415c100 2024-04-26T23:45:35.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39ea200640 1 -- 172.21.15.47:0/1974812688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e415c100 msgr2=0x7f39e415cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39ea200640 1 --2- 172.21.15.47:0/1974812688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e415c100 0x7f39e415cf60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39e41609e0 tx=0x7f39d401c540 comp rx=0 tx=0).stop 2024-04-26T23:45:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39ea200640 1 -- 172.21.15.47:0/1974812688 shutdown_connections 2024-04-26T23:45:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39ea200640 1 --2- 172.21.15.47:0/1974812688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e415c100 0x7f39e415cf60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39ea200640 1 -- 172.21.15.47:0/1974812688 >> 172.21.15.47:0/1974812688 conn(0x7f39e406c800 msgr2=0x7f39e406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39ea200640 1 -- 172.21.15.47:0/1974812688 shutdown_connections 2024-04-26T23:45:35.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.861+0000 7f39ea200640 1 -- 172.21.15.47:0/1974812688 wait complete. 2024-04-26T23:45:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 Processor -- start 2024-04-26T23:45:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 -- start start 2024-04-26T23:45:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e406fcd0 0x7f39e4159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40ce310 0x7f39e4073370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39e415c100 0x7f39e415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b6140 con 0x7f39e40ce310 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b5fc0 con 0x7f39e406fcd0 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39e4169e60 con 0x7f39e415c100 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40ce310 0x7f39e4073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40ce310 0x7f39e4073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49234/0 (socket says 172.21.15.47:49234) 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 -- 172.21.15.47:0/122406133 learned_addr learned my addr 172.21.15.47:0/122406133 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39e3400640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e406fcd0 0x7f39e4159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39e3e00640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39e415c100 0x7f39e415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 -- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39e415c100 msgr2=0x7f39e415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39e415c100 0x7f39e415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 -- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e406fcd0 msgr2=0x7f39e4159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e406fcd0 0x7f39e4159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 -- 172.21.15.47:0/122406133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e415b720 con 0x7f39e40ce310 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39e3e00640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39e415c100 0x7f39e415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39daa00640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40ce310 0x7f39e4073370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c450 tx=0x7f39cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39dbe00640 1 -- 172.21.15.47:0/122406133 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc0052d0 con 0x7f39e40ce310 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39dbe00640 1 -- 172.21.15.47:0/122406133 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc005470 con 0x7f39e40ce310 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39dbe00640 1 -- 172.21.15.47:0/122406133 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc003890 con 0x7f39e40ce310 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e40722d0 con 0x7f39e40ce310 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.865+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e4072890 con 0x7f39e40ce310 2024-04-26T23:45:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.869+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e4069700 con 0x7f39e40ce310 2024-04-26T23:45:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.869+0000 7f39dbe00640 1 -- 172.21.15.47:0/122406133 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39cc003a30 con 0x7f39e40ce310 2024-04-26T23:45:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.869+0000 7f39dbe00640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f39c0068380 0x7f39c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.869+0000 7f39dbe00640 1 -- 172.21.15.47:0/122406133 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f39cc086600 con 0x7f39e40ce310 2024-04-26T23:45:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.869+0000 7f39e3400640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f39c0068380 0x7f39c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.869+0000 7f39e3400640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f39c0068380 0x7f39c006a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39d40af000 tx=0x7f39d40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:35.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:35.873+0000 7f39dbe00640 1 -- 172.21.15.47:0/122406133 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f39cc056b20 con 0x7f39e40ce310 2024-04-26T23:45:36.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.073+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39e415cfe0 con 0x7f39e40ce310 2024-04-26T23:45:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.073+0000 7f39dbe00640 1 -- 172.21.15.47:0/122406133 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f39cc056420 con 0x7f39e40ce310 2024-04-26T23:45:36.081 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:36.081 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:45:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f39c0068380 msgr2=0x7f39c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f39c0068380 0x7f39c006a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f39d40af000 tx=0x7f39d40a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40ce310 msgr2=0x7f39e4073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40ce310 0x7f39e4073370 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c450 tx=0x7f39cc00c910 comp rx=0 tx=0).stop 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 shutdown_connections 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f39c0068380 0x7f39c006a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39e415c100 0x7f39e415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39e40ce310 0x7f39e4073370 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 --2- 172.21.15.47:0/122406133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f39e406fcd0 0x7f39e4159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 >> 172.21.15.47:0/122406133 conn(0x7f39e406c800 msgr2=0x7f39e415c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 shutdown_connections 2024-04-26T23:45:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.077+0000 7f39ea200640 1 -- 172.21.15.47:0/122406133 wait complete. 2024-04-26T23:45:36.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 Processor -- start 2024-04-26T23:45:36.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 -- start start 2024-04-26T23:45:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f38340b4360 0x7f38340cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f383415d5b0 0x7f383415da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f38340ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f383415e050 con 0x7f38340b4360 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f383415e330 con 0x7f383415d5b0 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f383a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f38340ceda0 con 0x7f38340cdc00 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.237+0000 7f3833400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f38340b4360 0x7f38340cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f38340b4360 0x7f38340cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49236/0 (socket says 172.21.15.47:49236) 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 -- 172.21.15.47:0/3294198678 learned_addr learned my addr 172.21.15.47:0/3294198678 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833e00640 1 --2- 172.21.15.47:0/3294198678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f38340ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f382aa00640 1 --2- 172.21.15.47:0/3294198678 >> v2:172.21.15.203:3300/0 conn(0x7f383415d5b0 0x7f383415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 -- 172.21.15.47:0/3294198678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 msgr2=0x7f38340ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 --2- 172.21.15.47:0/3294198678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f38340ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 -- 172.21.15.47:0/3294198678 >> v2:172.21.15.203:3300/0 conn(0x7f383415d5b0 msgr2=0x7f383415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 --2- 172.21.15.47:0/3294198678 >> v2:172.21.15.203:3300/0 conn(0x7f383415d5b0 0x7f383415da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 -- 172.21.15.47:0/3294198678 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38340cf080 con 0x7f38340b4360 2024-04-26T23:45:36.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3833400640 1 --2- 172.21.15.47:0/3294198678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38340b4360 0x7f38340cf5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3834070630 tx=0x7f382401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7728318382f65cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3832a00640 1 -- 172.21.15.47:0/3294198678 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240b0070 con 0x7f38340b4360 2024-04-26T23:45:36.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3832a00640 1 -- 172.21.15.47:0/3294198678 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38240ab600 con 0x7f38340b4360 2024-04-26T23:45:36.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.241+0000 7f3832a00640 1 -- 172.21.15.47:0/3294198678 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240ab9d0 con 0x7f38340b4360 2024-04-26T23:45:36.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- 172.21.15.47:0/3294198678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38340b4360 msgr2=0x7f38340cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 --2- 172.21.15.47:0/3294198678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38340b4360 0x7f38340cf5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3834070630 tx=0x7f382401c520 comp rx=0 tx=0).stop 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- 172.21.15.47:0/3294198678 shutdown_connections 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 --2- 172.21.15.47:0/3294198678 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f38340ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 --2- 172.21.15.47:0/3294198678 >> v2:172.21.15.203:3300/0 conn(0x7f383415d5b0 0x7f383415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 --2- 172.21.15.47:0/3294198678 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38340b4360 0x7f38340cf5a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- 172.21.15.47:0/3294198678 >> 172.21.15.47:0/3294198678 conn(0x7f383406c800 msgr2=0x7f383406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- 172.21.15.47:0/3294198678 shutdown_connections 2024-04-26T23:45:36.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- 172.21.15.47:0/3294198678 wait complete. 2024-04-26T23:45:36.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 Processor -- start 2024-04-26T23:45:36.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- start start 2024-04-26T23:45:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340b4360 0x7f38340b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f383413d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383415d5b0 0x7f3834156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f383415f100 con 0x7f383415d5b0 2024-04-26T23:45:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f383415ef80 con 0x7f38340b4360 2024-04-26T23:45:36.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f383a600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f383415f280 con 0x7f38340cdc00 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383415d5b0 0x7f3834156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383415d5b0 0x7f3834156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49250/0 (socket says 172.21.15.47:49250) 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 -- 172.21.15.47:0/2524163576 learned_addr learned my addr 172.21.15.47:0/2524163576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f382aa00640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f383413d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833400640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340b4360 0x7f38340b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 -- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 msgr2=0x7f383413d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f383413d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 -- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340b4360 msgr2=0x7f38340b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340b4360 0x7f38340b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 -- 172.21.15.47:0/2524163576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38340723a0 con 0x7f383415d5b0 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f382aa00640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f383413d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f3833e00640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383415d5b0 0x7f3834156a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f382c00eed0 tx=0x7f382c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.245+0000 7f382be00640 1 -- 172.21.15.47:0/2524163576 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c018020 con 0x7f383415d5b0 2024-04-26T23:45:36.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f382be00640 1 -- 172.21.15.47:0/2524163576 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c00bd20 con 0x7f383415d5b0 2024-04-26T23:45:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f382be00640 1 -- 172.21.15.47:0/2524163576 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c014640 con 0x7f383415d5b0 2024-04-26T23:45:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3834072680 con 0x7f383415d5b0 2024-04-26T23:45:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383414ae80 con 0x7f383415d5b0 2024-04-26T23:45:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3834069700 con 0x7f383415d5b0 2024-04-26T23:45:36.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f382be00640 1 -- 172.21.15.47:0/2524163576 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f382c01b020 con 0x7f383415d5b0 2024-04-26T23:45:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f382be00640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3810068380 0x7f381006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.249+0000 7f382be00640 1 -- 172.21.15.47:0/2524163576 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f382c087380 con 0x7f383415d5b0 2024-04-26T23:45:36.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.253+0000 7f3833400640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3810068380 0x7f381006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.253+0000 7f3833400640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3810068380 0x7f381006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f38240ad000 tx=0x7f38240a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.253+0000 7f382be00640 1 -- 172.21.15.47:0/2524163576 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f382c022030 con 0x7f383415d5b0 2024-04-26T23:45:36.384 INFO:tasks.ceph.mds.d.smithi203.stderr:2024-04-26T23:45:36.379+0000 7fce88a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:45:36.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38340d06a0 con 0x7f383415d5b0 2024-04-26T23:45:36.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f382be00640 1 -- 172.21.15.47:0/2524163576 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f382c057810 con 0x7f383415d5b0 2024-04-26T23:45:36.429 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:36.429 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3810068380 msgr2=0x7f381006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3810068380 0x7f381006a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f38240ad000 tx=0x7f38240a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383415d5b0 msgr2=0x7f3834156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383415d5b0 0x7f3834156a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f382c00eed0 tx=0x7f382c00b480 comp rx=0 tx=0).stop 2024-04-26T23:45:36.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 shutdown_connections 2024-04-26T23:45:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3810068380 0x7f381006a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f383415d5b0 0x7f3834156a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38340cdc00 0x7f383413d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 --2- 172.21.15.47:0/2524163576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38340b4360 0x7f38340b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 >> 172.21.15.47:0/2524163576 conn(0x7f383406c800 msgr2=0x7f383406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 shutdown_connections 2024-04-26T23:45:36.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.421+0000 7f383a600640 1 -- 172.21.15.47:0/2524163576 wait complete. 2024-04-26T23:45:36.450 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:45:36.450 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:36.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d2e00640 1 Processor -- start 2024-04-26T23:45:36.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d2e00640 1 -- start start 2024-04-26T23:45:36.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d2e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f68cc072150 0x7f68cc0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d2e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc0d1690 0x7f68cc0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d2e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68cc0cd830 con 0x7f68cc160810 2024-04-26T23:45:36.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d2e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f68cc071080 con 0x7f68cc072150 2024-04-26T23:45:36.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d2e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f68cc071360 con 0x7f68cc0d1690 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68c3e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f68cc072150 0x7f68cc0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68d0e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc0d1690 0x7f68cc0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68cbe00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f68cc160810 0x7f68cc071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57208/0 (socket says 172.21.15.47:57208) 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68cbe00640 1 -- 172.21.15.47:0/1636377956 learned_addr learned my addr 172.21.15.47:0/1636377956 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68c3e00640 1 -- 172.21.15.47:0/1636377956 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc0d1690 msgr2=0x7f68cc0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68c3e00640 1 --2- 172.21.15.47:0/1636377956 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc0d1690 0x7f68cc0cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68c3e00640 1 -- 172.21.15.47:0/1636377956 >> v1:172.21.15.203:6789/0 conn(0x7f68cc160810 legacy=0x7f68cc071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.585+0000 7f68c3e00640 1 -- 172.21.15.47:0/1636377956 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68cc0cdad0 con 0x7f68cc072150 2024-04-26T23:45:36.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68c3e00640 1 --2- 172.21.15.47:0/1636377956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc072150 0x7f68cc0d1150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68b40097c0 tx=0x7f68b401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30fdc20603a3dd49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68cb400640 1 -- 172.21.15.47:0/1636377956 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b40b5070 con 0x7f68cc072150 2024-04-26T23:45:36.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68cb400640 1 -- 172.21.15.47:0/1636377956 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b40a8990 con 0x7f68cc072150 2024-04-26T23:45:36.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68cb400640 1 -- 172.21.15.47:0/1636377956 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b40a8d60 con 0x7f68cc072150 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 -- 172.21.15.47:0/1636377956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc072150 msgr2=0x7f68cc0d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 --2- 172.21.15.47:0/1636377956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc072150 0x7f68cc0d1150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68b40097c0 tx=0x7f68b401ec90 comp rx=0 tx=0).stop 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 -- 172.21.15.47:0/1636377956 shutdown_connections 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 --2- 172.21.15.47:0/1636377956 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc0d1690 0x7f68cc0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 --2- 172.21.15.47:0/1636377956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc072150 0x7f68cc0d1150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 -- 172.21.15.47:0/1636377956 >> 172.21.15.47:0/1636377956 conn(0x7f68cc0d2e90 msgr2=0x7f68cc0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 -- 172.21.15.47:0/1636377956 shutdown_connections 2024-04-26T23:45:36.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.589+0000 7f68d2e00640 1 -- 172.21.15.47:0/1636377956 wait complete. 2024-04-26T23:45:36.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 Processor -- start 2024-04-26T23:45:36.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 -- start start 2024-04-26T23:45:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc072150 0x7f68cc15d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc0d1690 0x7f68cc0b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68cc160810 0x7f68cc0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc160d70 con 0x7f68cc160810 2024-04-26T23:45:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc160bf0 con 0x7f68cc0d1690 2024-04-26T23:45:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f68cc0ce530 con 0x7f68cc072150 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68cc160810 0x7f68cc0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68cc160810 0x7f68cc0cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49254/0 (socket says 172.21.15.47:49254) 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 -- 172.21.15.47:0/2405561113 learned_addr learned my addr 172.21.15.47:0/2405561113 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68cbe00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc072150 0x7f68cc15d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68c3e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc0d1690 0x7f68cc0b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 -- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc072150 msgr2=0x7f68cc15d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc072150 0x7f68cc15d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 -- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc0d1690 msgr2=0x7f68cc0b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc0d1690 0x7f68cc0b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 -- 172.21.15.47:0/2405561113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68cc1f8ea0 con 0x7f68cc160810 2024-04-26T23:45:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d0e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68cc160810 0x7f68cc0cf940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f68c400efc0 tx=0x7f68c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68c8c00640 1 -- 172.21.15.47:0/2405561113 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4018020 con 0x7f68cc160810 2024-04-26T23:45:36.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68c8c00640 1 -- 172.21.15.47:0/2405561113 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c4014480 con 0x7f68cc160810 2024-04-26T23:45:36.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68c8c00640 1 -- 172.21.15.47:0/2405561113 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4014870 con 0x7f68cc160810 2024-04-26T23:45:36.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68cc1f9180 con 0x7f68cc160810 2024-04-26T23:45:36.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68cc1f9740 con 0x7f68cc160810 2024-04-26T23:45:36.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.593+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68cc069700 con 0x7f68cc160810 2024-04-26T23:45:36.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.597+0000 7f68c8c00640 1 -- 172.21.15.47:0/2405561113 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f68c401b020 con 0x7f68cc160810 2024-04-26T23:45:36.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.597+0000 7f68c8c00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f68a8068380 0x7f68a806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.597+0000 7f68c8c00640 1 -- 172.21.15.47:0/2405561113 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f68c4087510 con 0x7f68cc160810 2024-04-26T23:45:36.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.597+0000 7f68cbe00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f68a8068380 0x7f68a806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.597+0000 7f68cbe00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f68a8068380 0x7f68a806a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68bc000f70 tx=0x7f68bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.601+0000 7f68c8c00640 1 -- 172.21.15.47:0/2405561113 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f68c4022070 con 0x7f68cc160810 2024-04-26T23:45:36.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.765+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68cc15ff30 con 0x7f68a8068380 2024-04-26T23:45:36.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.773+0000 7f68c8c00640 1 -- 172.21.15.47:0/2405561113 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f68cc15ff30 con 0x7f68a8068380 2024-04-26T23:45:36.783 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:36.784 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:45:36.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f68a8068380 msgr2=0x7f68a806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f68a8068380 0x7f68a806a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68bc000f70 tx=0x7f68bc009040 comp rx=0 tx=0).stop 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68cc160810 msgr2=0x7f68cc0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68cc160810 0x7f68cc0cf940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f68c400efc0 tx=0x7f68c400c490 comp rx=0 tx=0).stop 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 shutdown_connections 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f68a8068380 0x7f68a806a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68cc160810 0x7f68cc0cf940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68cc0d1690 0x7f68cc0b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 --2- 172.21.15.47:0/2405561113 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f68cc072150 0x7f68cc15d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 >> 172.21.15.47:0/2405561113 conn(0x7f68cc0d2e90 msgr2=0x7f68cc0c58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 shutdown_connections 2024-04-26T23:45:36.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.777+0000 7f68d2e00640 1 -- 172.21.15.47:0/2405561113 wait complete. 2024-04-26T23:45:36.803 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T23:45:36.154395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235764,"kb_used_data":2964,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738956,"statfs":{"total":773094113280,"available":772852690944,"internally_reserved":0,"allocated":3035136,"data_stored":1789096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.496181"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757462+0000","last_change":"2024-04-26T23:45:32.701302+0000","last_active":"2024-04-26T23:45:33.757462+0000","last_peered":"2024-04-26T23:45:33.757462+0000","last_clean":"2024-04-26T23:45:33.757462+0000","last_became_active":"2024-04-26T23:45:32.698183+0000","last_became_peered":"2024-04-26T23:45:32.698183+0000","last_unstale":"2024-04-26T23:45:33.757462+0000","last_undegraded":"2024-04-26T23:45:33.757462+0000","last_fullsized":"2024-04-26T23:45:33.757462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:12.210886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695950+0000","last_change":"2024-04-26T23:45:32.693831+0000","last_active":"2024-04-26T23:45:33.695950+0000","last_peered":"2024-04-26T23:45:33.695950+0000","last_clean":"2024-04-26T23:45:33.695950+0000","last_became_active":"2024-04-26T23:45:32.693553+0000","last_became_peered":"2024-04-26T23:45:32.693553+0000","last_unstale":"2024-04-26T23:45:33.695950+0000","last_undegraded":"2024-04-26T23:45:33.695950+0000","last_fullsized":"2024-04-26T23:45:33.695950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697171+0000","last_change":"2024-04-26T23:45:32.683112+0000","last_active":"2024-04-26T23:45:32.697171+0000","last_peered":"2024-04-26T23:45:32.697171+0000","last_clean":"2024-04-26T23:45:32.697171+0000","last_became_active":"2024-04-26T23:45:32.682830+0000","last_became_peered":"2024-04-26T23:45:32.682830+0000","last_unstale":"2024-04-26T23:45:32.697171+0000","last_undegraded":"2024-04-26T23:45:32.697171+0000","last_fullsized":"2024-04-26T23:45:32.697171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:14.818957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691013+0000","last_change":"2024-04-26T23:45:32.685512+0000","last_active":"2024-04-26T23:45:33.691013+0000","last_peered":"2024-04-26T23:45:33.691013+0000","last_clean":"2024-04-26T23:45:33.691013+0000","last_became_active":"2024-04-26T23:45:32.684550+0000","last_became_peered":"2024-04-26T23:45:32.684550+0000","last_unstale":"2024-04-26T23:45:33.691013+0000","last_undegraded":"2024-04-26T23:45:33.691013+0000","last_fullsized":"2024-04-26T23:45:33.691013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757117+0000","last_change":"2024-04-26T23:45:32.684222+0000","last_active":"2024-04-26T23:45:33.757117+0000","last_peered":"2024-04-26T23:45:33.757117+0000","last_clean":"2024-04-26T23:45:33.757117+0000","last_became_active":"2024-04-26T23:45:32.683890+0000","last_became_peered":"2024-04-26T23:45:32.683890+0000","last_unstale":"2024-04-26T23:45:33.757117+0000","last_undegraded":"2024-04-26T23:45:33.757117+0000","last_fullsized":"2024-04-26T23:45:33.757117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690568+0000","last_change":"2024-04-26T23:45:32.692472+0000","last_active":"2024-04-26T23:45:33.690568+0000","last_peered":"2024-04-26T23:45:33.690568+0000","last_clean":"2024-04-26T23:45:33.690568+0000","last_became_active":"2024-04-26T23:45:32.691251+0000","last_became_peered":"2024-04-26T23:45:32.691251+0000","last_unstale":"2024-04-26T23:45:33.690568+0000","last_undegraded":"2024-04-26T23:45:33.690568+0000","last_fullsized":"2024-04-26T23:45:33.690568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756809+0000","last_change":"2024-04-26T23:45:32.691299+0000","last_active":"2024-04-26T23:45:33.756809+0000","last_peered":"2024-04-26T23:45:33.756809+0000","last_clean":"2024-04-26T23:45:33.756809+0000","last_became_active":"2024-04-26T23:45:32.690917+0000","last_became_peered":"2024-04-26T23:45:32.690917+0000","last_unstale":"2024-04-26T23:45:33.756809+0000","last_undegraded":"2024-04-26T23:45:33.756809+0000","last_fullsized":"2024-04-26T23:45:33.756809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756676+0000","last_change":"2024-04-26T23:45:32.689444+0000","last_active":"2024-04-26T23:45:33.756676+0000","last_peered":"2024-04-26T23:45:33.756676+0000","last_clean":"2024-04-26T23:45:33.756676+0000","last_became_active":"2024-04-26T23:45:32.686829+0000","last_became_peered":"2024-04-26T23:45:32.686829+0000","last_unstale":"2024-04-26T23:45:33.756676+0000","last_undegraded":"2024-04-26T23:45:33.756676+0000","last_fullsized":"2024-04-26T23:45:33.756676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757439+0000","last_change":"2024-04-26T23:45:32.681039+0000","last_active":"2024-04-26T23:45:33.757439+0000","last_peered":"2024-04-26T23:45:33.757439+0000","last_clean":"2024-04-26T23:45:33.757439+0000","last_became_active":"2024-04-26T23:45:32.680744+0000","last_became_peered":"2024-04-26T23:45:32.680744+0000","last_unstale":"2024-04-26T23:45:33.757439+0000","last_undegraded":"2024-04-26T23:45:33.757439+0000","last_fullsized":"2024-04-26T23:45:33.757439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698759+0000","last_change":"2024-04-26T23:45:32.701873+0000","last_active":"2024-04-26T23:45:33.698759+0000","last_peered":"2024-04-26T23:45:33.698759+0000","last_clean":"2024-04-26T23:45:33.698759+0000","last_became_active":"2024-04-26T23:45:32.701524+0000","last_became_peered":"2024-04-26T23:45:32.701524+0000","last_unstale":"2024-04-26T23:45:33.698759+0000","last_undegraded":"2024-04-26T23:45:33.698759+0000","last_fullsized":"2024-04-26T23:45:33.698759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698643+0000","last_change":"2024-04-26T23:45:32.703627+0000","last_active":"2024-04-26T23:45:33.698643+0000","last_peered":"2024-04-26T23:45:33.698643+0000","last_clean":"2024-04-26T23:45:33.698643+0000","last_became_active":"2024-04-26T23:45:32.703329+0000","last_became_peered":"2024-04-26T23:45:32.703329+0000","last_unstale":"2024-04-26T23:45:33.698643+0000","last_undegraded":"2024-04-26T23:45:33.698643+0000","last_fullsized":"2024-04-26T23:45:33.698643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690062+0000","last_change":"2024-04-26T23:45:32.711843+0000","last_active":"2024-04-26T23:45:33.690062+0000","last_peered":"2024-04-26T23:45:33.690062+0000","last_clean":"2024-04-26T23:45:33.690062+0000","last_became_active":"2024-04-26T23:45:32.711550+0000","last_became_peered":"2024-04-26T23:45:32.711550+0000","last_unstale":"2024-04-26T23:45:33.690062+0000","last_undegraded":"2024-04-26T23:45:33.690062+0000","last_fullsized":"2024-04-26T23:45:33.690062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:27.177803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757662+0000","last_change":"2024-04-26T23:45:32.689403+0000","last_active":"2024-04-26T23:45:33.757662+0000","last_peered":"2024-04-26T23:45:33.757662+0000","last_clean":"2024-04-26T23:45:33.757662+0000","last_became_active":"2024-04-26T23:45:32.689107+0000","last_became_peered":"2024-04-26T23:45:32.689107+0000","last_unstale":"2024-04-26T23:45:33.757662+0000","last_undegraded":"2024-04-26T23:45:33.757662+0000","last_fullsized":"2024-04-26T23:45:33.757662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697287+0000","last_change":"2024-04-26T23:45:32.686927+0000","last_active":"2024-04-26T23:45:32.697287+0000","last_peered":"2024-04-26T23:45:32.697287+0000","last_clean":"2024-04-26T23:45:32.697287+0000","last_became_active":"2024-04-26T23:45:32.686599+0000","last_became_peered":"2024-04-26T23:45:32.686599+0000","last_unstale":"2024-04-26T23:45:32.697287+0000","last_undegraded":"2024-04-26T23:45:32.697287+0000","last_fullsized":"2024-04-26T23:45:32.697287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:27.697467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695791+0000","last_change":"2024-04-26T23:45:32.695206+0000","last_active":"2024-04-26T23:45:33.695791+0000","last_peered":"2024-04-26T23:45:33.695791+0000","last_clean":"2024-04-26T23:45:33.695791+0000","last_became_active":"2024-04-26T23:45:32.694923+0000","last_became_peered":"2024-04-26T23:45:32.694923+0000","last_unstale":"2024-04-26T23:45:33.695791+0000","last_undegraded":"2024-04-26T23:45:33.695791+0000","last_fullsized":"2024-04-26T23:45:33.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690353+0000","last_change":"2024-04-26T23:45:32.686596+0000","last_active":"2024-04-26T23:45:33.690353+0000","last_peered":"2024-04-26T23:45:33.690353+0000","last_clean":"2024-04-26T23:45:33.690353+0000","last_became_active":"2024-04-26T23:45:32.686298+0000","last_became_peered":"2024-04-26T23:45:32.686298+0000","last_unstale":"2024-04-26T23:45:33.690353+0000","last_undegraded":"2024-04-26T23:45:33.690353+0000","last_fullsized":"2024-04-26T23:45:33.690353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691470+0000","last_change":"2024-04-26T23:45:32.699393+0000","last_active":"2024-04-26T23:45:33.691470+0000","last_peered":"2024-04-26T23:45:33.691470+0000","last_clean":"2024-04-26T23:45:33.691470+0000","last_became_active":"2024-04-26T23:45:32.698747+0000","last_became_peered":"2024-04-26T23:45:32.698747+0000","last_unstale":"2024-04-26T23:45:33.691470+0000","last_undegraded":"2024-04-26T23:45:33.691470+0000","last_fullsized":"2024-04-26T23:45:33.691470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:32.702144+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:32.701834+0000","last_became_peered":"2024-04-26T23:45:32.701834+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:51.260148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757314+0000","last_change":"2024-04-26T23:45:32.678816+0000","last_active":"2024-04-26T23:45:33.757314+0000","last_peered":"2024-04-26T23:45:33.757314+0000","last_clean":"2024-04-26T23:45:33.757314+0000","last_became_active":"2024-04-26T23:45:32.678510+0000","last_became_peered":"2024-04-26T23:45:32.678510+0000","last_unstale":"2024-04-26T23:45:33.757314+0000","last_undegraded":"2024-04-26T23:45:33.757314+0000","last_fullsized":"2024-04-26T23:45:33.757314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698396+0000","last_change":"2024-04-26T23:45:32.713741+0000","last_active":"2024-04-26T23:45:33.698396+0000","last_peered":"2024-04-26T23:45:33.698396+0000","last_clean":"2024-04-26T23:45:33.698396+0000","last_became_active":"2024-04-26T23:45:32.713326+0000","last_became_peered":"2024-04-26T23:45:32.713326+0000","last_unstale":"2024-04-26T23:45:33.698396+0000","last_undegraded":"2024-04-26T23:45:33.698396+0000","last_fullsized":"2024-04-26T23:45:33.698396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697225+0000","last_change":"2024-04-26T23:45:32.685874+0000","last_active":"2024-04-26T23:45:32.697225+0000","last_peered":"2024-04-26T23:45:32.697225+0000","last_clean":"2024-04-26T23:45:32.697225+0000","last_became_active":"2024-04-26T23:45:32.685622+0000","last_became_peered":"2024-04-26T23:45:32.685622+0000","last_unstale":"2024-04-26T23:45:32.697225+0000","last_undegraded":"2024-04-26T23:45:32.697225+0000","last_fullsized":"2024-04-26T23:45:32.697225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:25.046528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691119+0000","last_change":"2024-04-26T23:45:32.699326+0000","last_active":"2024-04-26T23:45:33.691119+0000","last_peered":"2024-04-26T23:45:33.691119+0000","last_clean":"2024-04-26T23:45:33.691119+0000","last_became_active":"2024-04-26T23:45:32.698859+0000","last_became_peered":"2024-04-26T23:45:32.698859+0000","last_unstale":"2024-04-26T23:45:33.691119+0000","last_undegraded":"2024-04-26T23:45:33.691119+0000","last_fullsized":"2024-04-26T23:45:33.691119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756772+0000","last_change":"2024-04-26T23:45:32.695396+0000","last_active":"2024-04-26T23:45:33.756772+0000","last_peered":"2024-04-26T23:45:33.756772+0000","last_clean":"2024-04-26T23:45:33.756772+0000","last_became_active":"2024-04-26T23:45:32.694937+0000","last_became_peered":"2024-04-26T23:45:32.694937+0000","last_unstale":"2024-04-26T23:45:33.756772+0000","last_undegraded":"2024-04-26T23:45:33.756772+0000","last_fullsized":"2024-04-26T23:45:33.756772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690363+0000","last_change":"2024-04-26T23:45:32.679737+0000","last_active":"2024-04-26T23:45:33.690363+0000","last_peered":"2024-04-26T23:45:33.690363+0000","last_clean":"2024-04-26T23:45:33.690363+0000","last_became_active":"2024-04-26T23:45:32.679405+0000","last_became_peered":"2024-04-26T23:45:32.679405+0000","last_unstale":"2024-04-26T23:45:33.690363+0000","last_undegraded":"2024-04-26T23:45:33.690363+0000","last_fullsized":"2024-04-26T23:45:33.690363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758147+0000","last_change":"2024-04-26T23:45:32.695857+0000","last_active":"2024-04-26T23:45:33.758147+0000","last_peered":"2024-04-26T23:45:33.758147+0000","last_clean":"2024-04-26T23:45:33.758147+0000","last_became_active":"2024-04-26T23:45:32.695514+0000","last_became_peered":"2024-04-26T23:45:32.695514+0000","last_unstale":"2024-04-26T23:45:33.758147+0000","last_undegraded":"2024-04-26T23:45:33.758147+0000","last_fullsized":"2024-04-26T23:45:33.758147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698737+0000","last_change":"2024-04-26T23:45:32.708627+0000","last_active":"2024-04-26T23:45:33.698737+0000","last_peered":"2024-04-26T23:45:33.698737+0000","last_clean":"2024-04-26T23:45:33.698737+0000","last_became_active":"2024-04-26T23:45:32.708302+0000","last_became_peered":"2024-04-26T23:45:32.708302+0000","last_unstale":"2024-04-26T23:45:33.698737+0000","last_undegraded":"2024-04-26T23:45:33.698737+0000","last_fullsized":"2024-04-26T23:45:33.698737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695912+0000","last_change":"2024-04-26T23:45:32.689802+0000","last_active":"2024-04-26T23:45:33.695912+0000","last_peered":"2024-04-26T23:45:33.695912+0000","last_clean":"2024-04-26T23:45:33.695912+0000","last_became_active":"2024-04-26T23:45:32.689443+0000","last_became_peered":"2024-04-26T23:45:32.689443+0000","last_unstale":"2024-04-26T23:45:33.695912+0000","last_undegraded":"2024-04-26T23:45:33.695912+0000","last_fullsized":"2024-04-26T23:45:33.695912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757503+0000","last_change":"2024-04-26T23:45:32.713348+0000","last_active":"2024-04-26T23:45:33.757503+0000","last_peered":"2024-04-26T23:45:33.757503+0000","last_clean":"2024-04-26T23:45:33.757503+0000","last_became_active":"2024-04-26T23:45:32.712789+0000","last_became_peered":"2024-04-26T23:45:32.712789+0000","last_unstale":"2024-04-26T23:45:33.757503+0000","last_undegraded":"2024-04-26T23:45:33.757503+0000","last_fullsized":"2024-04-26T23:45:33.757503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.699286+0000","last_change":"2024-04-26T23:45:32.692031+0000","last_active":"2024-04-26T23:45:32.699286+0000","last_peered":"2024-04-26T23:45:32.699286+0000","last_clean":"2024-04-26T23:45:32.699286+0000","last_became_active":"2024-04-26T23:45:32.691740+0000","last_became_peered":"2024-04-26T23:45:32.691740+0000","last_unstale":"2024-04-26T23:45:32.699286+0000","last_undegraded":"2024-04-26T23:45:32.699286+0000","last_fullsized":"2024-04-26T23:45:32.699286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:29.825967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690742+0000","last_change":"2024-04-26T23:45:32.683420+0000","last_active":"2024-04-26T23:45:33.690742+0000","last_peered":"2024-04-26T23:45:33.690742+0000","last_clean":"2024-04-26T23:45:33.690742+0000","last_became_active":"2024-04-26T23:45:32.683079+0000","last_became_peered":"2024-04-26T23:45:32.683079+0000","last_unstale":"2024-04-26T23:45:33.690742+0000","last_undegraded":"2024-04-26T23:45:33.690742+0000","last_fullsized":"2024-04-26T23:45:33.690742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688083+0000","last_change":"2024-04-26T23:45:32.686223+0000","last_active":"2024-04-26T23:45:33.688083+0000","last_peered":"2024-04-26T23:45:33.688083+0000","last_clean":"2024-04-26T23:45:33.688083+0000","last_became_active":"2024-04-26T23:45:32.685930+0000","last_became_peered":"2024-04-26T23:45:32.685930+0000","last_unstale":"2024-04-26T23:45:33.688083+0000","last_undegraded":"2024-04-26T23:45:33.688083+0000","last_fullsized":"2024-04-26T23:45:33.688083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698368+0000","last_change":"2024-04-26T23:45:32.691705+0000","last_active":"2024-04-26T23:45:33.698368+0000","last_peered":"2024-04-26T23:45:33.698368+0000","last_clean":"2024-04-26T23:45:33.698368+0000","last_became_active":"2024-04-26T23:45:32.691423+0000","last_became_peered":"2024-04-26T23:45:32.691423+0000","last_unstale":"2024-04-26T23:45:33.698368+0000","last_undegraded":"2024-04-26T23:45:33.698368+0000","last_fullsized":"2024-04-26T23:45:33.698368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689572+0000","last_change":"2024-04-26T23:45:32.700367+0000","last_active":"2024-04-26T23:45:33.689572+0000","last_peered":"2024-04-26T23:45:33.689572+0000","last_clean":"2024-04-26T23:45:33.689572+0000","last_became_active":"2024-04-26T23:45:32.699940+0000","last_became_peered":"2024-04-26T23:45:32.699940+0000","last_unstale":"2024-04-26T23:45:33.689572+0000","last_undegraded":"2024-04-26T23:45:33.689572+0000","last_fullsized":"2024-04-26T23:45:33.689572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:36.201832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757768+0000","last_change":"2024-04-26T23:45:31.686196+0000","last_active":"2024-04-26T23:45:33.757768+0000","last_peered":"2024-04-26T23:45:33.757768+0000","last_clean":"2024-04-26T23:45:33.757768+0000","last_became_active":"2024-04-26T23:45:31.684117+0000","last_became_peered":"2024-04-26T23:45:31.684117+0000","last_unstale":"2024-04-26T23:45:33.757768+0000","last_undegraded":"2024-04-26T23:45:33.757768+0000","last_fullsized":"2024-04-26T23:45:33.757768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.699312+0000","last_change":"2024-04-26T23:45:32.696579+0000","last_active":"2024-04-26T23:45:32.699312+0000","last_peered":"2024-04-26T23:45:32.699312+0000","last_clean":"2024-04-26T23:45:32.699312+0000","last_became_active":"2024-04-26T23:45:32.696347+0000","last_became_peered":"2024-04-26T23:45:32.696347+0000","last_unstale":"2024-04-26T23:45:32.699312+0000","last_undegraded":"2024-04-26T23:45:32.699312+0000","last_fullsized":"2024-04-26T23:45:32.699312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:31.081233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698348+0000","last_change":"2024-04-26T23:45:31.693352+0000","last_active":"2024-04-26T23:45:33.698348+0000","last_peered":"2024-04-26T23:45:33.698348+0000","last_clean":"2024-04-26T23:45:33.698348+0000","last_became_active":"2024-04-26T23:45:31.693085+0000","last_became_peered":"2024-04-26T23:45:31.693085+0000","last_unstale":"2024-04-26T23:45:33.698348+0000","last_undegraded":"2024-04-26T23:45:33.698348+0000","last_fullsized":"2024-04-26T23:45:33.698348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756910+0000","last_change":"2024-04-26T23:45:31.691825+0000","last_active":"2024-04-26T23:45:33.756910+0000","last_peered":"2024-04-26T23:45:33.756910+0000","last_clean":"2024-04-26T23:45:33.756910+0000","last_became_active":"2024-04-26T23:45:31.691522+0000","last_became_peered":"2024-04-26T23:45:31.691522+0000","last_unstale":"2024-04-26T23:45:33.756910+0000","last_undegraded":"2024-04-26T23:45:33.756910+0000","last_fullsized":"2024-04-26T23:45:33.756910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756733+0000","last_change":"2024-04-26T23:45:32.689899+0000","last_active":"2024-04-26T23:45:33.756733+0000","last_peered":"2024-04-26T23:45:33.756733+0000","last_clean":"2024-04-26T23:45:33.756733+0000","last_became_active":"2024-04-26T23:45:32.689083+0000","last_became_peered":"2024-04-26T23:45:32.689083+0000","last_unstale":"2024-04-26T23:45:33.756733+0000","last_undegraded":"2024-04-26T23:45:33.756733+0000","last_fullsized":"2024-04-26T23:45:33.756733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690450+0000","last_change":"2024-04-26T23:45:31.692320+0000","last_active":"2024-04-26T23:45:33.690450+0000","last_peered":"2024-04-26T23:45:33.690450+0000","last_clean":"2024-04-26T23:45:33.690450+0000","last_became_active":"2024-04-26T23:45:31.691944+0000","last_became_peered":"2024-04-26T23:45:31.691944+0000","last_unstale":"2024-04-26T23:45:33.690450+0000","last_undegraded":"2024-04-26T23:45:33.690450+0000","last_fullsized":"2024-04-26T23:45:33.690450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695652+0000","last_change":"2024-04-26T23:45:32.684023+0000","last_active":"2024-04-26T23:45:33.695652+0000","last_peered":"2024-04-26T23:45:33.695652+0000","last_clean":"2024-04-26T23:45:33.695652+0000","last_became_active":"2024-04-26T23:45:32.683745+0000","last_became_peered":"2024-04-26T23:45:32.683745+0000","last_unstale":"2024-04-26T23:45:33.695652+0000","last_undegraded":"2024-04-26T23:45:33.695652+0000","last_fullsized":"2024-04-26T23:45:33.695652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698580+0000","last_change":"2024-04-26T23:45:31.690903+0000","last_active":"2024-04-26T23:45:33.698580+0000","last_peered":"2024-04-26T23:45:33.698580+0000","last_clean":"2024-04-26T23:45:33.698580+0000","last_became_active":"2024-04-26T23:45:31.690629+0000","last_became_peered":"2024-04-26T23:45:31.690629+0000","last_unstale":"2024-04-26T23:45:33.698580+0000","last_undegraded":"2024-04-26T23:45:33.698580+0000","last_fullsized":"2024-04-26T23:45:33.698580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690804+0000","last_change":"2024-04-26T23:45:32.682423+0000","last_active":"2024-04-26T23:45:33.690804+0000","last_peered":"2024-04-26T23:45:33.690804+0000","last_clean":"2024-04-26T23:45:33.690804+0000","last_became_active":"2024-04-26T23:45:32.681951+0000","last_became_peered":"2024-04-26T23:45:32.681951+0000","last_unstale":"2024-04-26T23:45:33.690804+0000","last_undegraded":"2024-04-26T23:45:33.690804+0000","last_fullsized":"2024-04-26T23:45:33.690804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690911+0000","last_change":"2024-04-26T23:45:31.684823+0000","last_active":"2024-04-26T23:45:33.690911+0000","last_peered":"2024-04-26T23:45:33.690911+0000","last_clean":"2024-04-26T23:45:33.690911+0000","last_became_active":"2024-04-26T23:45:31.683574+0000","last_became_peered":"2024-04-26T23:45:31.683574+0000","last_unstale":"2024-04-26T23:45:33.690911+0000","last_undegraded":"2024-04-26T23:45:33.690911+0000","last_fullsized":"2024-04-26T23:45:33.690911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697549+0000","last_change":"2024-04-26T23:45:32.691935+0000","last_active":"2024-04-26T23:45:32.697549+0000","last_peered":"2024-04-26T23:45:32.697549+0000","last_clean":"2024-04-26T23:45:32.697549+0000","last_became_active":"2024-04-26T23:45:32.689093+0000","last_became_peered":"2024-04-26T23:45:32.689093+0000","last_unstale":"2024-04-26T23:45:32.697549+0000","last_undegraded":"2024-04-26T23:45:32.697549+0000","last_fullsized":"2024-04-26T23:45:32.697549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:03.808111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695925+0000","last_change":"2024-04-26T23:45:31.688692+0000","last_active":"2024-04-26T23:45:33.695925+0000","last_peered":"2024-04-26T23:45:33.695925+0000","last_clean":"2024-04-26T23:45:33.695925+0000","last_became_active":"2024-04-26T23:45:31.688404+0000","last_became_peered":"2024-04-26T23:45:31.688404+0000","last_unstale":"2024-04-26T23:45:33.695925+0000","last_undegraded":"2024-04-26T23:45:33.695925+0000","last_fullsized":"2024-04-26T23:45:33.695925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690095+0000","last_change":"2024-04-26T23:45:32.710489+0000","last_active":"2024-04-26T23:45:33.690095+0000","last_peered":"2024-04-26T23:45:33.690095+0000","last_clean":"2024-04-26T23:45:33.690095+0000","last_became_active":"2024-04-26T23:45:32.710118+0000","last_became_peered":"2024-04-26T23:45:32.710118+0000","last_unstale":"2024-04-26T23:45:33.690095+0000","last_undegraded":"2024-04-26T23:45:33.690095+0000","last_fullsized":"2024-04-26T23:45:33.690095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698383+0000","last_change":"2024-04-26T23:45:31.690291+0000","last_active":"2024-04-26T23:45:33.698383+0000","last_peered":"2024-04-26T23:45:33.698383+0000","last_clean":"2024-04-26T23:45:33.698383+0000","last_became_active":"2024-04-26T23:45:31.689915+0000","last_became_peered":"2024-04-26T23:45:31.689915+0000","last_unstale":"2024-04-26T23:45:33.698383+0000","last_undegraded":"2024-04-26T23:45:33.698383+0000","last_fullsized":"2024-04-26T23:45:33.698383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756995+0000","last_change":"2024-04-26T23:45:32.696754+0000","last_active":"2024-04-26T23:45:33.756995+0000","last_peered":"2024-04-26T23:45:33.756995+0000","last_clean":"2024-04-26T23:45:33.756995+0000","last_became_active":"2024-04-26T23:45:32.696500+0000","last_became_peered":"2024-04-26T23:45:32.696500+0000","last_unstale":"2024-04-26T23:45:33.756995+0000","last_undegraded":"2024-04-26T23:45:33.756995+0000","last_fullsized":"2024-04-26T23:45:33.756995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.720054+0000","last_change":"2024-04-26T23:45:31.687471+0000","last_active":"2024-04-26T23:45:32.720054+0000","last_peered":"2024-04-26T23:45:32.720054+0000","last_clean":"2024-04-26T23:45:32.720054+0000","last_became_active":"2024-04-26T23:45:31.687204+0000","last_became_peered":"2024-04-26T23:45:31.687204+0000","last_unstale":"2024-04-26T23:45:32.720054+0000","last_undegraded":"2024-04-26T23:45:32.720054+0000","last_fullsized":"2024-04-26T23:45:32.720054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:12.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.702060+0000","last_change":"2024-04-26T23:45:32.700954+0000","last_active":"2024-04-26T23:45:32.702060+0000","last_peered":"2024-04-26T23:45:32.702060+0000","last_clean":"2024-04-26T23:45:32.702060+0000","last_became_active":"2024-04-26T23:45:32.700376+0000","last_became_peered":"2024-04-26T23:45:32.700376+0000","last_unstale":"2024-04-26T23:45:32.702060+0000","last_undegraded":"2024-04-26T23:45:32.702060+0000","last_fullsized":"2024-04-26T23:45:32.702060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:15.761551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691010+0000","last_change":"2024-04-26T23:45:31.690145+0000","last_active":"2024-04-26T23:45:33.691010+0000","last_peered":"2024-04-26T23:45:33.691010+0000","last_clean":"2024-04-26T23:45:33.691010+0000","last_became_active":"2024-04-26T23:45:31.687880+0000","last_became_peered":"2024-04-26T23:45:31.687880+0000","last_unstale":"2024-04-26T23:45:33.691010+0000","last_undegraded":"2024-04-26T23:45:33.691010+0000","last_fullsized":"2024-04-26T23:45:33.691010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757106+0000","last_change":"2024-04-26T23:45:32.695003+0000","last_active":"2024-04-26T23:45:33.757106+0000","last_peered":"2024-04-26T23:45:33.757106+0000","last_clean":"2024-04-26T23:45:33.757106+0000","last_became_active":"2024-04-26T23:45:32.694696+0000","last_became_peered":"2024-04-26T23:45:32.694696+0000","last_unstale":"2024-04-26T23:45:33.757106+0000","last_undegraded":"2024-04-26T23:45:33.757106+0000","last_fullsized":"2024-04-26T23:45:33.757106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698210+0000","last_change":"2024-04-26T23:45:31.694794+0000","last_active":"2024-04-26T23:45:33.698210+0000","last_peered":"2024-04-26T23:45:33.698210+0000","last_clean":"2024-04-26T23:45:33.698210+0000","last_became_active":"2024-04-26T23:45:31.694518+0000","last_became_peered":"2024-04-26T23:45:31.694518+0000","last_unstale":"2024-04-26T23:45:33.698210+0000","last_undegraded":"2024-04-26T23:45:33.698210+0000","last_fullsized":"2024-04-26T23:45:33.698210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698297+0000","last_change":"2024-04-26T23:45:32.691704+0000","last_active":"2024-04-26T23:45:33.698297+0000","last_peered":"2024-04-26T23:45:33.698297+0000","last_clean":"2024-04-26T23:45:33.698297+0000","last_became_active":"2024-04-26T23:45:32.691125+0000","last_became_peered":"2024-04-26T23:45:32.691125+0000","last_unstale":"2024-04-26T23:45:33.698297+0000","last_undegraded":"2024-04-26T23:45:33.698297+0000","last_fullsized":"2024-04-26T23:45:33.698297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:00.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688028+0000","last_change":"2024-04-26T23:45:31.677038+0000","last_active":"2024-04-26T23:45:33.688028+0000","last_peered":"2024-04-26T23:45:33.688028+0000","last_clean":"2024-04-26T23:45:33.688028+0000","last_became_active":"2024-04-26T23:45:31.676478+0000","last_became_peered":"2024-04-26T23:45:31.676478+0000","last_unstale":"2024-04-26T23:45:33.688028+0000","last_undegraded":"2024-04-26T23:45:33.688028+0000","last_fullsized":"2024-04-26T23:45:33.688028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756712+0000","last_change":"2024-04-26T23:45:32.693504+0000","last_active":"2024-04-26T23:45:33.756712+0000","last_peered":"2024-04-26T23:45:33.756712+0000","last_clean":"2024-04-26T23:45:33.756712+0000","last_became_active":"2024-04-26T23:45:32.693245+0000","last_became_peered":"2024-04-26T23:45:32.693245+0000","last_unstale":"2024-04-26T23:45:33.756712+0000","last_undegraded":"2024-04-26T23:45:33.756712+0000","last_fullsized":"2024-04-26T23:45:33.756712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689885+0000","last_change":"2024-04-26T23:45:31.686918+0000","last_active":"2024-04-26T23:45:33.689885+0000","last_peered":"2024-04-26T23:45:33.689885+0000","last_clean":"2024-04-26T23:45:33.689885+0000","last_became_active":"2024-04-26T23:45:31.686544+0000","last_became_peered":"2024-04-26T23:45:31.686544+0000","last_unstale":"2024-04-26T23:45:33.689885+0000","last_undegraded":"2024-04-26T23:45:33.689885+0000","last_fullsized":"2024-04-26T23:45:33.689885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:20:37.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757297+0000","last_change":"2024-04-26T23:45:32.713893+0000","last_active":"2024-04-26T23:45:33.757297+0000","last_peered":"2024-04-26T23:45:33.757297+0000","last_clean":"2024-04-26T23:45:33.757297+0000","last_became_active":"2024-04-26T23:45:32.713714+0000","last_became_peered":"2024-04-26T23:45:32.713714+0000","last_unstale":"2024-04-26T23:45:33.757297+0000","last_undegraded":"2024-04-26T23:45:33.757297+0000","last_fullsized":"2024-04-26T23:45:33.757297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:31.686652+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:31.686359+0000","last_became_peered":"2024-04-26T23:45:31.686359+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757524+0000","last_change":"2024-04-26T23:45:32.711891+0000","last_active":"2024-04-26T23:45:33.757524+0000","last_peered":"2024-04-26T23:45:33.757524+0000","last_clean":"2024-04-26T23:45:33.757524+0000","last_became_active":"2024-04-26T23:45:32.708109+0000","last_became_peered":"2024-04-26T23:45:32.708109+0000","last_unstale":"2024-04-26T23:45:33.757524+0000","last_undegraded":"2024-04-26T23:45:33.757524+0000","last_fullsized":"2024-04-26T23:45:33.757524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:23.840152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.696007+0000","last_change":"2024-04-26T23:45:31.689003+0000","last_active":"2024-04-26T23:45:33.696007+0000","last_peered":"2024-04-26T23:45:33.696007+0000","last_clean":"2024-04-26T23:45:33.696007+0000","last_became_active":"2024-04-26T23:45:31.688719+0000","last_became_peered":"2024-04-26T23:45:31.688719+0000","last_unstale":"2024-04-26T23:45:33.696007+0000","last_undegraded":"2024-04-26T23:45:33.696007+0000","last_fullsized":"2024-04-26T23:45:33.696007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690968+0000","last_change":"2024-04-26T23:45:32.682148+0000","last_active":"2024-04-26T23:45:33.690968+0000","last_peered":"2024-04-26T23:45:33.690968+0000","last_clean":"2024-04-26T23:45:33.690968+0000","last_became_active":"2024-04-26T23:45:32.681387+0000","last_became_peered":"2024-04-26T23:45:32.681387+0000","last_unstale":"2024-04-26T23:45:33.690968+0000","last_undegraded":"2024-04-26T23:45:33.690968+0000","last_fullsized":"2024-04-26T23:45:33.690968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688270+0000","last_change":"2024-04-26T23:45:31.693411+0000","last_active":"2024-04-26T23:45:33.688270+0000","last_peered":"2024-04-26T23:45:33.688270+0000","last_clean":"2024-04-26T23:45:33.688270+0000","last_became_active":"2024-04-26T23:45:31.693004+0000","last_became_peered":"2024-04-26T23:45:31.693004+0000","last_unstale":"2024-04-26T23:45:33.688270+0000","last_undegraded":"2024-04-26T23:45:33.688270+0000","last_fullsized":"2024-04-26T23:45:33.688270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757215+0000","last_change":"2024-04-26T23:45:32.680577+0000","last_active":"2024-04-26T23:45:33.757215+0000","last_peered":"2024-04-26T23:45:33.757215+0000","last_clean":"2024-04-26T23:45:33.757215+0000","last_became_active":"2024-04-26T23:45:32.680225+0000","last_became_peered":"2024-04-26T23:45:32.680225+0000","last_unstale":"2024-04-26T23:45:33.757215+0000","last_undegraded":"2024-04-26T23:45:33.757215+0000","last_fullsized":"2024-04-26T23:45:33.757215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756646+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:45:33.756646+0000","last_peered":"2024-04-26T23:45:33.756646+0000","last_clean":"2024-04-26T23:45:33.756646+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:45:33.756646+0000","last_undegraded":"2024-04-26T23:45:33.756646+0000","last_fullsized":"2024-04-26T23:45:33.756646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690400+0000","last_change":"2024-04-26T23:45:31.679166+0000","last_active":"2024-04-26T23:45:33.690400+0000","last_peered":"2024-04-26T23:45:33.690400+0000","last_clean":"2024-04-26T23:45:33.690400+0000","last_became_active":"2024-04-26T23:45:31.678173+0000","last_became_peered":"2024-04-26T23:45:31.678173+0000","last_unstale":"2024-04-26T23:45:33.690400+0000","last_undegraded":"2024-04-26T23:45:33.690400+0000","last_fullsized":"2024-04-26T23:45:33.690400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756798+0000","last_change":"2024-04-26T23:45:32.681749+0000","last_active":"2024-04-26T23:45:33.756798+0000","last_peered":"2024-04-26T23:45:33.756798+0000","last_clean":"2024-04-26T23:45:33.756798+0000","last_became_active":"2024-04-26T23:45:32.680979+0000","last_became_peered":"2024-04-26T23:45:32.680979+0000","last_unstale":"2024-04-26T23:45:33.756798+0000","last_undegraded":"2024-04-26T23:45:33.756798+0000","last_fullsized":"2024-04-26T23:45:33.756798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756606+0000","last_change":"2024-04-26T23:45:31.692253+0000","last_active":"2024-04-26T23:45:33.756606+0000","last_peered":"2024-04-26T23:45:33.756606+0000","last_clean":"2024-04-26T23:45:33.756606+0000","last_became_active":"2024-04-26T23:45:31.691948+0000","last_became_peered":"2024-04-26T23:45:31.691948+0000","last_unstale":"2024-04-26T23:45:33.756606+0000","last_undegraded":"2024-04-26T23:45:33.756606+0000","last_fullsized":"2024-04-26T23:45:33.756606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.700132+0000","last_change":"2024-04-26T23:45:32.696469+0000","last_active":"2024-04-26T23:45:32.700132+0000","last_peered":"2024-04-26T23:45:32.700132+0000","last_clean":"2024-04-26T23:45:32.700132+0000","last_became_active":"2024-04-26T23:45:32.696085+0000","last_became_peered":"2024-04-26T23:45:32.696085+0000","last_unstale":"2024-04-26T23:45:32.700132+0000","last_undegraded":"2024-04-26T23:45:32.700132+0000","last_fullsized":"2024-04-26T23:45:32.700132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:26:38.224401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688081+0000","last_change":"2024-04-26T23:45:31.686617+0000","last_active":"2024-04-26T23:45:33.688081+0000","last_peered":"2024-04-26T23:45:33.688081+0000","last_clean":"2024-04-26T23:45:33.688081+0000","last_became_active":"2024-04-26T23:45:31.686298+0000","last_became_peered":"2024-04-26T23:45:31.686298+0000","last_unstale":"2024-04-26T23:45:33.688081+0000","last_undegraded":"2024-04-26T23:45:33.688081+0000","last_fullsized":"2024-04-26T23:45:33.688081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695716+0000","last_change":"2024-04-26T23:45:32.679648+0000","last_active":"2024-04-26T23:45:33.695716+0000","last_peered":"2024-04-26T23:45:33.695716+0000","last_clean":"2024-04-26T23:45:33.695716+0000","last_became_active":"2024-04-26T23:45:32.678533+0000","last_became_peered":"2024-04-26T23:45:32.678533+0000","last_unstale":"2024-04-26T23:45:33.695716+0000","last_undegraded":"2024-04-26T23:45:33.695716+0000","last_fullsized":"2024-04-26T23:45:33.695716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691096+0000","last_change":"2024-04-26T23:45:31.681850+0000","last_active":"2024-04-26T23:45:33.691096+0000","last_peered":"2024-04-26T23:45:33.691096+0000","last_clean":"2024-04-26T23:45:33.691096+0000","last_became_active":"2024-04-26T23:45:31.679810+0000","last_became_peered":"2024-04-26T23:45:31.679810+0000","last_unstale":"2024-04-26T23:45:33.691096+0000","last_undegraded":"2024-04-26T23:45:33.691096+0000","last_fullsized":"2024-04-26T23:45:33.691096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689831+0000","last_change":"2024-04-26T23:45:32.710524+0000","last_active":"2024-04-26T23:45:33.689831+0000","last_peered":"2024-04-26T23:45:33.689831+0000","last_clean":"2024-04-26T23:45:33.689831+0000","last_became_active":"2024-04-26T23:45:32.703378+0000","last_became_peered":"2024-04-26T23:45:32.703378+0000","last_unstale":"2024-04-26T23:45:33.689831+0000","last_undegraded":"2024-04-26T23:45:33.689831+0000","last_fullsized":"2024-04-26T23:45:33.689831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:22.939348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695838+0000","last_change":"2024-04-26T23:45:31.681707+0000","last_active":"2024-04-26T23:45:33.695838+0000","last_peered":"2024-04-26T23:45:33.695838+0000","last_clean":"2024-04-26T23:45:33.695838+0000","last_became_active":"2024-04-26T23:45:31.681452+0000","last_became_peered":"2024-04-26T23:45:31.681452+0000","last_unstale":"2024-04-26T23:45:33.695838+0000","last_undegraded":"2024-04-26T23:45:33.695838+0000","last_fullsized":"2024-04-26T23:45:33.695838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690997+0000","last_change":"2024-04-26T23:45:32.690629+0000","last_active":"2024-04-26T23:45:33.690997+0000","last_peered":"2024-04-26T23:45:33.690997+0000","last_clean":"2024-04-26T23:45:33.690997+0000","last_became_active":"2024-04-26T23:45:32.690208+0000","last_became_peered":"2024-04-26T23:45:32.690208+0000","last_unstale":"2024-04-26T23:45:33.690997+0000","last_undegraded":"2024-04-26T23:45:33.690997+0000","last_fullsized":"2024-04-26T23:45:33.690997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757330+0000","last_change":"2024-04-26T23:45:31.693759+0000","last_active":"2024-04-26T23:45:33.757330+0000","last_peered":"2024-04-26T23:45:33.757330+0000","last_clean":"2024-04-26T23:45:33.757330+0000","last_became_active":"2024-04-26T23:45:31.693396+0000","last_became_peered":"2024-04-26T23:45:31.693396+0000","last_unstale":"2024-04-26T23:45:33.757330+0000","last_undegraded":"2024-04-26T23:45:33.757330+0000","last_fullsized":"2024-04-26T23:45:33.757330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:47.961582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695802+0000","last_change":"2024-04-26T23:45:32.679402+0000","last_active":"2024-04-26T23:45:33.695802+0000","last_peered":"2024-04-26T23:45:33.695802+0000","last_clean":"2024-04-26T23:45:33.695802+0000","last_became_active":"2024-04-26T23:45:32.678906+0000","last_became_peered":"2024-04-26T23:45:32.678906+0000","last_unstale":"2024-04-26T23:45:33.695802+0000","last_undegraded":"2024-04-26T23:45:33.695802+0000","last_fullsized":"2024-04-26T23:45:33.695802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.697710+0000","last_change":"2024-04-26T23:45:31.682989+0000","last_active":"2024-04-26T23:45:33.697710+0000","last_peered":"2024-04-26T23:45:33.697710+0000","last_clean":"2024-04-26T23:45:33.697710+0000","last_became_active":"2024-04-26T23:45:31.682706+0000","last_became_peered":"2024-04-26T23:45:31.682706+0000","last_unstale":"2024-04-26T23:45:33.697710+0000","last_undegraded":"2024-04-26T23:45:33.697710+0000","last_fullsized":"2024-04-26T23:45:33.697710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758153+0000","last_change":"2024-04-26T23:45:32.705019+0000","last_active":"2024-04-26T23:45:33.758153+0000","last_peered":"2024-04-26T23:45:33.758153+0000","last_clean":"2024-04-26T23:45:33.758153+0000","last_became_active":"2024-04-26T23:45:32.704605+0000","last_became_peered":"2024-04-26T23:45:32.704605+0000","last_unstale":"2024-04-26T23:45:33.758153+0000","last_undegraded":"2024-04-26T23:45:33.758153+0000","last_fullsized":"2024-04-26T23:45:33.758153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698690+0000","last_change":"2024-04-26T23:45:31.687021+0000","last_active":"2024-04-26T23:45:33.698690+0000","last_peered":"2024-04-26T23:45:33.698690+0000","last_clean":"2024-04-26T23:45:33.698690+0000","last_became_active":"2024-04-26T23:45:31.686729+0000","last_became_peered":"2024-04-26T23:45:31.686729+0000","last_unstale":"2024-04-26T23:45:33.698690+0000","last_undegraded":"2024-04-26T23:45:33.698690+0000","last_fullsized":"2024-04-26T23:45:33.698690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697422+0000","last_change":"2024-04-26T23:45:32.691521+0000","last_active":"2024-04-26T23:45:32.697422+0000","last_peered":"2024-04-26T23:45:32.697422+0000","last_clean":"2024-04-26T23:45:32.697422+0000","last_became_active":"2024-04-26T23:45:32.689417+0000","last_became_peered":"2024-04-26T23:45:32.689417+0000","last_unstale":"2024-04-26T23:45:32.697422+0000","last_undegraded":"2024-04-26T23:45:32.697422+0000","last_fullsized":"2024-04-26T23:45:32.697422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:17.717158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756573+0000","last_change":"2024-04-26T23:45:31.688837+0000","last_active":"2024-04-26T23:45:33.756573+0000","last_peered":"2024-04-26T23:45:33.756573+0000","last_clean":"2024-04-26T23:45:33.756573+0000","last_became_active":"2024-04-26T23:45:31.688197+0000","last_became_peered":"2024-04-26T23:45:31.688197+0000","last_unstale":"2024-04-26T23:45:33.756573+0000","last_undegraded":"2024-04-26T23:45:33.756573+0000","last_fullsized":"2024-04-26T23:45:33.756573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689758+0000","last_change":"2024-04-26T23:45:32.711123+0000","last_active":"2024-04-26T23:45:33.689758+0000","last_peered":"2024-04-26T23:45:33.689758+0000","last_clean":"2024-04-26T23:45:33.689758+0000","last_became_active":"2024-04-26T23:45:32.710879+0000","last_became_peered":"2024-04-26T23:45:32.710879+0000","last_unstale":"2024-04-26T23:45:33.689758+0000","last_undegraded":"2024-04-26T23:45:33.689758+0000","last_fullsized":"2024-04-26T23:45:33.689758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:48.052853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695742+0000","last_change":"2024-04-26T23:45:31.681304+0000","last_active":"2024-04-26T23:45:33.695742+0000","last_peered":"2024-04-26T23:45:33.695742+0000","last_clean":"2024-04-26T23:45:33.695742+0000","last_became_active":"2024-04-26T23:45:31.681010+0000","last_became_peered":"2024-04-26T23:45:31.681010+0000","last_unstale":"2024-04-26T23:45:33.695742+0000","last_undegraded":"2024-04-26T23:45:33.695742+0000","last_fullsized":"2024-04-26T23:45:33.695742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756926+0000","last_change":"2024-04-26T23:45:32.684124+0000","last_active":"2024-04-26T23:45:33.756926+0000","last_peered":"2024-04-26T23:45:33.756926+0000","last_clean":"2024-04-26T23:45:33.756926+0000","last_became_active":"2024-04-26T23:45:32.683833+0000","last_became_peered":"2024-04-26T23:45:32.683833+0000","last_unstale":"2024-04-26T23:45:33.756926+0000","last_undegraded":"2024-04-26T23:45:33.756926+0000","last_fullsized":"2024-04-26T23:45:33.756926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695748+0000","last_change":"2024-04-26T23:45:31.686558+0000","last_active":"2024-04-26T23:45:33.695748+0000","last_peered":"2024-04-26T23:45:33.695748+0000","last_clean":"2024-04-26T23:45:33.695748+0000","last_became_active":"2024-04-26T23:45:31.686256+0000","last_became_peered":"2024-04-26T23:45:31.686256+0000","last_unstale":"2024-04-26T23:45:33.695748+0000","last_undegraded":"2024-04-26T23:45:33.695748+0000","last_fullsized":"2024-04-26T23:45:33.695748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757677+0000","last_change":"2024-04-26T23:45:32.693947+0000","last_active":"2024-04-26T23:45:33.757677+0000","last_peered":"2024-04-26T23:45:33.757677+0000","last_clean":"2024-04-26T23:45:33.757677+0000","last_became_active":"2024-04-26T23:45:32.693704+0000","last_became_peered":"2024-04-26T23:45:32.693704+0000","last_unstale":"2024-04-26T23:45:33.757677+0000","last_undegraded":"2024-04-26T23:45:33.757677+0000","last_fullsized":"2024-04-26T23:45:33.757677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757253+0000","last_change":"2024-04-26T23:45:31.694659+0000","last_active":"2024-04-26T23:45:33.757253+0000","last_peered":"2024-04-26T23:45:33.757253+0000","last_clean":"2024-04-26T23:45:33.757253+0000","last_became_active":"2024-04-26T23:45:31.694372+0000","last_became_peered":"2024-04-26T23:45:31.694372+0000","last_unstale":"2024-04-26T23:45:33.757253+0000","last_undegraded":"2024-04-26T23:45:33.757253+0000","last_fullsized":"2024-04-26T23:45:33.757253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698364+0000","last_change":"2024-04-26T23:45:32.696663+0000","last_active":"2024-04-26T23:45:33.698364+0000","last_peered":"2024-04-26T23:45:33.698364+0000","last_clean":"2024-04-26T23:45:33.698364+0000","last_became_active":"2024-04-26T23:45:32.696375+0000","last_became_peered":"2024-04-26T23:45:32.696375+0000","last_unstale":"2024-04-26T23:45:33.698364+0000","last_undegraded":"2024-04-26T23:45:33.698364+0000","last_fullsized":"2024-04-26T23:45:33.698364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690867+0000","last_change":"2024-04-26T23:45:32.700585+0000","last_active":"2024-04-26T23:45:33.690867+0000","last_peered":"2024-04-26T23:45:33.690867+0000","last_clean":"2024-04-26T23:45:33.690867+0000","last_became_active":"2024-04-26T23:45:32.699809+0000","last_became_peered":"2024-04-26T23:45:32.699809+0000","last_unstale":"2024-04-26T23:45:33.690867+0000","last_undegraded":"2024-04-26T23:45:33.690867+0000","last_fullsized":"2024-04-26T23:45:33.690867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757098+0000","last_change":"2024-04-26T23:45:31.692287+0000","last_active":"2024-04-26T23:45:33.757098+0000","last_peered":"2024-04-26T23:45:33.757098+0000","last_clean":"2024-04-26T23:45:33.757098+0000","last_became_active":"2024-04-26T23:45:31.691971+0000","last_became_peered":"2024-04-26T23:45:31.691971+0000","last_unstale":"2024-04-26T23:45:33.757098+0000","last_undegraded":"2024-04-26T23:45:33.757098+0000","last_fullsized":"2024-04-26T23:45:33.757098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690790+0000","last_change":"2024-04-26T23:45:32.713320+0000","last_active":"2024-04-26T23:45:33.690790+0000","last_peered":"2024-04-26T23:45:33.690790+0000","last_clean":"2024-04-26T23:45:33.690790+0000","last_became_active":"2024-04-26T23:45:32.713003+0000","last_became_peered":"2024-04-26T23:45:32.713003+0000","last_unstale":"2024-04-26T23:45:33.690790+0000","last_undegraded":"2024-04-26T23:45:33.690790+0000","last_fullsized":"2024-04-26T23:45:33.690790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757116+0000","last_change":"2024-04-26T23:45:31.696984+0000","last_active":"2024-04-26T23:45:33.757116+0000","last_peered":"2024-04-26T23:45:33.757116+0000","last_clean":"2024-04-26T23:45:33.757116+0000","last_became_active":"2024-04-26T23:45:31.696695+0000","last_became_peered":"2024-04-26T23:45:31.696695+0000","last_unstale":"2024-04-26T23:45:33.757116+0000","last_undegraded":"2024-04-26T23:45:33.757116+0000","last_fullsized":"2024-04-26T23:45:33.757116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697404+0000","last_change":"2024-04-26T23:45:32.689960+0000","last_active":"2024-04-26T23:45:32.697404+0000","last_peered":"2024-04-26T23:45:32.697404+0000","last_clean":"2024-04-26T23:45:32.697404+0000","last_became_active":"2024-04-26T23:45:32.688270+0000","last_became_peered":"2024-04-26T23:45:32.688270+0000","last_unstale":"2024-04-26T23:45:32.697404+0000","last_undegraded":"2024-04-26T23:45:32.697404+0000","last_fullsized":"2024-04-26T23:45:32.697404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:25.573512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757915+0000","last_change":"2024-04-26T23:45:31.687488+0000","last_active":"2024-04-26T23:45:33.757915+0000","last_peered":"2024-04-26T23:45:33.757915+0000","last_clean":"2024-04-26T23:45:33.757915+0000","last_became_active":"2024-04-26T23:45:31.687025+0000","last_became_peered":"2024-04-26T23:45:31.687025+0000","last_unstale":"2024-04-26T23:45:33.757915+0000","last_undegraded":"2024-04-26T23:45:33.757915+0000","last_fullsized":"2024-04-26T23:45:33.757915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757776+0000","last_change":"2024-04-26T23:45:32.702678+0000","last_active":"2024-04-26T23:45:33.757776+0000","last_peered":"2024-04-26T23:45:33.757776+0000","last_clean":"2024-04-26T23:45:33.757776+0000","last_became_active":"2024-04-26T23:45:32.702293+0000","last_became_peered":"2024-04-26T23:45:32.702293+0000","last_unstale":"2024-04-26T23:45:33.757776+0000","last_undegraded":"2024-04-26T23:45:33.757776+0000","last_fullsized":"2024-04-26T23:45:33.757776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.717617+0000","last_change":"2024-04-26T23:45:31.690606+0000","last_active":"2024-04-26T23:45:32.717617+0000","last_peered":"2024-04-26T23:45:32.717617+0000","last_clean":"2024-04-26T23:45:32.717617+0000","last_became_active":"2024-04-26T23:45:31.690293+0000","last_became_peered":"2024-04-26T23:45:31.690293+0000","last_unstale":"2024-04-26T23:45:32.717617+0000","last_undegraded":"2024-04-26T23:45:32.717617+0000","last_fullsized":"2024-04-26T23:45:32.717617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.450816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":74815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":665661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:36.808 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:36.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.977+0000 7f40a3e00640 1 Processor -- start 2024-04-26T23:45:36.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.977+0000 7f40a3e00640 1 -- start start 2024-04-26T23:45:36.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a3e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f40a41467c0 0x7f40a406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a406c940 0x7f40a40d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a3e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a415d540 con 0x7f40a40d0b70 2024-04-26T23:45:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a3e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f40a40b4fc0 con 0x7f40a41467c0 2024-04-26T23:45:36.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f40a406cd80 con 0x7f40a406c940 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f409be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a406c940 0x7f40a40d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a2a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f40a41467c0 0x7f40a406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a3400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f40a40d0b70 0x7f40a4072f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57212/0 (socket says 172.21.15.47:57212) 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a3400640 1 -- 172.21.15.47:0/2176513053 learned_addr learned my addr 172.21.15.47:0/2176513053 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f409be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a406c940 0x7f40a40d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37332/0 (socket says 172.21.15.47:37332) 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f409be00640 1 -- 172.21.15.47:0/2176513053 >> v2:172.21.15.203:3300/0 conn(0x7f40a41467c0 msgr2=0x7f40a406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f409be00640 1 --2- 172.21.15.47:0/2176513053 >> v2:172.21.15.203:3300/0 conn(0x7f40a41467c0 0x7f40a406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f409be00640 1 -- 172.21.15.47:0/2176513053 >> v1:172.21.15.203:6789/0 conn(0x7f40a40d0b70 legacy=0x7f40a4072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f409be00640 1 -- 172.21.15.47:0/2176513053 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a40d13a0 con 0x7f40a406c940 2024-04-26T23:45:36.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.981+0000 7f40a2a00640 1 --2- 172.21.15.47:0/2176513053 >> v2:172.21.15.203:3300/0 conn(0x7f40a41467c0 0x7f40a406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:36.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f409be00640 1 --2- 172.21.15.47:0/2176513053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a406c940 0x7f40a40d0630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f408c0097c0 tx=0x7f408c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b024709f902cee79 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a2000640 1 -- 172.21.15.47:0/2176513053 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c0b2070 con 0x7f40a406c940 2024-04-26T23:45:36.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a2000640 1 -- 172.21.15.47:0/2176513053 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408c0ad640 con 0x7f40a406c940 2024-04-26T23:45:36.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a2000640 1 -- 172.21.15.47:0/2176513053 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408c0ada10 con 0x7f40a406c940 2024-04-26T23:45:36.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 -- 172.21.15.47:0/2176513053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a406c940 msgr2=0x7f40a40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 --2- 172.21.15.47:0/2176513053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a406c940 0x7f40a40d0630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f408c0097c0 tx=0x7f408c01c470 comp rx=0 tx=0).stop 2024-04-26T23:45:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 -- 172.21.15.47:0/2176513053 shutdown_connections 2024-04-26T23:45:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 --2- 172.21.15.47:0/2176513053 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a406c940 0x7f40a40d0630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 --2- 172.21.15.47:0/2176513053 >> v2:172.21.15.203:3300/0 conn(0x7f40a41467c0 0x7f40a406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 -- 172.21.15.47:0/2176513053 >> 172.21.15.47:0/2176513053 conn(0x7f40a40b38b0 msgr2=0x7f40a40b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 -- 172.21.15.47:0/2176513053 shutdown_connections 2024-04-26T23:45:36.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 -- 172.21.15.47:0/2176513053 wait complete. 2024-04-26T23:45:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 Processor -- start 2024-04-26T23:45:36.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 -- start start 2024-04-26T23:45:36.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40a406c940 0x7f40a415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.985+0000 7f40a3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a40d0b70 0x7f40a4165c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a41467c0 0x7f40a41661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4146d20 con 0x7f40a406c940 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40a4146ba0 con 0x7f40a41467c0 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f40a40b6460 con 0x7f40a40d0b70 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40a406c940 0x7f40a415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40a406c940 0x7f40a415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49258/0 (socket says 172.21.15.47:49258) 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 -- 172.21.15.47:0/300923668 learned_addr learned my addr 172.21.15.47:0/300923668 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3400640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a41467c0 0x7f40a41661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f409be00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a40d0b70 0x7f40a4165c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 -- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a40d0b70 msgr2=0x7f40a4165c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a40d0b70 0x7f40a4165c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 -- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a41467c0 msgr2=0x7f40a41661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a41467c0 0x7f40a41661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 -- 172.21.15.47:0/300923668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a4144cd0 con 0x7f40a406c940 2024-04-26T23:45:36.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a2a00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40a406c940 0x7f40a415c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f409400e980 tx=0x7f409400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f409aa00640 1 -- 172.21.15.47:0/300923668 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4094017070 con 0x7f40a406c940 2024-04-26T23:45:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f409aa00640 1 -- 172.21.15.47:0/300923668 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409400ca00 con 0x7f40a406c940 2024-04-26T23:45:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a4144fb0 con 0x7f40a406c940 2024-04-26T23:45:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f409aa00640 1 -- 172.21.15.47:0/300923668 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409400cdd0 con 0x7f40a406c940 2024-04-26T23:45:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a415d7b0 con 0x7f40a406c940 2024-04-26T23:45:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a4069470 con 0x7f40a406c940 2024-04-26T23:45:36.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.989+0000 7f409aa00640 1 -- 172.21.15.47:0/300923668 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f409401a070 con 0x7f40a406c940 2024-04-26T23:45:36.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.993+0000 7f409aa00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4080068380 0x7f408006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:36.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.993+0000 7f409aa00640 1 -- 172.21.15.47:0/300923668 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4094086c60 con 0x7f40a406c940 2024-04-26T23:45:36.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.993+0000 7f409be00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4080068380 0x7f408006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:36.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.993+0000 7f409be00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4080068380 0x7f408006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f408c0af000 tx=0x7f408c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:37.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:36.997+0000 7f409aa00640 1 -- 172.21.15.47:0/300923668 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f40940571a0 con 0x7f40a406c940 2024-04-26T23:45:37.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.157+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40a406cf30 con 0x7f4080068380 2024-04-26T23:45:37.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.165+0000 7f409aa00640 1 -- 172.21.15.47:0/300923668 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251935 (secure 0 0 0) 0x7f40a406cf30 con 0x7f4080068380 2024-04-26T23:45:37.176 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:37.177 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:45:37.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4080068380 msgr2=0x7f408006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4080068380 0x7f408006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f408c0af000 tx=0x7f408c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:37.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40a406c940 msgr2=0x7f40a415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40a406c940 0x7f40a415c9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f409400e980 tx=0x7f409400ee40 comp rx=0 tx=0).stop 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 shutdown_connections 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4080068380 0x7f408006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a41467c0 0x7f40a41661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40a40d0b70 0x7f40a4165c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 --2- 172.21.15.47:0/300923668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40a406c940 0x7f40a415c9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 >> 172.21.15.47:0/300923668 conn(0x7f40a40b38b0 msgr2=0x7f40a4141050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 shutdown_connections 2024-04-26T23:45:37.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.169+0000 7f40a3e00640 1 -- 172.21.15.47:0/300923668 wait complete. 2024-04-26T23:45:37.196 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T23:45:36.154395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":139,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235764,"kb_used_data":2964,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738956,"statfs":{"total":773094113280,"available":772852690944,"internally_reserved":0,"allocated":3035136,"data_stored":1789096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.496181"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757462+0000","last_change":"2024-04-26T23:45:32.701302+0000","last_active":"2024-04-26T23:45:33.757462+0000","last_peered":"2024-04-26T23:45:33.757462+0000","last_clean":"2024-04-26T23:45:33.757462+0000","last_became_active":"2024-04-26T23:45:32.698183+0000","last_became_peered":"2024-04-26T23:45:32.698183+0000","last_unstale":"2024-04-26T23:45:33.757462+0000","last_undegraded":"2024-04-26T23:45:33.757462+0000","last_fullsized":"2024-04-26T23:45:33.757462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:12.210886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695950+0000","last_change":"2024-04-26T23:45:32.693831+0000","last_active":"2024-04-26T23:45:33.695950+0000","last_peered":"2024-04-26T23:45:33.695950+0000","last_clean":"2024-04-26T23:45:33.695950+0000","last_became_active":"2024-04-26T23:45:32.693553+0000","last_became_peered":"2024-04-26T23:45:32.693553+0000","last_unstale":"2024-04-26T23:45:33.695950+0000","last_undegraded":"2024-04-26T23:45:33.695950+0000","last_fullsized":"2024-04-26T23:45:33.695950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697171+0000","last_change":"2024-04-26T23:45:32.683112+0000","last_active":"2024-04-26T23:45:32.697171+0000","last_peered":"2024-04-26T23:45:32.697171+0000","last_clean":"2024-04-26T23:45:32.697171+0000","last_became_active":"2024-04-26T23:45:32.682830+0000","last_became_peered":"2024-04-26T23:45:32.682830+0000","last_unstale":"2024-04-26T23:45:32.697171+0000","last_undegraded":"2024-04-26T23:45:32.697171+0000","last_fullsized":"2024-04-26T23:45:32.697171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:29:14.818957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691013+0000","last_change":"2024-04-26T23:45:32.685512+0000","last_active":"2024-04-26T23:45:33.691013+0000","last_peered":"2024-04-26T23:45:33.691013+0000","last_clean":"2024-04-26T23:45:33.691013+0000","last_became_active":"2024-04-26T23:45:32.684550+0000","last_became_peered":"2024-04-26T23:45:32.684550+0000","last_unstale":"2024-04-26T23:45:33.691013+0000","last_undegraded":"2024-04-26T23:45:33.691013+0000","last_fullsized":"2024-04-26T23:45:33.691013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757117+0000","last_change":"2024-04-26T23:45:32.684222+0000","last_active":"2024-04-26T23:45:33.757117+0000","last_peered":"2024-04-26T23:45:33.757117+0000","last_clean":"2024-04-26T23:45:33.757117+0000","last_became_active":"2024-04-26T23:45:32.683890+0000","last_became_peered":"2024-04-26T23:45:32.683890+0000","last_unstale":"2024-04-26T23:45:33.757117+0000","last_undegraded":"2024-04-26T23:45:33.757117+0000","last_fullsized":"2024-04-26T23:45:33.757117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690568+0000","last_change":"2024-04-26T23:45:32.692472+0000","last_active":"2024-04-26T23:45:33.690568+0000","last_peered":"2024-04-26T23:45:33.690568+0000","last_clean":"2024-04-26T23:45:33.690568+0000","last_became_active":"2024-04-26T23:45:32.691251+0000","last_became_peered":"2024-04-26T23:45:32.691251+0000","last_unstale":"2024-04-26T23:45:33.690568+0000","last_undegraded":"2024-04-26T23:45:33.690568+0000","last_fullsized":"2024-04-26T23:45:33.690568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756809+0000","last_change":"2024-04-26T23:45:32.691299+0000","last_active":"2024-04-26T23:45:33.756809+0000","last_peered":"2024-04-26T23:45:33.756809+0000","last_clean":"2024-04-26T23:45:33.756809+0000","last_became_active":"2024-04-26T23:45:32.690917+0000","last_became_peered":"2024-04-26T23:45:32.690917+0000","last_unstale":"2024-04-26T23:45:33.756809+0000","last_undegraded":"2024-04-26T23:45:33.756809+0000","last_fullsized":"2024-04-26T23:45:33.756809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756676+0000","last_change":"2024-04-26T23:45:32.689444+0000","last_active":"2024-04-26T23:45:33.756676+0000","last_peered":"2024-04-26T23:45:33.756676+0000","last_clean":"2024-04-26T23:45:33.756676+0000","last_became_active":"2024-04-26T23:45:32.686829+0000","last_became_peered":"2024-04-26T23:45:32.686829+0000","last_unstale":"2024-04-26T23:45:33.756676+0000","last_undegraded":"2024-04-26T23:45:33.756676+0000","last_fullsized":"2024-04-26T23:45:33.756676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757439+0000","last_change":"2024-04-26T23:45:32.681039+0000","last_active":"2024-04-26T23:45:33.757439+0000","last_peered":"2024-04-26T23:45:33.757439+0000","last_clean":"2024-04-26T23:45:33.757439+0000","last_became_active":"2024-04-26T23:45:32.680744+0000","last_became_peered":"2024-04-26T23:45:32.680744+0000","last_unstale":"2024-04-26T23:45:33.757439+0000","last_undegraded":"2024-04-26T23:45:33.757439+0000","last_fullsized":"2024-04-26T23:45:33.757439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698759+0000","last_change":"2024-04-26T23:45:32.701873+0000","last_active":"2024-04-26T23:45:33.698759+0000","last_peered":"2024-04-26T23:45:33.698759+0000","last_clean":"2024-04-26T23:45:33.698759+0000","last_became_active":"2024-04-26T23:45:32.701524+0000","last_became_peered":"2024-04-26T23:45:32.701524+0000","last_unstale":"2024-04-26T23:45:33.698759+0000","last_undegraded":"2024-04-26T23:45:33.698759+0000","last_fullsized":"2024-04-26T23:45:33.698759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698643+0000","last_change":"2024-04-26T23:45:32.703627+0000","last_active":"2024-04-26T23:45:33.698643+0000","last_peered":"2024-04-26T23:45:33.698643+0000","last_clean":"2024-04-26T23:45:33.698643+0000","last_became_active":"2024-04-26T23:45:32.703329+0000","last_became_peered":"2024-04-26T23:45:32.703329+0000","last_unstale":"2024-04-26T23:45:33.698643+0000","last_undegraded":"2024-04-26T23:45:33.698643+0000","last_fullsized":"2024-04-26T23:45:33.698643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690062+0000","last_change":"2024-04-26T23:45:32.711843+0000","last_active":"2024-04-26T23:45:33.690062+0000","last_peered":"2024-04-26T23:45:33.690062+0000","last_clean":"2024-04-26T23:45:33.690062+0000","last_became_active":"2024-04-26T23:45:32.711550+0000","last_became_peered":"2024-04-26T23:45:32.711550+0000","last_unstale":"2024-04-26T23:45:33.690062+0000","last_undegraded":"2024-04-26T23:45:33.690062+0000","last_fullsized":"2024-04-26T23:45:33.690062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:27.177803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757662+0000","last_change":"2024-04-26T23:45:32.689403+0000","last_active":"2024-04-26T23:45:33.757662+0000","last_peered":"2024-04-26T23:45:33.757662+0000","last_clean":"2024-04-26T23:45:33.757662+0000","last_became_active":"2024-04-26T23:45:32.689107+0000","last_became_peered":"2024-04-26T23:45:32.689107+0000","last_unstale":"2024-04-26T23:45:33.757662+0000","last_undegraded":"2024-04-26T23:45:33.757662+0000","last_fullsized":"2024-04-26T23:45:33.757662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697287+0000","last_change":"2024-04-26T23:45:32.686927+0000","last_active":"2024-04-26T23:45:32.697287+0000","last_peered":"2024-04-26T23:45:32.697287+0000","last_clean":"2024-04-26T23:45:32.697287+0000","last_became_active":"2024-04-26T23:45:32.686599+0000","last_became_peered":"2024-04-26T23:45:32.686599+0000","last_unstale":"2024-04-26T23:45:32.697287+0000","last_undegraded":"2024-04-26T23:45:32.697287+0000","last_fullsized":"2024-04-26T23:45:32.697287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:25:27.697467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695791+0000","last_change":"2024-04-26T23:45:32.695206+0000","last_active":"2024-04-26T23:45:33.695791+0000","last_peered":"2024-04-26T23:45:33.695791+0000","last_clean":"2024-04-26T23:45:33.695791+0000","last_became_active":"2024-04-26T23:45:32.694923+0000","last_became_peered":"2024-04-26T23:45:32.694923+0000","last_unstale":"2024-04-26T23:45:33.695791+0000","last_undegraded":"2024-04-26T23:45:33.695791+0000","last_fullsized":"2024-04-26T23:45:33.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690353+0000","last_change":"2024-04-26T23:45:32.686596+0000","last_active":"2024-04-26T23:45:33.690353+0000","last_peered":"2024-04-26T23:45:33.690353+0000","last_clean":"2024-04-26T23:45:33.690353+0000","last_became_active":"2024-04-26T23:45:32.686298+0000","last_became_peered":"2024-04-26T23:45:32.686298+0000","last_unstale":"2024-04-26T23:45:33.690353+0000","last_undegraded":"2024-04-26T23:45:33.690353+0000","last_fullsized":"2024-04-26T23:45:33.690353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691470+0000","last_change":"2024-04-26T23:45:32.699393+0000","last_active":"2024-04-26T23:45:33.691470+0000","last_peered":"2024-04-26T23:45:33.691470+0000","last_clean":"2024-04-26T23:45:33.691470+0000","last_became_active":"2024-04-26T23:45:32.698747+0000","last_became_peered":"2024-04-26T23:45:32.698747+0000","last_unstale":"2024-04-26T23:45:33.691470+0000","last_undegraded":"2024-04-26T23:45:33.691470+0000","last_fullsized":"2024-04-26T23:45:33.691470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:32.702144+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:32.701834+0000","last_became_peered":"2024-04-26T23:45:32.701834+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:51.260148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757314+0000","last_change":"2024-04-26T23:45:32.678816+0000","last_active":"2024-04-26T23:45:33.757314+0000","last_peered":"2024-04-26T23:45:33.757314+0000","last_clean":"2024-04-26T23:45:33.757314+0000","last_became_active":"2024-04-26T23:45:32.678510+0000","last_became_peered":"2024-04-26T23:45:32.678510+0000","last_unstale":"2024-04-26T23:45:33.757314+0000","last_undegraded":"2024-04-26T23:45:33.757314+0000","last_fullsized":"2024-04-26T23:45:33.757314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698396+0000","last_change":"2024-04-26T23:45:32.713741+0000","last_active":"2024-04-26T23:45:33.698396+0000","last_peered":"2024-04-26T23:45:33.698396+0000","last_clean":"2024-04-26T23:45:33.698396+0000","last_became_active":"2024-04-26T23:45:32.713326+0000","last_became_peered":"2024-04-26T23:45:32.713326+0000","last_unstale":"2024-04-26T23:45:33.698396+0000","last_undegraded":"2024-04-26T23:45:33.698396+0000","last_fullsized":"2024-04-26T23:45:33.698396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697225+0000","last_change":"2024-04-26T23:45:32.685874+0000","last_active":"2024-04-26T23:45:32.697225+0000","last_peered":"2024-04-26T23:45:32.697225+0000","last_clean":"2024-04-26T23:45:32.697225+0000","last_became_active":"2024-04-26T23:45:32.685622+0000","last_became_peered":"2024-04-26T23:45:32.685622+0000","last_unstale":"2024-04-26T23:45:32.697225+0000","last_undegraded":"2024-04-26T23:45:32.697225+0000","last_fullsized":"2024-04-26T23:45:32.697225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:25.046528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691119+0000","last_change":"2024-04-26T23:45:32.699326+0000","last_active":"2024-04-26T23:45:33.691119+0000","last_peered":"2024-04-26T23:45:33.691119+0000","last_clean":"2024-04-26T23:45:33.691119+0000","last_became_active":"2024-04-26T23:45:32.698859+0000","last_became_peered":"2024-04-26T23:45:32.698859+0000","last_unstale":"2024-04-26T23:45:33.691119+0000","last_undegraded":"2024-04-26T23:45:33.691119+0000","last_fullsized":"2024-04-26T23:45:33.691119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756772+0000","last_change":"2024-04-26T23:45:32.695396+0000","last_active":"2024-04-26T23:45:33.756772+0000","last_peered":"2024-04-26T23:45:33.756772+0000","last_clean":"2024-04-26T23:45:33.756772+0000","last_became_active":"2024-04-26T23:45:32.694937+0000","last_became_peered":"2024-04-26T23:45:32.694937+0000","last_unstale":"2024-04-26T23:45:33.756772+0000","last_undegraded":"2024-04-26T23:45:33.756772+0000","last_fullsized":"2024-04-26T23:45:33.756772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690363+0000","last_change":"2024-04-26T23:45:32.679737+0000","last_active":"2024-04-26T23:45:33.690363+0000","last_peered":"2024-04-26T23:45:33.690363+0000","last_clean":"2024-04-26T23:45:33.690363+0000","last_became_active":"2024-04-26T23:45:32.679405+0000","last_became_peered":"2024-04-26T23:45:32.679405+0000","last_unstale":"2024-04-26T23:45:33.690363+0000","last_undegraded":"2024-04-26T23:45:33.690363+0000","last_fullsized":"2024-04-26T23:45:33.690363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758147+0000","last_change":"2024-04-26T23:45:32.695857+0000","last_active":"2024-04-26T23:45:33.758147+0000","last_peered":"2024-04-26T23:45:33.758147+0000","last_clean":"2024-04-26T23:45:33.758147+0000","last_became_active":"2024-04-26T23:45:32.695514+0000","last_became_peered":"2024-04-26T23:45:32.695514+0000","last_unstale":"2024-04-26T23:45:33.758147+0000","last_undegraded":"2024-04-26T23:45:33.758147+0000","last_fullsized":"2024-04-26T23:45:33.758147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698737+0000","last_change":"2024-04-26T23:45:32.708627+0000","last_active":"2024-04-26T23:45:33.698737+0000","last_peered":"2024-04-26T23:45:33.698737+0000","last_clean":"2024-04-26T23:45:33.698737+0000","last_became_active":"2024-04-26T23:45:32.708302+0000","last_became_peered":"2024-04-26T23:45:32.708302+0000","last_unstale":"2024-04-26T23:45:33.698737+0000","last_undegraded":"2024-04-26T23:45:33.698737+0000","last_fullsized":"2024-04-26T23:45:33.698737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695912+0000","last_change":"2024-04-26T23:45:32.689802+0000","last_active":"2024-04-26T23:45:33.695912+0000","last_peered":"2024-04-26T23:45:33.695912+0000","last_clean":"2024-04-26T23:45:33.695912+0000","last_became_active":"2024-04-26T23:45:32.689443+0000","last_became_peered":"2024-04-26T23:45:32.689443+0000","last_unstale":"2024-04-26T23:45:33.695912+0000","last_undegraded":"2024-04-26T23:45:33.695912+0000","last_fullsized":"2024-04-26T23:45:33.695912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757503+0000","last_change":"2024-04-26T23:45:32.713348+0000","last_active":"2024-04-26T23:45:33.757503+0000","last_peered":"2024-04-26T23:45:33.757503+0000","last_clean":"2024-04-26T23:45:33.757503+0000","last_became_active":"2024-04-26T23:45:32.712789+0000","last_became_peered":"2024-04-26T23:45:32.712789+0000","last_unstale":"2024-04-26T23:45:33.757503+0000","last_undegraded":"2024-04-26T23:45:33.757503+0000","last_fullsized":"2024-04-26T23:45:33.757503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.699286+0000","last_change":"2024-04-26T23:45:32.692031+0000","last_active":"2024-04-26T23:45:32.699286+0000","last_peered":"2024-04-26T23:45:32.699286+0000","last_clean":"2024-04-26T23:45:32.699286+0000","last_became_active":"2024-04-26T23:45:32.691740+0000","last_became_peered":"2024-04-26T23:45:32.691740+0000","last_unstale":"2024-04-26T23:45:32.699286+0000","last_undegraded":"2024-04-26T23:45:32.699286+0000","last_fullsized":"2024-04-26T23:45:32.699286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:22:29.825967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690742+0000","last_change":"2024-04-26T23:45:32.683420+0000","last_active":"2024-04-26T23:45:33.690742+0000","last_peered":"2024-04-26T23:45:33.690742+0000","last_clean":"2024-04-26T23:45:33.690742+0000","last_became_active":"2024-04-26T23:45:32.683079+0000","last_became_peered":"2024-04-26T23:45:32.683079+0000","last_unstale":"2024-04-26T23:45:33.690742+0000","last_undegraded":"2024-04-26T23:45:33.690742+0000","last_fullsized":"2024-04-26T23:45:33.690742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688083+0000","last_change":"2024-04-26T23:45:32.686223+0000","last_active":"2024-04-26T23:45:33.688083+0000","last_peered":"2024-04-26T23:45:33.688083+0000","last_clean":"2024-04-26T23:45:33.688083+0000","last_became_active":"2024-04-26T23:45:32.685930+0000","last_became_peered":"2024-04-26T23:45:32.685930+0000","last_unstale":"2024-04-26T23:45:33.688083+0000","last_undegraded":"2024-04-26T23:45:33.688083+0000","last_fullsized":"2024-04-26T23:45:33.688083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698368+0000","last_change":"2024-04-26T23:45:32.691705+0000","last_active":"2024-04-26T23:45:33.698368+0000","last_peered":"2024-04-26T23:45:33.698368+0000","last_clean":"2024-04-26T23:45:33.698368+0000","last_became_active":"2024-04-26T23:45:32.691423+0000","last_became_peered":"2024-04-26T23:45:32.691423+0000","last_unstale":"2024-04-26T23:45:33.698368+0000","last_undegraded":"2024-04-26T23:45:33.698368+0000","last_fullsized":"2024-04-26T23:45:33.698368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689572+0000","last_change":"2024-04-26T23:45:32.700367+0000","last_active":"2024-04-26T23:45:33.689572+0000","last_peered":"2024-04-26T23:45:33.689572+0000","last_clean":"2024-04-26T23:45:33.689572+0000","last_became_active":"2024-04-26T23:45:32.699940+0000","last_became_peered":"2024-04-26T23:45:32.699940+0000","last_unstale":"2024-04-26T23:45:33.689572+0000","last_undegraded":"2024-04-26T23:45:33.689572+0000","last_fullsized":"2024-04-26T23:45:33.689572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:36.201832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757768+0000","last_change":"2024-04-26T23:45:31.686196+0000","last_active":"2024-04-26T23:45:33.757768+0000","last_peered":"2024-04-26T23:45:33.757768+0000","last_clean":"2024-04-26T23:45:33.757768+0000","last_became_active":"2024-04-26T23:45:31.684117+0000","last_became_peered":"2024-04-26T23:45:31.684117+0000","last_unstale":"2024-04-26T23:45:33.757768+0000","last_undegraded":"2024-04-26T23:45:33.757768+0000","last_fullsized":"2024-04-26T23:45:33.757768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.699312+0000","last_change":"2024-04-26T23:45:32.696579+0000","last_active":"2024-04-26T23:45:32.699312+0000","last_peered":"2024-04-26T23:45:32.699312+0000","last_clean":"2024-04-26T23:45:32.699312+0000","last_became_active":"2024-04-26T23:45:32.696347+0000","last_became_peered":"2024-04-26T23:45:32.696347+0000","last_unstale":"2024-04-26T23:45:32.699312+0000","last_undegraded":"2024-04-26T23:45:32.699312+0000","last_fullsized":"2024-04-26T23:45:32.699312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:31.081233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698348+0000","last_change":"2024-04-26T23:45:31.693352+0000","last_active":"2024-04-26T23:45:33.698348+0000","last_peered":"2024-04-26T23:45:33.698348+0000","last_clean":"2024-04-26T23:45:33.698348+0000","last_became_active":"2024-04-26T23:45:31.693085+0000","last_became_peered":"2024-04-26T23:45:31.693085+0000","last_unstale":"2024-04-26T23:45:33.698348+0000","last_undegraded":"2024-04-26T23:45:33.698348+0000","last_fullsized":"2024-04-26T23:45:33.698348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756910+0000","last_change":"2024-04-26T23:45:31.691825+0000","last_active":"2024-04-26T23:45:33.756910+0000","last_peered":"2024-04-26T23:45:33.756910+0000","last_clean":"2024-04-26T23:45:33.756910+0000","last_became_active":"2024-04-26T23:45:31.691522+0000","last_became_peered":"2024-04-26T23:45:31.691522+0000","last_unstale":"2024-04-26T23:45:33.756910+0000","last_undegraded":"2024-04-26T23:45:33.756910+0000","last_fullsized":"2024-04-26T23:45:33.756910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756733+0000","last_change":"2024-04-26T23:45:32.689899+0000","last_active":"2024-04-26T23:45:33.756733+0000","last_peered":"2024-04-26T23:45:33.756733+0000","last_clean":"2024-04-26T23:45:33.756733+0000","last_became_active":"2024-04-26T23:45:32.689083+0000","last_became_peered":"2024-04-26T23:45:32.689083+0000","last_unstale":"2024-04-26T23:45:33.756733+0000","last_undegraded":"2024-04-26T23:45:33.756733+0000","last_fullsized":"2024-04-26T23:45:33.756733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690450+0000","last_change":"2024-04-26T23:45:31.692320+0000","last_active":"2024-04-26T23:45:33.690450+0000","last_peered":"2024-04-26T23:45:33.690450+0000","last_clean":"2024-04-26T23:45:33.690450+0000","last_became_active":"2024-04-26T23:45:31.691944+0000","last_became_peered":"2024-04-26T23:45:31.691944+0000","last_unstale":"2024-04-26T23:45:33.690450+0000","last_undegraded":"2024-04-26T23:45:33.690450+0000","last_fullsized":"2024-04-26T23:45:33.690450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695652+0000","last_change":"2024-04-26T23:45:32.684023+0000","last_active":"2024-04-26T23:45:33.695652+0000","last_peered":"2024-04-26T23:45:33.695652+0000","last_clean":"2024-04-26T23:45:33.695652+0000","last_became_active":"2024-04-26T23:45:32.683745+0000","last_became_peered":"2024-04-26T23:45:32.683745+0000","last_unstale":"2024-04-26T23:45:33.695652+0000","last_undegraded":"2024-04-26T23:45:33.695652+0000","last_fullsized":"2024-04-26T23:45:33.695652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698580+0000","last_change":"2024-04-26T23:45:31.690903+0000","last_active":"2024-04-26T23:45:33.698580+0000","last_peered":"2024-04-26T23:45:33.698580+0000","last_clean":"2024-04-26T23:45:33.698580+0000","last_became_active":"2024-04-26T23:45:31.690629+0000","last_became_peered":"2024-04-26T23:45:31.690629+0000","last_unstale":"2024-04-26T23:45:33.698580+0000","last_undegraded":"2024-04-26T23:45:33.698580+0000","last_fullsized":"2024-04-26T23:45:33.698580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690804+0000","last_change":"2024-04-26T23:45:32.682423+0000","last_active":"2024-04-26T23:45:33.690804+0000","last_peered":"2024-04-26T23:45:33.690804+0000","last_clean":"2024-04-26T23:45:33.690804+0000","last_became_active":"2024-04-26T23:45:32.681951+0000","last_became_peered":"2024-04-26T23:45:32.681951+0000","last_unstale":"2024-04-26T23:45:33.690804+0000","last_undegraded":"2024-04-26T23:45:33.690804+0000","last_fullsized":"2024-04-26T23:45:33.690804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690911+0000","last_change":"2024-04-26T23:45:31.684823+0000","last_active":"2024-04-26T23:45:33.690911+0000","last_peered":"2024-04-26T23:45:33.690911+0000","last_clean":"2024-04-26T23:45:33.690911+0000","last_became_active":"2024-04-26T23:45:31.683574+0000","last_became_peered":"2024-04-26T23:45:31.683574+0000","last_unstale":"2024-04-26T23:45:33.690911+0000","last_undegraded":"2024-04-26T23:45:33.690911+0000","last_fullsized":"2024-04-26T23:45:33.690911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697549+0000","last_change":"2024-04-26T23:45:32.691935+0000","last_active":"2024-04-26T23:45:32.697549+0000","last_peered":"2024-04-26T23:45:32.697549+0000","last_clean":"2024-04-26T23:45:32.697549+0000","last_became_active":"2024-04-26T23:45:32.689093+0000","last_became_peered":"2024-04-26T23:45:32.689093+0000","last_unstale":"2024-04-26T23:45:32.697549+0000","last_undegraded":"2024-04-26T23:45:32.697549+0000","last_fullsized":"2024-04-26T23:45:32.697549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:01:03.808111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695925+0000","last_change":"2024-04-26T23:45:31.688692+0000","last_active":"2024-04-26T23:45:33.695925+0000","last_peered":"2024-04-26T23:45:33.695925+0000","last_clean":"2024-04-26T23:45:33.695925+0000","last_became_active":"2024-04-26T23:45:31.688404+0000","last_became_peered":"2024-04-26T23:45:31.688404+0000","last_unstale":"2024-04-26T23:45:33.695925+0000","last_undegraded":"2024-04-26T23:45:33.695925+0000","last_fullsized":"2024-04-26T23:45:33.695925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690095+0000","last_change":"2024-04-26T23:45:32.710489+0000","last_active":"2024-04-26T23:45:33.690095+0000","last_peered":"2024-04-26T23:45:33.690095+0000","last_clean":"2024-04-26T23:45:33.690095+0000","last_became_active":"2024-04-26T23:45:32.710118+0000","last_became_peered":"2024-04-26T23:45:32.710118+0000","last_unstale":"2024-04-26T23:45:33.690095+0000","last_undegraded":"2024-04-26T23:45:33.690095+0000","last_fullsized":"2024-04-26T23:45:33.690095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698383+0000","last_change":"2024-04-26T23:45:31.690291+0000","last_active":"2024-04-26T23:45:33.698383+0000","last_peered":"2024-04-26T23:45:33.698383+0000","last_clean":"2024-04-26T23:45:33.698383+0000","last_became_active":"2024-04-26T23:45:31.689915+0000","last_became_peered":"2024-04-26T23:45:31.689915+0000","last_unstale":"2024-04-26T23:45:33.698383+0000","last_undegraded":"2024-04-26T23:45:33.698383+0000","last_fullsized":"2024-04-26T23:45:33.698383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756995+0000","last_change":"2024-04-26T23:45:32.696754+0000","last_active":"2024-04-26T23:45:33.756995+0000","last_peered":"2024-04-26T23:45:33.756995+0000","last_clean":"2024-04-26T23:45:33.756995+0000","last_became_active":"2024-04-26T23:45:32.696500+0000","last_became_peered":"2024-04-26T23:45:32.696500+0000","last_unstale":"2024-04-26T23:45:33.756995+0000","last_undegraded":"2024-04-26T23:45:33.756995+0000","last_fullsized":"2024-04-26T23:45:33.756995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.720054+0000","last_change":"2024-04-26T23:45:31.687471+0000","last_active":"2024-04-26T23:45:32.720054+0000","last_peered":"2024-04-26T23:45:32.720054+0000","last_clean":"2024-04-26T23:45:32.720054+0000","last_became_active":"2024-04-26T23:45:31.687204+0000","last_became_peered":"2024-04-26T23:45:31.687204+0000","last_unstale":"2024-04-26T23:45:32.720054+0000","last_undegraded":"2024-04-26T23:45:32.720054+0000","last_fullsized":"2024-04-26T23:45:32.720054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:12.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.702060+0000","last_change":"2024-04-26T23:45:32.700954+0000","last_active":"2024-04-26T23:45:32.702060+0000","last_peered":"2024-04-26T23:45:32.702060+0000","last_clean":"2024-04-26T23:45:32.702060+0000","last_became_active":"2024-04-26T23:45:32.700376+0000","last_became_peered":"2024-04-26T23:45:32.700376+0000","last_unstale":"2024-04-26T23:45:32.702060+0000","last_undegraded":"2024-04-26T23:45:32.702060+0000","last_fullsized":"2024-04-26T23:45:32.702060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:15.761551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691010+0000","last_change":"2024-04-26T23:45:31.690145+0000","last_active":"2024-04-26T23:45:33.691010+0000","last_peered":"2024-04-26T23:45:33.691010+0000","last_clean":"2024-04-26T23:45:33.691010+0000","last_became_active":"2024-04-26T23:45:31.687880+0000","last_became_peered":"2024-04-26T23:45:31.687880+0000","last_unstale":"2024-04-26T23:45:33.691010+0000","last_undegraded":"2024-04-26T23:45:33.691010+0000","last_fullsized":"2024-04-26T23:45:33.691010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757106+0000","last_change":"2024-04-26T23:45:32.695003+0000","last_active":"2024-04-26T23:45:33.757106+0000","last_peered":"2024-04-26T23:45:33.757106+0000","last_clean":"2024-04-26T23:45:33.757106+0000","last_became_active":"2024-04-26T23:45:32.694696+0000","last_became_peered":"2024-04-26T23:45:32.694696+0000","last_unstale":"2024-04-26T23:45:33.757106+0000","last_undegraded":"2024-04-26T23:45:33.757106+0000","last_fullsized":"2024-04-26T23:45:33.757106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698210+0000","last_change":"2024-04-26T23:45:31.694794+0000","last_active":"2024-04-26T23:45:33.698210+0000","last_peered":"2024-04-26T23:45:33.698210+0000","last_clean":"2024-04-26T23:45:33.698210+0000","last_became_active":"2024-04-26T23:45:31.694518+0000","last_became_peered":"2024-04-26T23:45:31.694518+0000","last_unstale":"2024-04-26T23:45:33.698210+0000","last_undegraded":"2024-04-26T23:45:33.698210+0000","last_fullsized":"2024-04-26T23:45:33.698210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698297+0000","last_change":"2024-04-26T23:45:32.691704+0000","last_active":"2024-04-26T23:45:33.698297+0000","last_peered":"2024-04-26T23:45:33.698297+0000","last_clean":"2024-04-26T23:45:33.698297+0000","last_became_active":"2024-04-26T23:45:32.691125+0000","last_became_peered":"2024-04-26T23:45:32.691125+0000","last_unstale":"2024-04-26T23:45:33.698297+0000","last_undegraded":"2024-04-26T23:45:33.698297+0000","last_fullsized":"2024-04-26T23:45:33.698297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:00.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688028+0000","last_change":"2024-04-26T23:45:31.677038+0000","last_active":"2024-04-26T23:45:33.688028+0000","last_peered":"2024-04-26T23:45:33.688028+0000","last_clean":"2024-04-26T23:45:33.688028+0000","last_became_active":"2024-04-26T23:45:31.676478+0000","last_became_peered":"2024-04-26T23:45:31.676478+0000","last_unstale":"2024-04-26T23:45:33.688028+0000","last_undegraded":"2024-04-26T23:45:33.688028+0000","last_fullsized":"2024-04-26T23:45:33.688028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756712+0000","last_change":"2024-04-26T23:45:32.693504+0000","last_active":"2024-04-26T23:45:33.756712+0000","last_peered":"2024-04-26T23:45:33.756712+0000","last_clean":"2024-04-26T23:45:33.756712+0000","last_became_active":"2024-04-26T23:45:32.693245+0000","last_became_peered":"2024-04-26T23:45:32.693245+0000","last_unstale":"2024-04-26T23:45:33.756712+0000","last_undegraded":"2024-04-26T23:45:33.756712+0000","last_fullsized":"2024-04-26T23:45:33.756712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689885+0000","last_change":"2024-04-26T23:45:31.686918+0000","last_active":"2024-04-26T23:45:33.689885+0000","last_peered":"2024-04-26T23:45:33.689885+0000","last_clean":"2024-04-26T23:45:33.689885+0000","last_became_active":"2024-04-26T23:45:31.686544+0000","last_became_peered":"2024-04-26T23:45:31.686544+0000","last_unstale":"2024-04-26T23:45:33.689885+0000","last_undegraded":"2024-04-26T23:45:33.689885+0000","last_fullsized":"2024-04-26T23:45:33.689885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:20:37.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757297+0000","last_change":"2024-04-26T23:45:32.713893+0000","last_active":"2024-04-26T23:45:33.757297+0000","last_peered":"2024-04-26T23:45:33.757297+0000","last_clean":"2024-04-26T23:45:33.757297+0000","last_became_active":"2024-04-26T23:45:32.713714+0000","last_became_peered":"2024-04-26T23:45:32.713714+0000","last_unstale":"2024-04-26T23:45:33.757297+0000","last_undegraded":"2024-04-26T23:45:33.757297+0000","last_fullsized":"2024-04-26T23:45:33.757297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:31.686652+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:31.686359+0000","last_became_peered":"2024-04-26T23:45:31.686359+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757524+0000","last_change":"2024-04-26T23:45:32.711891+0000","last_active":"2024-04-26T23:45:33.757524+0000","last_peered":"2024-04-26T23:45:33.757524+0000","last_clean":"2024-04-26T23:45:33.757524+0000","last_became_active":"2024-04-26T23:45:32.708109+0000","last_became_peered":"2024-04-26T23:45:32.708109+0000","last_unstale":"2024-04-26T23:45:33.757524+0000","last_undegraded":"2024-04-26T23:45:33.757524+0000","last_fullsized":"2024-04-26T23:45:33.757524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:23.840152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.696007+0000","last_change":"2024-04-26T23:45:31.689003+0000","last_active":"2024-04-26T23:45:33.696007+0000","last_peered":"2024-04-26T23:45:33.696007+0000","last_clean":"2024-04-26T23:45:33.696007+0000","last_became_active":"2024-04-26T23:45:31.688719+0000","last_became_peered":"2024-04-26T23:45:31.688719+0000","last_unstale":"2024-04-26T23:45:33.696007+0000","last_undegraded":"2024-04-26T23:45:33.696007+0000","last_fullsized":"2024-04-26T23:45:33.696007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690968+0000","last_change":"2024-04-26T23:45:32.682148+0000","last_active":"2024-04-26T23:45:33.690968+0000","last_peered":"2024-04-26T23:45:33.690968+0000","last_clean":"2024-04-26T23:45:33.690968+0000","last_became_active":"2024-04-26T23:45:32.681387+0000","last_became_peered":"2024-04-26T23:45:32.681387+0000","last_unstale":"2024-04-26T23:45:33.690968+0000","last_undegraded":"2024-04-26T23:45:33.690968+0000","last_fullsized":"2024-04-26T23:45:33.690968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688270+0000","last_change":"2024-04-26T23:45:31.693411+0000","last_active":"2024-04-26T23:45:33.688270+0000","last_peered":"2024-04-26T23:45:33.688270+0000","last_clean":"2024-04-26T23:45:33.688270+0000","last_became_active":"2024-04-26T23:45:31.693004+0000","last_became_peered":"2024-04-26T23:45:31.693004+0000","last_unstale":"2024-04-26T23:45:33.688270+0000","last_undegraded":"2024-04-26T23:45:33.688270+0000","last_fullsized":"2024-04-26T23:45:33.688270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757215+0000","last_change":"2024-04-26T23:45:32.680577+0000","last_active":"2024-04-26T23:45:33.757215+0000","last_peered":"2024-04-26T23:45:33.757215+0000","last_clean":"2024-04-26T23:45:33.757215+0000","last_became_active":"2024-04-26T23:45:32.680225+0000","last_became_peered":"2024-04-26T23:45:32.680225+0000","last_unstale":"2024-04-26T23:45:33.757215+0000","last_undegraded":"2024-04-26T23:45:33.757215+0000","last_fullsized":"2024-04-26T23:45:33.757215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756646+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:45:33.756646+0000","last_peered":"2024-04-26T23:45:33.756646+0000","last_clean":"2024-04-26T23:45:33.756646+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:45:33.756646+0000","last_undegraded":"2024-04-26T23:45:33.756646+0000","last_fullsized":"2024-04-26T23:45:33.756646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690400+0000","last_change":"2024-04-26T23:45:31.679166+0000","last_active":"2024-04-26T23:45:33.690400+0000","last_peered":"2024-04-26T23:45:33.690400+0000","last_clean":"2024-04-26T23:45:33.690400+0000","last_became_active":"2024-04-26T23:45:31.678173+0000","last_became_peered":"2024-04-26T23:45:31.678173+0000","last_unstale":"2024-04-26T23:45:33.690400+0000","last_undegraded":"2024-04-26T23:45:33.690400+0000","last_fullsized":"2024-04-26T23:45:33.690400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756798+0000","last_change":"2024-04-26T23:45:32.681749+0000","last_active":"2024-04-26T23:45:33.756798+0000","last_peered":"2024-04-26T23:45:33.756798+0000","last_clean":"2024-04-26T23:45:33.756798+0000","last_became_active":"2024-04-26T23:45:32.680979+0000","last_became_peered":"2024-04-26T23:45:32.680979+0000","last_unstale":"2024-04-26T23:45:33.756798+0000","last_undegraded":"2024-04-26T23:45:33.756798+0000","last_fullsized":"2024-04-26T23:45:33.756798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756606+0000","last_change":"2024-04-26T23:45:31.692253+0000","last_active":"2024-04-26T23:45:33.756606+0000","last_peered":"2024-04-26T23:45:33.756606+0000","last_clean":"2024-04-26T23:45:33.756606+0000","last_became_active":"2024-04-26T23:45:31.691948+0000","last_became_peered":"2024-04-26T23:45:31.691948+0000","last_unstale":"2024-04-26T23:45:33.756606+0000","last_undegraded":"2024-04-26T23:45:33.756606+0000","last_fullsized":"2024-04-26T23:45:33.756606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.700132+0000","last_change":"2024-04-26T23:45:32.696469+0000","last_active":"2024-04-26T23:45:32.700132+0000","last_peered":"2024-04-26T23:45:32.700132+0000","last_clean":"2024-04-26T23:45:32.700132+0000","last_became_active":"2024-04-26T23:45:32.696085+0000","last_became_peered":"2024-04-26T23:45:32.696085+0000","last_unstale":"2024-04-26T23:45:32.700132+0000","last_undegraded":"2024-04-26T23:45:32.700132+0000","last_fullsized":"2024-04-26T23:45:32.700132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:26:38.224401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688081+0000","last_change":"2024-04-26T23:45:31.686617+0000","last_active":"2024-04-26T23:45:33.688081+0000","last_peered":"2024-04-26T23:45:33.688081+0000","last_clean":"2024-04-26T23:45:33.688081+0000","last_became_active":"2024-04-26T23:45:31.686298+0000","last_became_peered":"2024-04-26T23:45:31.686298+0000","last_unstale":"2024-04-26T23:45:33.688081+0000","last_undegraded":"2024-04-26T23:45:33.688081+0000","last_fullsized":"2024-04-26T23:45:33.688081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695716+0000","last_change":"2024-04-26T23:45:32.679648+0000","last_active":"2024-04-26T23:45:33.695716+0000","last_peered":"2024-04-26T23:45:33.695716+0000","last_clean":"2024-04-26T23:45:33.695716+0000","last_became_active":"2024-04-26T23:45:32.678533+0000","last_became_peered":"2024-04-26T23:45:32.678533+0000","last_unstale":"2024-04-26T23:45:33.695716+0000","last_undegraded":"2024-04-26T23:45:33.695716+0000","last_fullsized":"2024-04-26T23:45:33.695716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691096+0000","last_change":"2024-04-26T23:45:31.681850+0000","last_active":"2024-04-26T23:45:33.691096+0000","last_peered":"2024-04-26T23:45:33.691096+0000","last_clean":"2024-04-26T23:45:33.691096+0000","last_became_active":"2024-04-26T23:45:31.679810+0000","last_became_peered":"2024-04-26T23:45:31.679810+0000","last_unstale":"2024-04-26T23:45:33.691096+0000","last_undegraded":"2024-04-26T23:45:33.691096+0000","last_fullsized":"2024-04-26T23:45:33.691096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689831+0000","last_change":"2024-04-26T23:45:32.710524+0000","last_active":"2024-04-26T23:45:33.689831+0000","last_peered":"2024-04-26T23:45:33.689831+0000","last_clean":"2024-04-26T23:45:33.689831+0000","last_became_active":"2024-04-26T23:45:32.703378+0000","last_became_peered":"2024-04-26T23:45:32.703378+0000","last_unstale":"2024-04-26T23:45:33.689831+0000","last_undegraded":"2024-04-26T23:45:33.689831+0000","last_fullsized":"2024-04-26T23:45:33.689831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:22.939348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695838+0000","last_change":"2024-04-26T23:45:31.681707+0000","last_active":"2024-04-26T23:45:33.695838+0000","last_peered":"2024-04-26T23:45:33.695838+0000","last_clean":"2024-04-26T23:45:33.695838+0000","last_became_active":"2024-04-26T23:45:31.681452+0000","last_became_peered":"2024-04-26T23:45:31.681452+0000","last_unstale":"2024-04-26T23:45:33.695838+0000","last_undegraded":"2024-04-26T23:45:33.695838+0000","last_fullsized":"2024-04-26T23:45:33.695838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690997+0000","last_change":"2024-04-26T23:45:32.690629+0000","last_active":"2024-04-26T23:45:33.690997+0000","last_peered":"2024-04-26T23:45:33.690997+0000","last_clean":"2024-04-26T23:45:33.690997+0000","last_became_active":"2024-04-26T23:45:32.690208+0000","last_became_peered":"2024-04-26T23:45:32.690208+0000","last_unstale":"2024-04-26T23:45:33.690997+0000","last_undegraded":"2024-04-26T23:45:33.690997+0000","last_fullsized":"2024-04-26T23:45:33.690997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757330+0000","last_change":"2024-04-26T23:45:31.693759+0000","last_active":"2024-04-26T23:45:33.757330+0000","last_peered":"2024-04-26T23:45:33.757330+0000","last_clean":"2024-04-26T23:45:33.757330+0000","last_became_active":"2024-04-26T23:45:31.693396+0000","last_became_peered":"2024-04-26T23:45:31.693396+0000","last_unstale":"2024-04-26T23:45:33.757330+0000","last_undegraded":"2024-04-26T23:45:33.757330+0000","last_fullsized":"2024-04-26T23:45:33.757330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:47.961582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695802+0000","last_change":"2024-04-26T23:45:32.679402+0000","last_active":"2024-04-26T23:45:33.695802+0000","last_peered":"2024-04-26T23:45:33.695802+0000","last_clean":"2024-04-26T23:45:33.695802+0000","last_became_active":"2024-04-26T23:45:32.678906+0000","last_became_peered":"2024-04-26T23:45:32.678906+0000","last_unstale":"2024-04-26T23:45:33.695802+0000","last_undegraded":"2024-04-26T23:45:33.695802+0000","last_fullsized":"2024-04-26T23:45:33.695802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.697710+0000","last_change":"2024-04-26T23:45:31.682989+0000","last_active":"2024-04-26T23:45:33.697710+0000","last_peered":"2024-04-26T23:45:33.697710+0000","last_clean":"2024-04-26T23:45:33.697710+0000","last_became_active":"2024-04-26T23:45:31.682706+0000","last_became_peered":"2024-04-26T23:45:31.682706+0000","last_unstale":"2024-04-26T23:45:33.697710+0000","last_undegraded":"2024-04-26T23:45:33.697710+0000","last_fullsized":"2024-04-26T23:45:33.697710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758153+0000","last_change":"2024-04-26T23:45:32.705019+0000","last_active":"2024-04-26T23:45:33.758153+0000","last_peered":"2024-04-26T23:45:33.758153+0000","last_clean":"2024-04-26T23:45:33.758153+0000","last_became_active":"2024-04-26T23:45:32.704605+0000","last_became_peered":"2024-04-26T23:45:32.704605+0000","last_unstale":"2024-04-26T23:45:33.758153+0000","last_undegraded":"2024-04-26T23:45:33.758153+0000","last_fullsized":"2024-04-26T23:45:33.758153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698690+0000","last_change":"2024-04-26T23:45:31.687021+0000","last_active":"2024-04-26T23:45:33.698690+0000","last_peered":"2024-04-26T23:45:33.698690+0000","last_clean":"2024-04-26T23:45:33.698690+0000","last_became_active":"2024-04-26T23:45:31.686729+0000","last_became_peered":"2024-04-26T23:45:31.686729+0000","last_unstale":"2024-04-26T23:45:33.698690+0000","last_undegraded":"2024-04-26T23:45:33.698690+0000","last_fullsized":"2024-04-26T23:45:33.698690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697422+0000","last_change":"2024-04-26T23:45:32.691521+0000","last_active":"2024-04-26T23:45:32.697422+0000","last_peered":"2024-04-26T23:45:32.697422+0000","last_clean":"2024-04-26T23:45:32.697422+0000","last_became_active":"2024-04-26T23:45:32.689417+0000","last_became_peered":"2024-04-26T23:45:32.689417+0000","last_unstale":"2024-04-26T23:45:32.697422+0000","last_undegraded":"2024-04-26T23:45:32.697422+0000","last_fullsized":"2024-04-26T23:45:32.697422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:12:17.717158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756573+0000","last_change":"2024-04-26T23:45:31.688837+0000","last_active":"2024-04-26T23:45:33.756573+0000","last_peered":"2024-04-26T23:45:33.756573+0000","last_clean":"2024-04-26T23:45:33.756573+0000","last_became_active":"2024-04-26T23:45:31.688197+0000","last_became_peered":"2024-04-26T23:45:31.688197+0000","last_unstale":"2024-04-26T23:45:33.756573+0000","last_undegraded":"2024-04-26T23:45:33.756573+0000","last_fullsized":"2024-04-26T23:45:33.756573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689758+0000","last_change":"2024-04-26T23:45:32.711123+0000","last_active":"2024-04-26T23:45:33.689758+0000","last_peered":"2024-04-26T23:45:33.689758+0000","last_clean":"2024-04-26T23:45:33.689758+0000","last_became_active":"2024-04-26T23:45:32.710879+0000","last_became_peered":"2024-04-26T23:45:32.710879+0000","last_unstale":"2024-04-26T23:45:33.689758+0000","last_undegraded":"2024-04-26T23:45:33.689758+0000","last_fullsized":"2024-04-26T23:45:33.689758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:48.052853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695742+0000","last_change":"2024-04-26T23:45:31.681304+0000","last_active":"2024-04-26T23:45:33.695742+0000","last_peered":"2024-04-26T23:45:33.695742+0000","last_clean":"2024-04-26T23:45:33.695742+0000","last_became_active":"2024-04-26T23:45:31.681010+0000","last_became_peered":"2024-04-26T23:45:31.681010+0000","last_unstale":"2024-04-26T23:45:33.695742+0000","last_undegraded":"2024-04-26T23:45:33.695742+0000","last_fullsized":"2024-04-26T23:45:33.695742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756926+0000","last_change":"2024-04-26T23:45:32.684124+0000","last_active":"2024-04-26T23:45:33.756926+0000","last_peered":"2024-04-26T23:45:33.756926+0000","last_clean":"2024-04-26T23:45:33.756926+0000","last_became_active":"2024-04-26T23:45:32.683833+0000","last_became_peered":"2024-04-26T23:45:32.683833+0000","last_unstale":"2024-04-26T23:45:33.756926+0000","last_undegraded":"2024-04-26T23:45:33.756926+0000","last_fullsized":"2024-04-26T23:45:33.756926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695748+0000","last_change":"2024-04-26T23:45:31.686558+0000","last_active":"2024-04-26T23:45:33.695748+0000","last_peered":"2024-04-26T23:45:33.695748+0000","last_clean":"2024-04-26T23:45:33.695748+0000","last_became_active":"2024-04-26T23:45:31.686256+0000","last_became_peered":"2024-04-26T23:45:31.686256+0000","last_unstale":"2024-04-26T23:45:33.695748+0000","last_undegraded":"2024-04-26T23:45:33.695748+0000","last_fullsized":"2024-04-26T23:45:33.695748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757677+0000","last_change":"2024-04-26T23:45:32.693947+0000","last_active":"2024-04-26T23:45:33.757677+0000","last_peered":"2024-04-26T23:45:33.757677+0000","last_clean":"2024-04-26T23:45:33.757677+0000","last_became_active":"2024-04-26T23:45:32.693704+0000","last_became_peered":"2024-04-26T23:45:32.693704+0000","last_unstale":"2024-04-26T23:45:33.757677+0000","last_undegraded":"2024-04-26T23:45:33.757677+0000","last_fullsized":"2024-04-26T23:45:33.757677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757253+0000","last_change":"2024-04-26T23:45:31.694659+0000","last_active":"2024-04-26T23:45:33.757253+0000","last_peered":"2024-04-26T23:45:33.757253+0000","last_clean":"2024-04-26T23:45:33.757253+0000","last_became_active":"2024-04-26T23:45:31.694372+0000","last_became_peered":"2024-04-26T23:45:31.694372+0000","last_unstale":"2024-04-26T23:45:33.757253+0000","last_undegraded":"2024-04-26T23:45:33.757253+0000","last_fullsized":"2024-04-26T23:45:33.757253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698364+0000","last_change":"2024-04-26T23:45:32.696663+0000","last_active":"2024-04-26T23:45:33.698364+0000","last_peered":"2024-04-26T23:45:33.698364+0000","last_clean":"2024-04-26T23:45:33.698364+0000","last_became_active":"2024-04-26T23:45:32.696375+0000","last_became_peered":"2024-04-26T23:45:32.696375+0000","last_unstale":"2024-04-26T23:45:33.698364+0000","last_undegraded":"2024-04-26T23:45:33.698364+0000","last_fullsized":"2024-04-26T23:45:33.698364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690867+0000","last_change":"2024-04-26T23:45:32.700585+0000","last_active":"2024-04-26T23:45:33.690867+0000","last_peered":"2024-04-26T23:45:33.690867+0000","last_clean":"2024-04-26T23:45:33.690867+0000","last_became_active":"2024-04-26T23:45:32.699809+0000","last_became_peered":"2024-04-26T23:45:32.699809+0000","last_unstale":"2024-04-26T23:45:33.690867+0000","last_undegraded":"2024-04-26T23:45:33.690867+0000","last_fullsized":"2024-04-26T23:45:33.690867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757098+0000","last_change":"2024-04-26T23:45:31.692287+0000","last_active":"2024-04-26T23:45:33.757098+0000","last_peered":"2024-04-26T23:45:33.757098+0000","last_clean":"2024-04-26T23:45:33.757098+0000","last_became_active":"2024-04-26T23:45:31.691971+0000","last_became_peered":"2024-04-26T23:45:31.691971+0000","last_unstale":"2024-04-26T23:45:33.757098+0000","last_undegraded":"2024-04-26T23:45:33.757098+0000","last_fullsized":"2024-04-26T23:45:33.757098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690790+0000","last_change":"2024-04-26T23:45:32.713320+0000","last_active":"2024-04-26T23:45:33.690790+0000","last_peered":"2024-04-26T23:45:33.690790+0000","last_clean":"2024-04-26T23:45:33.690790+0000","last_became_active":"2024-04-26T23:45:32.713003+0000","last_became_peered":"2024-04-26T23:45:32.713003+0000","last_unstale":"2024-04-26T23:45:33.690790+0000","last_undegraded":"2024-04-26T23:45:33.690790+0000","last_fullsized":"2024-04-26T23:45:33.690790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757116+0000","last_change":"2024-04-26T23:45:31.696984+0000","last_active":"2024-04-26T23:45:33.757116+0000","last_peered":"2024-04-26T23:45:33.757116+0000","last_clean":"2024-04-26T23:45:33.757116+0000","last_became_active":"2024-04-26T23:45:31.696695+0000","last_became_peered":"2024-04-26T23:45:31.696695+0000","last_unstale":"2024-04-26T23:45:33.757116+0000","last_undegraded":"2024-04-26T23:45:33.757116+0000","last_fullsized":"2024-04-26T23:45:33.757116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.697404+0000","last_change":"2024-04-26T23:45:32.689960+0000","last_active":"2024-04-26T23:45:32.697404+0000","last_peered":"2024-04-26T23:45:32.697404+0000","last_clean":"2024-04-26T23:45:32.697404+0000","last_became_active":"2024-04-26T23:45:32.688270+0000","last_became_peered":"2024-04-26T23:45:32.688270+0000","last_unstale":"2024-04-26T23:45:32.697404+0000","last_undegraded":"2024-04-26T23:45:32.697404+0000","last_fullsized":"2024-04-26T23:45:32.697404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:25.573512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757915+0000","last_change":"2024-04-26T23:45:31.687488+0000","last_active":"2024-04-26T23:45:33.757915+0000","last_peered":"2024-04-26T23:45:33.757915+0000","last_clean":"2024-04-26T23:45:33.757915+0000","last_became_active":"2024-04-26T23:45:31.687025+0000","last_became_peered":"2024-04-26T23:45:31.687025+0000","last_unstale":"2024-04-26T23:45:33.757915+0000","last_undegraded":"2024-04-26T23:45:33.757915+0000","last_fullsized":"2024-04-26T23:45:33.757915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757776+0000","last_change":"2024-04-26T23:45:32.702678+0000","last_active":"2024-04-26T23:45:33.757776+0000","last_peered":"2024-04-26T23:45:33.757776+0000","last_clean":"2024-04-26T23:45:33.757776+0000","last_became_active":"2024-04-26T23:45:32.702293+0000","last_became_peered":"2024-04-26T23:45:32.702293+0000","last_unstale":"2024-04-26T23:45:33.757776+0000","last_undegraded":"2024-04-26T23:45:33.757776+0000","last_fullsized":"2024-04-26T23:45:33.757776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T23:45:32.717617+0000","last_change":"2024-04-26T23:45:31.690606+0000","last_active":"2024-04-26T23:45:32.717617+0000","last_peered":"2024-04-26T23:45:32.717617+0000","last_clean":"2024-04-26T23:45:32.717617+0000","last_became_active":"2024-04-26T23:45:31.690293+0000","last_became_peered":"2024-04-26T23:45:31.690293+0000","last_unstale":"2024-04-26T23:45:32.717617+0000","last_undegraded":"2024-04-26T23:45:32.717617+0000","last_fullsized":"2024-04-26T23:45:32.717617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.450816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":665605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":74745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":74781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":76267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":74655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":74815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":827392,"data_stored":665661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:37.200 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:45:37.200 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T23:45:37.200 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T23:45:37.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T23:45:37.201 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T23:45:37.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ea00640 1 Processor -- start 2024-04-26T23:45:37.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ea00640 1 -- start start 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e5815f080 0x7f5e580b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5e580b6830 0x7f5e580cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ea00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e580b4db0 con 0x7f5e580731e0 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ea00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5e580b6c90 con 0x7f5e580b6830 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5e580b5090 con 0x7f5e5815f080 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e4f400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5e580b6830 0x7f5e580cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ca00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5e580731e0 0x7f5e5806e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41220/0 (socket says 172.21.15.47:41220) 2024-04-26T23:45:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.369+0000 7f5e5ca00640 1 -- 172.21.15.47:0/2977603549 learned_addr learned my addr 172.21.15.47:0/2977603549 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:37.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e57e00640 1 --2- 172.21.15.47:0/2977603549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e5815f080 0x7f5e580b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e4f400640 1 -- 172.21.15.47:0/2977603549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e5815f080 msgr2=0x7f5e580b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:37.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e4f400640 1 --2- 172.21.15.47:0/2977603549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e5815f080 0x7f5e580b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e4f400640 1 -- 172.21.15.47:0/2977603549 >> v1:172.21.15.47:6789/0 conn(0x7f5e580731e0 legacy=0x7f5e5806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e4f400640 1 -- 172.21.15.47:0/2977603549 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e580ce210 con 0x7f5e580b6830 2024-04-26T23:45:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e4f400640 1 --2- 172.21.15.47:0/2977603549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580b6830 0x7f5e580cea10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e400097a0 tx=0x7f5e4001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2371272125bbda31 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e57400640 1 -- 172.21.15.47:0/2977603549 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400b0070 con 0x7f5e580b6830 2024-04-26T23:45:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e57400640 1 -- 172.21.15.47:0/2977603549 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e400ab600 con 0x7f5e580b6830 2024-04-26T23:45:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e57400640 1 -- 172.21.15.47:0/2977603549 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e400ab9d0 con 0x7f5e580b6830 2024-04-26T23:45:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e5ea00640 1 -- 172.21.15.47:0/2977603549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580b6830 msgr2=0x7f5e580cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.373+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/2977603549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580b6830 0x7f5e580cea10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5e400097a0 tx=0x7f5e4001c480 comp rx=0 tx=0).stop 2024-04-26T23:45:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- 172.21.15.47:0/2977603549 shutdown_connections 2024-04-26T23:45:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/2977603549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580b6830 0x7f5e580cea10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/2977603549 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e5815f080 0x7f5e580b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- 172.21.15.47:0/2977603549 >> 172.21.15.47:0/2977603549 conn(0x7f5e58075c20 msgr2=0x7f5e58076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- 172.21.15.47:0/2977603549 shutdown_connections 2024-04-26T23:45:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- 172.21.15.47:0/2977603549 wait complete. 2024-04-26T23:45:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 Processor -- start 2024-04-26T23:45:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- start start 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580731e0 0x7f5e5814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e580b6830 0x7f5e5815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e5815f080 0x7f5e5815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58073b80 con 0x7f5e580731e0 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e58073a00 con 0x7f5e5815f080 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5815f460 con 0x7f5e580b6830 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580731e0 0x7f5e5814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580731e0 0x7f5e5814dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49268/0 (socket says 172.21.15.47:49268) 2024-04-26T23:45:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 -- 172.21.15.47:0/3649779177 learned_addr learned my addr 172.21.15.47:0/3649779177 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e4f400640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e580b6830 0x7f5e5815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ca00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e5815f080 0x7f5e5815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 -- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e580b6830 msgr2=0x7f5e5815e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e580b6830 0x7f5e5815e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 -- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e5815f080 msgr2=0x7f5e5815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e5815f080 0x7f5e5815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 -- 172.21.15.47:0/3649779177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e5814e5c0 con 0x7f5e580731e0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e4f400640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e580b6830 0x7f5e5815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e57e00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580731e0 0x7f5e5814dee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800d620 tx=0x7f5e4800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e54c00640 1 -- 172.21.15.47:0/3649779177 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800b620 con 0x7f5e580731e0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e54c00640 1 -- 172.21.15.47:0/3649779177 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e48019070 con 0x7f5e580731e0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e54c00640 1 -- 172.21.15.47:0/3649779177 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800b9e0 con 0x7f5e580731e0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.377+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e5814e8a0 con 0x7f5e580731e0 2024-04-26T23:45:37.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.381+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e5814ee60 con 0x7f5e580731e0 2024-04-26T23:45:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.381+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e58069700 con 0x7f5e580731e0 2024-04-26T23:45:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.381+0000 7f5e54c00640 1 -- 172.21.15.47:0/3649779177 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e4800bb80 con 0x7f5e580731e0 2024-04-26T23:45:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.381+0000 7f5e54c00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e340683b0 0x7f5e3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.381+0000 7f5e54c00640 1 -- 172.21.15.47:0/3649779177 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5e48086d60 con 0x7f5e580731e0 2024-04-26T23:45:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.381+0000 7f5e4f400640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e340683b0 0x7f5e3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.381+0000 7f5e4f400640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e340683b0 0x7f5e3406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e400ad000 tx=0x7f5e40008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:37.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.385+0000 7f5e54c00640 1 -- 172.21.15.47:0/3649779177 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5e480573b0 con 0x7f5e580731e0 2024-04-26T23:45:37.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.589+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5e58162680 con 0x7f5e580731e0 2024-04-26T23:45:37.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e54c00640 1 -- 172.21.15.47:0/3649779177 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168092 (secure 0 0 0) 0x7f5e48056cb0 con 0x7f5e580731e0 2024-04-26T23:45:37.601 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:37.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e340683b0 msgr2=0x7f5e3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e340683b0 0x7f5e3406a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e400ad000 tx=0x7f5e40008040 comp rx=0 tx=0).stop 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580731e0 msgr2=0x7f5e5814dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580731e0 0x7f5e5814dee0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800d620 tx=0x7f5e4800dae0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 shutdown_connections 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e340683b0 0x7f5e3406a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e5815f080 0x7f5e5815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e580b6830 0x7f5e5815e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 --2- 172.21.15.47:0/3649779177 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e580731e0 0x7f5e5814dee0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.593+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 >> 172.21.15.47:0/3649779177 conn(0x7f5e58075c20 msgr2=0x7f5e580b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.597+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 shutdown_connections 2024-04-26T23:45:37.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.597+0000 7f5e5ea00640 1 -- 172.21.15.47:0/3649779177 wait complete. 2024-04-26T23:45:37.621 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":2140288453},{"type":"v1","addr":"172.21.15.203:6833","nonce":2140288453}]},"active_addr":"172.21.15.203:6833/2140288453","active_change":"2024-04-26T23:45:12.139276+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":3390614324}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":1115423812}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":1834056578}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.203:0","nonce":2003888218}]}]} 2024-04-26T23:45:37.624 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T23:45:37.624 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T23:45:37.624 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:37.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.757+0000 7ff3e2c00640 1 Processor -- start 2024-04-26T23:45:37.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3e2c00640 1 -- start start 2024-04-26T23:45:37.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3e2c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3dc06c400 0x7ff3dc166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3e2c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3dc0cf840 con 0x7ff3dc162a30 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3e2c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3dc0cea80 con 0x7ff3dc0d0af0 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3e2c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff3dc0d1c70 con 0x7ff3dc06c400 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3d3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3dc06c400 0x7ff3dc166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3dbe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff3dc162a30 0x7ff3dc0d03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41222/0 (socket says 172.21.15.47:41222) 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3d3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff3dc06c400 0x7ff3dc166eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49274/0 (socket says 172.21.15.47:49274) 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3dbe00640 1 -- 172.21.15.47:0/2348520801 learned_addr learned my addr 172.21.15.47:0/2348520801 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3d3e00640 1 -- 172.21.15.47:0/2348520801 >> v1:172.21.15.203:6789/0 conn(0x7ff3dc0d0af0 legacy=0x7ff3dc169400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3d3e00640 1 -- 172.21.15.47:0/2348520801 >> v1:172.21.15.47:6789/0 conn(0x7ff3dc162a30 legacy=0x7ff3dc0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.761+0000 7ff3d3e00640 1 -- 172.21.15.47:0/2348520801 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc0ced60 con 0x7ff3dc06c400 2024-04-26T23:45:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3d3e00640 1 --2- 172.21.15.47:0/2348520801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc06c400 0x7ff3dc166eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40097c0 tx=0x7ff3c401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad2caf0dec9c2e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3db400640 1 -- 172.21.15.47:0/2348520801 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b0070 con 0x7ff3dc06c400 2024-04-26T23:45:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3db400640 1 -- 172.21.15.47:0/2348520801 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c40ab600 con 0x7ff3dc06c400 2024-04-26T23:45:37.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3db400640 1 -- 172.21.15.47:0/2348520801 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40ab9d0 con 0x7ff3dc06c400 2024-04-26T23:45:37.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2348520801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc06c400 msgr2=0x7ff3dc166eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2348520801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc06c400 0x7ff3dc166eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40097c0 tx=0x7ff3c401c410 comp rx=0 tx=0).stop 2024-04-26T23:45:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2348520801 shutdown_connections 2024-04-26T23:45:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2348520801 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc06c400 0x7ff3dc166eb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2348520801 >> 172.21.15.47:0/2348520801 conn(0x7ff3dc0d1df0 msgr2=0x7ff3dc0d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2348520801 shutdown_connections 2024-04-26T23:45:37.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2348520801 wait complete. 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 Processor -- start 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.765+0000 7ff3e2c00640 1 -- start start 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3dc0d0af0 0x7ff3dc15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc159530 0x7ff3dc0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3dc0b2860 0x7ff3dc150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc0b1230 con 0x7ff3dc159530 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc0b10b0 con 0x7ff3dc0b2860 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff3dc16d750 con 0x7ff3dc0d0af0 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc159530 0x7ff3dc0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc159530 0x7ff3dc0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49280/0 (socket says 172.21.15.47:49280) 2024-04-26T23:45:37.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 -- 172.21.15.47:0/2645925896 learned_addr learned my addr 172.21.15.47:0/2645925896 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3dbe00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3dc0d0af0 0x7ff3dc15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e0c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3dc0b2860 0x7ff3dc150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 -- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3dc0d0af0 msgr2=0x7ff3dc15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3dc0d0af0 0x7ff3dc15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 -- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3dc0b2860 msgr2=0x7ff3dc150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3dc0b2860 0x7ff3dc150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 -- 172.21.15.47:0/2645925896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc15c300 con 0x7ff3dc159530 2024-04-26T23:45:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d3e00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc159530 0x7ff3dc0b2320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4019020 tx=0x7ff3c40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d8c00640 1 -- 172.21.15.47:0/2645925896 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b8030 con 0x7ff3dc159530 2024-04-26T23:45:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d8c00640 1 -- 172.21.15.47:0/2645925896 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3c40b4410 con 0x7ff3dc159530 2024-04-26T23:45:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d8c00640 1 -- 172.21.15.47:0/2645925896 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b0040 con 0x7ff3dc159530 2024-04-26T23:45:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc15c5e0 con 0x7ff3dc159530 2024-04-26T23:45:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc1501f0 con 0x7ff3dc159530 2024-04-26T23:45:37.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3dc069700 con 0x7ff3dc159530 2024-04-26T23:45:37.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.769+0000 7ff3d8c00640 1 -- 172.21.15.47:0/2645925896 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3c40bb070 con 0x7ff3dc159530 2024-04-26T23:45:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.773+0000 7ff3d8c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff3b80683b0 0x7ff3b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.773+0000 7ff3d8c00640 1 -- 172.21.15.47:0/2645925896 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff3c411fe20 con 0x7ff3dc159530 2024-04-26T23:45:37.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.773+0000 7ff3dbe00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff3b80683b0 0x7ff3b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:37.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.773+0000 7ff3dbe00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff3b80683b0 0x7ff3b806a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc005890 tx=0x7ff3cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:37.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.777+0000 7ff3d8c00640 1 -- 172.21.15.47:0/2645925896 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff3c40c3020 con 0x7ff3dc159530 2024-04-26T23:45:37.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.941+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3dc0afc90 con 0x7ff3dc159530 2024-04-26T23:45:37.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.941+0000 7ff3d8c00640 1 -- 172.21.15.47:0/2645925896 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7ff3c4016090 con 0x7ff3dc159530 2024-04-26T23:45:37.949 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:37.949 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff3b80683b0 msgr2=0x7ff3b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff3b80683b0 0x7ff3b806a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc005890 tx=0x7ff3cc009040 comp rx=0 tx=0).stop 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc159530 msgr2=0x7ff3dc0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc159530 0x7ff3dc0b2320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4019020 tx=0x7ff3c40191b0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 shutdown_connections 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff3b80683b0 0x7ff3b806a870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff3dc0b2860 0x7ff3dc150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3dc159530 0x7ff3dc0b2320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 --2- 172.21.15.47:0/2645925896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff3dc0d0af0 0x7ff3dc15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:37.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 >> 172.21.15.47:0/2645925896 conn(0x7ff3dc0d1df0 msgr2=0x7ff3dc161b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:37.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 shutdown_connections 2024-04-26T23:45:37.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:37.945+0000 7ff3e2c00640 1 -- 172.21.15.47:0/2645925896 wait complete. 2024-04-26T23:45:37.970 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T23:45:37.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.101+0000 7fa140a00640 1 Processor -- start 2024-04-26T23:45:38.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.101+0000 7fa140a00640 1 -- start start 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa140a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c070390 0x7fa13c0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa140a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa13c072f70 0x7fa13c0733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa140a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13c0b4d50 con 0x7fa13c145280 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa140a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa13c073910 con 0x7fa13c072f70 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa140a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c0b5680 con 0x7fa13c070390 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13b200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa13c072f70 0x7fa13c0733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13b200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa13c072f70 0x7fa13c0733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49290/0 (socket says 172.21.15.47:49290) 2024-04-26T23:45:38.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13b200640 1 -- 172.21.15.47:0/1163073865 learned_addr learned my addr 172.21.15.47:0/1163073865 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13a800640 1 --1- 172.21.15.47:0/1163073865 >> v1:172.21.15.47:6789/0 conn(0x7fa13c145280 0x7fa13c06f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41228/0 (socket says 172.21.15.47:41228) 2024-04-26T23:45:38.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa131e00640 1 --2- 172.21.15.47:0/1163073865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c070390 0x7fa13c0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13b200640 1 -- 172.21.15.47:0/1163073865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c070390 msgr2=0x7fa13c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13b200640 1 --2- 172.21.15.47:0/1163073865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c070390 0x7fa13c0cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13b200640 1 -- 172.21.15.47:0/1163073865 >> v1:172.21.15.47:6789/0 conn(0x7fa13c145280 legacy=0x7fa13c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.105+0000 7fa13b200640 1 -- 172.21.15.47:0/1163073865 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c0b5030 con 0x7fa13c072f70 2024-04-26T23:45:38.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa13b200640 1 --2- 172.21.15.47:0/1163073865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c0733d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa134009e50 tx=0x7fa13401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c378cccd51bb7340 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa139e00640 1 -- 172.21.15.47:0/1163073865 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340a5700 con 0x7fa13c072f70 2024-04-26T23:45:38.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa139e00640 1 -- 172.21.15.47:0/1163073865 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1340a58a0 con 0x7fa13c072f70 2024-04-26T23:45:38.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa139e00640 1 -- 172.21.15.47:0/1163073865 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340a5c70 con 0x7fa13c072f70 2024-04-26T23:45:38.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- 172.21.15.47:0/1163073865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 msgr2=0x7fa13c0733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 --2- 172.21.15.47:0/1163073865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c0733d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa134009e50 tx=0x7fa13401ca30 comp rx=0 tx=0).stop 2024-04-26T23:45:38.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- 172.21.15.47:0/1163073865 shutdown_connections 2024-04-26T23:45:38.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 --2- 172.21.15.47:0/1163073865 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c0733d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 --2- 172.21.15.47:0/1163073865 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c070390 0x7fa13c0cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- 172.21.15.47:0/1163073865 >> 172.21.15.47:0/1163073865 conn(0x7fa13c0b38b0 msgr2=0x7fa13c0b3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- 172.21.15.47:0/1163073865 shutdown_connections 2024-04-26T23:45:38.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- 172.21.15.47:0/1163073865 wait complete. 2024-04-26T23:45:38.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 Processor -- start 2024-04-26T23:45:38.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- start start 2024-04-26T23:45:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c1663c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c145280 0x7fa13c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c0c7720 0x7fa13c1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c0b66d0 con 0x7fa13c072f70 2024-04-26T23:45:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c0b6550 con 0x7fa13c0c7720 2024-04-26T23:45:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.109+0000 7fa140a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c0b6850 con 0x7fa13c145280 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c1663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c1663c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49292/0 (socket says 172.21.15.47:49292) 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 -- 172.21.15.47:0/2026997700 learned_addr learned my addr 172.21.15.47:0/2026997700 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa131e00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c145280 0x7fa13c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13b200640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c0c7720 0x7fa13c1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 -- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c145280 msgr2=0x7fa13c15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c145280 0x7fa13c15d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 -- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c0c7720 msgr2=0x7fa13c1580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c0c7720 0x7fa13c1580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 -- 172.21.15.47:0/2026997700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c165900 con 0x7fa13c072f70 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13b200640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c0c7720 0x7fa13c1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa131e00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c145280 0x7fa13c15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa13a800640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c1663c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c450 tx=0x7fa12c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa133400640 1 -- 172.21.15.47:0/2026997700 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c017070 con 0x7fa13c072f70 2024-04-26T23:45:38.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa133400640 1 -- 172.21.15.47:0/2026997700 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c006480 con 0x7fa13c072f70 2024-04-26T23:45:38.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa133400640 1 -- 172.21.15.47:0/2026997700 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0049f0 con 0x7fa13c072f70 2024-04-26T23:45:38.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c15da60 con 0x7fa13c072f70 2024-04-26T23:45:38.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c15f320 con 0x7fa13c072f70 2024-04-26T23:45:38.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13c069470 con 0x7fa13c072f70 2024-04-26T23:45:38.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.113+0000 7fa133400640 1 -- 172.21.15.47:0/2026997700 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa12c01a070 con 0x7fa13c072f70 2024-04-26T23:45:38.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.117+0000 7fa133400640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa118068380 0x7fa11806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.117+0000 7fa133400640 1 -- 172.21.15.47:0/2026997700 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa12c085c50 con 0x7fa13c072f70 2024-04-26T23:45:38.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.117+0000 7fa131e00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa118068380 0x7fa11806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.117+0000 7fa131e00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa118068380 0x7fa11806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa13c159cc0 tx=0x7fa124008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.121+0000 7fa133400640 1 -- 172.21.15.47:0/2026997700 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa12c08b020 con 0x7fa13c072f70 2024-04-26T23:45:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.285+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa13c070a10 con 0x7fa13c072f70 2024-04-26T23:45:38.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.285+0000 7fa133400640 1 -- 172.21.15.47:0/2026997700 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fa12c0562a0 con 0x7fa13c072f70 2024-04-26T23:45:38.293 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:38.293 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa118068380 msgr2=0x7fa11806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa118068380 0x7fa11806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa13c159cc0 tx=0x7fa124008040 comp rx=0 tx=0).stop 2024-04-26T23:45:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 msgr2=0x7fa13c1663c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c1663c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c450 tx=0x7fa12c00c910 comp rx=0 tx=0).stop 2024-04-26T23:45:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 shutdown_connections 2024-04-26T23:45:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa118068380 0x7fa11806a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c0c7720 0x7fa13c1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa13c145280 0x7fa13c15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 --2- 172.21.15.47:0/2026997700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa13c072f70 0x7fa13c1663c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 >> 172.21.15.47:0/2026997700 conn(0x7fa13c0b38b0 msgr2=0x7fa13c1600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 shutdown_connections 2024-04-26T23:45:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.289+0000 7fa140a00640 1 -- 172.21.15.47:0/2026997700 wait complete. 2024-04-26T23:45:38.315 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T23:45:38.315 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T23:45:38.316 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T23:45:38.316 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T23:45:38.316 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T23:45:38.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T23:45:38.317 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T23:45:38.318 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T23:45:38.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.549+0000 7f4cbd200640 1 Processor -- start 2024-04-26T23:45:38.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.549+0000 7f4cbd200640 1 -- start start 2024-04-26T23:45:38.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cbd200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4cb80b6630 0x7f4cb81631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cbd200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4cb80d3b40 0x7f4cb8163700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cbd200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb80b1e50 con 0x7f4cb80d3760 2024-04-26T23:45:38.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cbd200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb80b2a20 con 0x7f4cb80d3b40 2024-04-26T23:45:38.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cbd200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb80b20f0 con 0x7f4cb80b6630 2024-04-26T23:45:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb5400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4cb80b6630 0x7f4cb81631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb5e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4cb80d3760 0x7f4cb80d5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41234/0 (socket says 172.21.15.47:41234) 2024-04-26T23:45:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb5e00640 1 -- 172.21.15.47:0/945813188 learned_addr learned my addr 172.21.15.47:0/945813188 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:38.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb7200640 1 --2- 172.21.15.47:0/945813188 >> v2:172.21.15.47:3300/0 conn(0x7f4cb80d3b40 0x7f4cb8163700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb5400640 1 -- 172.21.15.47:0/945813188 >> v2:172.21.15.47:3300/0 conn(0x7f4cb80d3b40 msgr2=0x7f4cb8163700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb5400640 1 --2- 172.21.15.47:0/945813188 >> v2:172.21.15.47:3300/0 conn(0x7f4cb80d3b40 0x7f4cb8163700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb5400640 1 -- 172.21.15.47:0/945813188 >> v1:172.21.15.47:6789/0 conn(0x7f4cb80d3760 legacy=0x7f4cb80d5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb5400640 1 -- 172.21.15.47:0/945813188 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb80b23d0 con 0x7f4cb80b6630 2024-04-26T23:45:38.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7f4cb7200640 1 --2- 172.21.15.47:0/945813188 >> v2:172.21.15.47:3300/0 conn(0x7f4cb80d3b40 0x7f4cb8163700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:38.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7fb560a00640 1 Processor -- start 2024-04-26T23:45:38.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.553+0000 7fb560a00640 1 -- start start 2024-04-26T23:45:38.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb560a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0cf430 0x7fb55c0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb560a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb55c0d0060 0x7fb55c073780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb560a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb55c0d04e0 0x7fb55c073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb560a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb55c15c4e0 con 0x7fb55c0d04e0 2024-04-26T23:45:38.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb560a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb55c074200 con 0x7fb55c0d0060 2024-04-26T23:45:38.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb560a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb55c15b8d0 con 0x7fb55c0cf430 2024-04-26T23:45:38.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb55b400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0cf430 0x7fb55c0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb55b400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0cf430 0x7fb55c0ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37392/0 (socket says 172.21.15.47:37392) 2024-04-26T23:45:38.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb55b400640 1 -- 172.21.15.47:0/1618642533 learned_addr learned my addr 172.21.15.47:0/1618642533 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb55aa00640 1 --2- 172.21.15.47:0/1618642533 >> v2:172.21.15.203:3300/0 conn(0x7fb55c0d0060 0x7fb55c073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.557+0000 7fb55be00640 1 --2- 172.21.15.47:0/1618642533 >> v2:172.21.15.47:3300/0 conn(0x7fb55c0d04e0 0x7fb55c073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7fb55be00640 1 -- 172.21.15.47:0/1618642533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0cf430 msgr2=0x7fb55c0ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7fb55be00640 1 --2- 172.21.15.47:0/1618642533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0cf430 0x7fb55c0ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7fb55be00640 1 -- 172.21.15.47:0/1618642533 >> v2:172.21.15.203:3300/0 conn(0x7fb55c0d0060 msgr2=0x7fb55c073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7fb55be00640 1 --2- 172.21.15.47:0/1618642533 >> v2:172.21.15.203:3300/0 conn(0x7fb55c0d0060 0x7fb55c073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7fb55be00640 1 -- 172.21.15.47:0/1618642533 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c15bbb0 con 0x7fb55c0d04e0 2024-04-26T23:45:38.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7fb55b400640 1 --2- 172.21.15.47:0/1618642533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0cf430 0x7fb55c0ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:38.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cb5400640 1 --2- 172.21.15.47:0/945813188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80b6630 0x7f4cb81631c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b2ba0 tx=0x7f4ca401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5614a592f2b37463 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cb4a00640 1 -- 172.21.15.47:0/945813188 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40b0070 con 0x7f4cb80b6630 2024-04-26T23:45:38.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cb4a00640 1 -- 172.21.15.47:0/945813188 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca40ab600 con 0x7f4cb80b6630 2024-04-26T23:45:38.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cb4a00640 1 -- 172.21.15.47:0/945813188 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40ab9d0 con 0x7f4cb80b6630 2024-04-26T23:45:38.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cbd200640 1 -- 172.21.15.47:0/945813188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80b6630 msgr2=0x7f4cb81631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cbd200640 1 --2- 172.21.15.47:0/945813188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80b6630 0x7f4cb81631c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4cb80b2ba0 tx=0x7f4ca401c3a0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cbd200640 1 -- 172.21.15.47:0/945813188 shutdown_connections 2024-04-26T23:45:38.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cbd200640 1 --2- 172.21.15.47:0/945813188 >> v2:172.21.15.47:3300/0 conn(0x7f4cb80d3b40 0x7f4cb8163700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cbd200640 1 --2- 172.21.15.47:0/945813188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80b6630 0x7f4cb81631c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.561+0000 7f4cbd200640 1 -- 172.21.15.47:0/945813188 >> 172.21.15.47:0/945813188 conn(0x7f4cb809e450 msgr2=0x7f4cb80d5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f4cbd200640 1 -- 172.21.15.47:0/945813188 shutdown_connections 2024-04-26T23:45:38.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 Processor -- start 2024-04-26T23:45:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 -- start start 2024-04-26T23:45:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f1e02a00640 1 Processor -- start 2024-04-26T23:45:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb55be00640 1 --2- 172.21.15.47:0/1618642533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0d04e0 0x7fb55c073cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b6d00 tx=0x7fb55401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506c005b8368460a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f1e02a00640 1 -- start start 2024-04-26T23:45:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb55a000640 1 -- 172.21.15.47:0/1618642533 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5540b2070 con 0x7fb55c0d04e0 2024-04-26T23:45:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb55a000640 1 -- 172.21.15.47:0/1618642533 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5540a58f0 con 0x7fb55c0d04e0 2024-04-26T23:45:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb55a000640 1 -- 172.21.15.47:0/1618642533 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5540a5cc0 con 0x7fb55c0d04e0 2024-04-26T23:45:38.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3b2c15f360 0x7f3b2c162e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b2c1633d0 0x7f3b2c163880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f4cbd200640 1 -- 172.21.15.47:0/945813188 wait complete. 2024-04-26T23:45:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f4cbd200640 1 Processor -- start 2024-04-26T23:45:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 0x7f3b2c0d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2c160610 con 0x7f3b2c1633d0 2024-04-26T23:45:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3b2c15fa40 con 0x7f3b2c15f360 2024-04-26T23:45:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b32400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2c15fce0 con 0x7f3b2c0cfd90 2024-04-26T23:45:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 -- 172.21.15.47:0/1618642533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0d04e0 msgr2=0x7fb55c073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 --2- 172.21.15.47:0/1618642533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0d04e0 0x7fb55c073cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b6d00 tx=0x7fb55401c870 comp rx=0 tx=0).stop 2024-04-26T23:45:38.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b2aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b2c1633d0 0x7f3b2c163880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 -- 172.21.15.47:0/1618642533 shutdown_connections 2024-04-26T23:45:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 --2- 172.21.15.47:0/1618642533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0d04e0 0x7fb55c073cc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b2aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b2c1633d0 0x7f3b2c163880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49320/0 (socket says 172.21.15.47:49320) 2024-04-26T23:45:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b2aa00640 1 -- 172.21.15.47:0/3644421129 learned_addr learned my addr 172.21.15.47:0/3644421129 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 --2- 172.21.15.47:0/1618642533 >> v2:172.21.15.203:3300/0 conn(0x7fb55c0d0060 0x7fb55c073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 --2- 172.21.15.47:0/1618642533 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0cf430 0x7fb55c0ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f1e02a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1dfc0ae220 0x7f1dfc073000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 -- 172.21.15.47:0/1618642533 >> 172.21.15.47:0/1618642533 conn(0x7fb55c0b27c0 msgr2=0x7fb55c0b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f1e02a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dfc072160 con 0x7f1dfc15f130 2024-04-26T23:45:38.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f5b03200640 1 Processor -- start 2024-04-26T23:45:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f1e02a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dfc0b5970 con 0x7f1dfc0add90 2024-04-26T23:45:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f1e02a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1dfc0b5c50 con 0x7f1dfc0ae220 2024-04-26T23:45:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 -- 172.21.15.47:0/1618642533 shutdown_connections 2024-04-26T23:45:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7fb560a00640 1 -- 172.21.15.47:0/1618642533 wait complete. 2024-04-26T23:45:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b2b400640 1 --2- 172.21.15.47:0/3644421129 >> v2:172.21.15.203:3300/0 conn(0x7f3b2c15f360 0x7f3b2c162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f4cbd200640 1 -- start start 2024-04-26T23:45:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f1dfb400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f1dfc0add90 0x7f1dfc0728f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57234/0 (socket says 172.21.15.47:57234) 2024-04-26T23:45:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f1dfb400640 1 -- 172.21.15.47:0/2466086649 learned_addr learned my addr 172.21.15.47:0/2466086649 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f1e00a00640 1 --2- 172.21.15.47:0/2466086649 >> v2:172.21.15.203:3300/0 conn(0x7f1dfc0ae220 0x7f1dfc073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f5b03200640 1 -- start start 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f1e00a00640 1 -- 172.21.15.47:0/2466086649 >> v1:172.21.15.203:6789/0 conn(0x7f1dfc0add90 legacy=0x7f1dfc0728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f1e00a00640 1 -- 172.21.15.47:0/2466086649 >> v1:172.21.15.47:6789/0 conn(0x7f1dfc15f130 legacy=0x7f1dfc0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.565+0000 7f3b2be00640 1 --2- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 0x7f3b2c0d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f3b2b400640 1 -- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 msgr2=0x7f3b2c0d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f3b2b400640 1 --2- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 0x7f3b2c0d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f3b2b400640 1 -- 172.21.15.47:0/3644421129 >> v2:172.21.15.47:3300/0 conn(0x7f3b2c1633d0 msgr2=0x7f3b2c163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f3b2b400640 1 --2- 172.21.15.47:0/3644421129 >> v2:172.21.15.47:3300/0 conn(0x7f3b2c1633d0 0x7f3b2c163880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f3b2b400640 1 -- 172.21.15.47:0/3644421129 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c15ffc0 con 0x7f3b2c15f360 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f1e00a00640 1 -- 172.21.15.47:0/2466086649 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc0723d0 con 0x7f1dfc0ae220 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cbd200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb80b6630 0x7f4cb8154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cbd200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80d3760 0x7f4cb8162510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cbd200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb80d3b40 0x7f4cb806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cbd200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb80b3a30 con 0x7f4cb80b6630 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cbd200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb80b38b0 con 0x7f4cb80d3760 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cbd200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb80b3bb0 con 0x7f4cb80d3b40 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb80d3b40 0x7f4cb806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb5400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80d3760 0x7f4cb8162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb80d3b40 0x7f4cb806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37412/0 (socket says 172.21.15.47:37412) 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 -- 172.21.15.47:0/1835247335 learned_addr learned my addr 172.21.15.47:0/1835247335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 -- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80d3760 msgr2=0x7f4cb8162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4cb80d3760 0x7f4cb8162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 -- 172.21.15.47:0/1835247335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb80b6630 msgr2=0x7f4cb8154200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4cb80b6630 0x7f4cb8154200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 -- 172.21.15.47:0/1835247335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb8154740 con 0x7f4cb80d3b40 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7fb560a00640 1 Processor -- start 2024-04-26T23:45:38.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7fb560a00640 1 -- start start 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b03200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b0415f060 0x7f5b0415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b03200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5b0415f980 0x7f5b040cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b03200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b03200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5b040d3070 con 0x7f5b0415f060 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b03200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5b0415fec0 con 0x7f5b0415f980 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5b0415f060 0x7f5b0415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b03200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5b041601a0 con 0x7f5b040ba930 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5b0415f980 0x7f5b040cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5b0415f980 0x7f5b040cfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53720/0 (socket says 172.21.15.47:53720) 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 -- 172.21.15.47:0/2462119727 learned_addr learned my addr 172.21.15.47:0/2462119727 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b02800640 1 --2- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 -- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 msgr2=0x7f5b040d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 --2- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 -- 172.21.15.47:0/2462119727 >> v2:172.21.15.47:3300/0 conn(0x7f5b0415f060 msgr2=0x7f5b0415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 --2- 172.21.15.47:0/2462119727 >> v2:172.21.15.47:3300/0 conn(0x7f5b0415f060 0x7f5b0415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f5b01400640 1 -- 172.21.15.47:0/2462119727 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b04160480 con 0x7f5b0415f980 2024-04-26T23:45:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cb7200640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb80d3b40 0x7f4cb806cf40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000efc0 tx=0x7f4cb000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0018030 con 0x7f4cb80d3b40 2024-04-26T23:45:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb000cd30 con 0x7f4cb80d3b40 2024-04-26T23:45:38.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0003bf0 con 0x7f4cb80d3b40 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.569+0000 7f4cbd200640 1 -- 172.21.15.47:0/1835247335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb8161470 con 0x7f4cb80d3b40 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f4cbd200640 1 -- 172.21.15.47:0/1835247335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb8161a30 con 0x7f4cb80d3b40 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb560a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0cf430 0x7fb55c0cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb560a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0d0060 0x7fb55c157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb560a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb55c0d04e0 0x7fb55c0b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb560a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c0cf990 con 0x7fb55c0cf430 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb560a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c0cf810 con 0x7fb55c0d04e0 2024-04-26T23:45:38.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb560a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb55c06ea70 con 0x7fb55c0d0060 2024-04-26T23:45:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cb8161220 con 0x7f4cb80d3b40 2024-04-26T23:45:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f3b2b400640 1 --2- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c162e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c08d380 tx=0x7f3b1c024ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c72e7b725ca50ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb55c0d04e0 0x7fb55c0b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb55c0d04e0 0x7fb55c0b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53736/0 (socket says 172.21.15.47:53736) 2024-04-26T23:45:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0cf430 0x7fb55c0cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55be00640 1 -- 172.21.15.47:0/761049232 learned_addr learned my addr 172.21.15.47:0/761049232 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1e00a00640 1 --2- 172.21.15.47:0/2466086649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0ae220 0x7f1dfc073000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1df40097c0 tx=0x7f1df401c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdc8fed2b6837873 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f3b2a000640 1 -- 172.21.15.47:0/3644421129 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0ba070 con 0x7f3b2c15f360 2024-04-26T23:45:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f3b2a000640 1 -- 172.21.15.47:0/3644421129 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1c0adc00 con 0x7f3b2c15f360 2024-04-26T23:45:38.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f3b2a000640 1 -- 172.21.15.47:0/3644421129 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0b5440 con 0x7f3b2c15f360 2024-04-26T23:45:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0d0060 0x7fb55c157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1dfaa00640 1 -- 172.21.15.47:0/2466086649 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40b0070 con 0x7f1dfc0ae220 2024-04-26T23:45:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1dfaa00640 1 -- 172.21.15.47:0/2466086649 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df40ab600 con 0x7f1dfc0ae220 2024-04-26T23:45:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1dfaa00640 1 -- 172.21.15.47:0/2466086649 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df40ab9d0 con 0x7f1dfc0ae220 2024-04-26T23:45:38.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55b400640 1 -- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0d0060 msgr2=0x7fb55c157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55b400640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0d0060 0x7fb55c157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55b400640 1 -- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb55c0d04e0 msgr2=0x7fb55c0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55b400640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb55c0d04e0 0x7fb55c0b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55b400640 1 -- 172.21.15.47:0/761049232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c156cc0 con 0x7fb55c0cf430 2024-04-26T23:45:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1e02a00640 1 -- 172.21.15.47:0/2466086649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0ae220 msgr2=0x7f1dfc073000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1e02a00640 1 --2- 172.21.15.47:0/2466086649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0ae220 0x7f1dfc073000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1df40097c0 tx=0x7f1df401c3d0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7fb55aa00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb55c0d0060 0x7fb55c157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:38.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1e02a00640 1 -- 172.21.15.47:0/2466086649 shutdown_connections 2024-04-26T23:45:38.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1e02a00640 1 --2- 172.21.15.47:0/2466086649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0ae220 0x7f1dfc073000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f1e02a00640 1 -- 172.21.15.47:0/2466086649 >> 172.21.15.47:0/2466086649 conn(0x7f1dfc0b3220 msgr2=0x7f1dfc0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cb001b070 con 0x7f4cb80d3b40 2024-04-26T23:45:38.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f1e02a00640 1 -- 172.21.15.47:0/2466086649 shutdown_connections 2024-04-26T23:45:38.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7fb55b400640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0cf430 0x7fb55c0cdfa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb54800b730 tx=0x7fb54800e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f1e02a00640 1 -- 172.21.15.47:0/2466086649 wait complete. 2024-04-26T23:45:38.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 -- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 msgr2=0x7f3b2c162e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 --2- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c162e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c08d380 tx=0x7f3b1c024ca0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b01400640 1 --2- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f980 0x7f5b040cfd70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b040d4f00 tx=0x7f5af001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5adfc58b46c6e0a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f9104e00640 1 Processor -- start 2024-04-26T23:45:38.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.573+0000 7f9104e00640 1 -- start start 2024-04-26T23:45:38.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 -- 172.21.15.47:0/3644421129 shutdown_connections 2024-04-26T23:45:38.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54801b070 con 0x7fb55c0cf430 2024-04-26T23:45:38.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 --2- 172.21.15.47:0/3644421129 >> v2:172.21.15.47:3300/0 conn(0x7f3b2c1633d0 0x7f3b2c163880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f9104e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91000ae170 0x7f9100072550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54800ed00 con 0x7fb55c0cf430 2024-04-26T23:45:38.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548004230 con 0x7fb55c0cf430 2024-04-26T23:45:38.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 --2- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 0x7f3b2c0d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 --2- 172.21.15.47:0/3644421129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c162e90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 -- 172.21.15.47:0/3644421129 >> 172.21.15.47:0/3644421129 conn(0x7f3b2c09e3c0 msgr2=0x7f3b2c0d50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 -- 172.21.15.47:0/3644421129 shutdown_connections 2024-04-26T23:45:38.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b00a00640 1 -- 172.21.15.47:0/2462119727 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00aa430 con 0x7f5b0415f980 2024-04-26T23:45:38.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b00a00640 1 -- 172.21.15.47:0/2462119727 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af00af070 con 0x7f5b0415f980 2024-04-26T23:45:38.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b00a00640 1 -- 172.21.15.47:0/2462119727 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00aa7f0 con 0x7f5b0415f980 2024-04-26T23:45:38.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f9104e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9100072a90 0x7f9100072f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f9104e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91000b4e30 con 0x7f91000add90 2024-04-26T23:45:38.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f9104e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f91000b5110 con 0x7f91000ae170 2024-04-26T23:45:38.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f9104e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f91000b53f0 con 0x7f9100072a90 2024-04-26T23:45:38.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cae000640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c98068480 0x7f4c9806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4cb0087180 con 0x7f4cb80d3b40 2024-04-26T23:45:38.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cae000640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f4c980706a0 0x7f4c98072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cb5e00640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c98068480 0x7f4c9806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 --> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cb0009a50 con 0x7f4c980706a0 2024-04-26T23:45:38.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4cb008e050 con 0x7f4cb80d3b40 2024-04-26T23:45:38.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7fb560a00640 1 -- 172.21.15.47:0/761049232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c14ca30 con 0x7fb55c0cf430 2024-04-26T23:45:38.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7fb560a00640 1 -- 172.21.15.47:0/761049232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c157220 con 0x7fb55c0cf430 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 -- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f980 msgr2=0x7f5b040cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 --2- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f980 0x7f5b040cfd70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b040d4f00 tx=0x7f5af001c510 comp rx=0 tx=0).stop 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 -- 172.21.15.47:0/2462119727 shutdown_connections 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 --2- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 --2- 172.21.15.47:0/2462119727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f980 0x7f5b040cfd70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fde00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f91000add90 0x7f91000b0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57248/0 (socket says 172.21.15.47:57248) 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fde00640 1 -- 172.21.15.47:0/2301630241 learned_addr learned my addr 172.21.15.47:0/2301630241 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fd400640 1 --2- 172.21.15.47:0/2301630241 >> v2:172.21.15.47:3300/0 conn(0x7f91000ae170 0x7f9100072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fe800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9100072a90 0x7f9100072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 --2- 172.21.15.47:0/2462119727 >> v2:172.21.15.47:3300/0 conn(0x7f5b0415f060 0x7f5b0415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 -- 172.21.15.47:0/2462119727 >> 172.21.15.47:0/2462119727 conn(0x7f5b0406c800 msgr2=0x7f5b0406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fca00640 1 -- 172.21.15.47:0/2301630241 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442398199 0 0) 0x7f91000b4e30 con 0x7f91000add90 2024-04-26T23:45:38.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fe800640 1 -- 172.21.15.47:0/2301630241 >> v2:172.21.15.47:3300/0 conn(0x7f91000ae170 msgr2=0x7f9100072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f4cb5400640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f4c980706a0 0x7f4c98072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb55c069470 con 0x7fb55c0cf430 2024-04-26T23:45:38.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 -- 172.21.15.47:0/3644421129 wait complete. 2024-04-26T23:45:38.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 Processor -- start 2024-04-26T23:45:38.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f3b32400640 1 -- start start 2024-04-26T23:45:38.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 -- 172.21.15.47:0/2462119727 shutdown_connections 2024-04-26T23:45:38.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f5b03200640 1 -- 172.21.15.47:0/2462119727 wait complete. 2024-04-26T23:45:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fe800640 1 --2- 172.21.15.47:0/2301630241 >> v2:172.21.15.47:3300/0 conn(0x7f91000ae170 0x7f9100072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fe800640 1 -- 172.21.15.47:0/2301630241 >> v1:172.21.15.203:6789/0 conn(0x7f91000add90 legacy=0x7f91000b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.577+0000 7f90fe800640 1 -- 172.21.15.47:0/2301630241 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91000b56d0 con 0x7f9100072a90 2024-04-26T23:45:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2a00640 1 Processor -- start 2024-04-26T23:45:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f4cb5e00640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c98068480 0x7f4c9806a940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8000f70 tx=0x7f4ca8007a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2a00640 1 -- start start 2024-04-26T23:45:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 Processor -- start 2024-04-26T23:45:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 -- start start 2024-04-26T23:45:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f90fd400640 1 --2- 172.21.15.47:0/2301630241 >> v2:172.21.15.47:3300/0 conn(0x7f91000ae170 0x7f9100072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:38.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f4cb5400640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f4c980706a0 0x7f4c98072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b32400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 0x7f3b2c0ba790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b32400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b32400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b2c1633d0 0x7f3b2c0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b32400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c0d2e40 con 0x7f3b2c1633d0 2024-04-26T23:45:38.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b32400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c0d2cc0 con 0x7f3b2c15f360 2024-04-26T23:45:38.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b32400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2c0d2fc0 con 0x7f3b2c0cfd90 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0add90 0x7f1dfc141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1dfc0ae220 0x7f1dfc0b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc15f130 0x7f1dfc1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc15f510 con 0x7f1dfc15f130 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0b5f30 con 0x7f1dfc0add90 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1e02a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc16cf00 con 0x7f1dfc0ae220 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f5b03200640 1 Processor -- start 2024-04-26T23:45:38.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f5b03200640 1 -- start start 2024-04-26T23:45:38.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c0b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53746/0 (socket says 172.21.15.47:53746) 2024-04-26T23:45:38.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 -- 172.21.15.47:0/1747959868 learned_addr learned my addr 172.21.15.47:0/1747959868 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c403b940 0x7f09c4006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2b400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 0x7f3b2c0ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1dfb400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1dfc0ae220 0x7f1dfc0b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1dfb400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1dfc0ae220 0x7f1dfc0b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37458/0 (socket says 172.21.15.47:37458) 2024-04-26T23:45:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1dfb400640 1 -- 172.21.15.47:0/907229375 learned_addr learned my addr 172.21.15.47:0/907229375 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f09c4007500 0x7f09c4007930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f1dfbe00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0add90 0x7f1dfc141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== osd.0 v2:172.21.15.47:6800/4189436008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4cb0009a50 con 0x7f4c980706a0 2024-04-26T23:45:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 -- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 msgr2=0x7f3b2c0ba790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3b2c0cfd90 0x7f3b2c0ba790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 -- 172.21.15.47:0/1747959868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b2c1633d0 msgr2=0x7f3b2c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b2c1633d0 0x7f3b2c0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f3b2aa00640 1 -- 172.21.15.47:0/1747959868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c0b5c40 con 0x7f3b2c15f360 2024-04-26T23:45:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b2aa00640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c0b3ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800d7d0 tx=0x7f3b1800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1e00a00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc15f130 0x7f1dfc1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1dfb400640 1 -- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0add90 msgr2=0x7f1dfc141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1dfb400640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dfc0add90 0x7f1dfc141d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1dfb400640 1 -- 172.21.15.47:0/907229375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc15f130 msgr2=0x7f1dfc1489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1dfb400640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1dfc15f130 0x7f1dfc1489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1dfb400640 1 -- 172.21.15.47:0/907229375 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc0b2040 con 0x7f1dfc0ae220 2024-04-26T23:45:38.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c40559b0 con 0x7f09c40dfe60 2024-04-26T23:45:38.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f09c4007500 0x7f09c4007930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f09c4007500 0x7f09c4007930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49360/0 (socket says 172.21.15.47:49360) 2024-04-26T23:45:38.607 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7f09d2000640 1 -- 172.21.15.47:0/2175605513 learned_addr learned my addr 172.21.15.47:0/2175605513 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb54801e070 con 0x7fb55c0cf430 2024-04-26T23:45:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.581+0000 7fb553400640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb53c068480 0x7fb53c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb548086e60 con 0x7fb55c0cf430 2024-04-26T23:45:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7fb553400640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7fb53c0706a0 0x7fb53c072ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 --> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb548001d40 con 0x7fb53c0706a0 2024-04-26T23:45:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb548087250 con 0x7fb55c0cf430 2024-04-26T23:45:38.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b03200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18018020 con 0x7f3b2c15f360 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b180096a0 con 0x7f3b2c15f360 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18009a90 con 0x7f3b2c15f360 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2c0b4660 con 0x7f3b2c15f360 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2c0b4c20 con 0x7f3b2c15f360 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b03200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f060 0x7f5b04203fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b03200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b0415f980 0x7f5b040ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b03200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5b040b75c0 con 0x7f5b0415f980 2024-04-26T23:45:38.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b03200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b040b7440 con 0x7f5b0415f060 2024-04-26T23:45:38.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b03200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5b040b7740 con 0x7f5b040ba930 2024-04-26T23:45:38.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b01400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f060 0x7f5b04203fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b01400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f060 0x7f5b04203fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53764/0 (socket says 172.21.15.47:53764) 2024-04-26T23:45:38.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b01400640 1 -- 172.21.15.47:0/148069692 learned_addr learned my addr 172.21.15.47:0/148069692 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1dfb400640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1dfc0ae220 0x7f1dfc0b1650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1de400c530 tx=0x7f1de400c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f90fe800640 1 --2- 172.21.15.47:0/2301630241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9100072a90 0x7f9100072f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009d90 tx=0x7f90f801c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02893bf6f5919dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09d0c00640 1 --2- 172.21.15.47:0/2175605513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c403b940 0x7f09c4006fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09d2a00640 1 -- 172.21.15.47:0/2175605513 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f09c40546b0 con 0x7f09c4007500 2024-04-26T23:45:38.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09d2a00640 1 -- 172.21.15.47:0/2175605513 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f09c4054910 con 0x7f09c403b940 2024-04-26T23:45:38.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7fb55aa00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb53c068480 0x7fb53c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7fb55be00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7fb53c0706a0 0x7fb53c072ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b2c0b4410 con 0x7f3b2c15f360 2024-04-26T23:45:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b02800640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b0415f980 0x7f5b040ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4017070 con 0x7f1dfc0ae220 2024-04-26T23:45:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc0b2320 con 0x7f1dfc0ae220 2024-04-26T23:45:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de4005cf0 con 0x7f1dfc0ae220 2024-04-26T23:45:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de4007270 con 0x7f1dfc0ae220 2024-04-26T23:45:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc14ed70 con 0x7f1dfc0ae220 2024-04-26T23:45:38.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09cbe00640 1 -- 172.21.15.47:0/2175605513 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768357704 0 0) 0x7f09c40559b0 con 0x7f09c40dfe60 2024-04-26T23:45:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f90fca00640 1 -- 172.21.15.47:0/2301630241 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f80b2070 con 0x7f9100072a90 2024-04-26T23:45:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f90fca00640 1 -- 172.21.15.47:0/2301630241 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f80a5940 con 0x7f9100072a90 2024-04-26T23:45:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f90fca00640 1 -- 172.21.15.47:0/2301630241 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f80a5d10 con 0x7f9100072a90 2024-04-26T23:45:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7fb55be00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7fb53c0706a0 0x7fb53c072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b01e00640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b01400640 1 -- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 msgr2=0x7f5b040cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b01400640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f5b01400640 1 -- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b0415f980 msgr2=0x7f5b040ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1dfc0695f0 con 0x7f1dfc0ae220 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 -- 172.21.15.47:0/2301630241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9100072a90 msgr2=0x7f9100072f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 --2- 172.21.15.47:0/2301630241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9100072a90 0x7f9100072f20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f90f8009d90 tx=0x7f90f801c9b0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 -- 172.21.15.47:0/2301630241 shutdown_connections 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 --2- 172.21.15.47:0/2301630241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9100072a90 0x7f9100072f20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 --2- 172.21.15.47:0/2301630241 >> v2:172.21.15.47:3300/0 conn(0x7f91000ae170 0x7f9100072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 -- 172.21.15.47:0/2301630241 >> 172.21.15.47:0/2301630241 conn(0x7f91000b3220 msgr2=0x7f91000d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09cbe00640 1 -- 172.21.15.47:0/2175605513 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09b4003530 con 0x7f09c40dfe60 2024-04-26T23:45:38.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f9f23200640 1 Processor -- start 2024-04-26T23:45:38.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f9f23200640 1 -- start start 2024-04-26T23:45:38.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7fb55aa00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb53c068480 0x7fb53c06a940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b4180 tx=0x7fb54c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b1801b020 con 0x7f3b2c15f360 2024-04-26T23:45:38.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b23400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b0c0683d0 0x7f3b0c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3b18087480 con 0x7f3b2c15f360 2024-04-26T23:45:38.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== osd.1 v2:172.21.15.47:6815/1652104230 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb548001d40 con 0x7fb53c0706a0 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b2b400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b0c0683d0 0x7f3b0c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b23400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f3b0c0705f0 0x7f3b0c072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 --> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b18001d40 con 0x7f3b0c0705f0 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f3b18087960 con 0x7f3b2c15f360 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b2be00640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f3b0c0705f0 0x7f3b0c072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b01400640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b0415f980 0x7f5b040ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b01400640 1 -- 172.21.15.47:0/148069692 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b040ca000 con 0x7f5b0415f060 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b01e00640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5b040ba930 0x7f5b040cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b02800640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5b0415f980 0x7f5b040ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:38.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b01400640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f060 0x7f5b04203fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5af00ac040 tx=0x7f5af001ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 -- 172.21.15.47:0/2301630241 shutdown_connections 2024-04-26T23:45:38.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9104e00640 1 -- 172.21.15.47:0/2301630241 wait complete. 2024-04-26T23:45:38.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09d2000640 1 -- 172.21.15.47:0/2175605513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c403b940 msgr2=0x7f09c4006fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09d2000640 1 --2- 172.21.15.47:0/2175605513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c403b940 0x7f09c4006fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09d2000640 1 -- 172.21.15.47:0/2175605513 >> v1:172.21.15.47:6789/0 conn(0x7f09c40dfe60 legacy=0x7f09c4053fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.585+0000 7f09d2000640 1 -- 172.21.15.47:0/2175605513 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c4054bf0 con 0x7f09c4007500 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f23200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9f24166f10 0x7f9f240d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f23200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f240d1440 0x7f9f24072380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f23200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2414d290 con 0x7f9f2414ceb0 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f23200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9f240d18b0 con 0x7f9f24166f10 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f23200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9f241673a0 con 0x7f9f240d1440 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00b3800 con 0x7f5b0415f060 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af00b39c0 con 0x7f5b0415f060 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00b3db0 con 0x7f5b0415f060 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b040ca2e0 con 0x7f5b0415f060 2024-04-26T23:45:38.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b040ca8a0 con 0x7f5b0415f060 2024-04-26T23:45:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f21e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9f2414ceb0 0x7f9f240b5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41264/0 (socket says 172.21.15.47:41264) 2024-04-26T23:45:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f21e00640 1 -- 172.21.15.47:0/2074551259 learned_addr learned my addr 172.21.15.47:0/2074551259 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f22800640 1 --2- 172.21.15.47:0/2074551259 >> v2:172.21.15.203:3300/0 conn(0x7f9f240d1440 0x7f9f24072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f9f1be00640 1 --2- 172.21.15.47:0/2074551259 >> v2:172.21.15.47:3300/0 conn(0x7f9f24166f10 0x7f9f240d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b040caca0 con 0x7f5b0415f060 2024-04-26T23:45:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.589+0000 7f3b2be00640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f3b0c0705f0 0x7f3b0c072a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 Processor -- start 2024-04-26T23:45:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9f21400640 1 -- 172.21.15.47:0/2074551259 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632883652 0 0) 0x7f9f2414d290 con 0x7f9f2414ceb0 2024-04-26T23:45:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9f21400640 1 -- 172.21.15.47:0/2074551259 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f08003530 con 0x7f9f2414ceb0 2024-04-26T23:45:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9f22800640 1 -- 172.21.15.47:0/2074551259 >> v2:172.21.15.47:3300/0 conn(0x7f9f24166f10 msgr2=0x7f9f240d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9f22800640 1 --2- 172.21.15.47:0/2074551259 >> v2:172.21.15.47:3300/0 conn(0x7f9f24166f10 0x7f9f240d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9f22800640 1 -- 172.21.15.47:0/2074551259 >> v1:172.21.15.47:6789/0 conn(0x7f9f2414ceb0 legacy=0x7f9f240b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 -- start start 2024-04-26T23:45:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9f22800640 1 -- 172.21.15.47:0/2074551259 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f24167680 con 0x7f9f240d1440 2024-04-26T23:45:38.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5af00b2380 con 0x7f5b0415f060 2024-04-26T23:45:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9100072a90 0x7f91000cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91000add90 0x7f91000cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91000ae170 0x7f9100143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f910006fe50 con 0x7f91000add90 2024-04-26T23:45:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f910006fcd0 con 0x7f9100072a90 2024-04-26T23:45:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f9104e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9100170a90 con 0x7f91000ae170 2024-04-26T23:45:38.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== osd.2 v2:172.21.15.47:6808/359275893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b18001d40 con 0x7f3b0c0705f0 2024-04-26T23:45:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1de401a070 con 0x7f1dfc0ae220 2024-04-26T23:45:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1df3e00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1dd8068380 0x7f1dd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1de4085d50 con 0x7f1dfc0ae220 2024-04-26T23:45:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1df3e00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f1dd8070600 0x7f1dd8072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 --> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1dd80730d0 con 0x7f1dd8070600 2024-04-26T23:45:38.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1de40883b0 con 0x7f1dfc0ae220 2024-04-26T23:45:38.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5afa000640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5ae4068380 0x7f5ae406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5af0120e30 con 0x7f5b0415f060 2024-04-26T23:45:38.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f3b2b400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b0c0683d0 0x7f3b0c06a890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0b7000 tx=0x7f3b1c0af070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5afa000640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7f5ae4070520 0x7f5ae4072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5b01e00640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5ae4068380 0x7f5ae406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 --> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5af0008f30 con 0x7f5ae4070520 2024-04-26T23:45:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5af0123450 con 0x7f5b0415f060 2024-04-26T23:45:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1e00a00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f1dd8070600 0x7f1dd8072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1dfbe00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1dd8068380 0x7f1dd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fe800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91000ae170 0x7f9100143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9100072a90 0x7f91000cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9100072a90 0x7f91000cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53780/0 (socket says 172.21.15.47:53780) 2024-04-26T23:45:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 -- 172.21.15.47:0/2772412220 learned_addr learned my addr 172.21.15.47:0/2772412220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f5b01e00640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5ae4068380 0x7f5ae406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5af40097a0 tx=0x7f5af4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 -- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91000ae170 msgr2=0x7f9100143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91000ae170 0x7f9100143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 -- 172.21.15.47:0/2772412220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91000add90 msgr2=0x7f91000cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f09d2000640 1 --2- 172.21.15.47:0/2175605513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c4007500 0x7f09c4007930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09cc051cc0 tx=0x7f09cc09d3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5afe43986a53345 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f09cbe00640 1 -- 172.21.15.47:0/2175605513 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc132070 con 0x7f09c4007500 2024-04-26T23:45:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f09cbe00640 1 -- 172.21.15.47:0/2175605513 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc12d400 con 0x7f09c4007500 2024-04-26T23:45:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f09cbe00640 1 -- 172.21.15.47:0/2175605513 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc12d870 con 0x7f09c4007500 2024-04-26T23:45:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91000add90 0x7f91000cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f90fde00640 1 -- 172.21.15.47:0/2772412220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91001594e0 con 0x7f9100072a90 2024-04-26T23:45:38.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f5b02800640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7f5ae4070520 0x7f5ae4072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1e00a00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f1dd8070600 0x7f1dd8072a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.593+0000 7f1dfbe00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1dd8068380 0x7f1dd806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00b450 tx=0x7f1dec00d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== osd.4 v2:172.21.15.203:6800/1053635883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1dd80730d0 con 0x7f1dd8070600 2024-04-26T23:45:38.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 -- 172.21.15.47:0/2175605513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c4007500 msgr2=0x7f09c4007930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 --2- 172.21.15.47:0/2175605513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c4007500 0x7f09c4007930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f09cc051cc0 tx=0x7f09cc09d3f0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f9f22800640 1 --2- 172.21.15.47:0/2074551259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f240d1440 0x7f9f24072380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f2406cfe0 tx=0x7f9f1c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=295cb581e5aeab4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f5b02800640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7f5ae4070520 0x7f5ae4072940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f9f21400640 1 -- 172.21.15.47:0/2074551259 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0b2070 con 0x7f9f240d1440 2024-04-26T23:45:38.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 -- 172.21.15.47:0/2175605513 shutdown_connections 2024-04-26T23:45:38.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 --2- 172.21.15.47:0/2175605513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c4007500 0x7f09c4007930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 --2- 172.21.15.47:0/2175605513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c403b940 0x7f09c4006fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 -- 172.21.15.47:0/2175605513 >> 172.21.15.47:0/2175605513 conn(0x7f09c4055bf0 msgr2=0x7f09c4056000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f9f21400640 1 -- 172.21.15.47:0/2074551259 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c0a5850 con 0x7f9f240d1440 2024-04-26T23:45:38.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f9f21400640 1 -- 172.21.15.47:0/2074551259 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0a5c20 con 0x7f9f240d1440 2024-04-26T23:45:38.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 -- 172.21.15.47:0/2175605513 shutdown_connections 2024-04-26T23:45:38.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f09d2a00640 1 -- 172.21.15.47:0/2175605513 wait complete. 2024-04-26T23:45:38.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.597+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== osd.3 v2:172.21.15.47:6824/570899367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5af0008f30 con 0x7f5ae4070520 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f90fde00640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9100072a90 0x7f91000cfe50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90f000c410 tx=0x7f90f000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f00074e0 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f00047f0 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0007680 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91001597c0 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91000d04f0 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91000695f0 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f90f0011070 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f90f6000640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90e00683d0 0x7f90e006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f90f0086550 con 0x7f9100072a90 2024-04-26T23:45:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f90f6000640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7f90e00705f0 0x7f90e0072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 --> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90e00730c0 con 0x7f90e00705f0 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f90f008d050 con 0x7f9100072a90 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f09d2a00640 1 Processor -- start 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f09d2a00640 1 -- start start 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f09d2a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c4007500 0x7f09c40d9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f09d2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c403b940 0x7f09c40e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f09d1600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c4007500 0x7f09c40d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f09d1600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c4007500 0x7f09c40d9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37508/0 (socket says 172.21.15.47:37508) 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c403b940 0x7f09c40e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c403b940 0x7f09c40e04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49394/0 (socket says 172.21.15.47:49394) 2024-04-26T23:45:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d1600640 1 -- 172.21.15.47:0/613269184 learned_addr learned my addr 172.21.15.47:0/613269184 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d2a00640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09c40dfe60 0x7f09c40dbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d2a00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4055490 con 0x7f09c403b940 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d2a00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f09c40551b0 con 0x7f09c40dfe60 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d2a00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f09c40e0240 con 0x7f09c4007500 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 -- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c4007500 msgr2=0x7f09c40d9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c4007500 0x7f09c40d9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 -- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09c40dfe60 msgr2=0x7f09c40dbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f09c40dfe60 0x7f09c40dbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c40e21b0 con 0x7f09c403b940 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d1600640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f09c4007500 0x7f09c40d9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d0c00640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c403b940 0x7f09c40e04b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f09c000d620 tx=0x7f09c000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c000b620 con 0x7f09c403b940 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d2a00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c40e2490 con 0x7f09c403b940 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09d2a00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c40e2d30 con 0x7f09c403b940 2024-04-26T23:45:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c0019070 con 0x7f09c403b940 2024-04-26T23:45:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.605+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c000b620 con 0x7f09c403b940 2024-04-26T23:45:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f9f23200640 1 -- 172.21.15.47:0/2074551259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f240d1440 msgr2=0x7f9f24072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.601+0000 7f9f23200640 1 --2- 172.21.15.47:0/2074551259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f240d1440 0x7f9f24072380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f2406cfe0 tx=0x7f9f1c01c8e0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f09d2a00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09a8001040 con 0x7f09c403b940 2024-04-26T23:45:38.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f9f23200640 1 -- 172.21.15.47:0/2074551259 shutdown_connections 2024-04-26T23:45:38.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f9f23200640 1 --2- 172.21.15.47:0/2074551259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f240d1440 0x7f9f24072380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f90fd400640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90e00683d0 0x7f90e006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f90fe800640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7f90e00705f0 0x7f90e0072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f9f23200640 1 --2- 172.21.15.47:0/2074551259 >> v2:172.21.15.47:3300/0 conn(0x7f9f24166f10 0x7f9f240d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f9f23200640 1 -- 172.21.15.47:0/2074551259 >> 172.21.15.47:0/2074551259 conn(0x7f9f2406c400 msgr2=0x7f9f2406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f9f23200640 1 -- 172.21.15.47:0/2074551259 shutdown_connections 2024-04-26T23:45:38.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f9f23200640 1 -- 172.21.15.47:0/2074551259 wait complete. 2024-04-26T23:45:38.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f90fd400640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90e00683d0 0x7f90e006a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90ec006e90 tx=0x7f90ec006de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f90fe800640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7f90e00705f0 0x7f90e0072a10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== osd.5 v2:172.21.15.203:6803/4078733335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90e00730c0 con 0x7f90e00705f0 2024-04-26T23:45:38.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.609+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09c000b7c0 con 0x7f09c403b940 2024-04-26T23:45:38.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09c9600640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f09ac068780 0x7f09ac06ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 Processor -- start 2024-04-26T23:45:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f09c000f040 con 0x7f09c403b940 2024-04-26T23:45:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 -- start start 2024-04-26T23:45:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09d1600640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f09ac068780 0x7f09ac06ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09c9600640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f09ac071570 0x7f09ac073a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09ac0740e0 con 0x7f09ac071570 2024-04-26T23:45:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240d1440 0x7f9f241631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2414ceb0 0x7f9f2409da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2409dfb0 0x7f9f24165840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f24073250 con 0x7f9f2414ceb0 2024-04-26T23:45:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f240730d0 con 0x7f9f2409dfb0 2024-04-26T23:45:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f9f23200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f240733d0 con 0x7f9f240d1440 2024-04-26T23:45:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f09c0053a50 con 0x7f09c403b940 2024-04-26T23:45:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09d2000640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f09ac071570 0x7f09ac073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 --> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4cb80694e0 con 0x7f4c980706a0 2024-04-26T23:45:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240d1440 0x7f9f241631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240d1440 0x7f9f241631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37522/0 (socket says 172.21.15.47:37522) 2024-04-26T23:45:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 -- 172.21.15.47:0/1907679132 learned_addr learned my addr 172.21.15.47:0/1907679132 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f1be00640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2414ceb0 0x7f9f2409da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09d1600640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f09ac068780 0x7f09ac06ac40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f09b80011f0 tx=0x7f09b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f22800640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2409dfb0 0x7f9f24165840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.613+0000 7f09d2000640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f09ac071570 0x7f09ac073a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 -- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2409dfb0 msgr2=0x7f9f24165840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f2409dfb0 0x7f9f24165840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== osd.6 v2:172.21.15.203:6817/2269063813 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09ac0740e0 con 0x7f09ac071570 2024-04-26T23:45:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4cae000640 1 -- 172.21.15.47:0/1835247335 <== osd.0 v2:172.21.15.47:6800/4189436008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4cb80694e0 con 0x7f4c980706a0 2024-04-26T23:45:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 -- 172.21.15.47:0/1907679132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2414ceb0 msgr2=0x7f9f2409da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2414ceb0 0x7f9f2409da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 -- 172.21.15.47:0/1907679132 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2414b150 con 0x7f9f240d1440 2024-04-26T23:45:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f1be00640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f2414ceb0 0x7f9f2409da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f21e00640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240d1440 0x7f9f241631f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c530 tx=0x7f9f0c00c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f4c980706a0 msgr2=0x7f4c98072ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f4c980706a0 0x7f4c98072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c98068480 msgr2=0x7f4c9806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c98068480 0x7f4c9806a940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8000f70 tx=0x7f4ca8007a10 comp rx=0 tx=0).stop 2024-04-26T23:45:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb80d3b40 msgr2=0x7f4cb806cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 --2- 172.21.15.47:0/1835247335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4cb80d3b40 0x7f4cb806cf40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000efc0 tx=0x7f4cb000c490 comp rx=0 tx=0).stop 2024-04-26T23:45:38.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4cb7200640 1 -- 172.21.15.47:0/1835247335 reap_dead start 2024-04-26T23:45:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c018070 con 0x7f9f240d1440 2024-04-26T23:45:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 shutdown_connections 2024-04-26T23:45:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 >> 172.21.15.47:0/1835247335 conn(0x7f4cb809e450 msgr2=0x7f4cb80b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c0074e0 con 0x7f9f240d1440 2024-04-26T23:45:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c004a30 con 0x7f9f240d1440 2024-04-26T23:45:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2414a0b0 con 0x7f9f240d1440 2024-04-26T23:45:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2414a670 con 0x7f9f240d1440 2024-04-26T23:45:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.617+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f24069470 con 0x7f9f240d1440 2024-04-26T23:45:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 --> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1dfc15e630 con 0x7f1dd8070600 2024-04-26T23:45:38.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 shutdown_connections 2024-04-26T23:45:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f4ca3400640 1 -- 172.21.15.47:0/1835247335 wait complete. 2024-04-26T23:45:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1df3e00640 1 -- 172.21.15.47:0/907229375 <== osd.4 v2:172.21.15.203:6800/1053635883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1dfc15e630 con 0x7f1dd8070600 2024-04-26T23:45:38.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f1dd8070600 msgr2=0x7f1dd8072a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e02a00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f1dd8070600 0x7f1dd8072a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1dd8068380 msgr2=0x7f1dd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e02a00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1dd8068380 0x7f1dd806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00b450 tx=0x7f1dec00d040 comp rx=0 tx=0).stop 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1dfc0ae220 msgr2=0x7f1dfc0b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e02a00640 1 --2- 172.21.15.47:0/907229375 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1dfc0ae220 0x7f1dfc0b1650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1de400c530 tx=0x7f1de400c9f0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f1e00a00640 1 -- 172.21.15.47:0/907229375 reap_dead start 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f0c01b070 con 0x7f9f240d1440 2024-04-26T23:45:38.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 --> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb55c157810 con 0x7fb53c0706a0 2024-04-26T23:45:38.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.621+0000 7f9f1a000640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f00068400 0x7f9f0006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9f0c085e10 con 0x7f9f240d1440 2024-04-26T23:45:38.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f9f1a000640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f9f00070620 0x7f9f00072a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 --> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f0c017ec0 con 0x7f9f00070620 2024-04-26T23:45:38.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9f0c0862f0 con 0x7f9f240d1440 2024-04-26T23:45:38.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 shutdown_connections 2024-04-26T23:45:38.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 >> 172.21.15.47:0/907229375 conn(0x7f1dfc0b3220 msgr2=0x7f1dfc068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 shutdown_connections 2024-04-26T23:45:38.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f1e02a00640 1 -- 172.21.15.47:0/907229375 wait complete. 2024-04-26T23:45:38.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb553400640 1 -- 172.21.15.47:0/761049232 <== osd.1 v2:172.21.15.47:6815/1652104230 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb55c157810 con 0x7fb53c0706a0 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7fb53c0706a0 msgr2=0x7fb53c072ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7fb53c0706a0 0x7fb53c072ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb53c068480 msgr2=0x7fb53c06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb53c068480 0x7fb53c06a940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb55c0b4180 tx=0x7fb54c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0cf430 msgr2=0x7fb55c0cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 --2- 172.21.15.47:0/761049232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb55c0cf430 0x7fb55c0cdfa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb54800b730 tx=0x7fb54800e0c0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb55be00640 1 -- 172.21.15.47:0/761049232 reap_dead start 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 shutdown_connections 2024-04-26T23:45:38.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 >> 172.21.15.47:0/761049232 conn(0x7fb55c0b27c0 msgr2=0x7fb55c0af160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f9f1be00640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f00068400 0x7f9f0006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f9f22800640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f9f00070620 0x7f9f00072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.625+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 --> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b2c0695f0 con 0x7f3b0c0705f0 2024-04-26T23:45:38.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 shutdown_connections 2024-04-26T23:45:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f9f22800640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f9f00070620 0x7f9f00072a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f9f1be00640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f00068400 0x7f9f0006a8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f24165200 tx=0x7f9f14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b23400640 1 -- 172.21.15.47:0/1747959868 <== osd.2 v2:172.21.15.47:6808/359275893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b2c0695f0 con 0x7f3b0c0705f0 2024-04-26T23:45:38.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7fb550c00640 1 -- 172.21.15.47:0/761049232 wait complete. 2024-04-26T23:45:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== osd.7 v2:172.21.15.203:6816/3653597910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f0c017ec0 con 0x7f9f00070620 2024-04-26T23:45:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f3b0c0705f0 msgr2=0x7f3b0c072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f3b0c0705f0 0x7f3b0c072a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b0c0683d0 msgr2=0x7f3b0c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b0c0683d0 0x7f3b0c06a890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c0b7000 tx=0x7f3b1c0af070 comp rx=0 tx=0).stop 2024-04-26T23:45:38.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 msgr2=0x7f3b2c0b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 --2- 172.21.15.47:0/1747959868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b2c15f360 0x7f3b2c0b3ed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800d7d0 tx=0x7f3b1800dc90 comp rx=0 tx=0).stop 2024-04-26T23:45:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b2be00640 1 -- 172.21.15.47:0/1747959868 reap_dead start 2024-04-26T23:45:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 shutdown_connections 2024-04-26T23:45:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 >> 172.21.15.47:0/1747959868 conn(0x7f3b2c09e3c0 msgr2=0x7f3b2c06e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 --> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b04069470 con 0x7f5ae4070520 2024-04-26T23:45:38.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.629+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 shutdown_connections 2024-04-26T23:45:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5afa000640 1 -- 172.21.15.47:0/148069692 <== osd.3 v2:172.21.15.47:6824/570899367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b04069470 con 0x7f5ae4070520 2024-04-26T23:45:38.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f3b32400640 1 -- 172.21.15.47:0/1747959868 wait complete. 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7f5ae4070520 msgr2=0x7f5ae4072940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7f5ae4070520 0x7f5ae4072940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5ae4068380 msgr2=0x7f5ae406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5ae4068380 0x7f5ae406a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5af40097a0 tx=0x7f5af4008040 comp rx=0 tx=0).stop 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f060 msgr2=0x7f5b04203fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 --2- 172.21.15.47:0/148069692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b0415f060 0x7f5b04203fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5af00ac040 tx=0x7f5af001ad50 comp rx=0 tx=0).stop 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b02800640 1 -- 172.21.15.47:0/148069692 reap_dead start 2024-04-26T23:45:38.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 --> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91000cd440 con 0x7f90e00705f0 2024-04-26T23:45:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 shutdown_connections 2024-04-26T23:45:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.633+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 >> 172.21.15.47:0/148069692 conn(0x7f5b0406c800 msgr2=0x7f5b040b8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.637+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 shutdown_connections 2024-04-26T23:45:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.637+0000 7f5b03200640 1 -- 172.21.15.47:0/148069692 wait complete. 2024-04-26T23:45:38.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.637+0000 7f90f6000640 1 -- 172.21.15.47:0/2772412220 <== osd.5 v2:172.21.15.203:6803/4078733335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f91000cd440 con 0x7f90e00705f0 2024-04-26T23:45:38.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.637+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7f90e00705f0 msgr2=0x7f90e0072a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.637+0000 7f9104e00640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7f90e00705f0 0x7f90e0072a10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.641+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90e00683d0 msgr2=0x7f90e006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.641+0000 7f9104e00640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90e00683d0 0x7f90e006a890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90ec006e90 tx=0x7f90ec006de0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.641+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9100072a90 msgr2=0x7f91000cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.641+0000 7f9104e00640 1 --2- 172.21.15.47:0/2772412220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9100072a90 0x7f91000cfe50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90f000c410 tx=0x7f90f000c8d0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.641+0000 7f90fe800640 1 -- 172.21.15.47:0/2772412220 reap_dead start 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.641+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 shutdown_connections 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.641+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 >> 172.21.15.47:0/2772412220 conn(0x7f91000b3220 msgr2=0x7f91000b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.645+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 shutdown_connections 2024-04-26T23:45:38.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.645+0000 7f9104e00640 1 -- 172.21.15.47:0/2772412220 wait complete. 2024-04-26T23:45:38.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09d2a00640 1 -- 172.21.15.47:0/613269184 --> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09a8002de0 con 0x7f09ac071570 2024-04-26T23:45:38.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09c9600640 1 -- 172.21.15.47:0/613269184 <== osd.6 v2:172.21.15.203:6817/2269063813 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09a8002de0 con 0x7f09ac071570 2024-04-26T23:45:38.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 -- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f09ac071570 msgr2=0x7f09ac073a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f09ac071570 0x7f09ac073a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 -- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f09ac068780 msgr2=0x7f09ac06ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f09ac068780 0x7f09ac06ac40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f09b80011f0 tx=0x7f09b8009040 comp rx=0 tx=0).stop 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 -- 172.21.15.47:0/613269184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c403b940 msgr2=0x7f09c40e04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 --2- 172.21.15.47:0/613269184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09c403b940 0x7f09c40e04b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f09c000d620 tx=0x7f09c000dae0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09d2000640 1 -- 172.21.15.47:0/613269184 reap_dead start 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 -- 172.21.15.47:0/613269184 shutdown_connections 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 -- 172.21.15.47:0/613269184 >> 172.21.15.47:0/613269184 conn(0x7f09c4055bf0 msgr2=0x7f09c4037ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 -- 172.21.15.47:0/613269184 shutdown_connections 2024-04-26T23:45:38.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.649+0000 7f09bea00640 1 -- 172.21.15.47:0/613269184 wait complete. 2024-04-26T23:45:38.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.661+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 --> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9f240b1310 con 0x7f9f00070620 2024-04-26T23:45:38.669 INFO:teuthology.orchestra.run.smithi047.stdout:60129542152 2024-04-26T23:45:38.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:45:38.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.661+0000 7f9f1a000640 1 -- 172.21.15.47:0/1907679132 <== osd.7 v2:172.21.15.203:6816/3653597910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9f240b1310 con 0x7f9f00070620 2024-04-26T23:45:38.670 INFO:teuthology.orchestra.run.smithi047.stdout:64424509446 2024-04-26T23:45:38.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:45:38.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f9f00070620 msgr2=0x7f9f00072a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f9f00070620 0x7f9f00072a40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f00068400 msgr2=0x7f9f0006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f00068400 0x7f9f0006a8c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f24165200 tx=0x7f9f14008040 comp rx=0 tx=0).stop 2024-04-26T23:45:38.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240d1440 msgr2=0x7f9f241631f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 --2- 172.21.15.47:0/1907679132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f240d1440 0x7f9f241631f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00c530 tx=0x7f9f0c00c9f0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f22800640 1 -- 172.21.15.47:0/1907679132 reap_dead start 2024-04-26T23:45:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 shutdown_connections 2024-04-26T23:45:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 >> 172.21.15.47:0/1907679132 conn(0x7f9f2406c400 msgr2=0x7f9f240ae160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 shutdown_connections 2024-04-26T23:45:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.665+0000 7f9f23200640 1 -- 172.21.15.47:0/1907679132 wait complete. 2024-04-26T23:45:38.678 INFO:teuthology.orchestra.run.smithi047.stdout:64424509445 2024-04-26T23:45:38.679 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:45:38.683 INFO:teuthology.orchestra.run.smithi047.stdout:64424509445 2024-04-26T23:45:38.683 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:45:38.689 INFO:teuthology.orchestra.run.smithi047.stdout:64424509446 2024-04-26T23:45:38.689 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:45:38.691 INFO:teuthology.orchestra.run.smithi047.stdout:64424509445 2024-04-26T23:45:38.691 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:45:38.698 INFO:teuthology.orchestra.run.smithi047.stdout:64424509446 2024-04-26T23:45:38.699 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:45:38.705 INFO:teuthology.orchestra.run.smithi047.stdout:64424509446 2024-04-26T23:45:38.706 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:45:38.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.901+0000 7feb7f200640 1 Processor -- start 2024-04-26T23:45:38.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.901+0000 7feb7f200640 1 -- start start 2024-04-26T23:45:38.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d31f0 0x7feb800d5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7f200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7feb800d56b0 0x7feb800b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7f200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb800d0570 con 0x7feb8015f340 2024-04-26T23:45:38.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7f200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7feb800d0350 con 0x7feb800d56b0 2024-04-26T23:45:38.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feb800d5b40 con 0x7feb800d31f0 2024-04-26T23:45:38.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a1400640 1 Processor -- start 2024-04-26T23:45:38.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a1400640 1 -- start start 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7e800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7feb800d56b0 0x7feb800b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7e800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7feb800d56b0 0x7feb800b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53792/0 (socket says 172.21.15.47:53792) 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7e800640 1 -- 172.21.15.47:0/3173579701 learned_addr learned my addr 172.21.15.47:0/3173579701 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7d400640 1 --2- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d31f0 0x7feb800d5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7e800640 1 -- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d31f0 msgr2=0x7feb800d5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7e800640 1 --2- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d31f0 0x7feb800d5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7e800640 1 -- 172.21.15.47:0/3173579701 >> v1:172.21.15.47:6789/0 conn(0x7feb8015f340 legacy=0x7feb800cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7e800640 1 -- 172.21.15.47:0/3173579701 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb800d0850 con 0x7feb800d56b0 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7feb7d400640 1 --2- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d31f0 0x7feb800d5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:38.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a1400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f279c073e10 0x7f279c0b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c0b73f0 0x7f279c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a1400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279c0b8a20 con 0x7f279c0741f0 2024-04-26T23:45:38.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a1400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f279c0cf8b0 con 0x7f279c073e10 2024-04-26T23:45:38.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a1400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f279c06d920 con 0x7f279c0b73f0 2024-04-26T23:45:38.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c0b73f0 0x7f279c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f279be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f279c073e10 0x7f279c0b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c0b73f0 0x7f279c0d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37532/0 (socket says 172.21.15.47:37532) 2024-04-26T23:45:38.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.905+0000 7f27a0a00640 1 -- 172.21.15.47:0/3348486472 learned_addr learned my addr 172.21.15.47:0/3348486472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7f27a0a00640 1 -- 172.21.15.47:0/3348486472 >> v2:172.21.15.47:3300/0 conn(0x7f279c073e10 msgr2=0x7f279c0b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7f27a0a00640 1 --2- 172.21.15.47:0/3348486472 >> v2:172.21.15.47:3300/0 conn(0x7f279c073e10 0x7f279c0b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7f27a0a00640 1 -- 172.21.15.47:0/3348486472 >> v1:172.21.15.47:6789/0 conn(0x7f279c0741f0 legacy=0x7f279c0b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7f279be00640 1 --2- 172.21.15.47:0/3348486472 >> v2:172.21.15.47:3300/0 conn(0x7f279c073e10 0x7f279c0b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:38.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7feb7e800640 1 --2- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb800d56b0 0x7feb800b5130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009870 tx=0x7feb6c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e48732fbbe2f2bbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7feb7ca00640 1 -- 172.21.15.47:0/3173579701 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0b2070 con 0x7feb800d56b0 2024-04-26T23:45:38.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7feb7ca00640 1 -- 172.21.15.47:0/3173579701 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6c0a9070 con 0x7feb800d56b0 2024-04-26T23:45:38.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7feb7ca00640 1 -- 172.21.15.47:0/3173579701 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0ad880 con 0x7feb800d56b0 2024-04-26T23:45:38.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.909+0000 7f27a0a00640 1 -- 172.21.15.47:0/3348486472 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c06d2d0 con 0x7f279c0b73f0 2024-04-26T23:45:38.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 -- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb800d56b0 msgr2=0x7feb800b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 --2- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb800d56b0 0x7feb800b5130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009870 tx=0x7feb6c01c490 comp rx=0 tx=0).stop 2024-04-26T23:45:38.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 -- 172.21.15.47:0/3173579701 shutdown_connections 2024-04-26T23:45:38.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 --2- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb800d56b0 0x7feb800b5130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 --2- 172.21.15.47:0/3173579701 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d31f0 0x7feb800d5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 -- 172.21.15.47:0/3173579701 >> 172.21.15.47:0/3173579701 conn(0x7feb80075dc0 msgr2=0x7feb8009e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 -- 172.21.15.47:0/3173579701 shutdown_connections 2024-04-26T23:45:38.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 -- 172.21.15.47:0/3173579701 wait complete. 2024-04-26T23:45:38.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7f27a0a00640 1 --2- 172.21.15.47:0/3348486472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c0b73f0 0x7f279c0d0a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2794009e50 tx=0x7f279401ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3673a4686a8fbadc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7f279aa00640 1 -- 172.21.15.47:0/3348486472 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27940a5700 con 0x7f279c0b73f0 2024-04-26T23:45:38.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7f279aa00640 1 -- 172.21.15.47:0/3348486472 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27940a58a0 con 0x7f279c0b73f0 2024-04-26T23:45:38.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7f279aa00640 1 -- 172.21.15.47:0/3348486472 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27940a5700 con 0x7f279c0b73f0 2024-04-26T23:45:38.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.913+0000 7feb7f200640 1 Processor -- start 2024-04-26T23:45:38.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7f27a1400640 1 -- 172.21.15.47:0/3348486472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c0b73f0 msgr2=0x7f279c0d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7f27a1400640 1 --2- 172.21.15.47:0/3348486472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c0b73f0 0x7f279c0d0a50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2794009e50 tx=0x7f279401ca50 comp rx=0 tx=0).stop 2024-04-26T23:45:38.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7f200640 1 -- start start 2024-04-26T23:45:38.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb800d31f0 0x7feb80153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d56b0 0x7feb801545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb8015f340 0x7feb80157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb800b5e80 con 0x7feb800d31f0 2024-04-26T23:45:38.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7f27a1400640 1 -- 172.21.15.47:0/3348486472 shutdown_connections 2024-04-26T23:45:38.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7f27a1400640 1 --2- 172.21.15.47:0/3348486472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c0b73f0 0x7f279c0d0a50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7f27a1400640 1 --2- 172.21.15.47:0/3348486472 >> v2:172.21.15.47:3300/0 conn(0x7f279c073e10 0x7f279c0b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7f27a1400640 1 -- 172.21.15.47:0/3348486472 >> 172.21.15.47:0/3348486472 conn(0x7f279c0d1ce0 msgr2=0x7f279c0d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d56b0 0x7feb801545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d56b0 0x7feb801545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37544/0 (socket says 172.21.15.47:37544) 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7d400640 1 -- 172.21.15.47:0/4143932613 learned_addr learned my addr 172.21.15.47:0/4143932613 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7e800640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb8015f340 0x7feb80157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb800b6000 con 0x7feb8015f340 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feb800b6180 con 0x7feb800d56b0 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7e800640 1 -- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d56b0 msgr2=0x7feb801545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7e800640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d56b0 0x7feb801545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7e800640 1 -- 172.21.15.47:0/4143932613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb800d31f0 msgr2=0x7feb80153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7e800640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb800d31f0 0x7feb80153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.917+0000 7feb7e800640 1 -- 172.21.15.47:0/4143932613 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb80154f50 con 0x7feb8015f340 2024-04-26T23:45:38.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7feb7e800640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb8015f340 0x7feb80157210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0ac000 tx=0x7feb6c01acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7f27a1400640 1 -- 172.21.15.47:0/3348486472 shutdown_connections 2024-04-26T23:45:38.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7feb76000640 1 -- 172.21.15.47:0/4143932613 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0bc020 con 0x7feb8015f340 2024-04-26T23:45:38.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb80155230 con 0x7feb8015f340 2024-04-26T23:45:38.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb801557f0 con 0x7feb8015f340 2024-04-26T23:45:38.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7feb76000640 1 -- 172.21.15.47:0/4143932613 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6c0ade20 con 0x7feb8015f340 2024-04-26T23:45:38.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7feb76000640 1 -- 172.21.15.47:0/4143932613 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0bc020 con 0x7feb8015f340 2024-04-26T23:45:38.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7f27a1400640 1 -- 172.21.15.47:0/3348486472 wait complete. 2024-04-26T23:45:38.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb580052a0 con 0x7feb8015f340 2024-04-26T23:45:38.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7fea44a00640 1 Processor -- start 2024-04-26T23:45:38.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7f27a1400640 1 Processor -- start 2024-04-26T23:45:38.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.921+0000 7f27a1400640 1 -- start start 2024-04-26T23:45:38.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7feb76000640 1 -- 172.21.15.47:0/4143932613 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb6c0bf020 con 0x7feb8015f340 2024-04-26T23:45:38.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7fea44a00640 1 -- start start 2024-04-26T23:45:38.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f4295200640 1 Processor -- start 2024-04-26T23:45:38.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f27a1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c073e10 0x7f279c1647f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f27a1400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f279c0741f0 0x7f279c1665d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7feb76000640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb600685b0 0x7feb6006aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f279be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c073e10 0x7f279c1647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f279be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c073e10 0x7f279c1647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37550/0 (socket says 172.21.15.47:37550) 2024-04-26T23:45:38.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7feb76000640 1 -- 172.21.15.47:0/4143932613 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7feb6c120750 con 0x7feb8015f340 2024-04-26T23:45:38.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f279b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f279c0741f0 0x7f279c1665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f279b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f279c0741f0 0x7f279c1665d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53806/0 (socket says 172.21.15.47:53806) 2024-04-26T23:45:38.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f4295200640 1 -- start start 2024-04-26T23:45:38.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7fea44a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea4006fa20 0x7fea400af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f279be00640 1 -- 172.21.15.47:0/4160369517 learned_addr learned my addr 172.21.15.47:0/4160369517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7fea44a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea400afc10 con 0x7fea40072490 2024-04-26T23:45:38.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7fea44a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea400afef0 con 0x7fea400af060 2024-04-26T23:45:38.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7fea44a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea400b01d0 con 0x7fea4006fa20 2024-04-26T23:45:38.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f27a1400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c0b73f0 0x7f279c200070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f4295200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f4290167bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f279c06e040 con 0x7f279c0b73f0 2024-04-26T23:45:38.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.925+0000 7f4295200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f429006c630 0x7f429006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f27a0a00640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c0b73f0 0x7f279c200070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4295200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42900b5fe0 con 0x7f4290163af0 2024-04-26T23:45:38.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4295200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f42901646d0 con 0x7f429006c630 2024-04-26T23:45:38.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4295200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f42901649b0 con 0x7f4290161070 2024-04-26T23:45:38.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7feb7de00640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb600685b0 0x7feb6006aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7fea3e800640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fea400af060 0x7fea40073c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57250/0 (socket says 172.21.15.47:57250) 2024-04-26T23:45:38.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7fea3e800640 1 -- 172.21.15.47:0/1682202936 learned_addr learned my addr 172.21.15.47:0/1682202936 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:38.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4287e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f429006c630 0x7f429006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4287e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f429006c630 0x7f429006cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49430/0 (socket says 172.21.15.47:49430) 2024-04-26T23:45:38.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4287e00640 1 -- 172.21.15.47:0/662644154 learned_addr learned my addr 172.21.15.47:0/662644154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7fea3de00640 1 --2- 172.21.15.47:0/1682202936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea4006fa20 0x7fea400af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0b8800 con 0x7f279c0741f0 2024-04-26T23:45:38.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f279c06e1c0 con 0x7f279c073e10 2024-04-26T23:45:38.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7feb7de00640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb600685b0 0x7feb6006aa70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb80160c10 tx=0x7feb78009250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f428de00640 1 --2- 172.21.15.47:0/662644154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f4290167bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7fea3de00640 1 -- 172.21.15.47:0/1682202936 >> v1:172.21.15.203:6789/0 conn(0x7fea400af060 legacy=0x7fea40073c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7fea3de00640 1 -- 172.21.15.47:0/1682202936 >> v1:172.21.15.47:6789/0 conn(0x7fea40072490 legacy=0x7fea400d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7fea3de00640 1 -- 172.21.15.47:0/1682202936 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea400b04b0 con 0x7fea4006fa20 2024-04-26T23:45:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f279b400640 1 -- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c073e10 msgr2=0x7f279c1647f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f279b400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c073e10 0x7f279c1647f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f279b400640 1 -- 172.21.15.47:0/4160369517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c0b73f0 msgr2=0x7f279c200070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f279b400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c0b73f0 0x7f279c200070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f279b400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c166b10 con 0x7f279c0741f0 2024-04-26T23:45:38.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f27a0a00640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c0b73f0 0x7f279c200070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7feb76000640 1 -- 172.21.15.47:0/4143932613 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb6c0c6030 con 0x7feb8015f340 2024-04-26T23:45:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4287e00640 1 -- 172.21.15.47:0/662644154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 msgr2=0x7f4290167bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4287e00640 1 --2- 172.21.15.47:0/662644154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f4290167bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4287e00640 1 -- 172.21.15.47:0/662644154 >> v1:172.21.15.203:6789/0 conn(0x7f4290163af0 legacy=0x7f42900add90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:45:38.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f4287e00640 1 -- 172.21.15.47:0/662644154 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4290167110 con 0x7f429006c630 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f279b400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f279c0741f0 0x7f279c1665d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2788000f70 tx=0x7f278800c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f2793e00640 1 -- 172.21.15.47:0/4160369517 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788017070 con 0x7f279c0741f0 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f2793e00640 1 -- 172.21.15.47:0/4160369517 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27880052d0 con 0x7f279c0741f0 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f2793e00640 1 -- 172.21.15.47:0/4160369517 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27880054c0 con 0x7f279c0741f0 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c200950 con 0x7f279c0741f0 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.929+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c200f10 con 0x7f279c0741f0 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.933+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c069b80 con 0x7f279c0741f0 2024-04-26T23:45:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea3de00640 1 --2- 172.21.15.47:0/1682202936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea4006fa20 0x7fea400af440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0097f0 tx=0x7fea2c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8f5958082b4c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea3d400640 1 -- 172.21.15.47:0/1682202936 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0b0070 con 0x7fea4006fa20 2024-04-26T23:45:38.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea3d400640 1 -- 172.21.15.47:0/1682202936 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea2c0ab600 con 0x7fea4006fa20 2024-04-26T23:45:38.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea3d400640 1 -- 172.21.15.47:0/1682202936 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0ab9d0 con 0x7fea4006fa20 2024-04-26T23:45:38.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.933+0000 7f2793e00640 1 -- 172.21.15.47:0/4160369517 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f278801a070 con 0x7f279c0741f0 2024-04-26T23:45:38.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f2793e00640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f277c068450 0x7f277c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f2793e00640 1 -- 172.21.15.47:0/4160369517 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2788085b80 con 0x7f279c0741f0 2024-04-26T23:45:38.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4287e00640 1 --2- 172.21.15.47:0/662644154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 0x7f429006cab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4278009870 tx=0x7f427801c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15146a9d8a75c14d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f279be00640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f277c068450 0x7f277c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f428d400640 1 -- 172.21.15.47:0/662644154 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42780b0070 con 0x7f429006c630 2024-04-26T23:45:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f428d400640 1 -- 172.21.15.47:0/662644154 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42780ab600 con 0x7f429006c630 2024-04-26T23:45:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f428d400640 1 -- 172.21.15.47:0/662644154 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42780b0070 con 0x7f429006c630 2024-04-26T23:45:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4295200640 1 -- 172.21.15.47:0/662644154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 msgr2=0x7f429006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4295200640 1 --2- 172.21.15.47:0/662644154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 0x7f429006cab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4278009870 tx=0x7f427801c2b0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4295200640 1 -- 172.21.15.47:0/662644154 shutdown_connections 2024-04-26T23:45:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4295200640 1 --2- 172.21.15.47:0/662644154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 0x7f429006cab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4295200640 1 --2- 172.21.15.47:0/662644154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f4290167bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4295200640 1 -- 172.21.15.47:0/662644154 >> 172.21.15.47:0/662644154 conn(0x7f42900b2d40 msgr2=0x7f42900b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea44a00640 1 -- 172.21.15.47:0/1682202936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea4006fa20 msgr2=0x7fea400af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea44a00640 1 --2- 172.21.15.47:0/1682202936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea4006fa20 0x7fea400af440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0097f0 tx=0x7fea2c01c4e0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f279be00640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f277c068450 0x7f277c06a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f278c009b40 tx=0x7f278c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7f4295200640 1 -- 172.21.15.47:0/662644154 shutdown_connections 2024-04-26T23:45:38.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea44a00640 1 -- 172.21.15.47:0/1682202936 shutdown_connections 2024-04-26T23:45:38.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea44a00640 1 --2- 172.21.15.47:0/1682202936 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea4006fa20 0x7fea400af440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea44a00640 1 -- 172.21.15.47:0/1682202936 >> 172.21.15.47:0/1682202936 conn(0x7fea4006c400 msgr2=0x7fea4006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea44a00640 1 -- 172.21.15.47:0/1682202936 shutdown_connections 2024-04-26T23:45:38.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.937+0000 7fea44a00640 1 -- 172.21.15.47:0/1682202936 wait complete. 2024-04-26T23:45:38.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.941+0000 7f2793e00640 1 -- 172.21.15.47:0/4160369517 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2788055b60 con 0x7f279c0741f0 2024-04-26T23:45:38.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.941+0000 7f4295200640 1 -- 172.21.15.47:0/662644154 wait complete. 2024-04-26T23:45:38.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.941+0000 7f18c8800640 1 Processor -- start 2024-04-26T23:45:38.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.941+0000 7fea44a00640 1 Processor -- start 2024-04-26T23:45:38.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.941+0000 7f18c8800640 1 -- start start 2024-04-26T23:45:38.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.941+0000 7f4295200640 1 Processor -- start 2024-04-26T23:45:38.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.941+0000 7fea44a00640 1 -- start start 2024-04-26T23:45:38.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea44a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea4006fa20 0x7fea400b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea44a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea40072490 0x7fea400b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea44a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea400af060 0x7fea401562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea44a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea40163760 con 0x7fea4006fa20 2024-04-26T23:45:38.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea44a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea401638e0 con 0x7fea40072490 2024-04-26T23:45:38.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea44a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea4015c470 con 0x7fea400af060 2024-04-26T23:45:38.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c8800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18c006cb10 0x7f18c00aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c8800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c015d640 con 0x7f18c015d140 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c8800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c015d920 con 0x7f18c00b6f40 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c8800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f18c015e400 con 0x7f18c006cb10 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c5400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18c006cb10 0x7f18c00aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c5400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18c006cb10 0x7f18c00aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49440/0 (socket says 172.21.15.47:49440) 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c5400640 1 -- 172.21.15.47:0/3150641242 learned_addr learned my addr 172.21.15.47:0/3150641242 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea4006fa20 0x7fea400b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea40072490 0x7fea400b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea400af060 0x7fea401562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea400af060 0x7fea401562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37576/0 (socket says 172.21.15.47:37576) 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 -- 172.21.15.47:0/3546972400 learned_addr learned my addr 172.21.15.47:0/3546972400 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4295200640 1 -- start start 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4295200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 0x7f429014ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4295200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f429009e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4295200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4290163af0 0x7f429009c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4295200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f42900aea30 con 0x7f429006c630 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4295200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42900ae8b0 con 0x7f4290163af0 2024-04-26T23:45:38.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4295200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4290170c20 con 0x7f4290161070 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 -- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea40072490 msgr2=0x7fea400b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea40072490 0x7fea400b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 -- 172.21.15.47:0/3546972400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea4006fa20 msgr2=0x7fea400b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea4006fa20 0x7fea400b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 -- 172.21.15.47:0/3546972400 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea40156820 con 0x7fea400af060 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3e800640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea4006fa20 0x7fea400b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f429009e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f428e800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4290163af0 0x7f429009c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f429009e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37590/0 (socket says 172.21.15.47:37590) 2024-04-26T23:45:38.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fba53600640 1 Processor -- start 2024-04-26T23:45:38.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 -- 172.21.15.47:0/1836447926 learned_addr learned my addr 172.21.15.47:0/1836447926 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fba53600640 1 -- start start 2024-04-26T23:45:38.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea3f200640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea400af060 0x7fea401562e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c740 tx=0x7fea3800cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752734574 0 0) 0x7f18c015d920 con 0x7f18c00b6f40 2024-04-26T23:45:38.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18a8003530 con 0x7f18c00b6f40 2024-04-26T23:45:38.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 -- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4290163af0 msgr2=0x7f429009c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4290163af0 0x7f429009c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 -- 172.21.15.47:0/1836447926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 msgr2=0x7f429014ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 0x7f429014ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f4287e00640 1 -- 172.21.15.47:0/1836447926 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429009d120 con 0x7f4290161070 2024-04-26T23:45:38.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea36a00640 1 -- 172.21.15.47:0/3546972400 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38016020 con 0x7fea400af060 2024-04-26T23:45:38.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea36a00640 1 -- 172.21.15.47:0/3546972400 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3800ce50 con 0x7fea400af060 2024-04-26T23:45:38.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea36a00640 1 -- 172.21.15.47:0/3546972400 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38003980 con 0x7fea400af060 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2718476553 0 0) 0x7f18a8003530 con 0x7f18c00b6f40 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 >> v2:172.21.15.47:3300/0 conn(0x7f18c006cb10 msgr2=0x7f18c00aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 --2- 172.21.15.47:0/3150641242 >> v2:172.21.15.47:3300/0 conn(0x7f18c006cb10 0x7f18c00aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 >> v1:172.21.15.47:6789/0 conn(0x7f18c015d140 legacy=0x7f18c006c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c0071190 con 0x7f18c00b6f40 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f18bc001a00 con 0x7f18c00b6f40 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 >> v1:172.21.15.203:6789/0 conn(0x7f18c00b6f40 legacy=0x7f18c00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f4287e00640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f429009e1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4278000c10 tx=0x7f4278019050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a80039c0 0x7f18a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a8004810 0x7f18a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80051d0 0x7f18a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f18c015e400 con 0x7f18a80039c0 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18a800c0a0 con 0x7f18a80051d0 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18a800c2a0 con 0x7f18a8004810 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.945+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea400b2700 con 0x7fea400af060 2024-04-26T23:45:38.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea400b2cc0 con 0x7fea400af060 2024-04-26T23:45:38.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f4286000640 1 -- 172.21.15.47:0/1836447926 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42780b0040 con 0x7f4290161070 2024-04-26T23:45:38.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c5e00640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a80039c0 0x7f18a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c5400640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a8004810 0x7f18a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f4286000640 1 -- 172.21.15.47:0/1836447926 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42780ab9b0 con 0x7f4290161070 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429009d400 con 0x7f4290161070 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f4286000640 1 -- 172.21.15.47:0/1836447926 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42780abd60 con 0x7f4290161070 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f429009d9c0 con 0x7f4290161070 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42680052a0 con 0x7f4290161070 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c5e00640 1 -- 172.21.15.47:0/3150641242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a8004810 msgr2=0x7f18a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c5e00640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18a8004810 0x7f18a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c5e00640 1 -- 172.21.15.47:0/3150641242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80051d0 msgr2=0x7f18a800b9d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c5e00640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80051d0 0x7f18a800b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c5e00640 1 -- 172.21.15.47:0/3150641242 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c0071190 con 0x7f18a80039c0 2024-04-26T23:45:38.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f18c6800640 1 -- 172.21.15.47:0/3150641242 reap_dead start 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7fea36a00640 1 -- 172.21.15.47:0/3546972400 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea38003b20 con 0x7fea400af060 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f2208c00640 1 Processor -- start 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.949+0000 7f2208c00640 1 -- start start 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2208c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2204163670 0x7f220409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2208c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f22040b1250 0x7f220409bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2208c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22040b7940 con 0x7f22040b2510 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2208c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f22040afdb0 con 0x7f22040b1250 2024-04-26T23:45:38.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2208c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f22040b7c20 con 0x7f2204163670 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba53600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba4c0add90 0x7fba4c0ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba53600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fba4c0728f0 0x7fba4c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba53600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4c072160 con 0x7fba4c15f130 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba53600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fba4c0b5970 con 0x7fba4c0add90 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba53600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fba4c0b5c50 con 0x7fba4c0728f0 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba51600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fba4c0728f0 0x7fba4c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba51600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fba4c0728f0 0x7fba4c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53830/0 (socket says 172.21.15.47:53830) 2024-04-26T23:45:38.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba51600640 1 -- 172.21.15.47:0/1160046002 learned_addr learned my addr 172.21.15.47:0/1160046002 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2201e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2204163670 0x7f220409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2201400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f22040b2510 0x7f220406dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:57270/0 (socket says 172.21.15.47:57270) 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2201400640 1 -- 172.21.15.47:0/1680493419 learned_addr learned my addr 172.21.15.47:0/1680493419 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2202800640 1 --2- 172.21.15.47:0/1680493419 >> v2:172.21.15.203:3300/0 conn(0x7f22040b1250 0x7f220409bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2201e00640 1 -- 172.21.15.47:0/1680493419 >> v2:172.21.15.203:3300/0 conn(0x7f22040b1250 msgr2=0x7f220409bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2201e00640 1 --2- 172.21.15.47:0/1680493419 >> v2:172.21.15.203:3300/0 conn(0x7f22040b1250 0x7f220409bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2201e00640 1 -- 172.21.15.47:0/1680493419 >> v1:172.21.15.203:6789/0 conn(0x7f22040b2510 legacy=0x7f220406dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f4286000640 1 -- 172.21.15.47:0/1836447926 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4278003620 con 0x7f4290161070 2024-04-26T23:45:38.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f4286000640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f426c068380 0x7f426c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f4286000640 1 -- 172.21.15.47:0/1836447926 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4278120470 con 0x7f4290161070 2024-04-26T23:45:38.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba51600640 1 -- 172.21.15.47:0/1160046002 >> v2:172.21.15.47:3300/0 conn(0x7fba4c0add90 msgr2=0x7fba4c0ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba51600640 1 --2- 172.21.15.47:0/1160046002 >> v2:172.21.15.47:3300/0 conn(0x7fba4c0add90 0x7fba4c0ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba51600640 1 -- 172.21.15.47:0/1160046002 >> v1:172.21.15.203:6789/0 conn(0x7fba4c15f130 legacy=0x7fba4c0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:38.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea40069470 con 0x7fea400af060 2024-04-26T23:45:38.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fea36a00640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea200683d0 0x7fea2006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fea36a00640 1 -- 172.21.15.47:0/3546972400 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fea38086410 con 0x7fea400af060 2024-04-26T23:45:38.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fea3e800640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea200683d0 0x7fea2006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2201e00640 1 -- 172.21.15.47:0/1680493419 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22040b7f00 con 0x7f2204163670 2024-04-26T23:45:38.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f2202800640 1 --2- 172.21.15.47:0/1680493419 >> v2:172.21.15.203:3300/0 conn(0x7f22040b1250 0x7f220409bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:38.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fba51600640 1 -- 172.21.15.47:0/1160046002 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c0723d0 con 0x7fba4c0728f0 2024-04-26T23:45:38.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7fea3e800640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea200683d0 0x7fea2006a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea30005890 tx=0x7fea30009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f428de00640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f426c068380 0x7f426c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f18c5e00640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a80039c0 0x7f18a8003e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001760 tx=0x7f18b401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7239ae9c8908cf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f428de00640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f426c068380 0x7f426c06a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f429006cb40 tx=0x7f4280008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4001380 con 0x7f18a80039c0 2024-04-26T23:45:38.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b40052f0 con 0x7f18a80039c0 2024-04-26T23:45:38.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.953+0000 7f18c4a00640 1 -- 172.21.15.47:0/3150641242 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4003840 con 0x7f18a80039c0 2024-04-26T23:45:38.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 -- 172.21.15.47:0/3150641242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a80039c0 msgr2=0x7f18a8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a80039c0 0x7f18a8003e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001760 tx=0x7f18b401c400 comp rx=0 tx=0).stop 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 -- 172.21.15.47:0/3150641242 shutdown_connections 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 --2- 172.21.15.47:0/3150641242 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18a80039c0 0x7f18a8003e00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 -- 172.21.15.47:0/3150641242 >> 172.21.15.47:0/3150641242 conn(0x7f18c00b3ba0 msgr2=0x7f18c00b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 -- 172.21.15.47:0/3150641242 shutdown_connections 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 -- 172.21.15.47:0/3150641242 wait complete. 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 Processor -- start 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f2201e00640 1 --2- 172.21.15.47:0/1680493419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2204163670 0x7f220409ba60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21f40097c0 tx=0x7f21f401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7564a3846ec655d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 -- start start 2024-04-26T23:45:38.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7fba51600640 1 --2- 172.21.15.47:0/1160046002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c0728f0 0x7fba4c072cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0d1b60 tx=0x7fba4401c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a549bd55833631f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80039c0 0x7f18c0200ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.957+0000 7f18c8800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18c014f930 0x7f18c014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c8800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18c0151ef0 0x7f18c0152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba4b400640 1 -- 172.21.15.47:0/1160046002 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba440a56b0 con 0x7fba4c0728f0 2024-04-26T23:45:38.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba4b400640 1 -- 172.21.15.47:0/1160046002 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba440a5850 con 0x7fba4c0728f0 2024-04-26T23:45:38.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba4b400640 1 -- 172.21.15.47:0/1160046002 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba440a5c20 con 0x7fba4c0728f0 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c8800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00b1160 con 0x7f18c0151ef0 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c8800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18c00b4ea0 con 0x7f18a80039c0 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c8800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f18c00b12e0 con 0x7f18c014f930 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18c0151ef0 0x7f18c0152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18c0151ef0 0x7f18c0152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49480/0 (socket says 172.21.15.47:49480) 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18c014f930 0x7f18c014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c6800640 1 -- 172.21.15.47:0/2585345139 learned_addr learned my addr 172.21.15.47:0/2585345139 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5e00640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80039c0 0x7f18c0200ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5400640 1 -- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80039c0 msgr2=0x7f18c0200ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5400640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80039c0 0x7f18c0200ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5400640 1 -- 172.21.15.47:0/2585345139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18c0151ef0 msgr2=0x7f18c0152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5400640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18c0151ef0 0x7f18c0152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5400640 1 -- 172.21.15.47:0/2585345139 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c0150380 con 0x7f18c014f930 2024-04-26T23:45:38.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c5400640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18c014f930 0x7f18c014fd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18c0072b90 tx=0x7f18b00119f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 -- 172.21.15.47:0/1160046002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c0728f0 msgr2=0x7fba4c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 --2- 172.21.15.47:0/1160046002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c0728f0 0x7fba4c072cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0d1b60 tx=0x7fba4401c960 comp rx=0 tx=0).stop 2024-04-26T23:45:38.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 -- 172.21.15.47:0/1160046002 shutdown_connections 2024-04-26T23:45:38.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 --2- 172.21.15.47:0/1160046002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c0728f0 0x7fba4c072cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 --2- 172.21.15.47:0/1160046002 >> v2:172.21.15.47:3300/0 conn(0x7fba4c0add90 0x7fba4c0ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 -- 172.21.15.47:0/1160046002 >> 172.21.15.47:0/1160046002 conn(0x7fba4c0b3220 msgr2=0x7fba4c0d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:38.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7f18c6800640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18c0151ef0 0x7f18c0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:38.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 -- 172.21.15.47:0/1160046002 shutdown_connections 2024-04-26T23:45:38.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.961+0000 7fba53600640 1 -- 172.21.15.47:0/1160046002 wait complete. 2024-04-26T23:45:38.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 Processor -- start 2024-04-26T23:45:38.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 -- start start 2024-04-26T23:45:38.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4c0728f0 0x7fba4c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba4c0add90 0x7fba4c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba50c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4c0728f0 0x7fba4c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba50c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4c0728f0 0x7fba4c1513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:37624/0 (socket says 172.21.15.47:37624) 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba4be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba4c0add90 0x7fba4c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba4be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba4c0add90 0x7fba4c1540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49482/0 (socket says 172.21.15.47:49482) 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba50c00640 1 -- 172.21.15.47:0/2787069578 learned_addr learned my addr 172.21.15.47:0/2787069578 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c15f130 0x7fba4c1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c16bef0 con 0x7fba4c0add90 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba4c15f510 con 0x7fba4c15f130 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba4c16c070 con 0x7fba4c0728f0 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.965+0000 7fba51600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c15f130 0x7fba4c1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba4be00640 1 -- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4c0728f0 msgr2=0x7fba4c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba4be00640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4c0728f0 0x7fba4c1513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba4be00640 1 -- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c15f130 msgr2=0x7fba4c1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba4be00640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c15f130 0x7fba4c1591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba4be00640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4c154a60 con 0x7fba4c0add90 2024-04-26T23:45:38.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba4be00640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba4c0add90 0x7fba4c1540a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba3800b420 tx=0x7fba3800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba48c00640 1 -- 172.21.15.47:0/2787069578 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38011830 con 0x7fba4c0add90 2024-04-26T23:45:38.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba48c00640 1 -- 172.21.15.47:0/2787069578 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba38016070 con 0x7fba4c0add90 2024-04-26T23:45:38.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba48c00640 1 -- 172.21.15.47:0/2787069578 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba38011c10 con 0x7fba4c0add90 2024-04-26T23:45:38.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba4c1561b0 con 0x7fba4c0add90 2024-04-26T23:45:38.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba4c156770 con 0x7fba4c0add90 2024-04-26T23:45:38.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.969+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba4c0695f0 con 0x7fba4c0add90 2024-04-26T23:45:38.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.973+0000 7fba48c00640 1 -- 172.21.15.47:0/2787069578 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba3801b460 con 0x7fba4c0add90 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.973+0000 7fba48c00640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba2c0683d0 0x7fba2c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.973+0000 7fba48c00640 1 -- 172.21.15.47:0/2787069578 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fba38086420 con 0x7fba4c0add90 2024-04-26T23:45:38.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.973+0000 7fba50c00640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba2c0683d0 0x7fba2c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.973+0000 7fba50c00640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba2c0683d0 0x7fba2c06a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba40001810 tx=0x7fba40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:38.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.981+0000 7fba48c00640 1 -- 172.21.15.47:0/2787069578 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba38056480 con 0x7fba4c0add90 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f0490800640 1 Processor -- start 2024-04-26T23:45:38.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f0490800640 1 -- start start 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f0490800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880b21f0 0x7f04880d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f0490800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04880b4940 con 0x7f04880cdae0 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f0490800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04880b4c20 con 0x7f04880d1540 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f0490800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f04880b46f0 con 0x7f04880b21f0 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048e800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f04880cdae0 0x7f0488166bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41304/0 (socket says 172.21.15.47:41304) 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048e800640 1 -- 172.21.15.47:0/860951318 learned_addr learned my addr 172.21.15.47:0/860951318 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048d400640 1 --2- 172.21.15.47:0/860951318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880b21f0 0x7f04880d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048ca00640 1 -- 172.21.15.47:0/860951318 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510136594 0 0) 0x7f04880b4940 con 0x7f04880cdae0 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048ca00640 1 -- 172.21.15.47:0/860951318 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0470003530 con 0x7f04880cdae0 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048ca00640 1 -- 172.21.15.47:0/860951318 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721974517 0 0) 0x7f04880b4c20 con 0x7f04880d1540 2024-04-26T23:45:38.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048ca00640 1 -- 172.21.15.47:0/860951318 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04880b4940 con 0x7f04880d1540 2024-04-26T23:45:39.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048d400640 1 -- 172.21.15.47:0/860951318 >> v1:172.21.15.203:6789/0 conn(0x7f04880d1540 legacy=0x7f04880d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048d400640 1 -- 172.21.15.47:0/860951318 >> v1:172.21.15.47:6789/0 conn(0x7f04880cdae0 legacy=0x7f0488166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.989+0000 7f048d400640 1 -- 172.21.15.47:0/860951318 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04880b4f00 con 0x7f04880b21f0 2024-04-26T23:45:39.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:38.997+0000 7f048d400640 1 --2- 172.21.15.47:0/860951318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880b21f0 0x7f04880d0c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04880b4870 tx=0x7f047801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc68058a30eb4ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:39.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.121+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7feb58005860 con 0x7feb8015f340 2024-04-26T23:45:39.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.121+0000 7feb76000640 1 -- 172.21.15.47:0/4143932613 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb6c016110 con 0x7feb8015f340 2024-04-26T23:45:39.127 INFO:teuthology.orchestra.run.smithi047.stdout:60129542150 2024-04-26T23:45:39.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb600685b0 msgr2=0x7feb6006aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb600685b0 0x7feb6006aa70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feb80160c10 tx=0x7feb78009250 comp rx=0 tx=0).stop 2024-04-26T23:45:39.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb8015f340 msgr2=0x7feb80157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb8015f340 0x7feb80157210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0ac000 tx=0x7feb6c01acd0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 shutdown_connections 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb600685b0 0x7feb6006aa70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb8015f340 0x7feb80157210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb800d56b0 0x7feb801545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 --2- 172.21.15.47:0/4143932613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb800d31f0 0x7feb80153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 >> 172.21.15.47:0/4143932613 conn(0x7feb80075dc0 msgr2=0x7feb8015e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 shutdown_connections 2024-04-26T23:45:39.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.125+0000 7feb7f200640 1 -- 172.21.15.47:0/4143932613 wait complete. 2024-04-26T23:45:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.149+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fba4c06fdc0 con 0x7fba4c0add90 2024-04-26T23:45:39.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.149+0000 7fba48c00640 1 -- 172.21.15.47:0/2787069578 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fba3805a780 con 0x7fba4c0add90 2024-04-26T23:45:39.157 INFO:teuthology.orchestra.run.smithi047.stdout:64424509444 2024-04-26T23:45:39.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2024-04-26T23:45:39.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f279c09e3c0 con 0x7f279c0741f0 2024-04-26T23:45:39.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba2c0683d0 msgr2=0x7fba2c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba2c0683d0 0x7fba2c06a890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba40001810 tx=0x7fba40009040 comp rx=0 tx=0).stop 2024-04-26T23:45:39.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba4c0add90 msgr2=0x7fba4c1540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba4c0add90 0x7fba4c1540a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba3800b420 tx=0x7fba3800b8e0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f2793e00640 1 -- 172.21.15.47:0/4160369517 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2788059e60 con 0x7f279c0741f0 2024-04-26T23:45:39.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 shutdown_connections 2024-04-26T23:45:39.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba2c0683d0 0x7fba2c06a890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba4c15f130 0x7fba4c1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba4c0add90 0x7fba4c1540a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 --2- 172.21.15.47:0/2787069578 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba4c0728f0 0x7fba4c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 >> 172.21.15.47:0/2787069578 conn(0x7fba4c0b3220 msgr2=0x7fba4c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.161 INFO:teuthology.orchestra.run.smithi047.stdout:64424509445 2024-04-26T23:45:39.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 shutdown_connections 2024-04-26T23:45:39.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7fba53600640 1 -- 172.21.15.47:0/2787069578 wait complete. 2024-04-26T23:45:39.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f277c068450 msgr2=0x7f277c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f277c068450 0x7f277c06a910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f278c009b40 tx=0x7f278c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:39.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f279c0741f0 msgr2=0x7f279c1665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f279c0741f0 0x7f279c1665d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2788000f70 tx=0x7f278800c890 comp rx=0 tx=0).stop 2024-04-26T23:45:39.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 shutdown_connections 2024-04-26T23:45:39.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f277c068450 0x7f277c06a910 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f279c0b73f0 0x7f279c200070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f279c0741f0 0x7f279c1665d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 --2- 172.21.15.47:0/4160369517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f279c073e10 0x7f279c1647f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.153+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 >> 172.21.15.47:0/4160369517 conn(0x7f279c0d1ce0 msgr2=0x7f279c15c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.157+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 shutdown_connections 2024-04-26T23:45:39.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.157+0000 7f27a1400640 1 -- 172.21.15.47:0/4160369517 wait complete. 2024-04-26T23:45:39.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.157+0000 7f4286000640 1 -- 172.21.15.47:0/1836447926 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f42900b5fe0 con 0x7f4290161070 2024-04-26T23:45:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f2200a00640 1 -- 172.21.15.47:0/1680493419 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f40ab610 con 0x7f2204163670 2024-04-26T23:45:39.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f048ca00640 1 -- 172.21.15.47:0/860951318 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04780b1070 con 0x7f04880b21f0 2024-04-26T23:45:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f048ca00640 1 -- 172.21.15.47:0/860951318 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04780ac410 con 0x7f04880b21f0 2024-04-26T23:45:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f048ca00640 1 -- 172.21.15.47:0/860951318 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04780ac7e0 con 0x7f04880b21f0 2024-04-26T23:45:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f2200a00640 1 -- 172.21.15.47:0/1680493419 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f40b0070 con 0x7f2204163670 2024-04-26T23:45:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f2200a00640 1 -- 172.21.15.47:0/1680493419 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f40ab9d0 con 0x7f2204163670 2024-04-26T23:45:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f18ba000640 1 -- 172.21.15.47:0/2585345139 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0015930 con 0x7f18c014f930 2024-04-26T23:45:39.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f18ba000640 1 -- 172.21.15.47:0/2585345139 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b0015ad0 con 0x7f18c014f930 2024-04-26T23:45:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7f18ba000640 1 -- 172.21.15.47:0/2585345139 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b001d400 con 0x7f18c014f930 2024-04-26T23:45:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.161+0000 7fea36a00640 1 -- 172.21.15.47:0/3546972400 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fea38020020 con 0x7fea400af060 2024-04-26T23:45:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c02001c0 con 0x7f18c014f930 2024-04-26T23:45:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 -- 172.21.15.47:0/860951318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880b21f0 msgr2=0x7f04880d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 --2- 172.21.15.47:0/860951318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880b21f0 0x7f04880d0c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f04880b4870 tx=0x7f047801c4c0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c0200780 con 0x7f18c014f930 2024-04-26T23:45:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 -- 172.21.15.47:0/860951318 shutdown_connections 2024-04-26T23:45:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 --2- 172.21.15.47:0/860951318 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880b21f0 0x7f04880d0c50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 -- 172.21.15.47:0/860951318 >> 172.21.15.47:0/860951318 conn(0x7f048809ba60 msgr2=0x7f048809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 -- 172.21.15.47:0/860951318 shutdown_connections 2024-04-26T23:45:39.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 -- 172.21.15.47:0/860951318 wait complete. 2024-04-26T23:45:39.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 -- 172.21.15.47:0/1680493419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2204163670 msgr2=0x7f220409ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 --2- 172.21.15.47:0/1680493419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2204163670 0x7f220409ba60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21f40097c0 tx=0x7f21f401c430 comp rx=0 tx=0).stop 2024-04-26T23:45:39.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c00695f0 con 0x7f18c014f930 2024-04-26T23:45:39.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f18ba000640 1 -- 172.21.15.47:0/2585345139 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18b001d5a0 con 0x7f18c014f930 2024-04-26T23:45:39.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 Processor -- start 2024-04-26T23:45:39.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 -- 172.21.15.47:0/1680493419 shutdown_connections 2024-04-26T23:45:39.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 --2- 172.21.15.47:0/1680493419 >> v2:172.21.15.203:3300/0 conn(0x7f22040b1250 0x7f220409bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 --2- 172.21.15.47:0/1680493419 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2204163670 0x7f220409ba60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 -- 172.21.15.47:0/1680493419 >> 172.21.15.47:0/1680493419 conn(0x7f2204075fe0 msgr2=0x7f22040b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 -- 172.21.15.47:0/1680493419 shutdown_connections 2024-04-26T23:45:39.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f2208c00640 1 -- 172.21.15.47:0/1680493419 wait complete. 2024-04-26T23:45:39.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 Processor -- start 2024-04-26T23:45:39.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 -- start start 2024-04-26T23:45:39.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f18ba000640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18a40683d0 0x7f18a406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f18ba000640 1 -- 172.21.15.47:0/2585345139 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f18b0086fb0 con 0x7f18c014f930 2024-04-26T23:45:39.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f18c5e00640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18a40683d0 0x7f18a406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22040b1250 0x7f220413a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22040b2510 0x7f2204149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2204163670 0x7f2204149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f220416e1f0 con 0x7f22040b2510 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f22040b7720 con 0x7f2204163670 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2208c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f220416e370 con 0x7f22040b1250 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.165+0000 7f0490800640 1 -- start start 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f0490800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04880b21f0 0x7f048815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f0490800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04880cdae0 0x7f0488157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f0490800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880d1540 0x7f04881580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f0490800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f048815d4c0 con 0x7f04880cdae0 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f0490800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f048815d340 con 0x7f04880b21f0 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f0490800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f048806d510 con 0x7f04880d1540 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f18c5e00640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18a40683d0 0x7f18a406a890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18b40ac000 tx=0x7f18b40011a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2204163670 0x7f2204149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2201e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22040b1250 0x7f220413a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2204163670 0x7f2204149cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:55214/0 (socket says 172.21.15.47:55214) 2024-04-26T23:45:39.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 -- 172.21.15.47:0/1046380284 learned_addr learned my addr 172.21.15.47:0/1046380284 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:39.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2201400640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22040b2510 0x7f2204149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880d1540 0x7f04881580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880d1540 0x7f04881580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43176/0 (socket says 172.21.15.47:43176) 2024-04-26T23:45:39.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 -- 172.21.15.47:0/2260008154 learned_addr learned my addr 172.21.15.47:0/2260008154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:39.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 -- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22040b1250 msgr2=0x7f220413a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22040b1250 0x7f220413a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 -- 172.21.15.47:0/1046380284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22040b2510 msgr2=0x7f2204149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22040b2510 0x7f2204149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f2202800640 1 -- 172.21.15.47:0/1046380284 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220414c590 con 0x7f2204163670 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048de00640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04880b21f0 0x7f048815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048d400640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04880cdae0 0x7f0488157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 -- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04880b21f0 msgr2=0x7f048815e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04880b21f0 0x7f048815e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 -- 172.21.15.47:0/2260008154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04880cdae0 msgr2=0x7f0488157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04880cdae0 0x7f0488157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048e800640 1 -- 172.21.15.47:0/2260008154 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048815e960 con 0x7f04880d1540 2024-04-26T23:45:39.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.169+0000 7f048d400640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04880cdae0 0x7f0488157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:39.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f2202800640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2204163670 0x7f2204149cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00ce80 tx=0x7f21fc00a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:39.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f048e800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880d1540 0x7f04881580d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f048400cae0 tx=0x7f048400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:39.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f21fa000640 1 -- 172.21.15.47:0/1046380284 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc01a070 con 0x7f2204163670 2024-04-26T23:45:39.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f21fa000640 1 -- 172.21.15.47:0/1046380284 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21fc00d880 con 0x7f2204163670 2024-04-26T23:45:39.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f21fa000640 1 -- 172.21.15.47:0/1046380284 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00dc70 con 0x7f2204163670 2024-04-26T23:45:39.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220414c870 con 0x7f2204163670 2024-04-26T23:45:39.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f220413e200 con 0x7f2204163670 2024-04-26T23:45:39.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f18ba000640 1 -- 172.21.15.47:0/2585345139 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f18b0019030 con 0x7f18c014f930 2024-04-26T23:45:39.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f0482000640 1 -- 172.21.15.47:0/2260008154 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484017070 con 0x7f04880d1540 2024-04-26T23:45:39.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220413e400 con 0x7f2204163670 2024-04-26T23:45:39.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f0482000640 1 -- 172.21.15.47:0/2260008154 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048400ac40 con 0x7f04880d1540 2024-04-26T23:45:39.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f0482000640 1 -- 172.21.15.47:0/2260008154 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484012400 con 0x7f04880d1540 2024-04-26T23:45:39.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.173+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048815ec40 con 0x7f04880d1540 2024-04-26T23:45:39.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.177+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0488153e40 con 0x7f04880d1540 2024-04-26T23:45:39.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.177+0000 7f21fa000640 1 -- 172.21.15.47:0/1046380284 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21fc01d070 con 0x7f2204163670 2024-04-26T23:45:39.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.177+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04880695f0 con 0x7f04880d1540 2024-04-26T23:45:39.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.177+0000 7f21fa000640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21e40683b0 0x7f21e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.177+0000 7f21fa000640 1 -- 172.21.15.47:0/1046380284 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f21fc086ed0 con 0x7f2204163670 2024-04-26T23:45:39.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.177+0000 7f2201e00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21e40683b0 0x7f21e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.177+0000 7f2201e00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21e40683b0 0x7f21e406a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21f40af000 tx=0x7f21f40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:39.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.181+0000 7f0482000640 1 -- 172.21.15.47:0/2260008154 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f048401a070 con 0x7f04880d1540 2024-04-26T23:45:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.181+0000 7f0482000640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f046c0683d0 0x7f046c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:39.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.181+0000 7f0482000640 1 -- 172.21.15.47:0/2260008154 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0484086b80 con 0x7f04880d1540 2024-04-26T23:45:39.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.5 2024-04-26T23:45:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.181+0000 7f048de00640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f046c0683d0 0x7f046c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:39.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.181+0000 7f21fa000640 1 -- 172.21.15.47:0/1046380284 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f220413e400 con 0x7f2204163670 2024-04-26T23:45:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.181+0000 7f048de00640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f046c0683d0 0x7f046c06a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f047c0011f0 tx=0x7f047c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:39.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.181+0000 7f0482000640 1 -- 172.21.15.47:0/2260008154 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0484021020 con 0x7f04880d1540 2024-04-26T23:45:39.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-04-26T23:45:39.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.337+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4268005590 con 0x7f4290161070 2024-04-26T23:45:39.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.337+0000 7f4286000640 1 -- 172.21.15.47:0/1836447926 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42780f0a20 con 0x7f4290161070 2024-04-26T23:45:39.346 INFO:teuthology.orchestra.run.smithi047.stdout:64424509444 2024-04-26T23:45:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f426c068380 msgr2=0x7f426c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f426c068380 0x7f426c06a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f429006cb40 tx=0x7f4280008040 comp rx=0 tx=0).stop 2024-04-26T23:45:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 msgr2=0x7f429009e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f429009e1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4278000c10 tx=0x7f4278019050 comp rx=0 tx=0).stop 2024-04-26T23:45:39.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 shutdown_connections 2024-04-26T23:45:39.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f426c068380 0x7f426c06a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4290163af0 0x7f429009c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4290161070 0x7f429009e1c0 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4278000c10 tx=0x7f4278019050 comp rx=0 tx=0).stop 2024-04-26T23:45:39.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 --2- 172.21.15.47:0/1836447926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f429006c630 0x7f429014ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 >> 172.21.15.47:0/1836447926 conn(0x7f42900b2d40 msgr2=0x7f4290160000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 shutdown_connections 2024-04-26T23:45:39.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.341+0000 7f4295200640 1 -- 172.21.15.47:0/1836447926 wait complete. 2024-04-26T23:45:39.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.353+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f04880d03d0 con 0x7f04880d1540 2024-04-26T23:45:39.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.353+0000 7f0482000640 1 -- 172.21.15.47:0/2260008154 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0484057220 con 0x7f04880d1540 2024-04-26T23:45:39.360 INFO:teuthology.orchestra.run.smithi047.stdout:64424509445 2024-04-26T23:45:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f046c0683d0 msgr2=0x7f046c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f046c0683d0 0x7f046c06a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f047c0011f0 tx=0x7f047c009040 comp rx=0 tx=0).stop 2024-04-26T23:45:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880d1540 msgr2=0x7f04881580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880d1540 0x7f04881580d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f048400cae0 tx=0x7f048400a060 comp rx=0 tx=0).stop 2024-04-26T23:45:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 shutdown_connections 2024-04-26T23:45:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f046c0683d0 0x7f046c06a890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f04880d1540 0x7f04881580d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04880cdae0 0x7f0488157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 --2- 172.21.15.47:0/2260008154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04880b21f0 0x7f048815e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 >> 172.21.15.47:0/2260008154 conn(0x7f048809ba60 msgr2=0x7f04880c6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 shutdown_connections 2024-04-26T23:45:39.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.357+0000 7f0490800640 1 -- 172.21.15.47:0/2260008154 wait complete. 2024-04-26T23:45:39.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.365+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f22040695f0 con 0x7f2204163670 2024-04-26T23:45:39.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.365+0000 7f21fa000640 1 -- 172.21.15.47:0/1046380284 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f21fc056e40 con 0x7f2204163670 2024-04-26T23:45:39.371 INFO:teuthology.orchestra.run.smithi047.stdout:64424509445 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21e40683b0 msgr2=0x7f21e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21e40683b0 0x7f21e406a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21f40af000 tx=0x7f21f40a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2204163670 msgr2=0x7f2204149cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2204163670 0x7f2204149cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00ce80 tx=0x7f21fc00a710 comp rx=0 tx=0).stop 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 shutdown_connections 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21e40683b0 0x7f21e406a870 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21f40af000 tx=0x7f21f40a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2204163670 0x7f2204149cd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22040b2510 0x7f2204149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 --2- 172.21.15.47:0/1046380284 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f22040b1250 0x7f220413a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 >> 172.21.15.47:0/1046380284 conn(0x7f2204075fe0 msgr2=0x7f22040b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 shutdown_connections 2024-04-26T23:45:39.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.369+0000 7f2208c00640 1 -- 172.21.15.47:0/1046380284 wait complete. 2024-04-26T23:45:39.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2024-04-26T23:45:39.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-04-26T23:45:39.398 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-04-26T23:45:39.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.457+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fea4009e8f0 con 0x7fea400af060 2024-04-26T23:45:39.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea36a00640 1 -- 172.21.15.47:0/3546972400 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea38056b40 con 0x7fea400af060 2024-04-26T23:45:39.466 INFO:teuthology.orchestra.run.smithi047.stdout:64424509444 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea200683d0 msgr2=0x7fea2006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea200683d0 0x7fea2006a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea30005890 tx=0x7fea30009040 comp rx=0 tx=0).stop 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea400af060 msgr2=0x7fea401562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea400af060 0x7fea401562e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c740 tx=0x7fea3800cc00 comp rx=0 tx=0).stop 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 shutdown_connections 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea200683d0 0x7fea2006a890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea400af060 0x7fea401562e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea40072490 0x7fea400b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 --2- 172.21.15.47:0/3546972400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea4006fa20 0x7fea400b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 >> 172.21.15.47:0/3546972400 conn(0x7fea4006c400 msgr2=0x7fea401575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 shutdown_connections 2024-04-26T23:45:39.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.461+0000 7fea44a00640 1 -- 172.21.15.47:0/3546972400 wait complete. 2024-04-26T23:45:39.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f18c0200950 con 0x7f18c014f930 2024-04-26T23:45:39.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18ba000640 1 -- 172.21.15.47:0/2585345139 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18b0056fb0 con 0x7f18c014f930 2024-04-26T23:45:39.472 INFO:teuthology.orchestra.run.smithi047.stdout:64424509445 2024-04-26T23:45:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18a40683d0 msgr2=0x7f18a406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18a40683d0 0x7f18a406a890 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18b40ac000 tx=0x7f18b40011a0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18c014f930 msgr2=0x7f18c014fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18c014f930 0x7f18c014fd90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18c0072b90 tx=0x7f18b00119f0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 shutdown_connections 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18a40683d0 0x7f18a406a890 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18c0151ef0 0x7f18c0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f18c014f930 0x7f18c014fd90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 --2- 172.21.15.47:0/2585345139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18a80039c0 0x7f18c0200ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.465+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 >> 172.21.15.47:0/2585345139 conn(0x7f18c00b3ba0 msgr2=0x7f18c0160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.469+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 shutdown_connections 2024-04-26T23:45:39.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:39.469+0000 7f18c8800640 1 -- 172.21.15.47:0/2585345139 wait complete. 2024-04-26T23:45:39.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2024-04-26T23:45:39.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-04-26T23:45:40.159 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:45:40.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T23:45:40.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T23:45:40.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.297+0000 7fcb7aa00640 1 Processor -- start 2024-04-26T23:45:40.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.297+0000 7fcb7aa00640 1 -- start start 2024-04-26T23:45:40.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb7aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb740d1540 0x7fcb740d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb7aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb740d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb7aa00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcb740cdae0 0x7fcb740b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb7aa00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcb740b46f0 con 0x7fcb740d1540 2024-04-26T23:45:40.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb7aa00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcb740d1e60 con 0x7fcb740cdae0 2024-04-26T23:45:40.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb7aa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb740b4940 con 0x7fcb740b21f0 2024-04-26T23:45:40.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb740d1540 0x7fcb740d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb740d1540 0x7fcb740d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46658/0 (socket says 172.21.15.47:46658) 2024-04-26T23:45:40.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 -- 172.21.15.47:0/3619557576 learned_addr learned my addr 172.21.15.47:0/3619557576 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb6be00640 1 --2- 172.21.15.47:0/3619557576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb740d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb78a00640 1 --2- 172.21.15.47:0/3619557576 >> v2:172.21.15.203:3300/0 conn(0x7fcb740cdae0 0x7fcb740b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 -- 172.21.15.47:0/3619557576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 msgr2=0x7fcb740d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 --2- 172.21.15.47:0/3619557576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb740d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 -- 172.21.15.47:0/3619557576 >> v2:172.21.15.203:3300/0 conn(0x7fcb740cdae0 msgr2=0x7fcb740b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 --2- 172.21.15.47:0/3619557576 >> v2:172.21.15.203:3300/0 conn(0x7fcb740cdae0 0x7fcb740b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb73e00640 1 -- 172.21.15.47:0/3619557576 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb740b4c20 con 0x7fcb740d1540 2024-04-26T23:45:40.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb6be00640 1 --2- 172.21.15.47:0/3619557576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb740d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:40.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.301+0000 7fcb78a00640 1 --2- 172.21.15.47:0/3619557576 >> v2:172.21.15.203:3300/0 conn(0x7fcb740cdae0 0x7fcb740b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:40.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb73e00640 1 --2- 172.21.15.47:0/3619557576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740d1540 0x7fcb740d1920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb740cd530 tx=0x7fcb6401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5991703d507b4cc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb73400640 1 -- 172.21.15.47:0/3619557576 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640aa610 con 0x7fcb740d1540 2024-04-26T23:45:40.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb73400640 1 -- 172.21.15.47:0/3619557576 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb640af070 con 0x7fcb740d1540 2024-04-26T23:45:40.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb73400640 1 -- 172.21.15.47:0/3619557576 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640aa9d0 con 0x7fcb740d1540 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 -- 172.21.15.47:0/3619557576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740d1540 msgr2=0x7fcb740d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/3619557576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740d1540 0x7fcb740d1920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb740cd530 tx=0x7fcb6401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 -- 172.21.15.47:0/3619557576 shutdown_connections 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/3619557576 >> v2:172.21.15.203:3300/0 conn(0x7fcb740cdae0 0x7fcb740b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/3619557576 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb740d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/3619557576 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740d1540 0x7fcb740d1920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 -- 172.21.15.47:0/3619557576 >> 172.21.15.47:0/3619557576 conn(0x7fcb7409ba60 msgr2=0x7fcb7409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 -- 172.21.15.47:0/3619557576 shutdown_connections 2024-04-26T23:45:40.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 -- 172.21.15.47:0/3619557576 wait complete. 2024-04-26T23:45:40.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 Processor -- start 2024-04-26T23:45:40.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.305+0000 7fcb7aa00640 1 -- start start 2024-04-26T23:45:40.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb7414bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740cdae0 0x7fcb7414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb740d1540 0x7fcb7406df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7415d340 con 0x7fcb740cdae0 2024-04-26T23:45:40.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcb740d1190 con 0x7fcb740d1540 2024-04-26T23:45:40.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7415d4c0 con 0x7fcb740b21f0 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb740d1540 0x7fcb7406df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb740d1540 0x7fcb7406df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:55238/0 (socket says 172.21.15.47:55238) 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 -- 172.21.15.47:0/2345342839 learned_addr learned my addr 172.21.15.47:0/2345342839 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb6be00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740cdae0 0x7fcb7414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb73e00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb7414bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 -- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 msgr2=0x7fcb7414bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb7414bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 -- 172.21.15.47:0/2345342839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740cdae0 msgr2=0x7fcb7414f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740cdae0 0x7fcb7414f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 -- 172.21.15.47:0/2345342839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7414c910 con 0x7fcb740d1540 2024-04-26T23:45:40.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb78a00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb740d1540 0x7fcb7406df20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009fa0 tx=0x7fcb6c00d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb70c00640 1 -- 172.21.15.47:0/2345342839 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c01a070 con 0x7fcb740d1540 2024-04-26T23:45:40.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb70c00640 1 -- 172.21.15.47:0/2345342839 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c003bc0 con 0x7fcb740d1540 2024-04-26T23:45:40.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb70c00640 1 -- 172.21.15.47:0/2345342839 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c004030 con 0x7fcb740d1540 2024-04-26T23:45:40.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7414cbf0 con 0x7fcb740d1540 2024-04-26T23:45:40.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7414d1b0 con 0x7fcb740d1540 2024-04-26T23:45:40.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.309+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb740695f0 con 0x7fcb740d1540 2024-04-26T23:45:40.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.313+0000 7fcb70c00640 1 -- 172.21.15.47:0/2345342839 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb6c01d070 con 0x7fcb740d1540 2024-04-26T23:45:40.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.313+0000 7fcb70c00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb50068380 0x7fcb5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.313+0000 7fcb70c00640 1 -- 172.21.15.47:0/2345342839 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcb6c086be0 con 0x7fcb740d1540 2024-04-26T23:45:40.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.313+0000 7fcb73e00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb50068380 0x7fcb5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.313+0000 7fcb73e00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb50068380 0x7fcb5006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb640ae000 tx=0x7fcb640a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.317+0000 7fcb70c00640 1 -- 172.21.15.47:0/2345342839 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb6c010070 con 0x7fcb740d1540 2024-04-26T23:45:40.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f7271600640 1 Processor -- start 2024-04-26T23:45:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f2860a00640 1 Processor -- start 2024-04-26T23:45:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f7271600640 1 -- start start 2024-04-26T23:45:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f2860a00640 1 -- start start 2024-04-26T23:45:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f7271600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f726c0b1480 0x7f726c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f7271600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c160470 0x7f726c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f7271600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f726c0af4b0 con 0x7f726c070900 2024-04-26T23:45:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f7271600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f726c0afa40 con 0x7f726c0b1480 2024-04-26T23:45:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.349+0000 7f7271600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f726c0af760 con 0x7f726c160470 2024-04-26T23:45:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f726b400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c160470 0x7f726c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f7263e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f726c0b1480 0x7f726c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f726aa00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f726c070900 0x7f726c0aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:42916/0 (socket says 172.21.15.47:42916) 2024-04-26T23:45:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f726aa00640 1 -- 172.21.15.47:0/1090530492 learned_addr learned my addr 172.21.15.47:0/1090530492 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f726b400640 1 -- 172.21.15.47:0/1090530492 >> v2:172.21.15.203:3300/0 conn(0x7f726c0b1480 msgr2=0x7f726c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f726b400640 1 --2- 172.21.15.47:0/1090530492 >> v2:172.21.15.203:3300/0 conn(0x7f726c0b1480 0x7f726c06c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f726b400640 1 -- 172.21.15.47:0/1090530492 >> v1:172.21.15.203:6789/0 conn(0x7f726c070900 legacy=0x7f726c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f726b400640 1 -- 172.21.15.47:0/1090530492 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c15f990 con 0x7f726c160470 2024-04-26T23:45:40.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2860a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c15d4e0 0x7f285c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2860a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f285c0709f0 0x7f285c070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2860a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f285c15d940 con 0x7f285c09ba60 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2860a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f285c15dbb0 con 0x7f285c0709f0 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2860a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f285c15de90 con 0x7f285c15d4e0 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2859e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f285c09ba60 0x7f285c09be40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45424/0 (socket says 172.21.15.47:45424) 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2859e00640 1 -- 172.21.15.47:0/2442611235 learned_addr learned my addr 172.21.15.47:0/2442611235 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2859400640 1 --2- 172.21.15.47:0/2442611235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c15d4e0 0x7f285c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f285a800640 1 --2- 172.21.15.47:0/2442611235 >> v2:172.21.15.203:3300/0 conn(0x7f285c0709f0 0x7f285c070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2858a00640 1 -- 172.21.15.47:0/2442611235 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661787629 0 0) 0x7f285c15d940 con 0x7f285c09ba60 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2858a00640 1 -- 172.21.15.47:0/2442611235 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2840003530 con 0x7f285c09ba60 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2859400640 1 -- 172.21.15.47:0/2442611235 >> v2:172.21.15.203:3300/0 conn(0x7f285c0709f0 msgr2=0x7f285c070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2859400640 1 --2- 172.21.15.47:0/2442611235 >> v2:172.21.15.203:3300/0 conn(0x7f285c0709f0 0x7f285c070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2859400640 1 -- 172.21.15.47:0/2442611235 >> v1:172.21.15.47:6789/0 conn(0x7f285c09ba60 legacy=0x7f285c09be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f2859400640 1 -- 172.21.15.47:0/2442611235 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c15e170 con 0x7f285c15d4e0 2024-04-26T23:45:40.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.353+0000 7f285a800640 1 --2- 172.21.15.47:0/2442611235 >> v2:172.21.15.203:3300/0 conn(0x7f285c0709f0 0x7f285c070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:40.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f726b400640 1 --2- 172.21.15.47:0/1090530492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c160470 0x7f726c06c940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7264009d90 tx=0x7f726401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2d780c3793207a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f726a000640 1 -- 172.21.15.47:0/1090530492 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72640b2070 con 0x7f726c160470 2024-04-26T23:45:40.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f726a000640 1 -- 172.21.15.47:0/1090530492 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72640a5a00 con 0x7f726c160470 2024-04-26T23:45:40.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f726a000640 1 -- 172.21.15.47:0/1090530492 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72640a5dd0 con 0x7f726c160470 2024-04-26T23:45:40.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2859400640 1 --2- 172.21.15.47:0/2442611235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c15d4e0 0x7f285c0b60e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28480097c0 tx=0x7f284801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1b444e5fd63636 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2858a00640 1 -- 172.21.15.47:0/2442611235 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28480b1070 con 0x7f285c15d4e0 2024-04-26T23:45:40.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 -- 172.21.15.47:0/1090530492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c160470 msgr2=0x7f726c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 --2- 172.21.15.47:0/1090530492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c160470 0x7f726c06c940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7264009d90 tx=0x7f726401c940 comp rx=0 tx=0).stop 2024-04-26T23:45:40.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2858a00640 1 -- 172.21.15.47:0/2442611235 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28480a8050 con 0x7f285c15d4e0 2024-04-26T23:45:40.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2858a00640 1 -- 172.21.15.47:0/2442611235 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28480ac860 con 0x7f285c15d4e0 2024-04-26T23:45:40.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 -- 172.21.15.47:0/1090530492 shutdown_connections 2024-04-26T23:45:40.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 --2- 172.21.15.47:0/1090530492 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c160470 0x7f726c06c940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 --2- 172.21.15.47:0/1090530492 >> v2:172.21.15.203:3300/0 conn(0x7f726c0b1480 0x7f726c06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 -- 172.21.15.47:0/1090530492 >> 172.21.15.47:0/1090530492 conn(0x7f726c0b4470 msgr2=0x7f726c0d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 -- 172.21.15.47:0/1090530492 shutdown_connections 2024-04-26T23:45:40.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 -- 172.21.15.47:0/1090530492 wait complete. 2024-04-26T23:45:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 -- 172.21.15.47:0/2442611235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c15d4e0 msgr2=0x7f285c0b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 --2- 172.21.15.47:0/2442611235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c15d4e0 0x7f285c0b60e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f28480097c0 tx=0x7f284801c3e0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 -- 172.21.15.47:0/2442611235 shutdown_connections 2024-04-26T23:45:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 --2- 172.21.15.47:0/2442611235 >> v2:172.21.15.203:3300/0 conn(0x7f285c0709f0 0x7f285c070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 --2- 172.21.15.47:0/2442611235 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c15d4e0 0x7f285c0b60e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 -- 172.21.15.47:0/2442611235 >> 172.21.15.47:0/2442611235 conn(0x7f285c075fe0 msgr2=0x7f285c0b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 -- 172.21.15.47:0/2442611235 shutdown_connections 2024-04-26T23:45:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f2860a00640 1 -- 172.21.15.47:0/2442611235 wait complete. 2024-04-26T23:45:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.357+0000 7f7271600640 1 Processor -- start 2024-04-26T23:45:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 -- start start 2024-04-26T23:45:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 Processor -- start 2024-04-26T23:45:40.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 -- start start 2024-04-26T23:45:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f726c070900 0x7f726c1622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c0b1480 0x7f726c160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f726c160470 0x7f726c157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f726c159990 con 0x7f726c070900 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f726c159810 con 0x7f726c160470 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f726c159b10 con 0x7f726c0b1480 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f726c070900 0x7f726c1622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f726c070900 0x7f726c1622c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46680/0 (socket says 172.21.15.47:46680) 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 -- 172.21.15.47:0/2180904472 learned_addr learned my addr 172.21.15.47:0/2180904472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7263e00640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c0b1480 0x7f726c160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726b400640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f726c160470 0x7f726c157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c0709f0 0x7f285c14baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f285c09ba60 0x7f285c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f285c15d4e0 0x7f285c156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f285c16a010 con 0x7f285c09ba60 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f285c169e90 con 0x7f285c15d4e0 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2860a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f285c16a190 con 0x7f285c0709f0 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 -- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c0b1480 msgr2=0x7f726c160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c0b1480 0x7f726c160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 -- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f726c160470 msgr2=0x7f726c157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f726c160470 0x7f726c157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 -- 172.21.15.47:0/2180904472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726c162800 con 0x7f726c070900 2024-04-26T23:45:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c0709f0 0x7f285c14baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f285a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f285c15d4e0 0x7f285c156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c0709f0 0x7f285c14baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43242/0 (socket says 172.21.15.47:43242) 2024-04-26T23:45:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 -- 172.21.15.47:0/4048657771 learned_addr learned my addr 172.21.15.47:0/4048657771 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859400640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f285c09ba60 0x7f285c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f726aa00640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f726c070900 0x7f726c1622c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c370 tx=0x7f725c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7262a00640 1 -- 172.21.15.47:0/2180904472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c017070 con 0x7f726c070900 2024-04-26T23:45:40.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7262a00640 1 -- 172.21.15.47:0/2180904472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725c005cf0 con 0x7f726c070900 2024-04-26T23:45:40.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7262a00640 1 -- 172.21.15.47:0/2180904472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725c0072f0 con 0x7f726c070900 2024-04-26T23:45:40.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 -- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f285c15d4e0 msgr2=0x7f285c156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f285c15d4e0 0x7f285c156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 -- 172.21.15.47:0/4048657771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f285c09ba60 msgr2=0x7f285c156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f285c09ba60 0x7f285c156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 -- 172.21.15.47:0/4048657771 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c13b8f0 con 0x7f285c0709f0 2024-04-26T23:45:40.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726c161220 con 0x7f726c070900 2024-04-26T23:45:40.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726c161ac0 con 0x7f726c070900 2024-04-26T23:45:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.361+0000 7f2859e00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c0709f0 0x7f285c14baa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c450 tx=0x7f284c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f2852000640 1 -- 172.21.15.47:0/4048657771 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c017070 con 0x7f285c0709f0 2024-04-26T23:45:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f2852000640 1 -- 172.21.15.47:0/4048657771 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c005cf0 con 0x7f285c0709f0 2024-04-26T23:45:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f2852000640 1 -- 172.21.15.47:0/4048657771 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c0072f0 con 0x7f285c0709f0 2024-04-26T23:45:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c138d10 con 0x7f285c0709f0 2024-04-26T23:45:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c1392d0 con 0x7f285c0709f0 2024-04-26T23:45:40.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726c0695f0 con 0x7f726c070900 2024-04-26T23:45:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285c0695f0 con 0x7f285c0709f0 2024-04-26T23:45:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f7262a00640 1 -- 172.21.15.47:0/2180904472 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f725c01a070 con 0x7f726c070900 2024-04-26T23:45:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f7262a00640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7248068380 0x7f724806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f7262a00640 1 -- 172.21.15.47:0/2180904472 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f725c0860d0 con 0x7f726c070900 2024-04-26T23:45:40.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f7263e00640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7248068380 0x7f724806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.365+0000 7f2852000640 1 -- 172.21.15.47:0/4048657771 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f284c01a070 con 0x7f285c0709f0 2024-04-26T23:45:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.369+0000 7f2852000640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f283c0683b0 0x7f283c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.369+0000 7f2852000640 1 -- 172.21.15.47:0/4048657771 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f284c085dc0 con 0x7f285c0709f0 2024-04-26T23:45:40.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.369+0000 7f2859400640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f283c0683b0 0x7f283c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.369+0000 7f7263e00640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7248068380 0x7f724806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f726c15cef0 tx=0x7f7254009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.369+0000 7f2859400640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f283c0683b0 0x7f283c06a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28480ae000 tx=0x7f28480a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.369+0000 7f7262a00640 1 -- 172.21.15.47:0/2180904472 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f725c021020 con 0x7f726c070900 2024-04-26T23:45:40.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T23:45:40.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.373+0000 7f2852000640 1 -- 172.21.15.47:0/4048657771 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f284c055c90 con 0x7f285c0709f0 2024-04-26T23:45:40.389 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T23:45:40.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T23:45:40.492 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T23:45:40.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T23:45:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.517+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcb74068cb0 con 0x7fcb740d1540 2024-04-26T23:45:40.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.517+0000 7fcb70c00640 1 -- 172.21.15.47:0/2345342839 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb6c056b40 con 0x7fcb740d1540 2024-04-26T23:45:40.526 INFO:teuthology.orchestra.run.smithi047.stdout:60129542150 2024-04-26T23:45:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.521+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb50068380 msgr2=0x7fcb5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.521+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb50068380 0x7fcb5006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb640ae000 tx=0x7fcb640a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.521+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb740d1540 msgr2=0x7fcb7406df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.521+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb740d1540 0x7fcb7406df20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009fa0 tx=0x7fcb6c00d560 comp rx=0 tx=0).stop 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 shutdown_connections 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb50068380 0x7fcb5006a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb740d1540 0x7fcb7406df20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb740cdae0 0x7fcb7414f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 --2- 172.21.15.47:0/2345342839 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb740b21f0 0x7fcb7414bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 >> 172.21.15.47:0/2345342839 conn(0x7fcb7409ba60 msgr2=0x7fcb740cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 shutdown_connections 2024-04-26T23:45:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.525+0000 7fcb7aa00640 1 -- 172.21.15.47:0/2345342839 wait complete. 2024-04-26T23:45:40.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.545+0000 7f6774a00640 1 Processor -- start 2024-04-26T23:45:40.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.549+0000 7f6774a00640 1 -- start start 2024-04-26T23:45:40.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.549+0000 7f6774a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f677015e690 0x7f6770073780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.549+0000 7f676ea00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6770073e40 0x7f67700d1050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45430/0 (socket says 172.21.15.47:45430) 2024-04-26T23:45:40.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676f400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f677015e690 0x7f6770073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676fe00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f67700d1760 0x7f67700722d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:42918/0 (socket says 172.21.15.47:42918) 2024-04-26T23:45:40.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676f400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f677015e690 0x7f6770073780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46700/0 (socket says 172.21.15.47:46700) 2024-04-26T23:45:40.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676ea00640 1 -- 172.21.15.47:0/685636880 learned_addr learned my addr 172.21.15.47:0/685636880 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:40.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677015ec40 con 0x7f6770073e40 2024-04-26T23:45:40.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677015ef20 con 0x7f67700d1760 2024-04-26T23:45:40.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f67700b4970 con 0x7f677015e690 2024-04-26T23:45:40.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119098194 0 0) 0x7f677015ef20 con 0x7f67700d1760 2024-04-26T23:45:40.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6754003530 con 0x7f67700d1760 2024-04-26T23:45:40.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180327339 0 0) 0x7f677015ec40 con 0x7f6770073e40 2024-04-26T23:45:40.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f677015ef20 con 0x7f6770073e40 2024-04-26T23:45:40.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 <== mon.1 v1:172.21.15.203:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2784128668 0 0) 0x7f6754003530 con 0x7f67700d1760 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 >> v2:172.21.15.47:3300/0 conn(0x7f677015e690 msgr2=0x7f6770073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 --2- 172.21.15.47:0/685636880 >> v2:172.21.15.47:3300/0 conn(0x7f677015e690 0x7f6770073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 >> v1:172.21.15.47:6789/0 conn(0x7f6770073e40 legacy=0x7f67700d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 --> v1:172.21.15.203:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677015f200 con 0x7f67700d1760 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 <== mon.1 v1:172.21.15.203:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f6768001a00 con 0x7f67700d1760 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 >> v1:172.21.15.203:6789/0 conn(0x7f67700d1760 legacy=0x7f67700722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6754003b50 0x7f6754003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6754004810 0x7f6754004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f675400ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f67700b4970 con 0x7f6754003b50 2024-04-26T23:45:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6754010550 con 0x7f6754004810 2024-04-26T23:45:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6754010750 con 0x7f67540051d0 2024-04-26T23:45:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676fe00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f675400ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.553+0000 7f676ea00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6754004810 0x7f6754004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.557+0000 7f676f400640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6754003b50 0x7f6754003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.0 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.557+0000 7f676fe00640 1 -- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6754004810 msgr2=0x7f6754004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.557+0000 7f676fe00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6754004810 0x7f6754004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.557+0000 7f676fe00640 1 -- 172.21.15.47:0/685636880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6754003b50 msgr2=0x7f6754003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.557+0000 7f676fe00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6754003b50 0x7f6754003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.557+0000 7f676fe00640 1 -- 172.21.15.47:0/685636880 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6754003530 con 0x7f67540051d0 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.557+0000 7f676ea00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6754004810 0x7f6754004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.561+0000 7f676fe00640 1 -- 172.21.15.47:0/685636880 reap_dead start 2024-04-26T23:45:40.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.561+0000 7f676fe00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f675400ffe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f676800c490 tx=0x7f676801cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b3279ed5129574 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.561+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676800c0e0 con 0x7f67540051d0 2024-04-26T23:45:40.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.561+0000 7f676e000640 1 -- 172.21.15.47:0/685636880 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67680a9070 con 0x7f67540051d0 2024-04-26T23:45:40.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.561+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 msgr2=0x7f675400ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.561+0000 7f6774a00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f675400ffe0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f676800c490 tx=0x7f676801cde0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.565+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 shutdown_connections 2024-04-26T23:45:40.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.565+0000 7f6774a00640 1 --2- 172.21.15.47:0/685636880 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f675400ffe0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.565+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 >> 172.21.15.47:0/685636880 conn(0x7f677006c400 msgr2=0x7f677006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.565+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 shutdown_connections 2024-04-26T23:45:40.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.565+0000 7f6774a00640 1 -- 172.21.15.47:0/685636880 wait complete. 2024-04-26T23:45:40.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.565+0000 7f6774a00640 1 Processor -- start 2024-04-26T23:45:40.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.565+0000 7f6774a00640 1 -- start start 2024-04-26T23:45:40.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f6774a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f6770151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f6774a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67701fc5b0 0x7f67700b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f6774a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67700b0d40 0x7f677009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f6774a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6770073b10 con 0x7f67700b0d40 2024-04-26T23:45:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f6774a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6770073990 con 0x7f67701fc5b0 2024-04-26T23:45:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f6774a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f677015f850 con 0x7f67540051d0 2024-04-26T23:45:40.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f6770151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f6770151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43254/0 (socket says 172.21.15.47:43254) 2024-04-26T23:45:40.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 -- 172.21.15.47:0/3958178992 learned_addr learned my addr 172.21.15.47:0/3958178992 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676ea00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67701fc5b0 0x7f67700b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 -- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67701fc5b0 msgr2=0x7f67700b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67701fc5b0 0x7f67700b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 -- 172.21.15.47:0/3958178992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67700b0d40 msgr2=0x7f677009ba60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T23:45:40.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67700b0d40 0x7f677009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 -- 172.21.15.47:0/3958178992 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67700b11e0 con 0x7f67540051d0 2024-04-26T23:45:40.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.569+0000 7f676f400640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f6770151e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f675c011760 tx=0x7f675c011c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.573+0000 7f6767400640 1 -- 172.21.15.47:0/3958178992 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c004440 con 0x7f67540051d0 2024-04-26T23:45:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.573+0000 7f6767400640 1 -- 172.21.15.47:0/3958178992 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675c01b070 con 0x7f67540051d0 2024-04-26T23:45:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.573+0000 7f6767400640 1 -- 172.21.15.47:0/3958178992 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c003860 con 0x7f67540051d0 2024-04-26T23:45:40.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.573+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67700b1520 con 0x7f67540051d0 2024-04-26T23:45:40.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.573+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f67700b1d60 con 0x7f67540051d0 2024-04-26T23:45:40.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.573+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67700b1f60 con 0x7f67540051d0 2024-04-26T23:45:40.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.577+0000 7f6767400640 1 -- 172.21.15.47:0/3958178992 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f675c003a00 con 0x7f67540051d0 2024-04-26T23:45:40.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.577+0000 7f6767400640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6750068380 0x7f675006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.577+0000 7f6767400640 1 -- 172.21.15.47:0/3958178992 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f675c086e30 con 0x7f67540051d0 2024-04-26T23:45:40.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.577+0000 7f676ea00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6750068380 0x7f675006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.581+0000 7f676ea00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6750068380 0x7f675006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6760007fd0 tx=0x7f6760009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.581+0000 7f6767400640 1 -- 172.21.15.47:0/3958178992 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f67700b1520 con 0x7f67540051d0 2024-04-26T23:45:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.617+0000 7f77d1800640 1 Processor -- start 2024-04-26T23:45:40.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.617+0000 7f77d1800640 1 -- start start 2024-04-26T23:45:40.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.617+0000 7f77d1800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f77cc0b3180 0x7f77cc0d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.617+0000 7f77d1800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f77cc0d06c0 0x7f77cc0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.617+0000 7f77d1800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77cc06d760 con 0x7f77cc0b3560 2024-04-26T23:45:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.617+0000 7f77d1800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f77cc0b42f0 con 0x7f77cc0b3180 2024-04-26T23:45:40.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.617+0000 7f77d1800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f77cc0b58d0 con 0x7f77cc0d06c0 2024-04-26T23:45:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77cb400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f77cc0b3560 0x7f77cc167370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:42930/0 (socket says 172.21.15.47:42930) 2024-04-26T23:45:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77cb400640 1 -- 172.21.15.47:0/864577996 learned_addr learned my addr 172.21.15.47:0/864577996 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77ca000640 1 --2- 172.21.15.47:0/864577996 >> v2:172.21.15.203:3300/0 conn(0x7f77cc0d06c0 0x7f77cc0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77c9600640 1 -- 172.21.15.47:0/864577996 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266788235 0 0) 0x7f77cc06d760 con 0x7f77cc0b3560 2024-04-26T23:45:40.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77caa00640 1 --2- 172.21.15.47:0/864577996 >> v2:172.21.15.47:3300/0 conn(0x7f77cc0b3180 0x7f77cc0d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77c9600640 1 -- 172.21.15.47:0/864577996 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b0003530 con 0x7f77cc0b3560 2024-04-26T23:45:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77ca000640 1 -- 172.21.15.47:0/864577996 >> v2:172.21.15.47:3300/0 conn(0x7f77cc0b3180 msgr2=0x7f77cc0d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77ca000640 1 --2- 172.21.15.47:0/864577996 >> v2:172.21.15.47:3300/0 conn(0x7f77cc0b3180 0x7f77cc0d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77ca000640 1 -- 172.21.15.47:0/864577996 >> v1:172.21.15.203:6789/0 conn(0x7f77cc0b3560 legacy=0x7f77cc167370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.621+0000 7f77ca000640 1 -- 172.21.15.47:0/864577996 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc06da40 con 0x7f77cc0d06c0 2024-04-26T23:45:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77ca000640 1 --2- 172.21.15.47:0/864577996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 0x7f77cc0c5f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77cc06f670 tx=0x7f77b801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84c096fd6cf16fd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77c9600640 1 -- 172.21.15.47:0/864577996 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b80b0070 con 0x7f77cc0d06c0 2024-04-26T23:45:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77c9600640 1 -- 172.21.15.47:0/864577996 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b80ab600 con 0x7f77cc0d06c0 2024-04-26T23:45:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77c9600640 1 -- 172.21.15.47:0/864577996 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b80ab9d0 con 0x7f77cc0d06c0 2024-04-26T23:45:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 -- 172.21.15.47:0/864577996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 msgr2=0x7f77cc0c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 --2- 172.21.15.47:0/864577996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 0x7f77cc0c5f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77cc06f670 tx=0x7f77b801c3f0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 -- 172.21.15.47:0/864577996 shutdown_connections 2024-04-26T23:45:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 --2- 172.21.15.47:0/864577996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 0x7f77cc0c5f30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 --2- 172.21.15.47:0/864577996 >> v2:172.21.15.47:3300/0 conn(0x7f77cc0b3180 0x7f77cc0d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 -- 172.21.15.47:0/864577996 >> 172.21.15.47:0/864577996 conn(0x7f77cc09ba60 msgr2=0x7f77cc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 -- 172.21.15.47:0/864577996 shutdown_connections 2024-04-26T23:45:40.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.625+0000 7f77d1800640 1 -- 172.21.15.47:0/864577996 wait complete. 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 Processor -- start 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 -- start start 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77cc0b3180 0x7f77cc0b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f77cc0b3560 0x7f77cc09c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 0x7f77cc1612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc1706f0 con 0x7f77cc0b3180 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc0c6880 con 0x7f77cc0d06c0 2024-04-26T23:45:40.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77d1800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f77cc170870 con 0x7f77cc0b3560 2024-04-26T23:45:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77caa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77cc0b3180 0x7f77cc0b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77ca000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f77cc0b3560 0x7f77cc09c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77caa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77cc0b3180 0x7f77cc0b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46732/0 (socket says 172.21.15.47:46732) 2024-04-26T23:45:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77caa00640 1 -- 172.21.15.47:0/1447968618 learned_addr learned my addr 172.21.15.47:0/1447968618 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77cb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 0x7f77cc1612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77ca000640 1 -- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 msgr2=0x7f77cc1612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77ca000640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 0x7f77cc1612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77ca000640 1 -- 172.21.15.47:0/1447968618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77cc0b3180 msgr2=0x7f77cc0b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77ca000640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77cc0b3180 0x7f77cc0b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.629+0000 7f77ca000640 1 -- 172.21.15.47:0/1447968618 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc161eb0 con 0x7f77cc0b3560 2024-04-26T23:45:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77ca000640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f77cc0b3560 0x7f77cc09c0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77b80ab000 tx=0x7f77b8019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77c2a00640 1 -- 172.21.15.47:0/1447968618 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b80b8020 con 0x7f77cc0b3560 2024-04-26T23:45:40.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77c2a00640 1 -- 172.21.15.47:0/1447968618 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b80b4410 con 0x7f77cc0b3560 2024-04-26T23:45:40.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77c2a00640 1 -- 172.21.15.47:0/1447968618 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b80b0040 con 0x7f77cc0b3560 2024-04-26T23:45:40.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77cc0b14b0 con 0x7f77cc0b3560 2024-04-26T23:45:40.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77cc0b1a70 con 0x7f77cc0b3560 2024-04-26T23:45:40.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77cc0695f0 con 0x7f77cc0b3560 2024-04-26T23:45:40.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.633+0000 7f77c2a00640 1 -- 172.21.15.47:0/1447968618 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f77b80bb020 con 0x7f77cc0b3560 2024-04-26T23:45:40.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.637+0000 7f77c2a00640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f77ac068380 0x7f77ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.637+0000 7f77c2a00640 1 -- 172.21.15.47:0/1447968618 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f77b8120420 con 0x7f77cc0b3560 2024-04-26T23:45:40.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.637+0000 7f77caa00640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f77ac068380 0x7f77ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.637+0000 7f77caa00640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f77ac068380 0x7f77ac06a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77cc167170 tx=0x7f77bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.637+0000 7f77c2a00640 1 -- 172.21.15.47:0/1447968618 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f77b80c2030 con 0x7f77cc0b3560 2024-04-26T23:45:40.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.673+0000 7f3bb3200640 1 Processor -- start 2024-04-26T23:45:40.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.673+0000 7f3bb3200640 1 -- start start 2024-04-26T23:45:40.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3bac15daa0 0x7f3bac06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb3200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bac167050 con 0x7f3bac15d6c0 2024-04-26T23:45:40.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bac1672f0 con 0x7f3bac06c940 2024-04-26T23:45:40.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3bac1675d0 con 0x7f3bac15daa0 2024-04-26T23:45:40.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb1e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3bac15d6c0 0x7f3bac073850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45432/0 (socket says 172.21.15.47:45432) 2024-04-26T23:45:40.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb1e00640 1 -- 172.21.15.47:0/619558490 learned_addr learned my addr 172.21.15.47:0/619558490 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:40.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb1400640 1 --2- 172.21.15.47:0/619558490 >> v2:172.21.15.47:3300/0 conn(0x7f3bac15daa0 0x7f3bac06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb1400640 1 -- 172.21.15.47:0/619558490 >> v1:172.21.15.203:6789/0 conn(0x7f3bac06c940 legacy=0x7f3bac163ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:45:40.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb1400640 1 -- 172.21.15.47:0/619558490 >> v1:172.21.15.47:6789/0 conn(0x7f3bac15d6c0 legacy=0x7f3bac073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.677+0000 7f3bb1400640 1 -- 172.21.15.47:0/619558490 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac1678b0 con 0x7f3bac15daa0 2024-04-26T23:45:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.685+0000 7f3bb1400640 1 --2- 172.21.15.47:0/619558490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac15daa0 0x7f3bac06c400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0097c0 tx=0x7f3b9c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d292131c9e048438 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.685+0000 7f3bb0a00640 1 -- 172.21.15.47:0/619558490 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0b0070 con 0x7f3bac15daa0 2024-04-26T23:45:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.685+0000 7f3bb0a00640 1 -- 172.21.15.47:0/619558490 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b9c0ab600 con 0x7f3bac15daa0 2024-04-26T23:45:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.685+0000 7f3bb0a00640 1 -- 172.21.15.47:0/619558490 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bac1649e0 con 0x7f3bac15daa0 2024-04-26T23:45:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.685+0000 7f3bb3200640 1 -- 172.21.15.47:0/619558490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac15daa0 msgr2=0x7f3bac06c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.685+0000 7f3bb3200640 1 --2- 172.21.15.47:0/619558490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac15daa0 0x7f3bac06c400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0097c0 tx=0x7f3b9c01c410 comp rx=0 tx=0).stop 2024-04-26T23:45:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.689+0000 7f3bb3200640 1 -- 172.21.15.47:0/619558490 shutdown_connections 2024-04-26T23:45:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.689+0000 7f3bb3200640 1 --2- 172.21.15.47:0/619558490 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac15daa0 0x7f3bac06c400 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.689+0000 7f3bb3200640 1 -- 172.21.15.47:0/619558490 >> 172.21.15.47:0/619558490 conn(0x7f3bac06d510 msgr2=0x7f3bac06d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.689+0000 7f3bb3200640 1 -- 172.21.15.47:0/619558490 shutdown_connections 2024-04-26T23:45:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.693+0000 7f3bb3200640 1 -- 172.21.15.47:0/619558490 wait complete. 2024-04-26T23:45:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.693+0000 7f3bb3200640 1 Processor -- start 2024-04-26T23:45:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.693+0000 7f3bb3200640 1 -- start start 2024-04-26T23:45:40.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac06c940 0x7f3bac153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bac15d6c0 0x7f3bac1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bac15daa0 0x7f3bac0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3bac171130 con 0x7f3bac06c940 2024-04-26T23:45:40.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bac06cd70 con 0x7f3bac15daa0 2024-04-26T23:45:40.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3bac1712b0 con 0x7f3bac15d6c0 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bac15d6c0 0x7f3bac1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bac15d6c0 0x7f3bac1550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43274/0 (socket says 172.21.15.47:43274) 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 -- 172.21.15.47:0/1978876844 learned_addr learned my addr 172.21.15.47:0/1978876844 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1e00640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac06c940 0x7f3bac153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb2800640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bac15daa0 0x7f3bac0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 -- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bac15daa0 msgr2=0x7f3bac0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bac15daa0 0x7f3bac0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 -- 172.21.15.47:0/1978876844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac06c940 msgr2=0x7f3bac153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac06c940 0x7f3bac153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 -- 172.21.15.47:0/1978876844 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac155a40 con 0x7f3bac15d6c0 2024-04-26T23:45:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb2800640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bac15daa0 0x7f3bac0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1e00640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac06c940 0x7f3bac153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.697+0000 7f3bb1400640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bac15d6c0 0x7f3bac1550a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c01aac0 tx=0x7f3b9c0191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.701+0000 7f3ba6000640 1 -- 172.21.15.47:0/1978876844 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0b9070 con 0x7f3bac15d6c0 2024-04-26T23:45:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.701+0000 7f3ba6000640 1 -- 172.21.15.47:0/1978876844 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b9c0b5680 con 0x7f3bac15d6c0 2024-04-26T23:45:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.701+0000 7f3ba6000640 1 -- 172.21.15.47:0/1978876844 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c0b0040 con 0x7f3bac15d6c0 2024-04-26T23:45:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.701+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bac155d20 con 0x7f3bac15d6c0 2024-04-26T23:45:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.701+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bac1562e0 con 0x7f3bac15d6c0 2024-04-26T23:45:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.701+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bac069b80 con 0x7f3bac15d6c0 2024-04-26T23:45:40.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.701+0000 7f3ba6000640 1 -- 172.21.15.47:0/1978876844 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b9c0bc070 con 0x7f3bac15d6c0 2024-04-26T23:45:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.705+0000 7f3ba6000640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b90068380 0x7f3b9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.705+0000 7f3ba6000640 1 -- 172.21.15.47:0/1978876844 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3b9c120c80 con 0x7f3bac15d6c0 2024-04-26T23:45:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.705+0000 7f3bb1e00640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b90068380 0x7f3b9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.705+0000 7f3bb1e00640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b90068380 0x7f3b9006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000f70 tx=0x7f3ba0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.709+0000 7f3ba6000640 1 -- 172.21.15.47:0/1978876844 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3b9c0c3030 con 0x7f3bac15d6c0 2024-04-26T23:45:40.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.721+0000 7fd3d1200640 1 Processor -- start 2024-04-26T23:45:40.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.721+0000 7fd3d1200640 1 -- start start 2024-04-26T23:45:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.721+0000 7fd3d1200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3cc0af060 0x7fd3cc0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.721+0000 7fd3d1200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc06fa20 0x7fd3cc073c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.721+0000 7fd3d1200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd3cc072490 0x7fd3cc0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3d1200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd3cc0afc10 con 0x7fd3cc0af060 2024-04-26T23:45:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3d1200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd3cc0afef0 con 0x7fd3cc072490 2024-04-26T23:45:40.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3d1200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd3cc0b01d0 con 0x7fd3cc06fa20 2024-04-26T23:45:40.734 INFO:teuthology.orchestra.run.smithi047.stdout:64424509447 2024-04-26T23:45:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f285c0b5500 con 0x7f285c0709f0 2024-04-26T23:45:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7f2852000640 1 -- 172.21.15.47:0/4048657771 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f284c059f90 con 0x7f285c0709f0 2024-04-26T23:45:40.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3caa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc06fa20 0x7fd3cc073c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3caa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc06fa20 0x7fd3cc073c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43282/0 (socket says 172.21.15.47:43282) 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3caa00640 1 -- 172.21.15.47:0/1469642175 learned_addr learned my addr 172.21.15.47:0/1469642175 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3cb400640 1 --2- 172.21.15.47:0/1469642175 >> v2:172.21.15.47:3300/0 conn(0x7fd3cc0af060 0x7fd3cc0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3cbe00640 1 --2- 172.21.15.47:0/1469642175 >> v2:172.21.15.203:3300/0 conn(0x7fd3cc072490 0x7fd3cc0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3cbe00640 1 -- 172.21.15.47:0/1469642175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc06fa20 msgr2=0x7fd3cc073c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3cbe00640 1 --2- 172.21.15.47:0/1469642175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc06fa20 0x7fd3cc073c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3cbe00640 1 -- 172.21.15.47:0/1469642175 >> v2:172.21.15.47:3300/0 conn(0x7fd3cc0af060 msgr2=0x7fd3cc0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3cbe00640 1 --2- 172.21.15.47:0/1469642175 >> v2:172.21.15.47:3300/0 conn(0x7fd3cc0af060 0x7fd3cc0af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.725+0000 7fd3cbe00640 1 -- 172.21.15.47:0/1469642175 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc0b04b0 con 0x7fd3cc072490 2024-04-26T23:45:40.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7fd3cbe00640 1 --2- 172.21.15.47:0/1469642175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 0x7fd3cc0d0f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0b0100 tx=0x7fd3c401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4e7f0c03b5335d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f283c0683b0 msgr2=0x7f283c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f283c0683b0 0x7f283c06a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f28480ae000 tx=0x7f28480a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:40.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c0709f0 msgr2=0x7f285c14baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c0709f0 0x7f285c14baa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f284c00c450 tx=0x7f284c00c850 comp rx=0 tx=0).stop 2024-04-26T23:45:40.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 shutdown_connections 2024-04-26T23:45:40.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7fd3ca000640 1 -- 172.21.15.47:0/1469642175 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40b2070 con 0x7fd3cc072490 2024-04-26T23:45:40.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7fd3ca000640 1 -- 172.21.15.47:0/1469642175 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c40a57b0 con 0x7fd3cc072490 2024-04-26T23:45:40.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7fd3ca000640 1 -- 172.21.15.47:0/1469642175 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40a5b80 con 0x7fd3cc072490 2024-04-26T23:45:40.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f283c0683b0 0x7f283c06a870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f285c15d4e0 0x7f285c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f285c09ba60 0x7f285c156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 --2- 172.21.15.47:0/4048657771 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f285c0709f0 0x7f285c14baa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 >> 172.21.15.47:0/4048657771 conn(0x7f285c075fe0 msgr2=0x7f285c15b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 shutdown_connections 2024-04-26T23:45:40.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.729+0000 7f2860a00640 1 -- 172.21.15.47:0/4048657771 wait complete. 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 -- 172.21.15.47:0/1469642175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 msgr2=0x7fd3cc0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 --2- 172.21.15.47:0/1469642175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 0x7fd3cc0d0f60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0b0100 tx=0x7fd3c401c930 comp rx=0 tx=0).stop 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 -- 172.21.15.47:0/1469642175 shutdown_connections 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 --2- 172.21.15.47:0/1469642175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 0x7fd3cc0d0f60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 --2- 172.21.15.47:0/1469642175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc06fa20 0x7fd3cc073c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 --2- 172.21.15.47:0/1469642175 >> v2:172.21.15.47:3300/0 conn(0x7fd3cc0af060 0x7fd3cc0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 -- 172.21.15.47:0/1469642175 >> 172.21.15.47:0/1469642175 conn(0x7fd3cc06c400 msgr2=0x7fd3cc06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 -- 172.21.15.47:0/1469642175 shutdown_connections 2024-04-26T23:45:40.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 -- 172.21.15.47:0/1469642175 wait complete. 2024-04-26T23:45:40.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 Processor -- start 2024-04-26T23:45:40.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.733+0000 7fd3d1200640 1 -- start start 2024-04-26T23:45:40.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f726c15d1f0 con 0x7f726c070900 2024-04-26T23:45:40.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3d1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3cc06fa20 0x7fd3cc144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3d1200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 0x7fd3cc09ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3d1200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc0af060 0x7fd3cc0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3d1200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc163970 con 0x7fd3cc06fa20 2024-04-26T23:45:40.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3d1200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd3cc0d18b0 con 0x7fd3cc072490 2024-04-26T23:45:40.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3d1200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd3cc144c50 con 0x7fd3cc0af060 2024-04-26T23:45:40.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3cc06fa20 0x7fd3cc144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3cc06fa20 0x7fd3cc144710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46764/0 (socket says 172.21.15.47:46764) 2024-04-26T23:45:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 -- 172.21.15.47:0/1376695423 learned_addr learned my addr 172.21.15.47:0/1376695423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7f7262a00640 1 -- 172.21.15.47:0/2180904472 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f725c056090 con 0x7f726c070900 2024-04-26T23:45:40.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3caa00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 0x7fd3cc09ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.745 INFO:teuthology.orchestra.run.smithi047.stdout:64424509446 2024-04-26T23:45:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 -- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc0af060 msgr2=0x7fd3cc0b0820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:45:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc0af060 0x7fd3cc0b0820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 -- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 msgr2=0x7fd3cc09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 0x7fd3cc09ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 -- 172.21.15.47:0/1376695423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3cc0b2fc0 con 0x7fd3cc06fa20 2024-04-26T23:45:40.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3cb400640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3cc06fa20 0x7fd3cc144710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00e8a0 tx=0x7fd3bc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3c3400640 1 -- 172.21.15.47:0/1376695423 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc017070 con 0x7fd3cc06fa20 2024-04-26T23:45:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3c3400640 1 -- 172.21.15.47:0/1376695423 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc00c940 con 0x7fd3cc06fa20 2024-04-26T23:45:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.737+0000 7fd3c3400640 1 -- 172.21.15.47:0/1376695423 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00cd10 con 0x7fd3cc06fa20 2024-04-26T23:45:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7fd3d1200640 1 -- 172.21.15.47:0/1376695423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3cc0b32a0 con 0x7fd3cc06fa20 2024-04-26T23:45:40.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7fd3d1200640 1 -- 172.21.15.47:0/1376695423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3cc152810 con 0x7fd3cc06fa20 2024-04-26T23:45:40.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a00052a0 con 0x7fd3cc06fa20 2024-04-26T23:45:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7248068380 msgr2=0x7f724806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7248068380 0x7f724806a840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f726c15cef0 tx=0x7f7254009190 comp rx=0 tx=0).stop 2024-04-26T23:45:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f726c070900 msgr2=0x7f726c1622c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f726c070900 0x7f726c1622c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f725c00c370 tx=0x7f725c00c830 comp rx=0 tx=0).stop 2024-04-26T23:45:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 shutdown_connections 2024-04-26T23:45:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7248068380 0x7f724806a840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f726c160470 0x7f726c157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f726c0b1480 0x7f726c160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 --2- 172.21.15.47:0/2180904472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f726c070900 0x7f726c1622c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 >> 172.21.15.47:0/2180904472 conn(0x7f726c0b4470 msgr2=0x7f726c0d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7fd3c3400640 1 -- 172.21.15.47:0/1376695423 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3bc01a070 con 0x7fd3cc06fa20 2024-04-26T23:45:40.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.741+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 shutdown_connections 2024-04-26T23:45:40.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7f7271600640 1 -- 172.21.15.47:0/2180904472 wait complete. 2024-04-26T23:45:40.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fd3c3400640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3ac068380 0x7fd3ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fd3c3400640 1 -- 172.21.15.47:0/1376695423 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd3bc086690 con 0x7fd3cc06fa20 2024-04-26T23:45:40.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fed43400640 1 Processor -- start 2024-04-26T23:45:40.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fd3caa00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3ac068380 0x7fd3ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fed43400640 1 -- start start 2024-04-26T23:45:40.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fd3caa00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3ac068380 0x7fd3ac06a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc169c50 tx=0x7fd3b8009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fed43400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fed3c163650 0x7fed3c0b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fed43400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c06c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fed43400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c0b6fa0 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fed43400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fed3c0d0fe0 con 0x7fed3c163650 2024-04-26T23:45:40.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.745+0000 7fed43400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c0d1280 con 0x7fed3c0b6a70 2024-04-26T23:45:40.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed3be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed41400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fed3c0b4dc0 0x7fed3c0cfc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45434/0 (socket says 172.21.15.47:45434) 2024-04-26T23:45:40.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed3be00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c06c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43300/0 (socket says 172.21.15.47:43300) 2024-04-26T23:45:40.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed3be00640 1 -- 172.21.15.47:0/785549456 learned_addr learned my addr 172.21.15.47:0/785549456 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed3be00640 1 -- 172.21.15.47:0/785549456 >> v2:172.21.15.203:3300/0 conn(0x7fed3c163650 msgr2=0x7fed3c0b6530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:45:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed3be00640 1 --2- 172.21.15.47:0/785549456 >> v2:172.21.15.203:3300/0 conn(0x7fed3c163650 0x7fed3c0b6530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed3be00640 1 -- 172.21.15.47:0/785549456 >> v1:172.21.15.47:6789/0 conn(0x7fed3c0b4dc0 legacy=0x7fed3c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.749+0000 7fed3be00640 1 -- 172.21.15.47:0/785549456 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c0d1560 con 0x7fed3c0b6a70 2024-04-26T23:45:40.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fd3c3400640 1 -- 172.21.15.47:0/1376695423 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd3bc056690 con 0x7fd3cc06fa20 2024-04-26T23:45:40.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed3be00640 1 --2- 172.21.15.47:0/785549456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c06c400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed34009870 tx=0x7fed3401c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f03537a92ae15a61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed3b400640 1 -- 172.21.15.47:0/785549456 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340aa5f0 con 0x7fed3c0b6a70 2024-04-26T23:45:40.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed3b400640 1 -- 172.21.15.47:0/785549456 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed340af070 con 0x7fed3c0b6a70 2024-04-26T23:45:40.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed3b400640 1 -- 172.21.15.47:0/785549456 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed340aa9b0 con 0x7fed3c0b6a70 2024-04-26T23:45:40.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed43400640 1 -- 172.21.15.47:0/785549456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 msgr2=0x7fed3c06c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed43400640 1 --2- 172.21.15.47:0/785549456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c06c400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fed34009870 tx=0x7fed3401c580 comp rx=0 tx=0).stop 2024-04-26T23:45:40.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed43400640 1 -- 172.21.15.47:0/785549456 shutdown_connections 2024-04-26T23:45:40.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.753+0000 7fed43400640 1 --2- 172.21.15.47:0/785549456 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c06c400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.757+0000 7fed43400640 1 --2- 172.21.15.47:0/785549456 >> v2:172.21.15.203:3300/0 conn(0x7fed3c163650 0x7fed3c0b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.757+0000 7fed43400640 1 -- 172.21.15.47:0/785549456 >> 172.21.15.47:0/785549456 conn(0x7fed3c0b39c0 msgr2=0x7fed3c0b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.757+0000 7fed43400640 1 -- 172.21.15.47:0/785549456 shutdown_connections 2024-04-26T23:45:40.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.757+0000 7fed43400640 1 -- 172.21.15.47:0/785549456 wait complete. 2024-04-26T23:45:40.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2024-04-26T23:45:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.757+0000 7fed43400640 1 Processor -- start 2024-04-26T23:45:40.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.757+0000 7fed43400640 1 -- start start 2024-04-26T23:45:40.766 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed43400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c0b4dc0 0x7fed3c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed43400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c15f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c0b4dc0 0x7fed3c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c0b4dc0 0x7fed3c14eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:55360/0 (socket says 172.21.15.47:55360) 2024-04-26T23:45:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 -- 172.21.15.47:0/526047299 learned_addr learned my addr 172.21.15.47:0/526047299 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed43400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3c163650 0x7fed3c0afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c170440 con 0x7fed3c163650 2024-04-26T23:45:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c1702c0 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c1705c0 con 0x7fed3c0b6a70 2024-04-26T23:45:40.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed3be00640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c15f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed41400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3c163650 0x7fed3c0afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 -- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 msgr2=0x7fed3c15f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c15f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 -- 172.21.15.47:0/526047299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3c163650 msgr2=0x7fed3c0afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3c163650 0x7fed3c0afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed40a00640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c14f670 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.761+0000 7fed41400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3c163650 0x7fed3c0afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed40a00640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c0b4dc0 0x7fed3c14eec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00ba50 tx=0x7fed2c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed38c00640 1 -- 172.21.15.47:0/526047299 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c019070 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed38c00640 1 -- 172.21.15.47:0/526047299 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c00cc10 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed38c00640 1 -- 172.21.15.47:0/526047299 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c014440 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c14f950 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c14ff10 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c0695f0 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.765+0000 7fed38c00640 1 -- 172.21.15.47:0/526047299 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed2c01c070 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.769+0000 7fed38c00640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed18068380 0x7fed1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:40.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.769+0000 7fed38c00640 1 -- 172.21.15.47:0/526047299 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fed2c086790 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.769+0000 7fed3be00640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed18068380 0x7fed1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:40.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.769+0000 7fed3be00640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed18068380 0x7fed1806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed340ae000 tx=0x7fed340a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:40.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.773+0000 7fed38c00640 1 -- 172.21.15.47:0/526047299 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fed2c056660 con 0x7fed3c0b4dc0 2024-04-26T23:45:40.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.5 2024-04-26T23:45:40.785 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:40.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.881+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6770149b50 con 0x7f67540051d0 2024-04-26T23:45:40.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6767400640 1 -- 172.21.15.47:0/3958178992 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f675c0572c0 con 0x7f67540051d0 2024-04-26T23:45:40.890 INFO:teuthology.orchestra.run.smithi047.stdout:64424509446 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6750068380 msgr2=0x7f675006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6750068380 0x7f675006a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6760007fd0 tx=0x7f6760009040 comp rx=0 tx=0).stop 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 msgr2=0x7f6770151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f6770151e90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f675c011760 tx=0x7f675c011c20 comp rx=0 tx=0).stop 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 shutdown_connections 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6750068380 0x7f675006a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f67700b0d40 0x7f677009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f67701fc5b0 0x7f67700b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 --2- 172.21.15.47:0/3958178992 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f67540051d0 0x7f6770151e90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 >> 172.21.15.47:0/3958178992 conn(0x7f677006c400 msgr2=0x7f67700cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 shutdown_connections 2024-04-26T23:45:40.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.885+0000 7f6774a00640 1 -- 172.21.15.47:0/3958178992 wait complete. 2024-04-26T23:45:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.905+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f77cc0cff60 con 0x7f77cc0b3560 2024-04-26T23:45:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.905+0000 7f77c2a00640 1 -- 172.21.15.47:0/1447968618 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f77b8016070 con 0x7f77cc0b3560 2024-04-26T23:45:40.912 INFO:teuthology.orchestra.run.smithi047.stdout:64424509447 2024-04-26T23:45:40.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.3 2024-04-26T23:45:40.915 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f77ac068380 msgr2=0x7f77ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f77ac068380 0x7f77ac06a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f77cc167170 tx=0x7f77bc008040 comp rx=0 tx=0).stop 2024-04-26T23:45:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f77cc0b3560 msgr2=0x7f77cc09c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f77cc0b3560 0x7f77cc09c0a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77b80ab000 tx=0x7f77b8019190 comp rx=0 tx=0).stop 2024-04-26T23:45:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 shutdown_connections 2024-04-26T23:45:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f77ac068380 0x7f77ac06a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77cc0d06c0 0x7f77cc1612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f77cc0b3560 0x7f77cc09c0a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 --2- 172.21.15.47:0/1447968618 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77cc0b3180 0x7f77cc0b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 >> 172.21.15.47:0/1447968618 conn(0x7f77cc09ba60 msgr2=0x7f77cc0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 shutdown_connections 2024-04-26T23:45:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f3bac153b90 con 0x7f3bac15d6c0 2024-04-26T23:45:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f77d1800640 1 -- 172.21.15.47:0/1447968618 wait complete. 2024-04-26T23:45:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.909+0000 7f3ba6000640 1 -- 172.21.15.47:0/1978876844 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b9c016090 con 0x7f3bac15d6c0 2024-04-26T23:45:40.918 INFO:teuthology.orchestra.run.smithi047.stdout:64424509447 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b90068380 msgr2=0x7f3b9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b90068380 0x7f3b9006a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0000f70 tx=0x7f3ba0009040 comp rx=0 tx=0).stop 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bac15d6c0 msgr2=0x7f3bac1550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bac15d6c0 0x7f3bac1550a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c01aac0 tx=0x7f3b9c0191b0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 shutdown_connections 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3b90068380 0x7f3b9006a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bac15daa0 0x7f3bac0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3bac15d6c0 0x7f3bac1550a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 --2- 172.21.15.47:0/1978876844 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3bac06c940 0x7f3bac153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:40.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 >> 172.21.15.47:0/1978876844 conn(0x7f3bac06d510 msgr2=0x7f3bac0b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:40.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 shutdown_connections 2024-04-26T23:45:40.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:40.913+0000 7f3bb3200640 1 -- 172.21.15.47:0/1978876844 wait complete. 2024-04-26T23:45:40.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2024-04-26T23:45:40.947 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:40.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.6 2024-04-26T23:45:40.949 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:41.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.021+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd3a0005860 con 0x7fd3cc06fa20 2024-04-26T23:45:41.031 INFO:teuthology.orchestra.run.smithi047.stdout:64424509446 2024-04-26T23:45:41.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c3400640 1 -- 172.21.15.47:0/1376695423 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd3bc05a990 con 0x7fd3cc06fa20 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3ac068380 msgr2=0x7fd3ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3ac068380 0x7fd3ac06a840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc169c50 tx=0x7fd3b8009240 comp rx=0 tx=0).stop 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3cc06fa20 msgr2=0x7fd3cc144710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3cc06fa20 0x7fd3cc144710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00e8a0 tx=0x7fd3bc00eca0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 shutdown_connections 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3ac068380 0x7fd3ac06a840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3cc0af060 0x7fd3cc0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3cc072490 0x7fd3cc09ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 --2- 172.21.15.47:0/1376695423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3cc06fa20 0x7fd3cc144710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 >> 172.21.15.47:0/1376695423 conn(0x7fd3cc06c400 msgr2=0x7fd3cc160740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 shutdown_connections 2024-04-26T23:45:41.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.025+0000 7fd3c0c00640 1 -- 172.21.15.47:0/1376695423 wait complete. 2024-04-26T23:45:41.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.037+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fed3c0b2520 con 0x7fed3c0b4dc0 2024-04-26T23:45:41.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.037+0000 7fed38c00640 1 -- 172.21.15.47:0/526047299 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed2c05a960 con 0x7fed3c0b4dc0 2024-04-26T23:45:41.045 INFO:teuthology.orchestra.run.smithi047.stdout:64424509447 2024-04-26T23:45:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed18068380 msgr2=0x7fed1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed18068380 0x7fed1806a840 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed340ae000 tx=0x7fed340a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c0b4dc0 msgr2=0x7fed3c14eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c0b4dc0 0x7fed3c14eec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fed2c00ba50 tx=0x7fed2c00bf10 comp rx=0 tx=0).stop 2024-04-26T23:45:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 shutdown_connections 2024-04-26T23:45:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed18068380 0x7fed1806a840 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3c163650 0x7fed3c0afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3c0b6a70 0x7fed3c15f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 --2- 172.21.15.47:0/526047299 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3c0b4dc0 0x7fed3c14eec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 >> 172.21.15.47:0/526047299 conn(0x7fed3c0b39c0 msgr2=0x7fed3c0b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:41.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 shutdown_connections 2024-04-26T23:45:41.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.041+0000 7fed43400640 1 -- 172.21.15.47:0/526047299 wait complete. 2024-04-26T23:45:41.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.1 2024-04-26T23:45:41.052 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:41.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2024-04-26T23:45:41.067 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:41.566 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T23:45:41.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.701+0000 7f948c600640 1 Processor -- start 2024-04-26T23:45:41.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.701+0000 7f948c600640 1 -- start start 2024-04-26T23:45:41.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948c600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9484159b70 0x7f948406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:41.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948c600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94841603b0 0x7f948406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:41.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948c600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94840aea30 con 0x7f94840af7f0 2024-04-26T23:45:41.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948c600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f94840af360 con 0x7f94841603b0 2024-04-26T23:45:41.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948c600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f94840aed10 con 0x7f9484159b70 2024-04-26T23:45:41.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948a600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94841603b0 0x7f948406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:41.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948a600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94841603b0 0x7f948406cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46780/0 (socket says 172.21.15.47:46780) 2024-04-26T23:45:41.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948a600640 1 -- 172.21.15.47:0/1015433018 learned_addr learned my addr 172.21.15.47:0/1015433018 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:41.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f9489c00640 1 --2- 172.21.15.47:0/1015433018 >> v2:172.21.15.203:3300/0 conn(0x7f9484159b70 0x7f948406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:41.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948a600640 1 -- 172.21.15.47:0/1015433018 >> v2:172.21.15.203:3300/0 conn(0x7f9484159b70 msgr2=0x7f948406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:41.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948a600640 1 --2- 172.21.15.47:0/1015433018 >> v2:172.21.15.203:3300/0 conn(0x7f9484159b70 0x7f948406c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948a600640 1 -- 172.21.15.47:0/1015433018 >> v1:172.21.15.203:6789/0 conn(0x7f94840af7f0 legacy=0x7f948415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.705+0000 7f948a600640 1 -- 172.21.15.47:0/1015433018 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94840aeff0 con 0x7f94841603b0 2024-04-26T23:45:41.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948a600640 1 --2- 172.21.15.47:0/1015433018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948406cb70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f948406d180 tx=0x7f947c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c05872a0ddda3d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:41.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f9483e00640 1 -- 172.21.15.47:0/1015433018 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a58e0 con 0x7f94841603b0 2024-04-26T23:45:41.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f9483e00640 1 -- 172.21.15.47:0/1015433018 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c0a5a80 con 0x7f94841603b0 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f9483e00640 1 -- 172.21.15.47:0/1015433018 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a5e50 con 0x7f94841603b0 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 -- 172.21.15.47:0/1015433018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 msgr2=0x7f948406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 --2- 172.21.15.47:0/1015433018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948406cb70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f948406d180 tx=0x7f947c01c9f0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 -- 172.21.15.47:0/1015433018 shutdown_connections 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 --2- 172.21.15.47:0/1015433018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948406cb70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 --2- 172.21.15.47:0/1015433018 >> v2:172.21.15.203:3300/0 conn(0x7f9484159b70 0x7f948406c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 -- 172.21.15.47:0/1015433018 >> 172.21.15.47:0/1015433018 conn(0x7f94840b2d40 msgr2=0x7f94840b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 -- 172.21.15.47:0/1015433018 shutdown_connections 2024-04-26T23:45:41.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 -- 172.21.15.47:0/1015433018 wait complete. 2024-04-26T23:45:41.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 Processor -- start 2024-04-26T23:45:41.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 -- start start 2024-04-26T23:45:41.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94840af7f0 0x7f94840ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:41.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.709+0000 7f948c600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9484159b70 0x7f948414af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948c600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948c600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f948406fa60 con 0x7f94841603b0 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948c600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f948406f8e0 con 0x7f94840af7f0 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948c600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f948406fbe0 con 0x7f9484159b70 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948415d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46796/0 (socket says 172.21.15.47:46796) 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 -- 172.21.15.47:0/4150907812 learned_addr learned my addr 172.21.15.47:0/4150907812 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f9489c00640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94840af7f0 0x7f94840ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f9489200640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9484159b70 0x7f948414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 -- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9484159b70 msgr2=0x7f948414af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9484159b70 0x7f948414af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 -- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94840af7f0 msgr2=0x7f94840ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94840af7f0 0x7f94840ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 -- 172.21.15.47:0/4150907812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948415e8f0 con 0x7f94841603b0 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f9489200640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9484159b70 0x7f948414af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948a600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948415d9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f947c0af040 tx=0x7f947c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f9481600640 1 -- 172.21.15.47:0/4150907812 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a58e0 con 0x7f94841603b0 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f9481600640 1 -- 172.21.15.47:0/4150907812 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c0be070 con 0x7f94841603b0 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948415e330 con 0x7f94841603b0 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f9481600640 1 -- 172.21.15.47:0/4150907812 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c009510 con 0x7f94841603b0 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94840cd800 con 0x7f94841603b0 2024-04-26T23:45:41.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94840695f0 con 0x7f94841603b0 2024-04-26T23:45:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.713+0000 7f9481600640 1 -- 172.21.15.47:0/4150907812 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f947c0b86b0 con 0x7f94841603b0 2024-04-26T23:45:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.717+0000 7f9481600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f94640683b0 0x7f946406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.717+0000 7f9481600640 1 -- 172.21.15.47:0/4150907812 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f947c122160 con 0x7f94841603b0 2024-04-26T23:45:41.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.717+0000 7f9489c00640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f94640683b0 0x7f946406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:41.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.717+0000 7f9489c00640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f94640683b0 0x7f946406a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9478009b60 tx=0x7f9478009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:41.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.721+0000 7f9481600640 1 -- 172.21.15.47:0/4150907812 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f947c0165e0 con 0x7f94841603b0 2024-04-26T23:45:41.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.885+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f948406eca0 con 0x7f94841603b0 2024-04-26T23:45:41.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f9481600640 1 -- 172.21.15.47:0/4150907812 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f947c0f26b0 con 0x7f94841603b0 2024-04-26T23:45:41.895 INFO:teuthology.orchestra.run.smithi047.stdout:60129542152 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f94640683b0 msgr2=0x7f946406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f94640683b0 0x7f946406a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9478009b60 tx=0x7f9478009190 comp rx=0 tx=0).stop 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 msgr2=0x7f948415d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948415d9c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f947c0af040 tx=0x7f947c019790 comp rx=0 tx=0).stop 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 shutdown_connections 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f94640683b0 0x7f946406a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94841603b0 0x7f948415d9c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9484159b70 0x7f948414af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 --2- 172.21.15.47:0/4150907812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94840af7f0 0x7f94840ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 >> 172.21.15.47:0/4150907812 conn(0x7f94840b2d40 msgr2=0x7f94840b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 shutdown_connections 2024-04-26T23:45:41.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:41.889+0000 7f948c600640 1 -- 172.21.15.47:0/4150907812 wait complete. 2024-04-26T23:45:41.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2024-04-26T23:45:41.915 DEBUG:teuthology.parallel:result is None 2024-04-26T23:45:41.915 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:45:41.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:42.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023e00640 1 Processor -- start 2024-04-26T23:45:42.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023e00640 1 -- start start 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f80241563c0 0x7f80240b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024073020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80241567a0 con 0x7f802415cf10 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f80240b4c50 con 0x7f80241563c0 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f80240b5c60 con 0x7f802415cad0 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8022a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f80241563c0 0x7f80240b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f802415cf10 0x7f80240aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45436/0 (socket says 172.21.15.47:45436) 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8022a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f80241563c0 0x7f80240b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46798/0 (socket says 172.21.15.47:46798) 2024-04-26T23:45:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8023400640 1 -- 172.21.15.47:0/4054482134 learned_addr learned my addr 172.21.15.47:0/4054482134 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:42.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f801be00640 1 --2- 172.21.15.47:0/4054482134 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024073020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8022a00640 1 -- 172.21.15.47:0/4054482134 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 msgr2=0x7f8024073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:42.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8022a00640 1 --2- 172.21.15.47:0/4054482134 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024073020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8022a00640 1 -- 172.21.15.47:0/4054482134 >> v1:172.21.15.47:6789/0 conn(0x7f802415cf10 legacy=0x7f80240aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8022a00640 1 -- 172.21.15.47:0/4054482134 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80240b4ea0 con 0x7f80241563c0 2024-04-26T23:45:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f8022000640 1 -- 172.21.15.47:0/4054482134 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990570281 0 0) 0x7f80241567a0 con 0x7f802415cf10 2024-04-26T23:45:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.049+0000 7f801be00640 1 --2- 172.21.15.47:0/4054482134 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024073020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8022a00640 1 --2- 172.21.15.47:0/4054482134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f80240b0b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f80240b4dd0 tx=0x7f801401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ec1ec013fdceb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8022000640 1 -- 172.21.15.47:0/4054482134 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140b0070 con 0x7f80241563c0 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8022000640 1 -- 172.21.15.47:0/4054482134 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80140ab600 con 0x7f80241563c0 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8022000640 1 -- 172.21.15.47:0/4054482134 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140ab9d0 con 0x7f80241563c0 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 -- 172.21.15.47:0/4054482134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 msgr2=0x7f80240b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 --2- 172.21.15.47:0/4054482134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f80240b0b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f80240b4dd0 tx=0x7f801401c3e0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 -- 172.21.15.47:0/4054482134 shutdown_connections 2024-04-26T23:45:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 --2- 172.21.15.47:0/4054482134 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024073020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 --2- 172.21.15.47:0/4054482134 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f80240b0b80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 -- 172.21.15.47:0/4054482134 >> 172.21.15.47:0/4054482134 conn(0x7f802406df60 msgr2=0x7f80240b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:42.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 -- 172.21.15.47:0/4054482134 shutdown_connections 2024-04-26T23:45:42.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.053+0000 7f8023e00640 1 -- 172.21.15.47:0/4054482134 wait complete. 2024-04-26T23:45:42.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 Processor -- start 2024-04-26T23:45:42.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 -- start start 2024-04-26T23:45:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f802414dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f802415cf10 0x7f80241569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f802406c400 con 0x7f80241563c0 2024-04-26T23:45:42.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f80240b6f40 con 0x7f802415cf10 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f802406c580 con 0x7f802415cad0 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f802414dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f802414dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46808/0 (socket says 172.21.15.47:46808) 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 -- 172.21.15.47:0/2297538624 learned_addr learned my addr 172.21.15.47:0/2297538624 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f801be00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023400640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f802415cf10 0x7f80241569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 -- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 msgr2=0x7f8024141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 -- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f802415cf10 msgr2=0x7f80241569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f802415cf10 0x7f80241569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 -- 172.21.15.47:0/2297538624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8024158cf0 con 0x7f80241563c0 2024-04-26T23:45:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8022a00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f802414dbf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80140ae040 tx=0x7f801401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f801aa00640 1 -- 172.21.15.47:0/2297538624 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140b0050 con 0x7f80241563c0 2024-04-26T23:45:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f801aa00640 1 -- 172.21.15.47:0/2297538624 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80140bc070 con 0x7f80241563c0 2024-04-26T23:45:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f801aa00640 1 -- 172.21.15.47:0/2297538624 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80140b5a70 con 0x7f80241563c0 2024-04-26T23:45:42.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8024158fd0 con 0x7f80241563c0 2024-04-26T23:45:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.057+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8024159590 con 0x7f80241563c0 2024-04-26T23:45:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.061+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8024069b80 con 0x7f80241563c0 2024-04-26T23:45:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.061+0000 7f801aa00640 1 -- 172.21.15.47:0/2297538624 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80140ab4c0 con 0x7f80241563c0 2024-04-26T23:45:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.061+0000 7f801aa00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f80000683b0 0x7f800006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.061+0000 7f801aa00640 1 -- 172.21.15.47:0/2297538624 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f80141212c0 con 0x7f80241563c0 2024-04-26T23:45:42.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.061+0000 7f801be00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f80000683b0 0x7f800006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.061+0000 7f801be00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f80000683b0 0x7f800006a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f80241fb460 tx=0x7f800c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.065+0000 7f801aa00640 1 -- 172.21.15.47:0/2297538624 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8014016090 con 0x7f80241563c0 2024-04-26T23:45:42.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.229+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8024159e50 con 0x7f80000683b0 2024-04-26T23:45:42.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.233+0000 7f801aa00640 1 -- 172.21.15.47:0/2297538624 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f8024159e50 con 0x7f80000683b0 2024-04-26T23:45:42.244 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:42.246 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f80000683b0 msgr2=0x7f800006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f80000683b0 0x7f800006a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f80241fb460 tx=0x7f800c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 msgr2=0x7f802414dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f802414dbf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80140ae040 tx=0x7f801401ac20 comp rx=0 tx=0).stop 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 shutdown_connections 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f80000683b0 0x7f800006a870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f802415cf10 0x7f80241569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f802415cad0 0x7f8024141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 --2- 172.21.15.47:0/2297538624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80241563c0 0x7f802414dbf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 >> 172.21.15.47:0/2297538624 conn(0x7f802406df60 msgr2=0x7f802414f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:42.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 shutdown_connections 2024-04-26T23:45:42.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.237+0000 7f8023e00640 1 -- 172.21.15.47:0/2297538624 wait complete. 2024-04-26T23:45:42.266 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-26T23:45:42.156029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235876,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738844,"statfs":{"total":773094113280,"available":772852576256,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.488909"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757462+0000","last_change":"2024-04-26T23:45:32.701302+0000","last_active":"2024-04-26T23:45:33.757462+0000","last_peered":"2024-04-26T23:45:33.757462+0000","last_clean":"2024-04-26T23:45:33.757462+0000","last_became_active":"2024-04-26T23:45:32.698183+0000","last_became_peered":"2024-04-26T23:45:32.698183+0000","last_unstale":"2024-04-26T23:45:33.757462+0000","last_undegraded":"2024-04-26T23:45:33.757462+0000","last_fullsized":"2024-04-26T23:45:33.757462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:12.210886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695950+0000","last_change":"2024-04-26T23:45:32.693831+0000","last_active":"2024-04-26T23:45:33.695950+0000","last_peered":"2024-04-26T23:45:33.695950+0000","last_clean":"2024-04-26T23:45:33.695950+0000","last_became_active":"2024-04-26T23:45:32.693553+0000","last_became_peered":"2024-04-26T23:45:32.693553+0000","last_unstale":"2024-04-26T23:45:33.695950+0000","last_undegraded":"2024-04-26T23:45:33.695950+0000","last_fullsized":"2024-04-26T23:45:33.695950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757761+0000","last_change":"2024-04-26T23:45:32.683112+0000","last_active":"2024-04-26T23:45:33.757761+0000","last_peered":"2024-04-26T23:45:33.757761+0000","last_clean":"2024-04-26T23:45:33.757761+0000","last_became_active":"2024-04-26T23:45:32.682830+0000","last_became_peered":"2024-04-26T23:45:32.682830+0000","last_unstale":"2024-04-26T23:45:33.757761+0000","last_undegraded":"2024-04-26T23:45:33.757761+0000","last_fullsized":"2024-04-26T23:45:33.757761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:52:40.747110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691013+0000","last_change":"2024-04-26T23:45:32.685512+0000","last_active":"2024-04-26T23:45:33.691013+0000","last_peered":"2024-04-26T23:45:33.691013+0000","last_clean":"2024-04-26T23:45:33.691013+0000","last_became_active":"2024-04-26T23:45:32.684550+0000","last_became_peered":"2024-04-26T23:45:32.684550+0000","last_unstale":"2024-04-26T23:45:33.691013+0000","last_undegraded":"2024-04-26T23:45:33.691013+0000","last_fullsized":"2024-04-26T23:45:33.691013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757117+0000","last_change":"2024-04-26T23:45:32.684222+0000","last_active":"2024-04-26T23:45:33.757117+0000","last_peered":"2024-04-26T23:45:33.757117+0000","last_clean":"2024-04-26T23:45:33.757117+0000","last_became_active":"2024-04-26T23:45:32.683890+0000","last_became_peered":"2024-04-26T23:45:32.683890+0000","last_unstale":"2024-04-26T23:45:33.757117+0000","last_undegraded":"2024-04-26T23:45:33.757117+0000","last_fullsized":"2024-04-26T23:45:33.757117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690568+0000","last_change":"2024-04-26T23:45:32.692472+0000","last_active":"2024-04-26T23:45:33.690568+0000","last_peered":"2024-04-26T23:45:33.690568+0000","last_clean":"2024-04-26T23:45:33.690568+0000","last_became_active":"2024-04-26T23:45:32.691251+0000","last_became_peered":"2024-04-26T23:45:32.691251+0000","last_unstale":"2024-04-26T23:45:33.690568+0000","last_undegraded":"2024-04-26T23:45:33.690568+0000","last_fullsized":"2024-04-26T23:45:33.690568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756809+0000","last_change":"2024-04-26T23:45:32.691299+0000","last_active":"2024-04-26T23:45:33.756809+0000","last_peered":"2024-04-26T23:45:33.756809+0000","last_clean":"2024-04-26T23:45:33.756809+0000","last_became_active":"2024-04-26T23:45:32.690917+0000","last_became_peered":"2024-04-26T23:45:32.690917+0000","last_unstale":"2024-04-26T23:45:33.756809+0000","last_undegraded":"2024-04-26T23:45:33.756809+0000","last_fullsized":"2024-04-26T23:45:33.756809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756676+0000","last_change":"2024-04-26T23:45:32.689444+0000","last_active":"2024-04-26T23:45:33.756676+0000","last_peered":"2024-04-26T23:45:33.756676+0000","last_clean":"2024-04-26T23:45:33.756676+0000","last_became_active":"2024-04-26T23:45:32.686829+0000","last_became_peered":"2024-04-26T23:45:32.686829+0000","last_unstale":"2024-04-26T23:45:33.756676+0000","last_undegraded":"2024-04-26T23:45:33.756676+0000","last_fullsized":"2024-04-26T23:45:33.756676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757439+0000","last_change":"2024-04-26T23:45:32.681039+0000","last_active":"2024-04-26T23:45:33.757439+0000","last_peered":"2024-04-26T23:45:33.757439+0000","last_clean":"2024-04-26T23:45:33.757439+0000","last_became_active":"2024-04-26T23:45:32.680744+0000","last_became_peered":"2024-04-26T23:45:32.680744+0000","last_unstale":"2024-04-26T23:45:33.757439+0000","last_undegraded":"2024-04-26T23:45:33.757439+0000","last_fullsized":"2024-04-26T23:45:33.757439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698759+0000","last_change":"2024-04-26T23:45:32.701873+0000","last_active":"2024-04-26T23:45:33.698759+0000","last_peered":"2024-04-26T23:45:33.698759+0000","last_clean":"2024-04-26T23:45:33.698759+0000","last_became_active":"2024-04-26T23:45:32.701524+0000","last_became_peered":"2024-04-26T23:45:32.701524+0000","last_unstale":"2024-04-26T23:45:33.698759+0000","last_undegraded":"2024-04-26T23:45:33.698759+0000","last_fullsized":"2024-04-26T23:45:33.698759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698643+0000","last_change":"2024-04-26T23:45:32.703627+0000","last_active":"2024-04-26T23:45:33.698643+0000","last_peered":"2024-04-26T23:45:33.698643+0000","last_clean":"2024-04-26T23:45:33.698643+0000","last_became_active":"2024-04-26T23:45:32.703329+0000","last_became_peered":"2024-04-26T23:45:32.703329+0000","last_unstale":"2024-04-26T23:45:33.698643+0000","last_undegraded":"2024-04-26T23:45:33.698643+0000","last_fullsized":"2024-04-26T23:45:33.698643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690062+0000","last_change":"2024-04-26T23:45:32.711843+0000","last_active":"2024-04-26T23:45:33.690062+0000","last_peered":"2024-04-26T23:45:33.690062+0000","last_clean":"2024-04-26T23:45:33.690062+0000","last_became_active":"2024-04-26T23:45:32.711550+0000","last_became_peered":"2024-04-26T23:45:32.711550+0000","last_unstale":"2024-04-26T23:45:33.690062+0000","last_undegraded":"2024-04-26T23:45:33.690062+0000","last_fullsized":"2024-04-26T23:45:33.690062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:27.177803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757662+0000","last_change":"2024-04-26T23:45:32.689403+0000","last_active":"2024-04-26T23:45:33.757662+0000","last_peered":"2024-04-26T23:45:33.757662+0000","last_clean":"2024-04-26T23:45:33.757662+0000","last_became_active":"2024-04-26T23:45:32.689107+0000","last_became_peered":"2024-04-26T23:45:32.689107+0000","last_unstale":"2024-04-26T23:45:33.757662+0000","last_undegraded":"2024-04-26T23:45:33.757662+0000","last_fullsized":"2024-04-26T23:45:33.757662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757182+0000","last_change":"2024-04-26T23:45:32.686927+0000","last_active":"2024-04-26T23:45:33.757182+0000","last_peered":"2024-04-26T23:45:33.757182+0000","last_clean":"2024-04-26T23:45:33.757182+0000","last_became_active":"2024-04-26T23:45:32.686599+0000","last_became_peered":"2024-04-26T23:45:32.686599+0000","last_unstale":"2024-04-26T23:45:33.757182+0000","last_undegraded":"2024-04-26T23:45:33.757182+0000","last_fullsized":"2024-04-26T23:45:33.757182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:30:15.988811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695791+0000","last_change":"2024-04-26T23:45:32.695206+0000","last_active":"2024-04-26T23:45:33.695791+0000","last_peered":"2024-04-26T23:45:33.695791+0000","last_clean":"2024-04-26T23:45:33.695791+0000","last_became_active":"2024-04-26T23:45:32.694923+0000","last_became_peered":"2024-04-26T23:45:32.694923+0000","last_unstale":"2024-04-26T23:45:33.695791+0000","last_undegraded":"2024-04-26T23:45:33.695791+0000","last_fullsized":"2024-04-26T23:45:33.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690353+0000","last_change":"2024-04-26T23:45:32.686596+0000","last_active":"2024-04-26T23:45:33.690353+0000","last_peered":"2024-04-26T23:45:33.690353+0000","last_clean":"2024-04-26T23:45:33.690353+0000","last_became_active":"2024-04-26T23:45:32.686298+0000","last_became_peered":"2024-04-26T23:45:32.686298+0000","last_unstale":"2024-04-26T23:45:33.690353+0000","last_undegraded":"2024-04-26T23:45:33.690353+0000","last_fullsized":"2024-04-26T23:45:33.690353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691470+0000","last_change":"2024-04-26T23:45:32.699393+0000","last_active":"2024-04-26T23:45:33.691470+0000","last_peered":"2024-04-26T23:45:33.691470+0000","last_clean":"2024-04-26T23:45:33.691470+0000","last_became_active":"2024-04-26T23:45:32.698747+0000","last_became_peered":"2024-04-26T23:45:32.698747+0000","last_unstale":"2024-04-26T23:45:33.691470+0000","last_undegraded":"2024-04-26T23:45:33.691470+0000","last_fullsized":"2024-04-26T23:45:33.691470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:32.702144+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:32.701834+0000","last_became_peered":"2024-04-26T23:45:32.701834+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:51.260148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757314+0000","last_change":"2024-04-26T23:45:32.678816+0000","last_active":"2024-04-26T23:45:33.757314+0000","last_peered":"2024-04-26T23:45:33.757314+0000","last_clean":"2024-04-26T23:45:33.757314+0000","last_became_active":"2024-04-26T23:45:32.678510+0000","last_became_peered":"2024-04-26T23:45:32.678510+0000","last_unstale":"2024-04-26T23:45:33.757314+0000","last_undegraded":"2024-04-26T23:45:33.757314+0000","last_fullsized":"2024-04-26T23:45:33.757314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698396+0000","last_change":"2024-04-26T23:45:32.713741+0000","last_active":"2024-04-26T23:45:33.698396+0000","last_peered":"2024-04-26T23:45:33.698396+0000","last_clean":"2024-04-26T23:45:33.698396+0000","last_became_active":"2024-04-26T23:45:32.713326+0000","last_became_peered":"2024-04-26T23:45:32.713326+0000","last_unstale":"2024-04-26T23:45:33.698396+0000","last_undegraded":"2024-04-26T23:45:33.698396+0000","last_fullsized":"2024-04-26T23:45:33.698396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757204+0000","last_change":"2024-04-26T23:45:32.685874+0000","last_active":"2024-04-26T23:45:33.757204+0000","last_peered":"2024-04-26T23:45:33.757204+0000","last_clean":"2024-04-26T23:45:33.757204+0000","last_became_active":"2024-04-26T23:45:32.685622+0000","last_became_peered":"2024-04-26T23:45:32.685622+0000","last_unstale":"2024-04-26T23:45:33.757204+0000","last_undegraded":"2024-04-26T23:45:33.757204+0000","last_fullsized":"2024-04-26T23:45:33.757204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:01.096293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691119+0000","last_change":"2024-04-26T23:45:32.699326+0000","last_active":"2024-04-26T23:45:33.691119+0000","last_peered":"2024-04-26T23:45:33.691119+0000","last_clean":"2024-04-26T23:45:33.691119+0000","last_became_active":"2024-04-26T23:45:32.698859+0000","last_became_peered":"2024-04-26T23:45:32.698859+0000","last_unstale":"2024-04-26T23:45:33.691119+0000","last_undegraded":"2024-04-26T23:45:33.691119+0000","last_fullsized":"2024-04-26T23:45:33.691119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756772+0000","last_change":"2024-04-26T23:45:32.695396+0000","last_active":"2024-04-26T23:45:33.756772+0000","last_peered":"2024-04-26T23:45:33.756772+0000","last_clean":"2024-04-26T23:45:33.756772+0000","last_became_active":"2024-04-26T23:45:32.694937+0000","last_became_peered":"2024-04-26T23:45:32.694937+0000","last_unstale":"2024-04-26T23:45:33.756772+0000","last_undegraded":"2024-04-26T23:45:33.756772+0000","last_fullsized":"2024-04-26T23:45:33.756772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690363+0000","last_change":"2024-04-26T23:45:32.679737+0000","last_active":"2024-04-26T23:45:33.690363+0000","last_peered":"2024-04-26T23:45:33.690363+0000","last_clean":"2024-04-26T23:45:33.690363+0000","last_became_active":"2024-04-26T23:45:32.679405+0000","last_became_peered":"2024-04-26T23:45:32.679405+0000","last_unstale":"2024-04-26T23:45:33.690363+0000","last_undegraded":"2024-04-26T23:45:33.690363+0000","last_fullsized":"2024-04-26T23:45:33.690363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758147+0000","last_change":"2024-04-26T23:45:32.695857+0000","last_active":"2024-04-26T23:45:33.758147+0000","last_peered":"2024-04-26T23:45:33.758147+0000","last_clean":"2024-04-26T23:45:33.758147+0000","last_became_active":"2024-04-26T23:45:32.695514+0000","last_became_peered":"2024-04-26T23:45:32.695514+0000","last_unstale":"2024-04-26T23:45:33.758147+0000","last_undegraded":"2024-04-26T23:45:33.758147+0000","last_fullsized":"2024-04-26T23:45:33.758147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698737+0000","last_change":"2024-04-26T23:45:32.708627+0000","last_active":"2024-04-26T23:45:33.698737+0000","last_peered":"2024-04-26T23:45:33.698737+0000","last_clean":"2024-04-26T23:45:33.698737+0000","last_became_active":"2024-04-26T23:45:32.708302+0000","last_became_peered":"2024-04-26T23:45:32.708302+0000","last_unstale":"2024-04-26T23:45:33.698737+0000","last_undegraded":"2024-04-26T23:45:33.698737+0000","last_fullsized":"2024-04-26T23:45:33.698737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695912+0000","last_change":"2024-04-26T23:45:32.689802+0000","last_active":"2024-04-26T23:45:33.695912+0000","last_peered":"2024-04-26T23:45:33.695912+0000","last_clean":"2024-04-26T23:45:33.695912+0000","last_became_active":"2024-04-26T23:45:32.689443+0000","last_became_peered":"2024-04-26T23:45:32.689443+0000","last_unstale":"2024-04-26T23:45:33.695912+0000","last_undegraded":"2024-04-26T23:45:33.695912+0000","last_fullsized":"2024-04-26T23:45:33.695912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757503+0000","last_change":"2024-04-26T23:45:32.713348+0000","last_active":"2024-04-26T23:45:33.757503+0000","last_peered":"2024-04-26T23:45:33.757503+0000","last_clean":"2024-04-26T23:45:33.757503+0000","last_became_active":"2024-04-26T23:45:32.712789+0000","last_became_peered":"2024-04-26T23:45:32.712789+0000","last_unstale":"2024-04-26T23:45:33.757503+0000","last_undegraded":"2024-04-26T23:45:33.757503+0000","last_fullsized":"2024-04-26T23:45:33.757503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757335+0000","last_change":"2024-04-26T23:45:32.692031+0000","last_active":"2024-04-26T23:45:33.757335+0000","last_peered":"2024-04-26T23:45:33.757335+0000","last_clean":"2024-04-26T23:45:33.757335+0000","last_became_active":"2024-04-26T23:45:32.691740+0000","last_became_peered":"2024-04-26T23:45:32.691740+0000","last_unstale":"2024-04-26T23:45:33.757335+0000","last_undegraded":"2024-04-26T23:45:33.757335+0000","last_fullsized":"2024-04-26T23:45:33.757335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:45.504592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690742+0000","last_change":"2024-04-26T23:45:32.683420+0000","last_active":"2024-04-26T23:45:33.690742+0000","last_peered":"2024-04-26T23:45:33.690742+0000","last_clean":"2024-04-26T23:45:33.690742+0000","last_became_active":"2024-04-26T23:45:32.683079+0000","last_became_peered":"2024-04-26T23:45:32.683079+0000","last_unstale":"2024-04-26T23:45:33.690742+0000","last_undegraded":"2024-04-26T23:45:33.690742+0000","last_fullsized":"2024-04-26T23:45:33.690742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688083+0000","last_change":"2024-04-26T23:45:32.686223+0000","last_active":"2024-04-26T23:45:33.688083+0000","last_peered":"2024-04-26T23:45:33.688083+0000","last_clean":"2024-04-26T23:45:33.688083+0000","last_became_active":"2024-04-26T23:45:32.685930+0000","last_became_peered":"2024-04-26T23:45:32.685930+0000","last_unstale":"2024-04-26T23:45:33.688083+0000","last_undegraded":"2024-04-26T23:45:33.688083+0000","last_fullsized":"2024-04-26T23:45:33.688083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698368+0000","last_change":"2024-04-26T23:45:32.691705+0000","last_active":"2024-04-26T23:45:33.698368+0000","last_peered":"2024-04-26T23:45:33.698368+0000","last_clean":"2024-04-26T23:45:33.698368+0000","last_became_active":"2024-04-26T23:45:32.691423+0000","last_became_peered":"2024-04-26T23:45:32.691423+0000","last_unstale":"2024-04-26T23:45:33.698368+0000","last_undegraded":"2024-04-26T23:45:33.698368+0000","last_fullsized":"2024-04-26T23:45:33.698368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689572+0000","last_change":"2024-04-26T23:45:32.700367+0000","last_active":"2024-04-26T23:45:33.689572+0000","last_peered":"2024-04-26T23:45:33.689572+0000","last_clean":"2024-04-26T23:45:33.689572+0000","last_became_active":"2024-04-26T23:45:32.699940+0000","last_became_peered":"2024-04-26T23:45:32.699940+0000","last_unstale":"2024-04-26T23:45:33.689572+0000","last_undegraded":"2024-04-26T23:45:33.689572+0000","last_fullsized":"2024-04-26T23:45:33.689572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:36.201832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757768+0000","last_change":"2024-04-26T23:45:31.686196+0000","last_active":"2024-04-26T23:45:33.757768+0000","last_peered":"2024-04-26T23:45:33.757768+0000","last_clean":"2024-04-26T23:45:33.757768+0000","last_became_active":"2024-04-26T23:45:31.684117+0000","last_became_peered":"2024-04-26T23:45:31.684117+0000","last_unstale":"2024-04-26T23:45:33.757768+0000","last_undegraded":"2024-04-26T23:45:33.757768+0000","last_fullsized":"2024-04-26T23:45:33.757768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757348+0000","last_change":"2024-04-26T23:45:32.696579+0000","last_active":"2024-04-26T23:45:33.757348+0000","last_peered":"2024-04-26T23:45:33.757348+0000","last_clean":"2024-04-26T23:45:33.757348+0000","last_became_active":"2024-04-26T23:45:32.696347+0000","last_became_peered":"2024-04-26T23:45:32.696347+0000","last_unstale":"2024-04-26T23:45:33.757348+0000","last_undegraded":"2024-04-26T23:45:33.757348+0000","last_fullsized":"2024-04-26T23:45:33.757348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:04.690049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698348+0000","last_change":"2024-04-26T23:45:31.693352+0000","last_active":"2024-04-26T23:45:33.698348+0000","last_peered":"2024-04-26T23:45:33.698348+0000","last_clean":"2024-04-26T23:45:33.698348+0000","last_became_active":"2024-04-26T23:45:31.693085+0000","last_became_peered":"2024-04-26T23:45:31.693085+0000","last_unstale":"2024-04-26T23:45:33.698348+0000","last_undegraded":"2024-04-26T23:45:33.698348+0000","last_fullsized":"2024-04-26T23:45:33.698348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756910+0000","last_change":"2024-04-26T23:45:31.691825+0000","last_active":"2024-04-26T23:45:33.756910+0000","last_peered":"2024-04-26T23:45:33.756910+0000","last_clean":"2024-04-26T23:45:33.756910+0000","last_became_active":"2024-04-26T23:45:31.691522+0000","last_became_peered":"2024-04-26T23:45:31.691522+0000","last_unstale":"2024-04-26T23:45:33.756910+0000","last_undegraded":"2024-04-26T23:45:33.756910+0000","last_fullsized":"2024-04-26T23:45:33.756910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756733+0000","last_change":"2024-04-26T23:45:32.689899+0000","last_active":"2024-04-26T23:45:33.756733+0000","last_peered":"2024-04-26T23:45:33.756733+0000","last_clean":"2024-04-26T23:45:33.756733+0000","last_became_active":"2024-04-26T23:45:32.689083+0000","last_became_peered":"2024-04-26T23:45:32.689083+0000","last_unstale":"2024-04-26T23:45:33.756733+0000","last_undegraded":"2024-04-26T23:45:33.756733+0000","last_fullsized":"2024-04-26T23:45:33.756733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690450+0000","last_change":"2024-04-26T23:45:31.692320+0000","last_active":"2024-04-26T23:45:33.690450+0000","last_peered":"2024-04-26T23:45:33.690450+0000","last_clean":"2024-04-26T23:45:33.690450+0000","last_became_active":"2024-04-26T23:45:31.691944+0000","last_became_peered":"2024-04-26T23:45:31.691944+0000","last_unstale":"2024-04-26T23:45:33.690450+0000","last_undegraded":"2024-04-26T23:45:33.690450+0000","last_fullsized":"2024-04-26T23:45:33.690450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695652+0000","last_change":"2024-04-26T23:45:32.684023+0000","last_active":"2024-04-26T23:45:33.695652+0000","last_peered":"2024-04-26T23:45:33.695652+0000","last_clean":"2024-04-26T23:45:33.695652+0000","last_became_active":"2024-04-26T23:45:32.683745+0000","last_became_peered":"2024-04-26T23:45:32.683745+0000","last_unstale":"2024-04-26T23:45:33.695652+0000","last_undegraded":"2024-04-26T23:45:33.695652+0000","last_fullsized":"2024-04-26T23:45:33.695652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698580+0000","last_change":"2024-04-26T23:45:31.690903+0000","last_active":"2024-04-26T23:45:33.698580+0000","last_peered":"2024-04-26T23:45:33.698580+0000","last_clean":"2024-04-26T23:45:33.698580+0000","last_became_active":"2024-04-26T23:45:31.690629+0000","last_became_peered":"2024-04-26T23:45:31.690629+0000","last_unstale":"2024-04-26T23:45:33.698580+0000","last_undegraded":"2024-04-26T23:45:33.698580+0000","last_fullsized":"2024-04-26T23:45:33.698580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690804+0000","last_change":"2024-04-26T23:45:32.682423+0000","last_active":"2024-04-26T23:45:33.690804+0000","last_peered":"2024-04-26T23:45:33.690804+0000","last_clean":"2024-04-26T23:45:33.690804+0000","last_became_active":"2024-04-26T23:45:32.681951+0000","last_became_peered":"2024-04-26T23:45:32.681951+0000","last_unstale":"2024-04-26T23:45:33.690804+0000","last_undegraded":"2024-04-26T23:45:33.690804+0000","last_fullsized":"2024-04-26T23:45:33.690804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690911+0000","last_change":"2024-04-26T23:45:31.684823+0000","last_active":"2024-04-26T23:45:33.690911+0000","last_peered":"2024-04-26T23:45:33.690911+0000","last_clean":"2024-04-26T23:45:33.690911+0000","last_became_active":"2024-04-26T23:45:31.683574+0000","last_became_peered":"2024-04-26T23:45:31.683574+0000","last_unstale":"2024-04-26T23:45:33.690911+0000","last_undegraded":"2024-04-26T23:45:33.690911+0000","last_fullsized":"2024-04-26T23:45:33.690911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757926+0000","last_change":"2024-04-26T23:45:32.691935+0000","last_active":"2024-04-26T23:45:33.757926+0000","last_peered":"2024-04-26T23:45:33.757926+0000","last_clean":"2024-04-26T23:45:33.757926+0000","last_became_active":"2024-04-26T23:45:32.689093+0000","last_became_peered":"2024-04-26T23:45:32.689093+0000","last_unstale":"2024-04-26T23:45:33.757926+0000","last_undegraded":"2024-04-26T23:45:33.757926+0000","last_fullsized":"2024-04-26T23:45:33.757926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:09:17.239673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695925+0000","last_change":"2024-04-26T23:45:31.688692+0000","last_active":"2024-04-26T23:45:33.695925+0000","last_peered":"2024-04-26T23:45:33.695925+0000","last_clean":"2024-04-26T23:45:33.695925+0000","last_became_active":"2024-04-26T23:45:31.688404+0000","last_became_peered":"2024-04-26T23:45:31.688404+0000","last_unstale":"2024-04-26T23:45:33.695925+0000","last_undegraded":"2024-04-26T23:45:33.695925+0000","last_fullsized":"2024-04-26T23:45:33.695925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690095+0000","last_change":"2024-04-26T23:45:32.710489+0000","last_active":"2024-04-26T23:45:33.690095+0000","last_peered":"2024-04-26T23:45:33.690095+0000","last_clean":"2024-04-26T23:45:33.690095+0000","last_became_active":"2024-04-26T23:45:32.710118+0000","last_became_peered":"2024-04-26T23:45:32.710118+0000","last_unstale":"2024-04-26T23:45:33.690095+0000","last_undegraded":"2024-04-26T23:45:33.690095+0000","last_fullsized":"2024-04-26T23:45:33.690095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698383+0000","last_change":"2024-04-26T23:45:31.690291+0000","last_active":"2024-04-26T23:45:33.698383+0000","last_peered":"2024-04-26T23:45:33.698383+0000","last_clean":"2024-04-26T23:45:33.698383+0000","last_became_active":"2024-04-26T23:45:31.689915+0000","last_became_peered":"2024-04-26T23:45:31.689915+0000","last_unstale":"2024-04-26T23:45:33.698383+0000","last_undegraded":"2024-04-26T23:45:33.698383+0000","last_fullsized":"2024-04-26T23:45:33.698383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756995+0000","last_change":"2024-04-26T23:45:32.696754+0000","last_active":"2024-04-26T23:45:33.756995+0000","last_peered":"2024-04-26T23:45:33.756995+0000","last_clean":"2024-04-26T23:45:33.756995+0000","last_became_active":"2024-04-26T23:45:32.696500+0000","last_became_peered":"2024-04-26T23:45:32.696500+0000","last_unstale":"2024-04-26T23:45:33.756995+0000","last_undegraded":"2024-04-26T23:45:33.756995+0000","last_fullsized":"2024-04-26T23:45:33.756995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757429+0000","last_change":"2024-04-26T23:45:31.687471+0000","last_active":"2024-04-26T23:45:33.757429+0000","last_peered":"2024-04-26T23:45:33.757429+0000","last_clean":"2024-04-26T23:45:33.757429+0000","last_became_active":"2024-04-26T23:45:31.687204+0000","last_became_peered":"2024-04-26T23:45:31.687204+0000","last_unstale":"2024-04-26T23:45:33.757429+0000","last_undegraded":"2024-04-26T23:45:33.757429+0000","last_fullsized":"2024-04-26T23:45:33.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:12.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757316+0000","last_change":"2024-04-26T23:45:32.700954+0000","last_active":"2024-04-26T23:45:33.757316+0000","last_peered":"2024-04-26T23:45:33.757316+0000","last_clean":"2024-04-26T23:45:33.757316+0000","last_became_active":"2024-04-26T23:45:32.700376+0000","last_became_peered":"2024-04-26T23:45:32.700376+0000","last_unstale":"2024-04-26T23:45:33.757316+0000","last_undegraded":"2024-04-26T23:45:33.757316+0000","last_fullsized":"2024-04-26T23:45:33.757316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:40:10.353015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691010+0000","last_change":"2024-04-26T23:45:31.690145+0000","last_active":"2024-04-26T23:45:33.691010+0000","last_peered":"2024-04-26T23:45:33.691010+0000","last_clean":"2024-04-26T23:45:33.691010+0000","last_became_active":"2024-04-26T23:45:31.687880+0000","last_became_peered":"2024-04-26T23:45:31.687880+0000","last_unstale":"2024-04-26T23:45:33.691010+0000","last_undegraded":"2024-04-26T23:45:33.691010+0000","last_fullsized":"2024-04-26T23:45:33.691010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757106+0000","last_change":"2024-04-26T23:45:32.695003+0000","last_active":"2024-04-26T23:45:33.757106+0000","last_peered":"2024-04-26T23:45:33.757106+0000","last_clean":"2024-04-26T23:45:33.757106+0000","last_became_active":"2024-04-26T23:45:32.694696+0000","last_became_peered":"2024-04-26T23:45:32.694696+0000","last_unstale":"2024-04-26T23:45:33.757106+0000","last_undegraded":"2024-04-26T23:45:33.757106+0000","last_fullsized":"2024-04-26T23:45:33.757106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698210+0000","last_change":"2024-04-26T23:45:31.694794+0000","last_active":"2024-04-26T23:45:33.698210+0000","last_peered":"2024-04-26T23:45:33.698210+0000","last_clean":"2024-04-26T23:45:33.698210+0000","last_became_active":"2024-04-26T23:45:31.694518+0000","last_became_peered":"2024-04-26T23:45:31.694518+0000","last_unstale":"2024-04-26T23:45:33.698210+0000","last_undegraded":"2024-04-26T23:45:33.698210+0000","last_fullsized":"2024-04-26T23:45:33.698210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698297+0000","last_change":"2024-04-26T23:45:32.691704+0000","last_active":"2024-04-26T23:45:33.698297+0000","last_peered":"2024-04-26T23:45:33.698297+0000","last_clean":"2024-04-26T23:45:33.698297+0000","last_became_active":"2024-04-26T23:45:32.691125+0000","last_became_peered":"2024-04-26T23:45:32.691125+0000","last_unstale":"2024-04-26T23:45:33.698297+0000","last_undegraded":"2024-04-26T23:45:33.698297+0000","last_fullsized":"2024-04-26T23:45:33.698297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:00.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688028+0000","last_change":"2024-04-26T23:45:31.677038+0000","last_active":"2024-04-26T23:45:33.688028+0000","last_peered":"2024-04-26T23:45:33.688028+0000","last_clean":"2024-04-26T23:45:33.688028+0000","last_became_active":"2024-04-26T23:45:31.676478+0000","last_became_peered":"2024-04-26T23:45:31.676478+0000","last_unstale":"2024-04-26T23:45:33.688028+0000","last_undegraded":"2024-04-26T23:45:33.688028+0000","last_fullsized":"2024-04-26T23:45:33.688028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756712+0000","last_change":"2024-04-26T23:45:32.693504+0000","last_active":"2024-04-26T23:45:33.756712+0000","last_peered":"2024-04-26T23:45:33.756712+0000","last_clean":"2024-04-26T23:45:33.756712+0000","last_became_active":"2024-04-26T23:45:32.693245+0000","last_became_peered":"2024-04-26T23:45:32.693245+0000","last_unstale":"2024-04-26T23:45:33.756712+0000","last_undegraded":"2024-04-26T23:45:33.756712+0000","last_fullsized":"2024-04-26T23:45:33.756712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689885+0000","last_change":"2024-04-26T23:45:31.686918+0000","last_active":"2024-04-26T23:45:33.689885+0000","last_peered":"2024-04-26T23:45:33.689885+0000","last_clean":"2024-04-26T23:45:33.689885+0000","last_became_active":"2024-04-26T23:45:31.686544+0000","last_became_peered":"2024-04-26T23:45:31.686544+0000","last_unstale":"2024-04-26T23:45:33.689885+0000","last_undegraded":"2024-04-26T23:45:33.689885+0000","last_fullsized":"2024-04-26T23:45:33.689885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:20:37.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757297+0000","last_change":"2024-04-26T23:45:32.713893+0000","last_active":"2024-04-26T23:45:33.757297+0000","last_peered":"2024-04-26T23:45:33.757297+0000","last_clean":"2024-04-26T23:45:33.757297+0000","last_became_active":"2024-04-26T23:45:32.713714+0000","last_became_peered":"2024-04-26T23:45:32.713714+0000","last_unstale":"2024-04-26T23:45:33.757297+0000","last_undegraded":"2024-04-26T23:45:33.757297+0000","last_fullsized":"2024-04-26T23:45:33.757297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:31.686652+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:31.686359+0000","last_became_peered":"2024-04-26T23:45:31.686359+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757524+0000","last_change":"2024-04-26T23:45:32.711891+0000","last_active":"2024-04-26T23:45:33.757524+0000","last_peered":"2024-04-26T23:45:33.757524+0000","last_clean":"2024-04-26T23:45:33.757524+0000","last_became_active":"2024-04-26T23:45:32.708109+0000","last_became_peered":"2024-04-26T23:45:32.708109+0000","last_unstale":"2024-04-26T23:45:33.757524+0000","last_undegraded":"2024-04-26T23:45:33.757524+0000","last_fullsized":"2024-04-26T23:45:33.757524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:23.840152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.696007+0000","last_change":"2024-04-26T23:45:31.689003+0000","last_active":"2024-04-26T23:45:33.696007+0000","last_peered":"2024-04-26T23:45:33.696007+0000","last_clean":"2024-04-26T23:45:33.696007+0000","last_became_active":"2024-04-26T23:45:31.688719+0000","last_became_peered":"2024-04-26T23:45:31.688719+0000","last_unstale":"2024-04-26T23:45:33.696007+0000","last_undegraded":"2024-04-26T23:45:33.696007+0000","last_fullsized":"2024-04-26T23:45:33.696007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690968+0000","last_change":"2024-04-26T23:45:32.682148+0000","last_active":"2024-04-26T23:45:33.690968+0000","last_peered":"2024-04-26T23:45:33.690968+0000","last_clean":"2024-04-26T23:45:33.690968+0000","last_became_active":"2024-04-26T23:45:32.681387+0000","last_became_peered":"2024-04-26T23:45:32.681387+0000","last_unstale":"2024-04-26T23:45:33.690968+0000","last_undegraded":"2024-04-26T23:45:33.690968+0000","last_fullsized":"2024-04-26T23:45:33.690968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688270+0000","last_change":"2024-04-26T23:45:31.693411+0000","last_active":"2024-04-26T23:45:33.688270+0000","last_peered":"2024-04-26T23:45:33.688270+0000","last_clean":"2024-04-26T23:45:33.688270+0000","last_became_active":"2024-04-26T23:45:31.693004+0000","last_became_peered":"2024-04-26T23:45:31.693004+0000","last_unstale":"2024-04-26T23:45:33.688270+0000","last_undegraded":"2024-04-26T23:45:33.688270+0000","last_fullsized":"2024-04-26T23:45:33.688270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757215+0000","last_change":"2024-04-26T23:45:32.680577+0000","last_active":"2024-04-26T23:45:33.757215+0000","last_peered":"2024-04-26T23:45:33.757215+0000","last_clean":"2024-04-26T23:45:33.757215+0000","last_became_active":"2024-04-26T23:45:32.680225+0000","last_became_peered":"2024-04-26T23:45:32.680225+0000","last_unstale":"2024-04-26T23:45:33.757215+0000","last_undegraded":"2024-04-26T23:45:33.757215+0000","last_fullsized":"2024-04-26T23:45:33.757215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756646+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:45:33.756646+0000","last_peered":"2024-04-26T23:45:33.756646+0000","last_clean":"2024-04-26T23:45:33.756646+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:45:33.756646+0000","last_undegraded":"2024-04-26T23:45:33.756646+0000","last_fullsized":"2024-04-26T23:45:33.756646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690400+0000","last_change":"2024-04-26T23:45:31.679166+0000","last_active":"2024-04-26T23:45:33.690400+0000","last_peered":"2024-04-26T23:45:33.690400+0000","last_clean":"2024-04-26T23:45:33.690400+0000","last_became_active":"2024-04-26T23:45:31.678173+0000","last_became_peered":"2024-04-26T23:45:31.678173+0000","last_unstale":"2024-04-26T23:45:33.690400+0000","last_undegraded":"2024-04-26T23:45:33.690400+0000","last_fullsized":"2024-04-26T23:45:33.690400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756798+0000","last_change":"2024-04-26T23:45:32.681749+0000","last_active":"2024-04-26T23:45:33.756798+0000","last_peered":"2024-04-26T23:45:33.756798+0000","last_clean":"2024-04-26T23:45:33.756798+0000","last_became_active":"2024-04-26T23:45:32.680979+0000","last_became_peered":"2024-04-26T23:45:32.680979+0000","last_unstale":"2024-04-26T23:45:33.756798+0000","last_undegraded":"2024-04-26T23:45:33.756798+0000","last_fullsized":"2024-04-26T23:45:33.756798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756606+0000","last_change":"2024-04-26T23:45:31.692253+0000","last_active":"2024-04-26T23:45:33.756606+0000","last_peered":"2024-04-26T23:45:33.756606+0000","last_clean":"2024-04-26T23:45:33.756606+0000","last_became_active":"2024-04-26T23:45:31.691948+0000","last_became_peered":"2024-04-26T23:45:31.691948+0000","last_unstale":"2024-04-26T23:45:33.756606+0000","last_undegraded":"2024-04-26T23:45:33.756606+0000","last_fullsized":"2024-04-26T23:45:33.756606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757845+0000","last_change":"2024-04-26T23:45:32.696469+0000","last_active":"2024-04-26T23:45:33.757845+0000","last_peered":"2024-04-26T23:45:33.757845+0000","last_clean":"2024-04-26T23:45:33.757845+0000","last_became_active":"2024-04-26T23:45:32.696085+0000","last_became_peered":"2024-04-26T23:45:32.696085+0000","last_unstale":"2024-04-26T23:45:33.757845+0000","last_undegraded":"2024-04-26T23:45:33.757845+0000","last_fullsized":"2024-04-26T23:45:33.757845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:57.675683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688081+0000","last_change":"2024-04-26T23:45:31.686617+0000","last_active":"2024-04-26T23:45:33.688081+0000","last_peered":"2024-04-26T23:45:33.688081+0000","last_clean":"2024-04-26T23:45:33.688081+0000","last_became_active":"2024-04-26T23:45:31.686298+0000","last_became_peered":"2024-04-26T23:45:31.686298+0000","last_unstale":"2024-04-26T23:45:33.688081+0000","last_undegraded":"2024-04-26T23:45:33.688081+0000","last_fullsized":"2024-04-26T23:45:33.688081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695716+0000","last_change":"2024-04-26T23:45:32.679648+0000","last_active":"2024-04-26T23:45:33.695716+0000","last_peered":"2024-04-26T23:45:33.695716+0000","last_clean":"2024-04-26T23:45:33.695716+0000","last_became_active":"2024-04-26T23:45:32.678533+0000","last_became_peered":"2024-04-26T23:45:32.678533+0000","last_unstale":"2024-04-26T23:45:33.695716+0000","last_undegraded":"2024-04-26T23:45:33.695716+0000","last_fullsized":"2024-04-26T23:45:33.695716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691096+0000","last_change":"2024-04-26T23:45:31.681850+0000","last_active":"2024-04-26T23:45:33.691096+0000","last_peered":"2024-04-26T23:45:33.691096+0000","last_clean":"2024-04-26T23:45:33.691096+0000","last_became_active":"2024-04-26T23:45:31.679810+0000","last_became_peered":"2024-04-26T23:45:31.679810+0000","last_unstale":"2024-04-26T23:45:33.691096+0000","last_undegraded":"2024-04-26T23:45:33.691096+0000","last_fullsized":"2024-04-26T23:45:33.691096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689831+0000","last_change":"2024-04-26T23:45:32.710524+0000","last_active":"2024-04-26T23:45:33.689831+0000","last_peered":"2024-04-26T23:45:33.689831+0000","last_clean":"2024-04-26T23:45:33.689831+0000","last_became_active":"2024-04-26T23:45:32.703378+0000","last_became_peered":"2024-04-26T23:45:32.703378+0000","last_unstale":"2024-04-26T23:45:33.689831+0000","last_undegraded":"2024-04-26T23:45:33.689831+0000","last_fullsized":"2024-04-26T23:45:33.689831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:22.939348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695838+0000","last_change":"2024-04-26T23:45:31.681707+0000","last_active":"2024-04-26T23:45:33.695838+0000","last_peered":"2024-04-26T23:45:33.695838+0000","last_clean":"2024-04-26T23:45:33.695838+0000","last_became_active":"2024-04-26T23:45:31.681452+0000","last_became_peered":"2024-04-26T23:45:31.681452+0000","last_unstale":"2024-04-26T23:45:33.695838+0000","last_undegraded":"2024-04-26T23:45:33.695838+0000","last_fullsized":"2024-04-26T23:45:33.695838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690997+0000","last_change":"2024-04-26T23:45:32.690629+0000","last_active":"2024-04-26T23:45:33.690997+0000","last_peered":"2024-04-26T23:45:33.690997+0000","last_clean":"2024-04-26T23:45:33.690997+0000","last_became_active":"2024-04-26T23:45:32.690208+0000","last_became_peered":"2024-04-26T23:45:32.690208+0000","last_unstale":"2024-04-26T23:45:33.690997+0000","last_undegraded":"2024-04-26T23:45:33.690997+0000","last_fullsized":"2024-04-26T23:45:33.690997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757330+0000","last_change":"2024-04-26T23:45:31.693759+0000","last_active":"2024-04-26T23:45:33.757330+0000","last_peered":"2024-04-26T23:45:33.757330+0000","last_clean":"2024-04-26T23:45:33.757330+0000","last_became_active":"2024-04-26T23:45:31.693396+0000","last_became_peered":"2024-04-26T23:45:31.693396+0000","last_unstale":"2024-04-26T23:45:33.757330+0000","last_undegraded":"2024-04-26T23:45:33.757330+0000","last_fullsized":"2024-04-26T23:45:33.757330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:47.961582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695802+0000","last_change":"2024-04-26T23:45:32.679402+0000","last_active":"2024-04-26T23:45:33.695802+0000","last_peered":"2024-04-26T23:45:33.695802+0000","last_clean":"2024-04-26T23:45:33.695802+0000","last_became_active":"2024-04-26T23:45:32.678906+0000","last_became_peered":"2024-04-26T23:45:32.678906+0000","last_unstale":"2024-04-26T23:45:33.695802+0000","last_undegraded":"2024-04-26T23:45:33.695802+0000","last_fullsized":"2024-04-26T23:45:33.695802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.697710+0000","last_change":"2024-04-26T23:45:31.682989+0000","last_active":"2024-04-26T23:45:33.697710+0000","last_peered":"2024-04-26T23:45:33.697710+0000","last_clean":"2024-04-26T23:45:33.697710+0000","last_became_active":"2024-04-26T23:45:31.682706+0000","last_became_peered":"2024-04-26T23:45:31.682706+0000","last_unstale":"2024-04-26T23:45:33.697710+0000","last_undegraded":"2024-04-26T23:45:33.697710+0000","last_fullsized":"2024-04-26T23:45:33.697710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758153+0000","last_change":"2024-04-26T23:45:32.705019+0000","last_active":"2024-04-26T23:45:33.758153+0000","last_peered":"2024-04-26T23:45:33.758153+0000","last_clean":"2024-04-26T23:45:33.758153+0000","last_became_active":"2024-04-26T23:45:32.704605+0000","last_became_peered":"2024-04-26T23:45:32.704605+0000","last_unstale":"2024-04-26T23:45:33.758153+0000","last_undegraded":"2024-04-26T23:45:33.758153+0000","last_fullsized":"2024-04-26T23:45:33.758153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698690+0000","last_change":"2024-04-26T23:45:31.687021+0000","last_active":"2024-04-26T23:45:33.698690+0000","last_peered":"2024-04-26T23:45:33.698690+0000","last_clean":"2024-04-26T23:45:33.698690+0000","last_became_active":"2024-04-26T23:45:31.686729+0000","last_became_peered":"2024-04-26T23:45:31.686729+0000","last_unstale":"2024-04-26T23:45:33.698690+0000","last_undegraded":"2024-04-26T23:45:33.698690+0000","last_fullsized":"2024-04-26T23:45:33.698690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757951+0000","last_change":"2024-04-26T23:45:32.691521+0000","last_active":"2024-04-26T23:45:33.757951+0000","last_peered":"2024-04-26T23:45:33.757951+0000","last_clean":"2024-04-26T23:45:33.757951+0000","last_became_active":"2024-04-26T23:45:32.689417+0000","last_became_peered":"2024-04-26T23:45:32.689417+0000","last_unstale":"2024-04-26T23:45:33.757951+0000","last_undegraded":"2024-04-26T23:45:33.757951+0000","last_fullsized":"2024-04-26T23:45:33.757951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:08.179335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756573+0000","last_change":"2024-04-26T23:45:31.688837+0000","last_active":"2024-04-26T23:45:33.756573+0000","last_peered":"2024-04-26T23:45:33.756573+0000","last_clean":"2024-04-26T23:45:33.756573+0000","last_became_active":"2024-04-26T23:45:31.688197+0000","last_became_peered":"2024-04-26T23:45:31.688197+0000","last_unstale":"2024-04-26T23:45:33.756573+0000","last_undegraded":"2024-04-26T23:45:33.756573+0000","last_fullsized":"2024-04-26T23:45:33.756573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689758+0000","last_change":"2024-04-26T23:45:32.711123+0000","last_active":"2024-04-26T23:45:33.689758+0000","last_peered":"2024-04-26T23:45:33.689758+0000","last_clean":"2024-04-26T23:45:33.689758+0000","last_became_active":"2024-04-26T23:45:32.710879+0000","last_became_peered":"2024-04-26T23:45:32.710879+0000","last_unstale":"2024-04-26T23:45:33.689758+0000","last_undegraded":"2024-04-26T23:45:33.689758+0000","last_fullsized":"2024-04-26T23:45:33.689758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:48.052853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695742+0000","last_change":"2024-04-26T23:45:31.681304+0000","last_active":"2024-04-26T23:45:33.695742+0000","last_peered":"2024-04-26T23:45:33.695742+0000","last_clean":"2024-04-26T23:45:33.695742+0000","last_became_active":"2024-04-26T23:45:31.681010+0000","last_became_peered":"2024-04-26T23:45:31.681010+0000","last_unstale":"2024-04-26T23:45:33.695742+0000","last_undegraded":"2024-04-26T23:45:33.695742+0000","last_fullsized":"2024-04-26T23:45:33.695742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756926+0000","last_change":"2024-04-26T23:45:32.684124+0000","last_active":"2024-04-26T23:45:33.756926+0000","last_peered":"2024-04-26T23:45:33.756926+0000","last_clean":"2024-04-26T23:45:33.756926+0000","last_became_active":"2024-04-26T23:45:32.683833+0000","last_became_peered":"2024-04-26T23:45:32.683833+0000","last_unstale":"2024-04-26T23:45:33.756926+0000","last_undegraded":"2024-04-26T23:45:33.756926+0000","last_fullsized":"2024-04-26T23:45:33.756926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695748+0000","last_change":"2024-04-26T23:45:31.686558+0000","last_active":"2024-04-26T23:45:33.695748+0000","last_peered":"2024-04-26T23:45:33.695748+0000","last_clean":"2024-04-26T23:45:33.695748+0000","last_became_active":"2024-04-26T23:45:31.686256+0000","last_became_peered":"2024-04-26T23:45:31.686256+0000","last_unstale":"2024-04-26T23:45:33.695748+0000","last_undegraded":"2024-04-26T23:45:33.695748+0000","last_fullsized":"2024-04-26T23:45:33.695748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757677+0000","last_change":"2024-04-26T23:45:32.693947+0000","last_active":"2024-04-26T23:45:33.757677+0000","last_peered":"2024-04-26T23:45:33.757677+0000","last_clean":"2024-04-26T23:45:33.757677+0000","last_became_active":"2024-04-26T23:45:32.693704+0000","last_became_peered":"2024-04-26T23:45:32.693704+0000","last_unstale":"2024-04-26T23:45:33.757677+0000","last_undegraded":"2024-04-26T23:45:33.757677+0000","last_fullsized":"2024-04-26T23:45:33.757677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757253+0000","last_change":"2024-04-26T23:45:31.694659+0000","last_active":"2024-04-26T23:45:33.757253+0000","last_peered":"2024-04-26T23:45:33.757253+0000","last_clean":"2024-04-26T23:45:33.757253+0000","last_became_active":"2024-04-26T23:45:31.694372+0000","last_became_peered":"2024-04-26T23:45:31.694372+0000","last_unstale":"2024-04-26T23:45:33.757253+0000","last_undegraded":"2024-04-26T23:45:33.757253+0000","last_fullsized":"2024-04-26T23:45:33.757253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698364+0000","last_change":"2024-04-26T23:45:32.696663+0000","last_active":"2024-04-26T23:45:33.698364+0000","last_peered":"2024-04-26T23:45:33.698364+0000","last_clean":"2024-04-26T23:45:33.698364+0000","last_became_active":"2024-04-26T23:45:32.696375+0000","last_became_peered":"2024-04-26T23:45:32.696375+0000","last_unstale":"2024-04-26T23:45:33.698364+0000","last_undegraded":"2024-04-26T23:45:33.698364+0000","last_fullsized":"2024-04-26T23:45:33.698364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690867+0000","last_change":"2024-04-26T23:45:32.700585+0000","last_active":"2024-04-26T23:45:33.690867+0000","last_peered":"2024-04-26T23:45:33.690867+0000","last_clean":"2024-04-26T23:45:33.690867+0000","last_became_active":"2024-04-26T23:45:32.699809+0000","last_became_peered":"2024-04-26T23:45:32.699809+0000","last_unstale":"2024-04-26T23:45:33.690867+0000","last_undegraded":"2024-04-26T23:45:33.690867+0000","last_fullsized":"2024-04-26T23:45:33.690867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757098+0000","last_change":"2024-04-26T23:45:31.692287+0000","last_active":"2024-04-26T23:45:33.757098+0000","last_peered":"2024-04-26T23:45:33.757098+0000","last_clean":"2024-04-26T23:45:33.757098+0000","last_became_active":"2024-04-26T23:45:31.691971+0000","last_became_peered":"2024-04-26T23:45:31.691971+0000","last_unstale":"2024-04-26T23:45:33.757098+0000","last_undegraded":"2024-04-26T23:45:33.757098+0000","last_fullsized":"2024-04-26T23:45:33.757098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690790+0000","last_change":"2024-04-26T23:45:32.713320+0000","last_active":"2024-04-26T23:45:33.690790+0000","last_peered":"2024-04-26T23:45:33.690790+0000","last_clean":"2024-04-26T23:45:33.690790+0000","last_became_active":"2024-04-26T23:45:32.713003+0000","last_became_peered":"2024-04-26T23:45:32.713003+0000","last_unstale":"2024-04-26T23:45:33.690790+0000","last_undegraded":"2024-04-26T23:45:33.690790+0000","last_fullsized":"2024-04-26T23:45:33.690790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757116+0000","last_change":"2024-04-26T23:45:31.696984+0000","last_active":"2024-04-26T23:45:33.757116+0000","last_peered":"2024-04-26T23:45:33.757116+0000","last_clean":"2024-04-26T23:45:33.757116+0000","last_became_active":"2024-04-26T23:45:31.696695+0000","last_became_peered":"2024-04-26T23:45:31.696695+0000","last_unstale":"2024-04-26T23:45:33.757116+0000","last_undegraded":"2024-04-26T23:45:33.757116+0000","last_fullsized":"2024-04-26T23:45:33.757116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757885+0000","last_change":"2024-04-26T23:45:32.689960+0000","last_active":"2024-04-26T23:45:33.757885+0000","last_peered":"2024-04-26T23:45:33.757885+0000","last_clean":"2024-04-26T23:45:33.757885+0000","last_became_active":"2024-04-26T23:45:32.688270+0000","last_became_peered":"2024-04-26T23:45:32.688270+0000","last_unstale":"2024-04-26T23:45:33.757885+0000","last_undegraded":"2024-04-26T23:45:33.757885+0000","last_fullsized":"2024-04-26T23:45:33.757885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:06.416550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757915+0000","last_change":"2024-04-26T23:45:31.687488+0000","last_active":"2024-04-26T23:45:33.757915+0000","last_peered":"2024-04-26T23:45:33.757915+0000","last_clean":"2024-04-26T23:45:33.757915+0000","last_became_active":"2024-04-26T23:45:31.687025+0000","last_became_peered":"2024-04-26T23:45:31.687025+0000","last_unstale":"2024-04-26T23:45:33.757915+0000","last_undegraded":"2024-04-26T23:45:33.757915+0000","last_fullsized":"2024-04-26T23:45:33.757915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757776+0000","last_change":"2024-04-26T23:45:32.702678+0000","last_active":"2024-04-26T23:45:33.757776+0000","last_peered":"2024-04-26T23:45:33.757776+0000","last_clean":"2024-04-26T23:45:33.757776+0000","last_became_active":"2024-04-26T23:45:32.702293+0000","last_became_peered":"2024-04-26T23:45:32.702293+0000","last_unstale":"2024-04-26T23:45:33.757776+0000","last_undegraded":"2024-04-26T23:45:33.757776+0000","last_fullsized":"2024-04-26T23:45:33.757776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758083+0000","last_change":"2024-04-26T23:45:31.690606+0000","last_active":"2024-04-26T23:45:33.758083+0000","last_peered":"2024-04-26T23:45:33.758083+0000","last_clean":"2024-04-26T23:45:33.758083+0000","last_became_active":"2024-04-26T23:45:31.690293+0000","last_became_peered":"2024-04-26T23:45:31.690293+0000","last_unstale":"2024-04-26T23:45:33.758083+0000","last_undegraded":"2024-04-26T23:45:33.758083+0000","last_fullsized":"2024-04-26T23:45:33.758083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.450816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:42.270 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:45:42.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.441+0000 7f7078200640 1 Processor -- start 2024-04-26T23:45:42.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7078200640 1 -- start start 2024-04-26T23:45:42.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7078200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f707006c400 0x7f7070166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7078200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f70700d0af0 0x7f7070169400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7078200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70700cf840 con 0x7f7070162a30 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7078200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f70700d1c70 con 0x7f70700d0af0 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7078200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f70700ce830 con 0x7f707006c400 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7076200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f70700d0af0 0x7f7070169400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7076200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f70700d0af0 0x7f7070169400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46818/0 (socket says 172.21.15.47:46818) 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7076200640 1 -- 172.21.15.47:0/3075301304 learned_addr learned my addr 172.21.15.47:0/3075301304 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:42.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7074e00640 1 --2- 172.21.15.47:0/3075301304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f707006c400 0x7f7070166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7076200640 1 -- 172.21.15.47:0/3075301304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f707006c400 msgr2=0x7f7070166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:42.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7076200640 1 --2- 172.21.15.47:0/3075301304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f707006c400 0x7f7070166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7076200640 1 -- 172.21.15.47:0/3075301304 >> v1:172.21.15.203:6789/0 conn(0x7f7070162a30 legacy=0x7f70700d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.445+0000 7f7076200640 1 -- 172.21.15.47:0/3075301304 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70700cea80 con 0x7f70700d0af0 2024-04-26T23:45:42.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7076200640 1 --2- 172.21.15.47:0/3075301304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70700d0af0 0x7f7070169400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7068009e50 tx=0x7f706801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5318b809ad58a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f706fe00640 1 -- 172.21.15.47:0/3075301304 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680a5830 con 0x7f70700d0af0 2024-04-26T23:45:42.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f706fe00640 1 -- 172.21.15.47:0/3075301304 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70680a59d0 con 0x7f70700d0af0 2024-04-26T23:45:42.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f706fe00640 1 -- 172.21.15.47:0/3075301304 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680a5da0 con 0x7f70700d0af0 2024-04-26T23:45:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 -- 172.21.15.47:0/3075301304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70700d0af0 msgr2=0x7f7070169400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 --2- 172.21.15.47:0/3075301304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70700d0af0 0x7f7070169400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7068009e50 tx=0x7f706801c970 comp rx=0 tx=0).stop 2024-04-26T23:45:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 -- 172.21.15.47:0/3075301304 shutdown_connections 2024-04-26T23:45:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 --2- 172.21.15.47:0/3075301304 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f70700d0af0 0x7f7070169400 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 --2- 172.21.15.47:0/3075301304 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f707006c400 0x7f7070166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 -- 172.21.15.47:0/3075301304 >> 172.21.15.47:0/3075301304 conn(0x7f70700d1df0 msgr2=0x7f70700d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:42.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 -- 172.21.15.47:0/3075301304 shutdown_connections 2024-04-26T23:45:42.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 -- 172.21.15.47:0/3075301304 wait complete. 2024-04-26T23:45:42.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 Processor -- start 2024-04-26T23:45:42.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.449+0000 7f7078200640 1 -- start start 2024-04-26T23:45:42.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70700d0af0 0x7f70700b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70701503f0 0x7f7070150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f707014edf0 0x7f707014f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f70700b10b0 con 0x7f707014edf0 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7070074270 con 0x7f70701503f0 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f70700b1230 con 0x7f70700d0af0 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f707014edf0 0x7f707014f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f707014edf0 0x7f707014f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46828/0 (socket says 172.21.15.47:46828) 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 -- 172.21.15.47:0/2982661225 learned_addr learned my addr 172.21.15.47:0/2982661225 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7075800640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70700d0af0 0x7f70700b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7074e00640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70701503f0 0x7f7070150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 -- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70700d0af0 msgr2=0x7f70700b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70700d0af0 0x7f70700b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 -- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70701503f0 msgr2=0x7f7070150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70701503f0 0x7f7070150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 -- 172.21.15.47:0/2982661225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70700b5ad0 con 0x7f707014edf0 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7074e00640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70701503f0 0x7f7070150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:42.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7076200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f707014edf0 0x7f707014f270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70680af040 tx=0x7f7068019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f706d600640 1 -- 172.21.15.47:0/2982661225 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680b6680 con 0x7f707014edf0 2024-04-26T23:45:42.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f706d600640 1 -- 172.21.15.47:0/2982661225 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70680bc070 con 0x7f707014edf0 2024-04-26T23:45:42.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f706d600640 1 -- 172.21.15.47:0/2982661225 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680b6a60 con 0x7f707014edf0 2024-04-26T23:45:42.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70700b6c80 con 0x7f707014edf0 2024-04-26T23:45:42.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f707014e310 con 0x7f707014edf0 2024-04-26T23:45:42.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7070069700 con 0x7f707014edf0 2024-04-26T23:45:42.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.453+0000 7f706d600640 1 -- 172.21.15.47:0/2982661225 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70680b6c00 con 0x7f707014edf0 2024-04-26T23:45:42.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.457+0000 7f706d600640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7050068380 0x7f705006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.457+0000 7f706d600640 1 -- 172.21.15.47:0/2982661225 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f70681216f0 con 0x7f707014edf0 2024-04-26T23:45:42.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.457+0000 7f7075800640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7050068380 0x7f705006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.457+0000 7f7075800640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7050068380 0x7f705006a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70700ce230 tx=0x7f7064009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.461+0000 7f706d600640 1 -- 172.21.15.47:0/2982661225 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7068016620 con 0x7f707014edf0 2024-04-26T23:45:42.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.621+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70700d0430 con 0x7f7050068380 2024-04-26T23:45:42.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.629+0000 7f706d600640 1 -- 172.21.15.47:0/2982661225 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f70700d0430 con 0x7f7050068380 2024-04-26T23:45:42.638 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:42.640 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7050068380 msgr2=0x7f705006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7050068380 0x7f705006a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f70700ce230 tx=0x7f7064009040 comp rx=0 tx=0).stop 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f707014edf0 msgr2=0x7f707014f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f707014edf0 0x7f707014f270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f70680af040 tx=0x7f7068019710 comp rx=0 tx=0).stop 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 shutdown_connections 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7050068380 0x7f705006a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f707014edf0 0x7f707014f270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70701503f0 0x7f7070150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 --2- 172.21.15.47:0/2982661225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f70700d0af0 0x7f70700b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 >> 172.21.15.47:0/2982661225 conn(0x7f70700d1df0 msgr2=0x7f7070161be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:42.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 shutdown_connections 2024-04-26T23:45:42.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.633+0000 7f7078200640 1 -- 172.21.15.47:0/2982661225 wait complete. 2024-04-26T23:45:42.660 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-26T23:45:42.156029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235876,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738844,"statfs":{"total":773094113280,"available":772852576256,"internally_reserved":0,"allocated":3121152,"data_stored":1833196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.488909"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757462+0000","last_change":"2024-04-26T23:45:32.701302+0000","last_active":"2024-04-26T23:45:33.757462+0000","last_peered":"2024-04-26T23:45:33.757462+0000","last_clean":"2024-04-26T23:45:33.757462+0000","last_became_active":"2024-04-26T23:45:32.698183+0000","last_became_peered":"2024-04-26T23:45:32.698183+0000","last_unstale":"2024-04-26T23:45:33.757462+0000","last_undegraded":"2024-04-26T23:45:33.757462+0000","last_fullsized":"2024-04-26T23:45:33.757462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:40:12.210886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695950+0000","last_change":"2024-04-26T23:45:32.693831+0000","last_active":"2024-04-26T23:45:33.695950+0000","last_peered":"2024-04-26T23:45:33.695950+0000","last_clean":"2024-04-26T23:45:33.695950+0000","last_became_active":"2024-04-26T23:45:32.693553+0000","last_became_peered":"2024-04-26T23:45:32.693553+0000","last_unstale":"2024-04-26T23:45:33.695950+0000","last_undegraded":"2024-04-26T23:45:33.695950+0000","last_fullsized":"2024-04-26T23:45:33.695950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757761+0000","last_change":"2024-04-26T23:45:32.683112+0000","last_active":"2024-04-26T23:45:33.757761+0000","last_peered":"2024-04-26T23:45:33.757761+0000","last_clean":"2024-04-26T23:45:33.757761+0000","last_became_active":"2024-04-26T23:45:32.682830+0000","last_became_peered":"2024-04-26T23:45:32.682830+0000","last_unstale":"2024-04-26T23:45:33.757761+0000","last_undegraded":"2024-04-26T23:45:33.757761+0000","last_fullsized":"2024-04-26T23:45:33.757761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:52:40.747110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691013+0000","last_change":"2024-04-26T23:45:32.685512+0000","last_active":"2024-04-26T23:45:33.691013+0000","last_peered":"2024-04-26T23:45:33.691013+0000","last_clean":"2024-04-26T23:45:33.691013+0000","last_became_active":"2024-04-26T23:45:32.684550+0000","last_became_peered":"2024-04-26T23:45:32.684550+0000","last_unstale":"2024-04-26T23:45:33.691013+0000","last_undegraded":"2024-04-26T23:45:33.691013+0000","last_fullsized":"2024-04-26T23:45:33.691013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757117+0000","last_change":"2024-04-26T23:45:32.684222+0000","last_active":"2024-04-26T23:45:33.757117+0000","last_peered":"2024-04-26T23:45:33.757117+0000","last_clean":"2024-04-26T23:45:33.757117+0000","last_became_active":"2024-04-26T23:45:32.683890+0000","last_became_peered":"2024-04-26T23:45:32.683890+0000","last_unstale":"2024-04-26T23:45:33.757117+0000","last_undegraded":"2024-04-26T23:45:33.757117+0000","last_fullsized":"2024-04-26T23:45:33.757117+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690568+0000","last_change":"2024-04-26T23:45:32.692472+0000","last_active":"2024-04-26T23:45:33.690568+0000","last_peered":"2024-04-26T23:45:33.690568+0000","last_clean":"2024-04-26T23:45:33.690568+0000","last_became_active":"2024-04-26T23:45:32.691251+0000","last_became_peered":"2024-04-26T23:45:32.691251+0000","last_unstale":"2024-04-26T23:45:33.690568+0000","last_undegraded":"2024-04-26T23:45:33.690568+0000","last_fullsized":"2024-04-26T23:45:33.690568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756809+0000","last_change":"2024-04-26T23:45:32.691299+0000","last_active":"2024-04-26T23:45:33.756809+0000","last_peered":"2024-04-26T23:45:33.756809+0000","last_clean":"2024-04-26T23:45:33.756809+0000","last_became_active":"2024-04-26T23:45:32.690917+0000","last_became_peered":"2024-04-26T23:45:32.690917+0000","last_unstale":"2024-04-26T23:45:33.756809+0000","last_undegraded":"2024-04-26T23:45:33.756809+0000","last_fullsized":"2024-04-26T23:45:33.756809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756676+0000","last_change":"2024-04-26T23:45:32.689444+0000","last_active":"2024-04-26T23:45:33.756676+0000","last_peered":"2024-04-26T23:45:33.756676+0000","last_clean":"2024-04-26T23:45:33.756676+0000","last_became_active":"2024-04-26T23:45:32.686829+0000","last_became_peered":"2024-04-26T23:45:32.686829+0000","last_unstale":"2024-04-26T23:45:33.756676+0000","last_undegraded":"2024-04-26T23:45:33.756676+0000","last_fullsized":"2024-04-26T23:45:33.756676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757439+0000","last_change":"2024-04-26T23:45:32.681039+0000","last_active":"2024-04-26T23:45:33.757439+0000","last_peered":"2024-04-26T23:45:33.757439+0000","last_clean":"2024-04-26T23:45:33.757439+0000","last_became_active":"2024-04-26T23:45:32.680744+0000","last_became_peered":"2024-04-26T23:45:32.680744+0000","last_unstale":"2024-04-26T23:45:33.757439+0000","last_undegraded":"2024-04-26T23:45:33.757439+0000","last_fullsized":"2024-04-26T23:45:33.757439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698759+0000","last_change":"2024-04-26T23:45:32.701873+0000","last_active":"2024-04-26T23:45:33.698759+0000","last_peered":"2024-04-26T23:45:33.698759+0000","last_clean":"2024-04-26T23:45:33.698759+0000","last_became_active":"2024-04-26T23:45:32.701524+0000","last_became_peered":"2024-04-26T23:45:32.701524+0000","last_unstale":"2024-04-26T23:45:33.698759+0000","last_undegraded":"2024-04-26T23:45:33.698759+0000","last_fullsized":"2024-04-26T23:45:33.698759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698643+0000","last_change":"2024-04-26T23:45:32.703627+0000","last_active":"2024-04-26T23:45:33.698643+0000","last_peered":"2024-04-26T23:45:33.698643+0000","last_clean":"2024-04-26T23:45:33.698643+0000","last_became_active":"2024-04-26T23:45:32.703329+0000","last_became_peered":"2024-04-26T23:45:32.703329+0000","last_unstale":"2024-04-26T23:45:33.698643+0000","last_undegraded":"2024-04-26T23:45:33.698643+0000","last_fullsized":"2024-04-26T23:45:33.698643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690062+0000","last_change":"2024-04-26T23:45:32.711843+0000","last_active":"2024-04-26T23:45:33.690062+0000","last_peered":"2024-04-26T23:45:33.690062+0000","last_clean":"2024-04-26T23:45:33.690062+0000","last_became_active":"2024-04-26T23:45:32.711550+0000","last_became_peered":"2024-04-26T23:45:32.711550+0000","last_unstale":"2024-04-26T23:45:33.690062+0000","last_undegraded":"2024-04-26T23:45:33.690062+0000","last_fullsized":"2024-04-26T23:45:33.690062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:27.177803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757662+0000","last_change":"2024-04-26T23:45:32.689403+0000","last_active":"2024-04-26T23:45:33.757662+0000","last_peered":"2024-04-26T23:45:33.757662+0000","last_clean":"2024-04-26T23:45:33.757662+0000","last_became_active":"2024-04-26T23:45:32.689107+0000","last_became_peered":"2024-04-26T23:45:32.689107+0000","last_unstale":"2024-04-26T23:45:33.757662+0000","last_undegraded":"2024-04-26T23:45:33.757662+0000","last_fullsized":"2024-04-26T23:45:33.757662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757182+0000","last_change":"2024-04-26T23:45:32.686927+0000","last_active":"2024-04-26T23:45:33.757182+0000","last_peered":"2024-04-26T23:45:33.757182+0000","last_clean":"2024-04-26T23:45:33.757182+0000","last_became_active":"2024-04-26T23:45:32.686599+0000","last_became_peered":"2024-04-26T23:45:32.686599+0000","last_unstale":"2024-04-26T23:45:33.757182+0000","last_undegraded":"2024-04-26T23:45:33.757182+0000","last_fullsized":"2024-04-26T23:45:33.757182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:30:15.988811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695791+0000","last_change":"2024-04-26T23:45:32.695206+0000","last_active":"2024-04-26T23:45:33.695791+0000","last_peered":"2024-04-26T23:45:33.695791+0000","last_clean":"2024-04-26T23:45:33.695791+0000","last_became_active":"2024-04-26T23:45:32.694923+0000","last_became_peered":"2024-04-26T23:45:32.694923+0000","last_unstale":"2024-04-26T23:45:33.695791+0000","last_undegraded":"2024-04-26T23:45:33.695791+0000","last_fullsized":"2024-04-26T23:45:33.695791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690353+0000","last_change":"2024-04-26T23:45:32.686596+0000","last_active":"2024-04-26T23:45:33.690353+0000","last_peered":"2024-04-26T23:45:33.690353+0000","last_clean":"2024-04-26T23:45:33.690353+0000","last_became_active":"2024-04-26T23:45:32.686298+0000","last_became_peered":"2024-04-26T23:45:32.686298+0000","last_unstale":"2024-04-26T23:45:33.690353+0000","last_undegraded":"2024-04-26T23:45:33.690353+0000","last_fullsized":"2024-04-26T23:45:33.690353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691470+0000","last_change":"2024-04-26T23:45:32.699393+0000","last_active":"2024-04-26T23:45:33.691470+0000","last_peered":"2024-04-26T23:45:33.691470+0000","last_clean":"2024-04-26T23:45:33.691470+0000","last_became_active":"2024-04-26T23:45:32.698747+0000","last_became_peered":"2024-04-26T23:45:32.698747+0000","last_unstale":"2024-04-26T23:45:33.691470+0000","last_undegraded":"2024-04-26T23:45:33.691470+0000","last_fullsized":"2024-04-26T23:45:33.691470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:25.789992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:32.702144+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:32.701834+0000","last_became_peered":"2024-04-26T23:45:32.701834+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:51.260148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757314+0000","last_change":"2024-04-26T23:45:32.678816+0000","last_active":"2024-04-26T23:45:33.757314+0000","last_peered":"2024-04-26T23:45:33.757314+0000","last_clean":"2024-04-26T23:45:33.757314+0000","last_became_active":"2024-04-26T23:45:32.678510+0000","last_became_peered":"2024-04-26T23:45:32.678510+0000","last_unstale":"2024-04-26T23:45:33.757314+0000","last_undegraded":"2024-04-26T23:45:33.757314+0000","last_fullsized":"2024-04-26T23:45:33.757314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698396+0000","last_change":"2024-04-26T23:45:32.713741+0000","last_active":"2024-04-26T23:45:33.698396+0000","last_peered":"2024-04-26T23:45:33.698396+0000","last_clean":"2024-04-26T23:45:33.698396+0000","last_became_active":"2024-04-26T23:45:32.713326+0000","last_became_peered":"2024-04-26T23:45:32.713326+0000","last_unstale":"2024-04-26T23:45:33.698396+0000","last_undegraded":"2024-04-26T23:45:33.698396+0000","last_fullsized":"2024-04-26T23:45:33.698396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757204+0000","last_change":"2024-04-26T23:45:32.685874+0000","last_active":"2024-04-26T23:45:33.757204+0000","last_peered":"2024-04-26T23:45:33.757204+0000","last_clean":"2024-04-26T23:45:33.757204+0000","last_became_active":"2024-04-26T23:45:32.685622+0000","last_became_peered":"2024-04-26T23:45:32.685622+0000","last_unstale":"2024-04-26T23:45:33.757204+0000","last_undegraded":"2024-04-26T23:45:33.757204+0000","last_fullsized":"2024-04-26T23:45:33.757204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:01.096293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691119+0000","last_change":"2024-04-26T23:45:32.699326+0000","last_active":"2024-04-26T23:45:33.691119+0000","last_peered":"2024-04-26T23:45:33.691119+0000","last_clean":"2024-04-26T23:45:33.691119+0000","last_became_active":"2024-04-26T23:45:32.698859+0000","last_became_peered":"2024-04-26T23:45:32.698859+0000","last_unstale":"2024-04-26T23:45:33.691119+0000","last_undegraded":"2024-04-26T23:45:33.691119+0000","last_fullsized":"2024-04-26T23:45:33.691119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:51:48.409313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756772+0000","last_change":"2024-04-26T23:45:32.695396+0000","last_active":"2024-04-26T23:45:33.756772+0000","last_peered":"2024-04-26T23:45:33.756772+0000","last_clean":"2024-04-26T23:45:33.756772+0000","last_became_active":"2024-04-26T23:45:32.694937+0000","last_became_peered":"2024-04-26T23:45:32.694937+0000","last_unstale":"2024-04-26T23:45:33.756772+0000","last_undegraded":"2024-04-26T23:45:33.756772+0000","last_fullsized":"2024-04-26T23:45:33.756772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690363+0000","last_change":"2024-04-26T23:45:32.679737+0000","last_active":"2024-04-26T23:45:33.690363+0000","last_peered":"2024-04-26T23:45:33.690363+0000","last_clean":"2024-04-26T23:45:33.690363+0000","last_became_active":"2024-04-26T23:45:32.679405+0000","last_became_peered":"2024-04-26T23:45:32.679405+0000","last_unstale":"2024-04-26T23:45:33.690363+0000","last_undegraded":"2024-04-26T23:45:33.690363+0000","last_fullsized":"2024-04-26T23:45:33.690363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758147+0000","last_change":"2024-04-26T23:45:32.695857+0000","last_active":"2024-04-26T23:45:33.758147+0000","last_peered":"2024-04-26T23:45:33.758147+0000","last_clean":"2024-04-26T23:45:33.758147+0000","last_became_active":"2024-04-26T23:45:32.695514+0000","last_became_peered":"2024-04-26T23:45:32.695514+0000","last_unstale":"2024-04-26T23:45:33.758147+0000","last_undegraded":"2024-04-26T23:45:33.758147+0000","last_fullsized":"2024-04-26T23:45:33.758147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698737+0000","last_change":"2024-04-26T23:45:32.708627+0000","last_active":"2024-04-26T23:45:33.698737+0000","last_peered":"2024-04-26T23:45:33.698737+0000","last_clean":"2024-04-26T23:45:33.698737+0000","last_became_active":"2024-04-26T23:45:32.708302+0000","last_became_peered":"2024-04-26T23:45:32.708302+0000","last_unstale":"2024-04-26T23:45:33.698737+0000","last_undegraded":"2024-04-26T23:45:33.698737+0000","last_fullsized":"2024-04-26T23:45:33.698737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695912+0000","last_change":"2024-04-26T23:45:32.689802+0000","last_active":"2024-04-26T23:45:33.695912+0000","last_peered":"2024-04-26T23:45:33.695912+0000","last_clean":"2024-04-26T23:45:33.695912+0000","last_became_active":"2024-04-26T23:45:32.689443+0000","last_became_peered":"2024-04-26T23:45:32.689443+0000","last_unstale":"2024-04-26T23:45:33.695912+0000","last_undegraded":"2024-04-26T23:45:33.695912+0000","last_fullsized":"2024-04-26T23:45:33.695912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:52:08.480162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757503+0000","last_change":"2024-04-26T23:45:32.713348+0000","last_active":"2024-04-26T23:45:33.757503+0000","last_peered":"2024-04-26T23:45:33.757503+0000","last_clean":"2024-04-26T23:45:33.757503+0000","last_became_active":"2024-04-26T23:45:32.712789+0000","last_became_peered":"2024-04-26T23:45:32.712789+0000","last_unstale":"2024-04-26T23:45:33.757503+0000","last_undegraded":"2024-04-26T23:45:33.757503+0000","last_fullsized":"2024-04-26T23:45:33.757503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757335+0000","last_change":"2024-04-26T23:45:32.692031+0000","last_active":"2024-04-26T23:45:33.757335+0000","last_peered":"2024-04-26T23:45:33.757335+0000","last_clean":"2024-04-26T23:45:33.757335+0000","last_became_active":"2024-04-26T23:45:32.691740+0000","last_became_peered":"2024-04-26T23:45:32.691740+0000","last_unstale":"2024-04-26T23:45:33.757335+0000","last_undegraded":"2024-04-26T23:45:33.757335+0000","last_fullsized":"2024-04-26T23:45:33.757335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:09:45.504592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690742+0000","last_change":"2024-04-26T23:45:32.683420+0000","last_active":"2024-04-26T23:45:33.690742+0000","last_peered":"2024-04-26T23:45:33.690742+0000","last_clean":"2024-04-26T23:45:33.690742+0000","last_became_active":"2024-04-26T23:45:32.683079+0000","last_became_peered":"2024-04-26T23:45:32.683079+0000","last_unstale":"2024-04-26T23:45:33.690742+0000","last_undegraded":"2024-04-26T23:45:33.690742+0000","last_fullsized":"2024-04-26T23:45:33.690742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688083+0000","last_change":"2024-04-26T23:45:32.686223+0000","last_active":"2024-04-26T23:45:33.688083+0000","last_peered":"2024-04-26T23:45:33.688083+0000","last_clean":"2024-04-26T23:45:33.688083+0000","last_became_active":"2024-04-26T23:45:32.685930+0000","last_became_peered":"2024-04-26T23:45:32.685930+0000","last_unstale":"2024-04-26T23:45:33.688083+0000","last_undegraded":"2024-04-26T23:45:33.688083+0000","last_fullsized":"2024-04-26T23:45:33.688083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698368+0000","last_change":"2024-04-26T23:45:32.691705+0000","last_active":"2024-04-26T23:45:33.698368+0000","last_peered":"2024-04-26T23:45:33.698368+0000","last_clean":"2024-04-26T23:45:33.698368+0000","last_became_active":"2024-04-26T23:45:32.691423+0000","last_became_peered":"2024-04-26T23:45:32.691423+0000","last_unstale":"2024-04-26T23:45:33.698368+0000","last_undegraded":"2024-04-26T23:45:33.698368+0000","last_fullsized":"2024-04-26T23:45:33.698368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689572+0000","last_change":"2024-04-26T23:45:32.700367+0000","last_active":"2024-04-26T23:45:33.689572+0000","last_peered":"2024-04-26T23:45:33.689572+0000","last_clean":"2024-04-26T23:45:33.689572+0000","last_became_active":"2024-04-26T23:45:32.699940+0000","last_became_peered":"2024-04-26T23:45:32.699940+0000","last_unstale":"2024-04-26T23:45:33.689572+0000","last_undegraded":"2024-04-26T23:45:33.689572+0000","last_fullsized":"2024-04-26T23:45:33.689572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:36.201832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757768+0000","last_change":"2024-04-26T23:45:31.686196+0000","last_active":"2024-04-26T23:45:33.757768+0000","last_peered":"2024-04-26T23:45:33.757768+0000","last_clean":"2024-04-26T23:45:33.757768+0000","last_became_active":"2024-04-26T23:45:31.684117+0000","last_became_peered":"2024-04-26T23:45:31.684117+0000","last_unstale":"2024-04-26T23:45:33.757768+0000","last_undegraded":"2024-04-26T23:45:33.757768+0000","last_fullsized":"2024-04-26T23:45:33.757768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757348+0000","last_change":"2024-04-26T23:45:32.696579+0000","last_active":"2024-04-26T23:45:33.757348+0000","last_peered":"2024-04-26T23:45:33.757348+0000","last_clean":"2024-04-26T23:45:33.757348+0000","last_became_active":"2024-04-26T23:45:32.696347+0000","last_became_peered":"2024-04-26T23:45:32.696347+0000","last_unstale":"2024-04-26T23:45:33.757348+0000","last_undegraded":"2024-04-26T23:45:33.757348+0000","last_fullsized":"2024-04-26T23:45:33.757348+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:15:04.690049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698348+0000","last_change":"2024-04-26T23:45:31.693352+0000","last_active":"2024-04-26T23:45:33.698348+0000","last_peered":"2024-04-26T23:45:33.698348+0000","last_clean":"2024-04-26T23:45:33.698348+0000","last_became_active":"2024-04-26T23:45:31.693085+0000","last_became_peered":"2024-04-26T23:45:31.693085+0000","last_unstale":"2024-04-26T23:45:33.698348+0000","last_undegraded":"2024-04-26T23:45:33.698348+0000","last_fullsized":"2024-04-26T23:45:33.698348+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756910+0000","last_change":"2024-04-26T23:45:31.691825+0000","last_active":"2024-04-26T23:45:33.756910+0000","last_peered":"2024-04-26T23:45:33.756910+0000","last_clean":"2024-04-26T23:45:33.756910+0000","last_became_active":"2024-04-26T23:45:31.691522+0000","last_became_peered":"2024-04-26T23:45:31.691522+0000","last_unstale":"2024-04-26T23:45:33.756910+0000","last_undegraded":"2024-04-26T23:45:33.756910+0000","last_fullsized":"2024-04-26T23:45:33.756910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756733+0000","last_change":"2024-04-26T23:45:32.689899+0000","last_active":"2024-04-26T23:45:33.756733+0000","last_peered":"2024-04-26T23:45:33.756733+0000","last_clean":"2024-04-26T23:45:33.756733+0000","last_became_active":"2024-04-26T23:45:32.689083+0000","last_became_peered":"2024-04-26T23:45:32.689083+0000","last_unstale":"2024-04-26T23:45:33.756733+0000","last_undegraded":"2024-04-26T23:45:33.756733+0000","last_fullsized":"2024-04-26T23:45:33.756733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:52.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690450+0000","last_change":"2024-04-26T23:45:31.692320+0000","last_active":"2024-04-26T23:45:33.690450+0000","last_peered":"2024-04-26T23:45:33.690450+0000","last_clean":"2024-04-26T23:45:33.690450+0000","last_became_active":"2024-04-26T23:45:31.691944+0000","last_became_peered":"2024-04-26T23:45:31.691944+0000","last_unstale":"2024-04-26T23:45:33.690450+0000","last_undegraded":"2024-04-26T23:45:33.690450+0000","last_fullsized":"2024-04-26T23:45:33.690450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695652+0000","last_change":"2024-04-26T23:45:32.684023+0000","last_active":"2024-04-26T23:45:33.695652+0000","last_peered":"2024-04-26T23:45:33.695652+0000","last_clean":"2024-04-26T23:45:33.695652+0000","last_became_active":"2024-04-26T23:45:32.683745+0000","last_became_peered":"2024-04-26T23:45:32.683745+0000","last_unstale":"2024-04-26T23:45:33.695652+0000","last_undegraded":"2024-04-26T23:45:33.695652+0000","last_fullsized":"2024-04-26T23:45:33.695652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:06:15.019700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698580+0000","last_change":"2024-04-26T23:45:31.690903+0000","last_active":"2024-04-26T23:45:33.698580+0000","last_peered":"2024-04-26T23:45:33.698580+0000","last_clean":"2024-04-26T23:45:33.698580+0000","last_became_active":"2024-04-26T23:45:31.690629+0000","last_became_peered":"2024-04-26T23:45:31.690629+0000","last_unstale":"2024-04-26T23:45:33.698580+0000","last_undegraded":"2024-04-26T23:45:33.698580+0000","last_fullsized":"2024-04-26T23:45:33.698580+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690804+0000","last_change":"2024-04-26T23:45:32.682423+0000","last_active":"2024-04-26T23:45:33.690804+0000","last_peered":"2024-04-26T23:45:33.690804+0000","last_clean":"2024-04-26T23:45:33.690804+0000","last_became_active":"2024-04-26T23:45:32.681951+0000","last_became_peered":"2024-04-26T23:45:32.681951+0000","last_unstale":"2024-04-26T23:45:33.690804+0000","last_undegraded":"2024-04-26T23:45:33.690804+0000","last_fullsized":"2024-04-26T23:45:33.690804+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690911+0000","last_change":"2024-04-26T23:45:31.684823+0000","last_active":"2024-04-26T23:45:33.690911+0000","last_peered":"2024-04-26T23:45:33.690911+0000","last_clean":"2024-04-26T23:45:33.690911+0000","last_became_active":"2024-04-26T23:45:31.683574+0000","last_became_peered":"2024-04-26T23:45:31.683574+0000","last_unstale":"2024-04-26T23:45:33.690911+0000","last_undegraded":"2024-04-26T23:45:33.690911+0000","last_fullsized":"2024-04-26T23:45:33.690911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757926+0000","last_change":"2024-04-26T23:45:32.691935+0000","last_active":"2024-04-26T23:45:33.757926+0000","last_peered":"2024-04-26T23:45:33.757926+0000","last_clean":"2024-04-26T23:45:33.757926+0000","last_became_active":"2024-04-26T23:45:32.689093+0000","last_became_peered":"2024-04-26T23:45:32.689093+0000","last_unstale":"2024-04-26T23:45:33.757926+0000","last_undegraded":"2024-04-26T23:45:33.757926+0000","last_fullsized":"2024-04-26T23:45:33.757926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:09:17.239673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695925+0000","last_change":"2024-04-26T23:45:31.688692+0000","last_active":"2024-04-26T23:45:33.695925+0000","last_peered":"2024-04-26T23:45:33.695925+0000","last_clean":"2024-04-26T23:45:33.695925+0000","last_became_active":"2024-04-26T23:45:31.688404+0000","last_became_peered":"2024-04-26T23:45:31.688404+0000","last_unstale":"2024-04-26T23:45:33.695925+0000","last_undegraded":"2024-04-26T23:45:33.695925+0000","last_fullsized":"2024-04-26T23:45:33.695925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690095+0000","last_change":"2024-04-26T23:45:32.710489+0000","last_active":"2024-04-26T23:45:33.690095+0000","last_peered":"2024-04-26T23:45:33.690095+0000","last_clean":"2024-04-26T23:45:33.690095+0000","last_became_active":"2024-04-26T23:45:32.710118+0000","last_became_peered":"2024-04-26T23:45:32.710118+0000","last_unstale":"2024-04-26T23:45:33.690095+0000","last_undegraded":"2024-04-26T23:45:33.690095+0000","last_fullsized":"2024-04-26T23:45:33.690095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:44.929905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698383+0000","last_change":"2024-04-26T23:45:31.690291+0000","last_active":"2024-04-26T23:45:33.698383+0000","last_peered":"2024-04-26T23:45:33.698383+0000","last_clean":"2024-04-26T23:45:33.698383+0000","last_became_active":"2024-04-26T23:45:31.689915+0000","last_became_peered":"2024-04-26T23:45:31.689915+0000","last_unstale":"2024-04-26T23:45:33.698383+0000","last_undegraded":"2024-04-26T23:45:33.698383+0000","last_fullsized":"2024-04-26T23:45:33.698383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756995+0000","last_change":"2024-04-26T23:45:32.696754+0000","last_active":"2024-04-26T23:45:33.756995+0000","last_peered":"2024-04-26T23:45:33.756995+0000","last_clean":"2024-04-26T23:45:33.756995+0000","last_became_active":"2024-04-26T23:45:32.696500+0000","last_became_peered":"2024-04-26T23:45:32.696500+0000","last_unstale":"2024-04-26T23:45:33.756995+0000","last_undegraded":"2024-04-26T23:45:33.756995+0000","last_fullsized":"2024-04-26T23:45:33.756995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757429+0000","last_change":"2024-04-26T23:45:31.687471+0000","last_active":"2024-04-26T23:45:33.757429+0000","last_peered":"2024-04-26T23:45:33.757429+0000","last_clean":"2024-04-26T23:45:33.757429+0000","last_became_active":"2024-04-26T23:45:31.687204+0000","last_became_peered":"2024-04-26T23:45:31.687204+0000","last_unstale":"2024-04-26T23:45:33.757429+0000","last_undegraded":"2024-04-26T23:45:33.757429+0000","last_fullsized":"2024-04-26T23:45:33.757429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:12.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757316+0000","last_change":"2024-04-26T23:45:32.700954+0000","last_active":"2024-04-26T23:45:33.757316+0000","last_peered":"2024-04-26T23:45:33.757316+0000","last_clean":"2024-04-26T23:45:33.757316+0000","last_became_active":"2024-04-26T23:45:32.700376+0000","last_became_peered":"2024-04-26T23:45:32.700376+0000","last_unstale":"2024-04-26T23:45:33.757316+0000","last_undegraded":"2024-04-26T23:45:33.757316+0000","last_fullsized":"2024-04-26T23:45:33.757316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:40:10.353015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691010+0000","last_change":"2024-04-26T23:45:31.690145+0000","last_active":"2024-04-26T23:45:33.691010+0000","last_peered":"2024-04-26T23:45:33.691010+0000","last_clean":"2024-04-26T23:45:33.691010+0000","last_became_active":"2024-04-26T23:45:31.687880+0000","last_became_peered":"2024-04-26T23:45:31.687880+0000","last_unstale":"2024-04-26T23:45:33.691010+0000","last_undegraded":"2024-04-26T23:45:33.691010+0000","last_fullsized":"2024-04-26T23:45:33.691010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757106+0000","last_change":"2024-04-26T23:45:32.695003+0000","last_active":"2024-04-26T23:45:33.757106+0000","last_peered":"2024-04-26T23:45:33.757106+0000","last_clean":"2024-04-26T23:45:33.757106+0000","last_became_active":"2024-04-26T23:45:32.694696+0000","last_became_peered":"2024-04-26T23:45:32.694696+0000","last_unstale":"2024-04-26T23:45:33.757106+0000","last_undegraded":"2024-04-26T23:45:33.757106+0000","last_fullsized":"2024-04-26T23:45:33.757106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698210+0000","last_change":"2024-04-26T23:45:31.694794+0000","last_active":"2024-04-26T23:45:33.698210+0000","last_peered":"2024-04-26T23:45:33.698210+0000","last_clean":"2024-04-26T23:45:33.698210+0000","last_became_active":"2024-04-26T23:45:31.694518+0000","last_became_peered":"2024-04-26T23:45:31.694518+0000","last_unstale":"2024-04-26T23:45:33.698210+0000","last_undegraded":"2024-04-26T23:45:33.698210+0000","last_fullsized":"2024-04-26T23:45:33.698210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698297+0000","last_change":"2024-04-26T23:45:32.691704+0000","last_active":"2024-04-26T23:45:33.698297+0000","last_peered":"2024-04-26T23:45:33.698297+0000","last_clean":"2024-04-26T23:45:33.698297+0000","last_became_active":"2024-04-26T23:45:32.691125+0000","last_became_peered":"2024-04-26T23:45:32.691125+0000","last_unstale":"2024-04-26T23:45:33.698297+0000","last_undegraded":"2024-04-26T23:45:33.698297+0000","last_fullsized":"2024-04-26T23:45:33.698297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:00.356838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688028+0000","last_change":"2024-04-26T23:45:31.677038+0000","last_active":"2024-04-26T23:45:33.688028+0000","last_peered":"2024-04-26T23:45:33.688028+0000","last_clean":"2024-04-26T23:45:33.688028+0000","last_became_active":"2024-04-26T23:45:31.676478+0000","last_became_peered":"2024-04-26T23:45:31.676478+0000","last_unstale":"2024-04-26T23:45:33.688028+0000","last_undegraded":"2024-04-26T23:45:33.688028+0000","last_fullsized":"2024-04-26T23:45:33.688028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:13:06.081900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756712+0000","last_change":"2024-04-26T23:45:32.693504+0000","last_active":"2024-04-26T23:45:33.756712+0000","last_peered":"2024-04-26T23:45:33.756712+0000","last_clean":"2024-04-26T23:45:33.756712+0000","last_became_active":"2024-04-26T23:45:32.693245+0000","last_became_peered":"2024-04-26T23:45:32.693245+0000","last_unstale":"2024-04-26T23:45:33.756712+0000","last_undegraded":"2024-04-26T23:45:33.756712+0000","last_fullsized":"2024-04-26T23:45:33.756712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689885+0000","last_change":"2024-04-26T23:45:31.686918+0000","last_active":"2024-04-26T23:45:33.689885+0000","last_peered":"2024-04-26T23:45:33.689885+0000","last_clean":"2024-04-26T23:45:33.689885+0000","last_became_active":"2024-04-26T23:45:31.686544+0000","last_became_peered":"2024-04-26T23:45:31.686544+0000","last_unstale":"2024-04-26T23:45:33.689885+0000","last_undegraded":"2024-04-26T23:45:33.689885+0000","last_fullsized":"2024-04-26T23:45:33.689885+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:20:37.299506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757297+0000","last_change":"2024-04-26T23:45:32.713893+0000","last_active":"2024-04-26T23:45:33.757297+0000","last_peered":"2024-04-26T23:45:33.757297+0000","last_clean":"2024-04-26T23:45:33.757297+0000","last_became_active":"2024-04-26T23:45:32.713714+0000","last_became_peered":"2024-04-26T23:45:32.713714+0000","last_unstale":"2024-04-26T23:45:33.757297+0000","last_undegraded":"2024-04-26T23:45:33.757297+0000","last_fullsized":"2024-04-26T23:45:33.757297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:20:41.128382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688377+0000","last_change":"2024-04-26T23:45:31.686652+0000","last_active":"2024-04-26T23:45:33.688377+0000","last_peered":"2024-04-26T23:45:33.688377+0000","last_clean":"2024-04-26T23:45:33.688377+0000","last_became_active":"2024-04-26T23:45:31.686359+0000","last_became_peered":"2024-04-26T23:45:31.686359+0000","last_unstale":"2024-04-26T23:45:33.688377+0000","last_undegraded":"2024-04-26T23:45:33.688377+0000","last_fullsized":"2024-04-26T23:45:33.688377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757524+0000","last_change":"2024-04-26T23:45:32.711891+0000","last_active":"2024-04-26T23:45:33.757524+0000","last_peered":"2024-04-26T23:45:33.757524+0000","last_clean":"2024-04-26T23:45:33.757524+0000","last_became_active":"2024-04-26T23:45:32.708109+0000","last_became_peered":"2024-04-26T23:45:32.708109+0000","last_unstale":"2024-04-26T23:45:33.757524+0000","last_undegraded":"2024-04-26T23:45:33.757524+0000","last_fullsized":"2024-04-26T23:45:33.757524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:23.840152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.696007+0000","last_change":"2024-04-26T23:45:31.689003+0000","last_active":"2024-04-26T23:45:33.696007+0000","last_peered":"2024-04-26T23:45:33.696007+0000","last_clean":"2024-04-26T23:45:33.696007+0000","last_became_active":"2024-04-26T23:45:31.688719+0000","last_became_peered":"2024-04-26T23:45:31.688719+0000","last_unstale":"2024-04-26T23:45:33.696007+0000","last_undegraded":"2024-04-26T23:45:33.696007+0000","last_fullsized":"2024-04-26T23:45:33.696007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690968+0000","last_change":"2024-04-26T23:45:32.682148+0000","last_active":"2024-04-26T23:45:33.690968+0000","last_peered":"2024-04-26T23:45:33.690968+0000","last_clean":"2024-04-26T23:45:33.690968+0000","last_became_active":"2024-04-26T23:45:32.681387+0000","last_became_peered":"2024-04-26T23:45:32.681387+0000","last_unstale":"2024-04-26T23:45:33.690968+0000","last_undegraded":"2024-04-26T23:45:33.690968+0000","last_fullsized":"2024-04-26T23:45:33.690968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:41.760888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688270+0000","last_change":"2024-04-26T23:45:31.693411+0000","last_active":"2024-04-26T23:45:33.688270+0000","last_peered":"2024-04-26T23:45:33.688270+0000","last_clean":"2024-04-26T23:45:33.688270+0000","last_became_active":"2024-04-26T23:45:31.693004+0000","last_became_peered":"2024-04-26T23:45:31.693004+0000","last_unstale":"2024-04-26T23:45:33.688270+0000","last_undegraded":"2024-04-26T23:45:33.688270+0000","last_fullsized":"2024-04-26T23:45:33.688270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:05.116246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757215+0000","last_change":"2024-04-26T23:45:32.680577+0000","last_active":"2024-04-26T23:45:33.757215+0000","last_peered":"2024-04-26T23:45:33.757215+0000","last_clean":"2024-04-26T23:45:33.757215+0000","last_became_active":"2024-04-26T23:45:32.680225+0000","last_became_peered":"2024-04-26T23:45:32.680225+0000","last_unstale":"2024-04-26T23:45:33.757215+0000","last_undegraded":"2024-04-26T23:45:33.757215+0000","last_fullsized":"2024-04-26T23:45:33.757215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756646+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:45:33.756646+0000","last_peered":"2024-04-26T23:45:33.756646+0000","last_clean":"2024-04-26T23:45:33.756646+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:45:33.756646+0000","last_undegraded":"2024-04-26T23:45:33.756646+0000","last_fullsized":"2024-04-26T23:45:33.756646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690400+0000","last_change":"2024-04-26T23:45:31.679166+0000","last_active":"2024-04-26T23:45:33.690400+0000","last_peered":"2024-04-26T23:45:33.690400+0000","last_clean":"2024-04-26T23:45:33.690400+0000","last_became_active":"2024-04-26T23:45:31.678173+0000","last_became_peered":"2024-04-26T23:45:31.678173+0000","last_unstale":"2024-04-26T23:45:33.690400+0000","last_undegraded":"2024-04-26T23:45:33.690400+0000","last_fullsized":"2024-04-26T23:45:33.690400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756798+0000","last_change":"2024-04-26T23:45:32.681749+0000","last_active":"2024-04-26T23:45:33.756798+0000","last_peered":"2024-04-26T23:45:33.756798+0000","last_clean":"2024-04-26T23:45:33.756798+0000","last_became_active":"2024-04-26T23:45:32.680979+0000","last_became_peered":"2024-04-26T23:45:32.680979+0000","last_unstale":"2024-04-26T23:45:33.756798+0000","last_undegraded":"2024-04-26T23:45:33.756798+0000","last_fullsized":"2024-04-26T23:45:33.756798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756606+0000","last_change":"2024-04-26T23:45:31.692253+0000","last_active":"2024-04-26T23:45:33.756606+0000","last_peered":"2024-04-26T23:45:33.756606+0000","last_clean":"2024-04-26T23:45:33.756606+0000","last_became_active":"2024-04-26T23:45:31.691948+0000","last_became_peered":"2024-04-26T23:45:31.691948+0000","last_unstale":"2024-04-26T23:45:33.756606+0000","last_undegraded":"2024-04-26T23:45:33.756606+0000","last_fullsized":"2024-04-26T23:45:33.756606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757845+0000","last_change":"2024-04-26T23:45:32.696469+0000","last_active":"2024-04-26T23:45:33.757845+0000","last_peered":"2024-04-26T23:45:33.757845+0000","last_clean":"2024-04-26T23:45:33.757845+0000","last_became_active":"2024-04-26T23:45:32.696085+0000","last_became_peered":"2024-04-26T23:45:32.696085+0000","last_unstale":"2024-04-26T23:45:33.757845+0000","last_undegraded":"2024-04-26T23:45:33.757845+0000","last_fullsized":"2024-04-26T23:45:33.757845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:13:57.675683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.688081+0000","last_change":"2024-04-26T23:45:31.686617+0000","last_active":"2024-04-26T23:45:33.688081+0000","last_peered":"2024-04-26T23:45:33.688081+0000","last_clean":"2024-04-26T23:45:33.688081+0000","last_became_active":"2024-04-26T23:45:31.686298+0000","last_became_peered":"2024-04-26T23:45:31.686298+0000","last_unstale":"2024-04-26T23:45:33.688081+0000","last_undegraded":"2024-04-26T23:45:33.688081+0000","last_fullsized":"2024-04-26T23:45:33.688081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695716+0000","last_change":"2024-04-26T23:45:32.679648+0000","last_active":"2024-04-26T23:45:33.695716+0000","last_peered":"2024-04-26T23:45:33.695716+0000","last_clean":"2024-04-26T23:45:33.695716+0000","last_became_active":"2024-04-26T23:45:32.678533+0000","last_became_peered":"2024-04-26T23:45:32.678533+0000","last_unstale":"2024-04-26T23:45:33.695716+0000","last_undegraded":"2024-04-26T23:45:33.695716+0000","last_fullsized":"2024-04-26T23:45:33.695716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:14:54.851035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.691096+0000","last_change":"2024-04-26T23:45:31.681850+0000","last_active":"2024-04-26T23:45:33.691096+0000","last_peered":"2024-04-26T23:45:33.691096+0000","last_clean":"2024-04-26T23:45:33.691096+0000","last_became_active":"2024-04-26T23:45:31.679810+0000","last_became_peered":"2024-04-26T23:45:31.679810+0000","last_unstale":"2024-04-26T23:45:33.691096+0000","last_undegraded":"2024-04-26T23:45:33.691096+0000","last_fullsized":"2024-04-26T23:45:33.691096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689831+0000","last_change":"2024-04-26T23:45:32.710524+0000","last_active":"2024-04-26T23:45:33.689831+0000","last_peered":"2024-04-26T23:45:33.689831+0000","last_clean":"2024-04-26T23:45:33.689831+0000","last_became_active":"2024-04-26T23:45:32.703378+0000","last_became_peered":"2024-04-26T23:45:32.703378+0000","last_unstale":"2024-04-26T23:45:33.689831+0000","last_undegraded":"2024-04-26T23:45:33.689831+0000","last_fullsized":"2024-04-26T23:45:33.689831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:22.939348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695838+0000","last_change":"2024-04-26T23:45:31.681707+0000","last_active":"2024-04-26T23:45:33.695838+0000","last_peered":"2024-04-26T23:45:33.695838+0000","last_clean":"2024-04-26T23:45:33.695838+0000","last_became_active":"2024-04-26T23:45:31.681452+0000","last_became_peered":"2024-04-26T23:45:31.681452+0000","last_unstale":"2024-04-26T23:45:33.695838+0000","last_undegraded":"2024-04-26T23:45:33.695838+0000","last_fullsized":"2024-04-26T23:45:33.695838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:58:26.171918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690997+0000","last_change":"2024-04-26T23:45:32.690629+0000","last_active":"2024-04-26T23:45:33.690997+0000","last_peered":"2024-04-26T23:45:33.690997+0000","last_clean":"2024-04-26T23:45:33.690997+0000","last_became_active":"2024-04-26T23:45:32.690208+0000","last_became_peered":"2024-04-26T23:45:32.690208+0000","last_unstale":"2024-04-26T23:45:33.690997+0000","last_undegraded":"2024-04-26T23:45:33.690997+0000","last_fullsized":"2024-04-26T23:45:33.690997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:23.384611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757330+0000","last_change":"2024-04-26T23:45:31.693759+0000","last_active":"2024-04-26T23:45:33.757330+0000","last_peered":"2024-04-26T23:45:33.757330+0000","last_clean":"2024-04-26T23:45:33.757330+0000","last_became_active":"2024-04-26T23:45:31.693396+0000","last_became_peered":"2024-04-26T23:45:31.693396+0000","last_unstale":"2024-04-26T23:45:33.757330+0000","last_undegraded":"2024-04-26T23:45:33.757330+0000","last_fullsized":"2024-04-26T23:45:33.757330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:17:47.961582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695802+0000","last_change":"2024-04-26T23:45:32.679402+0000","last_active":"2024-04-26T23:45:33.695802+0000","last_peered":"2024-04-26T23:45:33.695802+0000","last_clean":"2024-04-26T23:45:33.695802+0000","last_became_active":"2024-04-26T23:45:32.678906+0000","last_became_peered":"2024-04-26T23:45:32.678906+0000","last_unstale":"2024-04-26T23:45:33.695802+0000","last_undegraded":"2024-04-26T23:45:33.695802+0000","last_fullsized":"2024-04-26T23:45:33.695802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:53:23.143681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.697710+0000","last_change":"2024-04-26T23:45:31.682989+0000","last_active":"2024-04-26T23:45:33.697710+0000","last_peered":"2024-04-26T23:45:33.697710+0000","last_clean":"2024-04-26T23:45:33.697710+0000","last_became_active":"2024-04-26T23:45:31.682706+0000","last_became_peered":"2024-04-26T23:45:31.682706+0000","last_unstale":"2024-04-26T23:45:33.697710+0000","last_undegraded":"2024-04-26T23:45:33.697710+0000","last_fullsized":"2024-04-26T23:45:33.697710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758153+0000","last_change":"2024-04-26T23:45:32.705019+0000","last_active":"2024-04-26T23:45:33.758153+0000","last_peered":"2024-04-26T23:45:33.758153+0000","last_clean":"2024-04-26T23:45:33.758153+0000","last_became_active":"2024-04-26T23:45:32.704605+0000","last_became_peered":"2024-04-26T23:45:32.704605+0000","last_unstale":"2024-04-26T23:45:33.758153+0000","last_undegraded":"2024-04-26T23:45:33.758153+0000","last_fullsized":"2024-04-26T23:45:33.758153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:29.097250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698690+0000","last_change":"2024-04-26T23:45:31.687021+0000","last_active":"2024-04-26T23:45:33.698690+0000","last_peered":"2024-04-26T23:45:33.698690+0000","last_clean":"2024-04-26T23:45:33.698690+0000","last_became_active":"2024-04-26T23:45:31.686729+0000","last_became_peered":"2024-04-26T23:45:31.686729+0000","last_unstale":"2024-04-26T23:45:33.698690+0000","last_undegraded":"2024-04-26T23:45:33.698690+0000","last_fullsized":"2024-04-26T23:45:33.698690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757951+0000","last_change":"2024-04-26T23:45:32.691521+0000","last_active":"2024-04-26T23:45:33.757951+0000","last_peered":"2024-04-26T23:45:33.757951+0000","last_clean":"2024-04-26T23:45:33.757951+0000","last_became_active":"2024-04-26T23:45:32.689417+0000","last_became_peered":"2024-04-26T23:45:32.689417+0000","last_unstale":"2024-04-26T23:45:33.757951+0000","last_undegraded":"2024-04-26T23:45:33.757951+0000","last_fullsized":"2024-04-26T23:45:33.757951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:18:08.179335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756573+0000","last_change":"2024-04-26T23:45:31.688837+0000","last_active":"2024-04-26T23:45:33.756573+0000","last_peered":"2024-04-26T23:45:33.756573+0000","last_clean":"2024-04-26T23:45:33.756573+0000","last_became_active":"2024-04-26T23:45:31.688197+0000","last_became_peered":"2024-04-26T23:45:31.688197+0000","last_unstale":"2024-04-26T23:45:33.756573+0000","last_undegraded":"2024-04-26T23:45:33.756573+0000","last_fullsized":"2024-04-26T23:45:33.756573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:49:21.933463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.689758+0000","last_change":"2024-04-26T23:45:32.711123+0000","last_active":"2024-04-26T23:45:33.689758+0000","last_peered":"2024-04-26T23:45:33.689758+0000","last_clean":"2024-04-26T23:45:33.689758+0000","last_became_active":"2024-04-26T23:45:32.710879+0000","last_became_peered":"2024-04-26T23:45:32.710879+0000","last_unstale":"2024-04-26T23:45:33.689758+0000","last_undegraded":"2024-04-26T23:45:33.689758+0000","last_fullsized":"2024-04-26T23:45:33.689758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:48.052853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695742+0000","last_change":"2024-04-26T23:45:31.681304+0000","last_active":"2024-04-26T23:45:33.695742+0000","last_peered":"2024-04-26T23:45:33.695742+0000","last_clean":"2024-04-26T23:45:33.695742+0000","last_became_active":"2024-04-26T23:45:31.681010+0000","last_became_peered":"2024-04-26T23:45:31.681010+0000","last_unstale":"2024-04-26T23:45:33.695742+0000","last_undegraded":"2024-04-26T23:45:33.695742+0000","last_fullsized":"2024-04-26T23:45:33.695742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.756926+0000","last_change":"2024-04-26T23:45:32.684124+0000","last_active":"2024-04-26T23:45:33.756926+0000","last_peered":"2024-04-26T23:45:33.756926+0000","last_clean":"2024-04-26T23:45:33.756926+0000","last_became_active":"2024-04-26T23:45:32.683833+0000","last_became_peered":"2024-04-26T23:45:32.683833+0000","last_unstale":"2024-04-26T23:45:33.756926+0000","last_undegraded":"2024-04-26T23:45:33.756926+0000","last_fullsized":"2024-04-26T23:45:33.756926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:29.963263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.695748+0000","last_change":"2024-04-26T23:45:31.686558+0000","last_active":"2024-04-26T23:45:33.695748+0000","last_peered":"2024-04-26T23:45:33.695748+0000","last_clean":"2024-04-26T23:45:33.695748+0000","last_became_active":"2024-04-26T23:45:31.686256+0000","last_became_peered":"2024-04-26T23:45:31.686256+0000","last_unstale":"2024-04-26T23:45:33.695748+0000","last_undegraded":"2024-04-26T23:45:33.695748+0000","last_fullsized":"2024-04-26T23:45:33.695748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757677+0000","last_change":"2024-04-26T23:45:32.693947+0000","last_active":"2024-04-26T23:45:33.757677+0000","last_peered":"2024-04-26T23:45:33.757677+0000","last_clean":"2024-04-26T23:45:33.757677+0000","last_became_active":"2024-04-26T23:45:32.693704+0000","last_became_peered":"2024-04-26T23:45:32.693704+0000","last_unstale":"2024-04-26T23:45:33.757677+0000","last_undegraded":"2024-04-26T23:45:33.757677+0000","last_fullsized":"2024-04-26T23:45:33.757677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:08.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757253+0000","last_change":"2024-04-26T23:45:31.694659+0000","last_active":"2024-04-26T23:45:33.757253+0000","last_peered":"2024-04-26T23:45:33.757253+0000","last_clean":"2024-04-26T23:45:33.757253+0000","last_became_active":"2024-04-26T23:45:31.694372+0000","last_became_peered":"2024-04-26T23:45:31.694372+0000","last_unstale":"2024-04-26T23:45:33.757253+0000","last_undegraded":"2024-04-26T23:45:33.757253+0000","last_fullsized":"2024-04-26T23:45:33.757253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:30:43.924020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.698364+0000","last_change":"2024-04-26T23:45:32.696663+0000","last_active":"2024-04-26T23:45:33.698364+0000","last_peered":"2024-04-26T23:45:33.698364+0000","last_clean":"2024-04-26T23:45:33.698364+0000","last_became_active":"2024-04-26T23:45:32.696375+0000","last_became_peered":"2024-04-26T23:45:32.696375+0000","last_unstale":"2024-04-26T23:45:33.698364+0000","last_undegraded":"2024-04-26T23:45:33.698364+0000","last_fullsized":"2024-04-26T23:45:33.698364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:37:16.996706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690867+0000","last_change":"2024-04-26T23:45:32.700585+0000","last_active":"2024-04-26T23:45:33.690867+0000","last_peered":"2024-04-26T23:45:33.690867+0000","last_clean":"2024-04-26T23:45:33.690867+0000","last_became_active":"2024-04-26T23:45:32.699809+0000","last_became_peered":"2024-04-26T23:45:32.699809+0000","last_unstale":"2024-04-26T23:45:33.690867+0000","last_undegraded":"2024-04-26T23:45:33.690867+0000","last_fullsized":"2024-04-26T23:45:33.690867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:08:17.455372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757098+0000","last_change":"2024-04-26T23:45:31.692287+0000","last_active":"2024-04-26T23:45:33.757098+0000","last_peered":"2024-04-26T23:45:33.757098+0000","last_clean":"2024-04-26T23:45:33.757098+0000","last_became_active":"2024-04-26T23:45:31.691971+0000","last_became_peered":"2024-04-26T23:45:31.691971+0000","last_unstale":"2024-04-26T23:45:33.757098+0000","last_undegraded":"2024-04-26T23:45:33.757098+0000","last_fullsized":"2024-04-26T23:45:33.757098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:47.046968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.690790+0000","last_change":"2024-04-26T23:45:32.713320+0000","last_active":"2024-04-26T23:45:33.690790+0000","last_peered":"2024-04-26T23:45:33.690790+0000","last_clean":"2024-04-26T23:45:33.690790+0000","last_became_active":"2024-04-26T23:45:32.713003+0000","last_became_peered":"2024-04-26T23:45:32.713003+0000","last_unstale":"2024-04-26T23:45:33.690790+0000","last_undegraded":"2024-04-26T23:45:33.690790+0000","last_fullsized":"2024-04-26T23:45:33.690790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:57:41.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757116+0000","last_change":"2024-04-26T23:45:31.696984+0000","last_active":"2024-04-26T23:45:33.757116+0000","last_peered":"2024-04-26T23:45:33.757116+0000","last_clean":"2024-04-26T23:45:33.757116+0000","last_became_active":"2024-04-26T23:45:31.696695+0000","last_became_peered":"2024-04-26T23:45:31.696695+0000","last_unstale":"2024-04-26T23:45:33.757116+0000","last_undegraded":"2024-04-26T23:45:33.757116+0000","last_fullsized":"2024-04-26T23:45:33.757116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:50.254264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757885+0000","last_change":"2024-04-26T23:45:32.689960+0000","last_active":"2024-04-26T23:45:33.757885+0000","last_peered":"2024-04-26T23:45:33.757885+0000","last_clean":"2024-04-26T23:45:33.757885+0000","last_became_active":"2024-04-26T23:45:32.688270+0000","last_became_peered":"2024-04-26T23:45:32.688270+0000","last_unstale":"2024-04-26T23:45:33.757885+0000","last_undegraded":"2024-04-26T23:45:33.757885+0000","last_fullsized":"2024-04-26T23:45:33.757885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:06.416550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757915+0000","last_change":"2024-04-26T23:45:31.687488+0000","last_active":"2024-04-26T23:45:33.757915+0000","last_peered":"2024-04-26T23:45:33.757915+0000","last_clean":"2024-04-26T23:45:33.757915+0000","last_became_active":"2024-04-26T23:45:31.687025+0000","last_became_peered":"2024-04-26T23:45:31.687025+0000","last_unstale":"2024-04-26T23:45:33.757915+0000","last_undegraded":"2024-04-26T23:45:33.757915+0000","last_fullsized":"2024-04-26T23:45:33.757915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:32:35.195948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.757776+0000","last_change":"2024-04-26T23:45:32.702678+0000","last_active":"2024-04-26T23:45:33.757776+0000","last_peered":"2024-04-26T23:45:33.757776+0000","last_clean":"2024-04-26T23:45:33.757776+0000","last_became_active":"2024-04-26T23:45:32.702293+0000","last_became_peered":"2024-04-26T23:45:32.702293+0000","last_unstale":"2024-04-26T23:45:33.757776+0000","last_undegraded":"2024-04-26T23:45:33.757776+0000","last_fullsized":"2024-04-26T23:45:33.757776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:31.656945+0000","last_clean_scrub_stamp":"2024-04-26T23:45:31.656945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:56:22.057637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T23:45:33.758083+0000","last_change":"2024-04-26T23:45:31.690606+0000","last_active":"2024-04-26T23:45:33.758083+0000","last_peered":"2024-04-26T23:45:33.758083+0000","last_clean":"2024-04-26T23:45:33.758083+0000","last_became_active":"2024-04-26T23:45:31.690293+0000","last_became_peered":"2024-04-26T23:45:31.690293+0000","last_unstale":"2024-04-26T23:45:33.758083+0000","last_undegraded":"2024-04-26T23:45:33.758083+0000","last_fullsized":"2024-04-26T23:45:33.758083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:30.651061+0000","last_clean_scrub_stamp":"2024-04-26T23:45:30.651061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:52:43.450816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":831488,"data_stored":671905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":81045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":81081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":82567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":80955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":81115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":839680,"data_stored":671961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:45:42.664 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:45:42.664 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T23:45:42.664 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T23:45:42.664 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T23:45:42.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.833+0000 7fd454600640 1 Processor -- start 2024-04-26T23:45:42.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.833+0000 7fd454600640 1 -- start start 2024-04-26T23:45:42.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.833+0000 7fd454600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd44c162c60 0x7fd44c0d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.833+0000 7fd454600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd44c0d1f30 0x7fd44c0d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd454600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44c0d5960 con 0x7fd44c0b3f80 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd454600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd44c0d5f20 con 0x7fd44c162c60 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd454600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd44c0d5c40 con 0x7fd44c0d1f30 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd44c162c60 0x7fd44c0d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd44c0b3f80 0x7fd44c0b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45444/0 (socket says 172.21.15.47:45444) 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd44c162c60 0x7fd44c0d19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46834/0 (socket says 172.21.15.47:46834) 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451200640 1 -- 172.21.15.47:0/1418162858 learned_addr learned my addr 172.21.15.47:0/1418162858 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd452600640 1 --2- 172.21.15.47:0/1418162858 >> v2:172.21.15.203:3300/0 conn(0x7fd44c0d1f30 0x7fd44c0d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451c00640 1 -- 172.21.15.47:0/1418162858 >> v2:172.21.15.203:3300/0 conn(0x7fd44c0d1f30 msgr2=0x7fd44c0d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:42.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451c00640 1 --2- 172.21.15.47:0/1418162858 >> v2:172.21.15.203:3300/0 conn(0x7fd44c0d1f30 0x7fd44c0d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451c00640 1 -- 172.21.15.47:0/1418162858 >> v1:172.21.15.47:6789/0 conn(0x7fd44c0b3f80 legacy=0x7fd44c0b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451c00640 1 -- 172.21.15.47:0/1418162858 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c0b4ae0 con 0x7fd44c162c60 2024-04-26T23:45:42.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd44be00640 1 -- 172.21.15.47:0/1418162858 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342997050 0 0) 0x7fd44c0d5960 con 0x7fd44c0b3f80 2024-04-26T23:45:42.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd451c00640 1 --2- 172.21.15.47:0/1418162858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c162c60 0x7fd44c0d19f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd44c08e510 tx=0x7fd44001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5536b3f5a01ea2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd44be00640 1 -- 172.21.15.47:0/1418162858 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400b0070 con 0x7fd44c162c60 2024-04-26T23:45:42.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd44be00640 1 -- 172.21.15.47:0/1418162858 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4400ab600 con 0x7fd44c162c60 2024-04-26T23:45:42.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.837+0000 7fd44be00640 1 -- 172.21.15.47:0/1418162858 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4400ab9d0 con 0x7fd44c162c60 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- 172.21.15.47:0/1418162858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c162c60 msgr2=0x7fd44c0d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 --2- 172.21.15.47:0/1418162858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c162c60 0x7fd44c0d19f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd44c08e510 tx=0x7fd44001c3f0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- 172.21.15.47:0/1418162858 shutdown_connections 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 --2- 172.21.15.47:0/1418162858 >> v2:172.21.15.203:3300/0 conn(0x7fd44c0d1f30 0x7fd44c0d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 --2- 172.21.15.47:0/1418162858 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c162c60 0x7fd44c0d19f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- 172.21.15.47:0/1418162858 >> 172.21.15.47:0/1418162858 conn(0x7fd44c09e3e0 msgr2=0x7fd44c0d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- 172.21.15.47:0/1418162858 shutdown_connections 2024-04-26T23:45:42.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- 172.21.15.47:0/1418162858 wait complete. 2024-04-26T23:45:42.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 Processor -- start 2024-04-26T23:45:42.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- start start 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd44c0b3f80 0x7fd44c14fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c0d1f30 0x7fd44c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd44c162c60 0x7fd44c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c0b6590 con 0x7fd44c0d1f30 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c0b6410 con 0x7fd44c162c60 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd454600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c16c180 con 0x7fd44c0b3f80 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c0d1f30 0x7fd44c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c0d1f30 0x7fd44c0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46846/0 (socket says 172.21.15.47:46846) 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 -- 172.21.15.47:0/1477610341 learned_addr learned my addr 172.21.15.47:0/1477610341 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451c00640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd44c0b3f80 0x7fd44c14fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd452600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd44c162c60 0x7fd44c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 -- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd44c0b3f80 msgr2=0x7fd44c14fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd44c0b3f80 0x7fd44c14fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 -- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd44c162c60 msgr2=0x7fd44c0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd44c162c60 0x7fd44c0c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451200640 1 -- 172.21.15.47:0/1477610341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c1537b0 con 0x7fd44c0d1f30 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.841+0000 7fd451c00640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd44c0b3f80 0x7fd44c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:42.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd451200640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c0d1f30 0x7fd44c0c9630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd43800c450 tx=0x7fd43800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd449600640 1 -- 172.21.15.47:0/1477610341 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd438018070 con 0x7fd44c0d1f30 2024-04-26T23:45:42.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd449600640 1 -- 172.21.15.47:0/1477610341 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4380074e0 con 0x7fd44c0d1f30 2024-04-26T23:45:42.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd449600640 1 -- 172.21.15.47:0/1477610341 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4380049f0 con 0x7fd44c0d1f30 2024-04-26T23:45:42.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c153a90 con 0x7fd44c0d1f30 2024-04-26T23:45:42.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c1533f0 con 0x7fd44c0d1f30 2024-04-26T23:45:42.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44c069700 con 0x7fd44c0d1f30 2024-04-26T23:45:42.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd449600640 1 -- 172.21.15.47:0/1477610341 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd43801b070 con 0x7fd44c0d1f30 2024-04-26T23:45:42.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd449600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd42c068380 0x7fd42c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:42.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd449600640 1 -- 172.21.15.47:0/1477610341 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd438085d20 con 0x7fd44c0d1f30 2024-04-26T23:45:42.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.845+0000 7fd451c00640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd42c068380 0x7fd42c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:42.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.849+0000 7fd451c00640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd42c068380 0x7fd42c06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4400ad000 tx=0x7fd4400a4f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:42.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:42.849+0000 7fd449600640 1 -- 172.21.15.47:0/1477610341 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd4380562d0 con 0x7fd44c0d1f30 2024-04-26T23:45:43.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.049+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd44c0d0040 con 0x7fd44c0d1f30 2024-04-26T23:45:43.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.049+0000 7fd449600640 1 -- 172.21.15.47:0/1477610341 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd438055bd0 con 0x7fd44c0d1f30 2024-04-26T23:45:43.058 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:43.058 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd42c068380 msgr2=0x7fd42c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd42c068380 0x7fd42c06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd4400ad000 tx=0x7fd4400a4f90 comp rx=0 tx=0).stop 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c0d1f30 msgr2=0x7fd44c0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c0d1f30 0x7fd44c0c9630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd43800c450 tx=0x7fd43800c910 comp rx=0 tx=0).stop 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 shutdown_connections 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd42c068380 0x7fd42c06a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd44c162c60 0x7fd44c0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd44c0d1f30 0x7fd44c0c9630 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 --2- 172.21.15.47:0/1477610341 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd44c0b3f80 0x7fd44c14fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 >> 172.21.15.47:0/1477610341 conn(0x7fd44c09e3e0 msgr2=0x7fd44c0b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:43.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 shutdown_connections 2024-04-26T23:45:43.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.053+0000 7fd454600640 1 -- 172.21.15.47:0/1477610341 wait complete. 2024-04-26T23:45:43.078 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T23:45:43.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:43.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7ec6800640 1 Processor -- start 2024-04-26T23:45:43.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7ec6800640 1 -- start start 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7ec6800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ec00ce310 0x7f7ec015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7ec6800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec015fc50 con 0x7f7ec006fcd0 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7ec6800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ec015ff30 con 0x7f7ec015c100 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7ec6800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7ec0160860 con 0x7f7ec00ce310 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7eb7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ec00ce310 0x7f7ec015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7eb7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7ec00ce310 0x7f7ec015cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46854/0 (socket says 172.21.15.47:46854) 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7eb7e00640 1 -- 172.21.15.47:0/2950347315 learned_addr learned my addr 172.21.15.47:0/2950347315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7ebfe00640 1 --1- 172.21.15.47:0/2950347315 >> v1:172.21.15.47:6789/0 conn(0x7f7ec006fcd0 0x7f7ec00b4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45460/0 (socket says 172.21.15.47:45460) 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7eb7e00640 1 -- 172.21.15.47:0/2950347315 >> v1:172.21.15.203:6789/0 conn(0x7f7ec015c100 legacy=0x7f7ec00cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7eb7e00640 1 -- 172.21.15.47:0/2950347315 >> v1:172.21.15.47:6789/0 conn(0x7f7ec006fcd0 legacy=0x7f7ec00b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.213+0000 7f7eb7e00640 1 -- 172.21.15.47:0/2950347315 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec0160210 con 0x7f7ec00ce310 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7eb7e00640 1 --2- 172.21.15.47:0/2950347315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec015cf60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8006fd0 tx=0x7f7ea801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7ed625e4401a56 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ebea00640 1 -- 172.21.15.47:0/2950347315 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80ab650 con 0x7f7ec00ce310 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ebea00640 1 -- 172.21.15.47:0/2950347315 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea80b0070 con 0x7f7ec00ce310 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ebea00640 1 -- 172.21.15.47:0/2950347315 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80aba10 con 0x7f7ec00ce310 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ec6800640 1 -- 172.21.15.47:0/2950347315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 msgr2=0x7f7ec015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ec6800640 1 --2- 172.21.15.47:0/2950347315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec015cf60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8006fd0 tx=0x7f7ea801c540 comp rx=0 tx=0).stop 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ec6800640 1 -- 172.21.15.47:0/2950347315 shutdown_connections 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ec6800640 1 --2- 172.21.15.47:0/2950347315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec015cf60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ec6800640 1 -- 172.21.15.47:0/2950347315 >> 172.21.15.47:0/2950347315 conn(0x7f7ec006c800 msgr2=0x7f7ec006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ec6800640 1 -- 172.21.15.47:0/2950347315 shutdown_connections 2024-04-26T23:45:43.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.217+0000 7f7ec6800640 1 -- 172.21.15.47:0/2950347315 wait complete. 2024-04-26T23:45:43.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 Processor -- start 2024-04-26T23:45:43.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 -- start start 2024-04-26T23:45:43.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ec006fcd0 0x7f7ec01489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ec015c100 0x7f7ec0153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00cec00 con 0x7f7ec00ce310 2024-04-26T23:45:43.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec00b6000 con 0x7f7ec006fcd0 2024-04-26T23:45:43.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7ec00ced80 con 0x7f7ec015c100 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec009ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46868/0 (socket says 172.21.15.47:46868) 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 -- 172.21.15.47:0/3158008541 learned_addr learned my addr 172.21.15.47:0/3158008541 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ebf400640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ec006fcd0 0x7f7ec01489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ebfe00640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ec015c100 0x7f7ec0153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 -- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ec015c100 msgr2=0x7f7ec0153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ec015c100 0x7f7ec0153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 -- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ec006fcd0 msgr2=0x7f7ec01489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ec006fcd0 0x7f7ec01489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 -- 172.21.15.47:0/3158008541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec0152bd0 con 0x7f7ec00ce310 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ebf400640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ec006fcd0 0x7f7ec01489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ebfe00640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ec015c100 0x7f7ec0153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:43.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7e00640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec009ba60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ea801a170 tx=0x7f7ea80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7400640 1 -- 172.21.15.47:0/3158008541 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80059a0 con 0x7f7ec00ce310 2024-04-26T23:45:43.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7400640 1 -- 172.21.15.47:0/3158008541 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea8005b40 con 0x7f7ec00ce310 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec0155f10 con 0x7f7ec00ce310 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7eb7400640 1 -- 172.21.15.47:0/3158008541 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8006030 con 0x7f7ec00ce310 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec0155c30 con 0x7f7ec00ce310 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.221+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec0069700 con 0x7f7ec00ce310 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.225+0000 7f7eb7400640 1 -- 172.21.15.47:0/3158008541 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ea80061d0 con 0x7f7ec00ce310 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.225+0000 7f7eb7400640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e9c0683b0 0x7f7e9c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.225+0000 7f7eb7400640 1 -- 172.21.15.47:0/3158008541 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7ea8120fa0 con 0x7f7ec00ce310 2024-04-26T23:45:43.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.225+0000 7f7ebf400640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e9c0683b0 0x7f7e9c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.225+0000 7f7ebf400640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e9c0683b0 0x7f7e9c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0001650 tx=0x7f7eb0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.229+0000 7f7eb7400640 1 -- 172.21.15.47:0/3158008541 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7ea80c3030 con 0x7f7ec00ce310 2024-04-26T23:45:43.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.393+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ec00cdf10 con 0x7f7ec00ce310 2024-04-26T23:45:43.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7eb7400640 1 -- 172.21.15.47:0/3158008541 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f7ea8016130 con 0x7f7ec00ce310 2024-04-26T23:45:43.403 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:43.403 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e9c0683b0 msgr2=0x7f7e9c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e9c0683b0 0x7f7e9c06a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0001650 tx=0x7f7eb0009040 comp rx=0 tx=0).stop 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 msgr2=0x7f7ec009ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec009ba60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ea801a170 tx=0x7f7ea80192e0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 shutdown_connections 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e9c0683b0 0x7f7e9c06a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ec015c100 0x7f7ec0153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ec00ce310 0x7f7ec009ba60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 --2- 172.21.15.47:0/3158008541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ec006fcd0 0x7f7ec01489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 >> 172.21.15.47:0/3158008541 conn(0x7f7ec006c800 msgr2=0x7f7ec00af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:43.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 shutdown_connections 2024-04-26T23:45:43.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.397+0000 7f7ec6800640 1 -- 172.21.15.47:0/3158008541 wait complete. 2024-04-26T23:45:43.424 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:45:43.424 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:45:43.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51fdc00640 1 Processor -- start 2024-04-26T23:45:43.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51fdc00640 1 -- start start 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51fdc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f51f8162ab0 0x7f51f809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51fdc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51f809bfa0 0x7f51f8070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51fdc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51f809c3b0 con 0x7f51f80b56f0 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51fdc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f51f8071620 con 0x7f51f809bfa0 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51fdc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f51f8162e90 con 0x7f51f8162ab0 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51f809bfa0 0x7f51f8070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f6000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f51f80b56f0 0x7f51f80704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45462/0 (socket says 172.21.15.47:45462) 2024-04-26T23:45:43.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f51f809bfa0 0x7f51f8070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46880/0 (socket says 172.21.15.47:46880) 2024-04-26T23:45:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f6000640 1 -- 172.21.15.47:0/726618009 learned_addr learned my addr 172.21.15.47:0/726618009 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f6a00640 1 --2- 172.21.15.47:0/726618009 >> v2:172.21.15.203:3300/0 conn(0x7f51f8162ab0 0x7f51f809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f7400640 1 -- 172.21.15.47:0/726618009 >> v2:172.21.15.203:3300/0 conn(0x7f51f8162ab0 msgr2=0x7f51f809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f7400640 1 --2- 172.21.15.47:0/726618009 >> v2:172.21.15.203:3300/0 conn(0x7f51f8162ab0 0x7f51f809ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f7400640 1 -- 172.21.15.47:0/726618009 >> v1:172.21.15.47:6789/0 conn(0x7f51f80b56f0 legacy=0x7f51f80704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.561+0000 7f51f7400640 1 -- 172.21.15.47:0/726618009 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f80d2d40 con 0x7f51f809bfa0 2024-04-26T23:45:43.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51f7400640 1 --2- 172.21.15.47:0/726618009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f809bfa0 0x7f51f8070be0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51f8074ac0 tx=0x7f51f001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9519278f78864276 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51f5600640 1 -- 172.21.15.47:0/726618009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f00b2070 con 0x7f51f809bfa0 2024-04-26T23:45:43.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51f5600640 1 -- 172.21.15.47:0/726618009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f00a5850 con 0x7f51f809bfa0 2024-04-26T23:45:43.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51f5600640 1 -- 172.21.15.47:0/726618009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f00a5c20 con 0x7f51f809bfa0 2024-04-26T23:45:43.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 -- 172.21.15.47:0/726618009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f809bfa0 msgr2=0x7f51f8070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 --2- 172.21.15.47:0/726618009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f809bfa0 0x7f51f8070be0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f51f8074ac0 tx=0x7f51f001c8a0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 -- 172.21.15.47:0/726618009 shutdown_connections 2024-04-26T23:45:43.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 --2- 172.21.15.47:0/726618009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f809bfa0 0x7f51f8070be0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 --2- 172.21.15.47:0/726618009 >> v2:172.21.15.203:3300/0 conn(0x7f51f8162ab0 0x7f51f809ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 -- 172.21.15.47:0/726618009 >> 172.21.15.47:0/726618009 conn(0x7f51f80b4c00 msgr2=0x7f51f80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:43.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 -- 172.21.15.47:0/726618009 shutdown_connections 2024-04-26T23:45:43.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.565+0000 7f51fdc00640 1 -- 172.21.15.47:0/726618009 wait complete. 2024-04-26T23:45:43.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 Processor -- start 2024-04-26T23:45:43.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 -- start start 2024-04-26T23:45:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51f809bfa0 0x7f51f81595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f80b56f0 0x7f51f80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51f8162ab0 0x7f51f815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f51f80d2320 con 0x7f51f80b56f0 2024-04-26T23:45:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f51f80718e0 con 0x7f51f809bfa0 2024-04-26T23:45:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f51f80d24a0 con 0x7f51f8162ab0 2024-04-26T23:45:43.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f80b56f0 0x7f51f80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f80b56f0 0x7f51f80c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46884/0 (socket says 172.21.15.47:46884) 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 -- 172.21.15.47:0/2726287671 learned_addr learned my addr 172.21.15.47:0/2726287671 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6a00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51f809bfa0 0x7f51f81595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f7400640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51f8162ab0 0x7f51f815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 -- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51f8162ab0 msgr2=0x7f51f815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51f8162ab0 0x7f51f815dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 -- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51f809bfa0 msgr2=0x7f51f81595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51f809bfa0 0x7f51f81595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 -- 172.21.15.47:0/2726287671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f815a6c0 con 0x7f51f80b56f0 2024-04-26T23:45:43.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6a00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51f809bfa0 0x7f51f81595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:43.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51f6000640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f80b56f0 0x7f51f80c6c00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c340 tx=0x7f51e400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51eea00640 1 -- 172.21.15.47:0/2726287671 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e4017070 con 0x7f51f80b56f0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51eea00640 1 -- 172.21.15.47:0/2726287671 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e4005cf0 con 0x7f51f80b56f0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51eea00640 1 -- 172.21.15.47:0/2726287671 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e40072f0 con 0x7f51f80b56f0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f815a9a0 con 0x7f51f80b56f0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.569+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f8158de0 con 0x7f51f80b56f0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.573+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f8072130 con 0x7f51f80b56f0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.573+0000 7f51eea00640 1 -- 172.21.15.47:0/2726287671 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f51e401a070 con 0x7f51f80b56f0 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.573+0000 7f51eea00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f51d8068380 0x7f51d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.573+0000 7f51eea00640 1 -- 172.21.15.47:0/2726287671 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f51e4085c30 con 0x7f51f80b56f0 2024-04-26T23:45:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.573+0000 7f51f6a00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f51d8068380 0x7f51d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.573+0000 7f51f6a00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f51d8068380 0x7f51d806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009b10 tx=0x7f51e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.577+0000 7f51eea00640 1 -- 172.21.15.47:0/2726287671 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f51f809c3b0 con 0x7f51f80b56f0 2024-04-26T23:45:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f51f8069700 con 0x7f51f80b56f0 2024-04-26T23:45:43.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51eea00640 1 -- 172.21.15.47:0/2726287671 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f51e4056280 con 0x7f51f80b56f0 2024-04-26T23:45:43.747 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:45:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f51d8068380 msgr2=0x7f51d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f51d8068380 0x7f51d806a840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009b10 tx=0x7f51e8008040 comp rx=0 tx=0).stop 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f80b56f0 msgr2=0x7f51f80c6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f80b56f0 0x7f51f80c6c00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f51e400c340 tx=0x7f51e400c800 comp rx=0 tx=0).stop 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 shutdown_connections 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f51d8068380 0x7f51d806a840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f51f8162ab0 0x7f51f815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f51f80b56f0 0x7f51f80c6c00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 --2- 172.21.15.47:0/2726287671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51f809bfa0 0x7f51f81595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 >> 172.21.15.47:0/2726287671 conn(0x7f51f80b4c00 msgr2=0x7f51f80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 shutdown_connections 2024-04-26T23:45:43.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.741+0000 7f51fdc00640 1 -- 172.21.15.47:0/2726287671 wait complete. 2024-04-26T23:45:43.768 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:45:43.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2f800640 1 Processor -- start 2024-04-26T23:45:43.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2f800640 1 -- start start 2024-04-26T23:45:43.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2f800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fba2815cf50 0x7fba280cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2f800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba280d04b0 0x7fba2806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2f800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba2806cfe0 con 0x7fba2806cb70 2024-04-26T23:45:43.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2f800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fba280af7a0 con 0x7fba280d04b0 2024-04-26T23:45:43.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2f800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fba280ae030 con 0x7fba2815cf50 2024-04-26T23:45:43.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba27e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba280d04b0 0x7fba2806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba27e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba280d04b0 0x7fba2806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46898/0 (socket says 172.21.15.47:46898) 2024-04-26T23:45:43.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba27e00640 1 -- 172.21.15.47:0/2922081081 learned_addr learned my addr 172.21.15.47:0/2922081081 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:43.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba2ce00640 1 --2- 172.21.15.47:0/2922081081 >> v2:172.21.15.203:3300/0 conn(0x7fba2815cf50 0x7fba280cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba27e00640 1 -- 172.21.15.47:0/2922081081 >> v2:172.21.15.203:3300/0 conn(0x7fba2815cf50 msgr2=0x7fba280cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:43.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba27e00640 1 --2- 172.21.15.47:0/2922081081 >> v2:172.21.15.203:3300/0 conn(0x7fba2815cf50 0x7fba280cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba27e00640 1 -- 172.21.15.47:0/2922081081 >> v1:172.21.15.203:6789/0 conn(0x7fba2806cb70 legacy=0x7fba280720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:43.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.905+0000 7fba27e00640 1 -- 172.21.15.47:0/2922081081 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba280d0ae0 con 0x7fba280d04b0 2024-04-26T23:45:43.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba27e00640 1 --2- 172.21.15.47:0/2922081081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2806c630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba280738d0 tx=0x7fba1401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdc7235a62d120e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba27400640 1 -- 172.21.15.47:0/2922081081 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba140b0070 con 0x7fba280d04b0 2024-04-26T23:45:43.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba27400640 1 -- 172.21.15.47:0/2922081081 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba140ab600 con 0x7fba280d04b0 2024-04-26T23:45:43.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba27400640 1 -- 172.21.15.47:0/2922081081 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba140ab9d0 con 0x7fba280d04b0 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 -- 172.21.15.47:0/2922081081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 msgr2=0x7fba2806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 --2- 172.21.15.47:0/2922081081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2806c630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fba280738d0 tx=0x7fba1401c520 comp rx=0 tx=0).stop 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 -- 172.21.15.47:0/2922081081 shutdown_connections 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 --2- 172.21.15.47:0/2922081081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2806c630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 --2- 172.21.15.47:0/2922081081 >> v2:172.21.15.203:3300/0 conn(0x7fba2815cf50 0x7fba280cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 -- 172.21.15.47:0/2922081081 >> 172.21.15.47:0/2922081081 conn(0x7fba280b2b70 msgr2=0x7fba280b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 -- 172.21.15.47:0/2922081081 shutdown_connections 2024-04-26T23:45:43.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.909+0000 7fba2f800640 1 -- 172.21.15.47:0/2922081081 wait complete. 2024-04-26T23:45:43.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 Processor -- start 2024-04-26T23:45:43.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 -- start start 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba2806cb70 0x7fba28148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba2815cf50 0x7fba2815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fba280b3c40 con 0x7fba280d04b0 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba2815d330 con 0x7fba2815cf50 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fba280b3dc0 con 0x7fba2806cb70 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2815d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46906/0 (socket says 172.21.15.47:46906) 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 -- 172.21.15.47:0/237386023 learned_addr learned my addr 172.21.15.47:0/237386023 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2d800640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba2815cf50 0x7fba2815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2ce00640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba2806cb70 0x7fba28148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 -- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba2806cb70 msgr2=0x7fba28148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba2806cb70 0x7fba28148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 -- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba2815cf50 msgr2=0x7fba2815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:43.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba2815cf50 0x7fba2815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:43.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 -- 172.21.15.47:0/237386023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba281492a0 con 0x7fba280d04b0 2024-04-26T23:45:43.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba27e00640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2815d4b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba14019130 tx=0x7fba140192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba24c00640 1 -- 172.21.15.47:0/237386023 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba140b9070 con 0x7fba280d04b0 2024-04-26T23:45:43.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba24c00640 1 -- 172.21.15.47:0/237386023 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba140b4400 con 0x7fba280d04b0 2024-04-26T23:45:43.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba28149580 con 0x7fba280d04b0 2024-04-26T23:45:43.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba24c00640 1 -- 172.21.15.47:0/237386023 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba140b0040 con 0x7fba280d04b0 2024-04-26T23:45:43.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba28149b40 con 0x7fba280d04b0 2024-04-26T23:45:43.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.913+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba28069700 con 0x7fba280d04b0 2024-04-26T23:45:43.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.917+0000 7fba24c00640 1 -- 172.21.15.47:0/237386023 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fba140bc070 con 0x7fba280d04b0 2024-04-26T23:45:43.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.917+0000 7fba24c00640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba08068380 0x7fba0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:43.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.917+0000 7fba24c00640 1 -- 172.21.15.47:0/237386023 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fba1411f980 con 0x7fba280d04b0 2024-04-26T23:45:43.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.917+0000 7fba2ce00640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba08068380 0x7fba0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:43.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.917+0000 7fba2ce00640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba08068380 0x7fba0806a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00b930 tx=0x7fba1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:43.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:43.921+0000 7fba24c00640 1 -- 172.21.15.47:0/237386023 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fba14016110 con 0x7fba280d04b0 2024-04-26T23:45:44.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fba28073d50 con 0x7fba280d04b0 2024-04-26T23:45:44.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba24c00640 1 -- 172.21.15.47:0/237386023 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fba140ef8e0 con 0x7fba280d04b0 2024-04-26T23:45:44.092 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:45:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba08068380 msgr2=0x7fba0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba08068380 0x7fba0806a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00b930 tx=0x7fba1c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:44.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 msgr2=0x7fba2815d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2815d4b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba14019130 tx=0x7fba140192c0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 shutdown_connections 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fba08068380 0x7fba0806a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba2815cf50 0x7fba2815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba280d04b0 0x7fba2815d4b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 --2- 172.21.15.47:0/237386023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fba2806cb70 0x7fba28148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.085+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 >> 172.21.15.47:0/237386023 conn(0x7fba280b2b70 msgr2=0x7fba280720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.089+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 shutdown_connections 2024-04-26T23:45:44.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.089+0000 7fba2f800640 1 -- 172.21.15.47:0/237386023 wait complete. 2024-04-26T23:45:44.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:45:44.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.249+0000 7fe475a00640 1 Processor -- start 2024-04-26T23:45:44.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.249+0000 7fe475a00640 1 -- start start 2024-04-26T23:45:44.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe475a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe470160670 0x7fe47009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe475a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4700d1ea0 con 0x7fe470160a50 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe475a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe470071f90 con 0x7fe4700b2490 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe475a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe470070ee0 con 0x7fe470160670 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe46ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe470160670 0x7fe47009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe46ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe470160670 0x7fe47009ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46912/0 (socket says 172.21.15.47:46912) 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe46ea00640 1 -- 172.21.15.47:0/3965784928 learned_addr learned my addr 172.21.15.47:0/3965784928 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe467e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe470160a50 0x7fe4700d1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45468/0 (socket says 172.21.15.47:45468) 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe46ea00640 1 -- 172.21.15.47:0/3965784928 >> v1:172.21.15.203:6789/0 conn(0x7fe4700b2490 legacy=0x7fe4700d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe46ea00640 1 -- 172.21.15.47:0/3965784928 >> v1:172.21.15.47:6789/0 conn(0x7fe470160a50 legacy=0x7fe4700d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.253+0000 7fe46ea00640 1 -- 172.21.15.47:0/3965784928 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4700cebc0 con 0x7fe470160670 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe46ea00640 1 --2- 172.21.15.47:0/3965784928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470160670 0x7fe47009ba60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe470071060 tx=0x7fe46001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9134ae17ee554a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe46e000640 1 -- 172.21.15.47:0/3965784928 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4600b0070 con 0x7fe470160670 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe46e000640 1 -- 172.21.15.47:0/3965784928 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4600ab600 con 0x7fe470160670 2024-04-26T23:45:44.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe46e000640 1 -- 172.21.15.47:0/3965784928 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4600ab9d0 con 0x7fe470160670 2024-04-26T23:45:44.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- 172.21.15.47:0/3965784928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470160670 msgr2=0x7fe47009ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 --2- 172.21.15.47:0/3965784928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470160670 0x7fe47009ba60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe470071060 tx=0x7fe46001c3b0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- 172.21.15.47:0/3965784928 shutdown_connections 2024-04-26T23:45:44.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 --2- 172.21.15.47:0/3965784928 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe470160670 0x7fe47009ba60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- 172.21.15.47:0/3965784928 >> 172.21.15.47:0/3965784928 conn(0x7fe4700b4c00 msgr2=0x7fe4700b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:44.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- 172.21.15.47:0/3965784928 shutdown_connections 2024-04-26T23:45:44.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- 172.21.15.47:0/3965784928 wait complete. 2024-04-26T23:45:44.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 Processor -- start 2024-04-26T23:45:44.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- start start 2024-04-26T23:45:44.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4700b2490 0x7fe4700ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe470160670 0x7fe4700cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe470160a50 0x7fe470156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe4700717d0 con 0x7fe4700b2490 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe470071650 con 0x7fe470160a50 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.257+0000 7fe475a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe4700b56f0 con 0x7fe470160670 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4700b2490 0x7fe4700ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4700b2490 0x7fe4700ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46918/0 (socket says 172.21.15.47:46918) 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 -- 172.21.15.47:0/2074443665 learned_addr learned my addr 172.21.15.47:0/2074443665 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe467e00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe470160670 0x7fe4700cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46f400640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe470160a50 0x7fe470156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 -- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe470160670 msgr2=0x7fe4700cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe470160670 0x7fe4700cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 -- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe470160a50 msgr2=0x7fe470156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe470160a50 0x7fe470156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 -- 172.21.15.47:0/2074443665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4700cabf0 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46f400640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe470160a50 0x7fe470156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe46ea00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4700b2490 0x7fe4700ccda0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe4600ae040 tx=0x7fe46001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe466a00640 1 -- 172.21.15.47:0/2074443665 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4600ba020 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe466a00640 1 -- 172.21.15.47:0/2074443665 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4600b6640 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe466a00640 1 -- 172.21.15.47:0/2074443665 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4600b0040 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4700cc450 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4700cb150 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe470069700 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.261+0000 7fe466a00640 1 -- 172.21.15.47:0/2074443665 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4600bd020 con 0x7fe4700b2490 2024-04-26T23:45:44.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.265+0000 7fe466a00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe44c068380 0x7fe44c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.265+0000 7fe466a00640 1 -- 172.21.15.47:0/2074443665 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe460120c10 con 0x7fe4700b2490 2024-04-26T23:45:44.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.265+0000 7fe467e00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe44c068380 0x7fe44c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.265+0000 7fe467e00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe44c068380 0x7fe44c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4700c9890 tx=0x7fe458007cd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:44.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.269+0000 7fe466a00640 1 -- 172.21.15.47:0/2074443665 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe4600c4030 con 0x7fe4700b2490 2024-04-26T23:45:44.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe4700b8f90 con 0x7fe4700b2490 2024-04-26T23:45:44.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe466a00640 1 -- 172.21.15.47:0/2074443665 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fe4700cabf0 con 0x7fe4700b2490 2024-04-26T23:45:44.659 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe44c068380 msgr2=0x7fe44c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe44c068380 0x7fe44c06a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe4700c9890 tx=0x7fe458007cd0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4700b2490 msgr2=0x7fe4700ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4700b2490 0x7fe4700ccda0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe4600ae040 tx=0x7fe46001abf0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 shutdown_connections 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe44c068380 0x7fe44c06a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe470160a50 0x7fe470156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe470160670 0x7fe4700cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 --2- 172.21.15.47:0/2074443665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe4700b2490 0x7fe4700ccda0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 >> 172.21.15.47:0/2074443665 conn(0x7fe4700b4c00 msgr2=0x7fe47015afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:44.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 shutdown_connections 2024-04-26T23:45:44.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.433+0000 7fe475a00640 1 -- 172.21.15.47:0/2074443665 wait complete. 2024-04-26T23:45:44.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:44.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1983000640 1 Processor -- start 2024-04-26T23:45:44.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1983000640 1 -- start start 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1983000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f197c06f0a0 0x7f197c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1983000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f197c09ba60 0x7f197c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1983000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197c0d2340 con 0x7f197c0ce340 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1983000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0cd580 con 0x7f197c09ba60 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1983000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0cd860 con 0x7f197c06f0a0 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1973e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f197c09ba60 0x7f197c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1981000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f197c0ce340 0x7f197c0ce7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45480/0 (socket says 172.21.15.47:45480) 2024-04-26T23:45:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1981000640 1 -- 172.21.15.47:0/2160048103 learned_addr learned my addr 172.21.15.47:0/2160048103 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f197be00640 1 --2- 172.21.15.47:0/2160048103 >> v2:172.21.15.203:3300/0 conn(0x7f197c06f0a0 0x7f197c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1973e00640 1 -- 172.21.15.47:0/2160048103 >> v2:172.21.15.203:3300/0 conn(0x7f197c06f0a0 msgr2=0x7f197c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1973e00640 1 --2- 172.21.15.47:0/2160048103 >> v2:172.21.15.203:3300/0 conn(0x7f197c06f0a0 0x7f197c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1973e00640 1 -- 172.21.15.47:0/2160048103 >> v1:172.21.15.47:6789/0 conn(0x7f197c0ce340 legacy=0x7f197c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f1973e00640 1 -- 172.21.15.47:0/2160048103 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c0cdb40 con 0x7f197c09ba60 2024-04-26T23:45:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.797+0000 7f197b400640 1 -- 172.21.15.47:0/2160048103 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862671378 0 0) 0x7f197c0d2340 con 0x7f197c0ce340 2024-04-26T23:45:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1973e00640 1 --2- 172.21.15.47:0/2160048103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c09bee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f197c0732e0 tx=0x7f196401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b88d916bce2062 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f197b400640 1 -- 172.21.15.47:0/2160048103 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0070 con 0x7f197c09ba60 2024-04-26T23:45:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f197b400640 1 -- 172.21.15.47:0/2160048103 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19640ab600 con 0x7f197c09ba60 2024-04-26T23:45:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f197b400640 1 -- 172.21.15.47:0/2160048103 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640ab9d0 con 0x7f197c09ba60 2024-04-26T23:45:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 -- 172.21.15.47:0/2160048103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 msgr2=0x7f197c09bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 --2- 172.21.15.47:0/2160048103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c09bee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f197c0732e0 tx=0x7f196401c480 comp rx=0 tx=0).stop 2024-04-26T23:45:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 -- 172.21.15.47:0/2160048103 shutdown_connections 2024-04-26T23:45:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 --2- 172.21.15.47:0/2160048103 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c09bee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 --2- 172.21.15.47:0/2160048103 >> v2:172.21.15.203:3300/0 conn(0x7f197c06f0a0 0x7f197c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 -- 172.21.15.47:0/2160048103 >> 172.21.15.47:0/2160048103 conn(0x7f197c0d2e90 msgr2=0x7f197c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 -- 172.21.15.47:0/2160048103 shutdown_connections 2024-04-26T23:45:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.801+0000 7f1983000640 1 -- 172.21.15.47:0/2160048103 wait complete. 2024-04-26T23:45:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 Processor -- start 2024-04-26T23:45:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 -- start start 2024-04-26T23:45:44.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197c06f0a0 0x7f197c148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f197c0ce340 0x7f197c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f197c0d2120 con 0x7f197c09ba60 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f197c0d1fa0 con 0x7f197c0ce340 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f197c06d510 con 0x7f197c06f0a0 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c0b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46936/0 (socket says 172.21.15.47:46936) 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 -- 172.21.15.47:0/2819376907 learned_addr learned my addr 172.21.15.47:0/2819376907 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1981000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f197c0ce340 0x7f197c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f197be00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197c06f0a0 0x7f197c148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 -- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197c06f0a0 msgr2=0x7f197c148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197c06f0a0 0x7f197c148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 -- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f197c0ce340 msgr2=0x7f197c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f197c0ce340 0x7f197c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 -- 172.21.15.47:0/2819376907 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c156170 con 0x7f197c09ba60 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1981000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f197c0ce340 0x7f197c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f197be00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197c06f0a0 0x7f197c148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1973e00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c0b1c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19640ae040 tx=0x7f196401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1978c00640 1 -- 172.21.15.47:0/2819376907 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b0050 con 0x7f197c09ba60 2024-04-26T23:45:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1978c00640 1 -- 172.21.15.47:0/2819376907 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19640bc070 con 0x7f197c09ba60 2024-04-26T23:45:44.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1978c00640 1 -- 172.21.15.47:0/2819376907 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19640b5870 con 0x7f197c09ba60 2024-04-26T23:45:44.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c156450 con 0x7f197c09ba60 2024-04-26T23:45:44.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.805+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c156a10 con 0x7f197c09ba60 2024-04-26T23:45:44.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.809+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197c069700 con 0x7f197c09ba60 2024-04-26T23:45:44.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.809+0000 7f1978c00640 1 -- 172.21.15.47:0/2819376907 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19640b5a10 con 0x7f197c09ba60 2024-04-26T23:45:44.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.809+0000 7f1978c00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1958068380 0x7f195806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:44.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.809+0000 7f1978c00640 1 -- 172.21.15.47:0/2819376907 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1964121250 con 0x7f197c09ba60 2024-04-26T23:45:44.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.809+0000 7f197be00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1958068380 0x7f195806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:44.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.809+0000 7f197be00640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1958068380 0x7f195806a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f197c15c7c0 tx=0x7f196c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:44.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:44.813+0000 7f1978c00640 1 -- 172.21.15.47:0/2819376907 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1964016070 con 0x7f197c09ba60 2024-04-26T23:45:45.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.009+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f197c0c9d00 con 0x7f197c09ba60 2024-04-26T23:45:45.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1978c00640 1 -- 172.21.15.47:0/2819376907 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f19640f1800 con 0x7f197c09ba60 2024-04-26T23:45:45.019 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:45.019 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:45:45.019 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:45:45.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1958068380 msgr2=0x7f195806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1958068380 0x7f195806a840 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f197c15c7c0 tx=0x7f196c008040 comp rx=0 tx=0).stop 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 msgr2=0x7f197c0b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c0b1c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f19640ae040 tx=0x7f196401acc0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 shutdown_connections 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1958068380 0x7f195806a840 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f197c0ce340 0x7f197c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f197c09ba60 0x7f197c0b1c10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 --2- 172.21.15.47:0/2819376907 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f197c06f0a0 0x7f197c148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 >> 172.21.15.47:0/2819376907 conn(0x7f197c0d2e90 msgr2=0x7f197c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 shutdown_connections 2024-04-26T23:45:45.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.013+0000 7f1983000640 1 -- 172.21.15.47:0/2819376907 wait complete. 2024-04-26T23:45:45.040 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:45.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d8800640 1 Processor -- start 2024-04-26T23:45:45.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d8800640 1 -- start start 2024-04-26T23:45:45.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d8800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd8d0160810 0x7fd8d0071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d8800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd8d0072150 0x7fd8d00d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d8800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d00cd830 con 0x7fd8d00d1690 2024-04-26T23:45:45.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d8800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d0071080 con 0x7fd8d0160810 2024-04-26T23:45:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d8800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d0071360 con 0x7fd8d0072150 2024-04-26T23:45:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd8d0160810 0x7fd8d0071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd8d0160810 0x7fd8d0071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46948/0 (socket says 172.21.15.47:46948) 2024-04-26T23:45:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5e00640 1 -- 172.21.15.47:0/1240214119 learned_addr learned my addr 172.21.15.47:0/1240214119 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5400640 1 --2- 172.21.15.47:0/1240214119 >> v2:172.21.15.203:3300/0 conn(0x7fd8d0072150 0x7fd8d00d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5e00640 1 -- 172.21.15.47:0/1240214119 >> v2:172.21.15.203:3300/0 conn(0x7fd8d0072150 msgr2=0x7fd8d00d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5e00640 1 --2- 172.21.15.47:0/1240214119 >> v2:172.21.15.203:3300/0 conn(0x7fd8d0072150 0x7fd8d00d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5e00640 1 -- 172.21.15.47:0/1240214119 >> v1:172.21.15.203:6789/0 conn(0x7fd8d00d1690 legacy=0x7fd8d009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5e00640 1 -- 172.21.15.47:0/1240214119 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d00cdad0 con 0x7fd8d0160810 2024-04-26T23:45:45.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.173+0000 7fd8d5400640 1 --2- 172.21.15.47:0/1240214119 >> v2:172.21.15.203:3300/0 conn(0x7fd8d0072150 0x7fd8d00d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:45.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d5e00640 1 --2- 172.21.15.47:0/1240214119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d0160810 0x7fd8d0071760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00a1090 tx=0x7fd8c401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9635685b3fd96292 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d4a00640 1 -- 172.21.15.47:0/1240214119 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40b5070 con 0x7fd8d0160810 2024-04-26T23:45:45.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d4a00640 1 -- 172.21.15.47:0/1240214119 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c40a8a10 con 0x7fd8d0160810 2024-04-26T23:45:45.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d4a00640 1 -- 172.21.15.47:0/1240214119 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c40a8de0 con 0x7fd8d0160810 2024-04-26T23:45:45.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 -- 172.21.15.47:0/1240214119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d0160810 msgr2=0x7fd8d0071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 --2- 172.21.15.47:0/1240214119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d0160810 0x7fd8d0071760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8d00a1090 tx=0x7fd8c401ed10 comp rx=0 tx=0).stop 2024-04-26T23:45:45.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 -- 172.21.15.47:0/1240214119 shutdown_connections 2024-04-26T23:45:45.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 --2- 172.21.15.47:0/1240214119 >> v2:172.21.15.203:3300/0 conn(0x7fd8d0072150 0x7fd8d00d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 --2- 172.21.15.47:0/1240214119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d0160810 0x7fd8d0071760 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 -- 172.21.15.47:0/1240214119 >> 172.21.15.47:0/1240214119 conn(0x7fd8d00d2e90 msgr2=0x7fd8d00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:45.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 -- 172.21.15.47:0/1240214119 shutdown_connections 2024-04-26T23:45:45.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.177+0000 7fd8d8800640 1 -- 172.21.15.47:0/1240214119 wait complete. 2024-04-26T23:45:45.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 Processor -- start 2024-04-26T23:45:45.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 -- start start 2024-04-26T23:45:45.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8d0072150 0x7fd8d01534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d00d1690 0x7fd8d00c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8d0160810 0x7fd8d006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d0160bf0 con 0x7fd8d00d1690 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d0071ca0 con 0x7fd8d0072150 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d0160d70 con 0x7fd8d0160810 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d00d1690 0x7fd8d00c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d00d1690 0x7fd8d00c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46958/0 (socket says 172.21.15.47:46958) 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 -- 172.21.15.47:0/3149528806 learned_addr learned my addr 172.21.15.47:0/3149528806 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5e00640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8d0072150 0x7fd8d01534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d6800640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8d0160810 0x7fd8d006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 -- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8d0160810 msgr2=0x7fd8d006ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8d0160810 0x7fd8d006ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 -- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8d0072150 msgr2=0x7fd8d01534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8d0072150 0x7fd8d01534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 -- 172.21.15.47:0/3149528806 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d00c7800 con 0x7fd8d00d1690 2024-04-26T23:45:45.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5e00640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8d0072150 0x7fd8d01534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:45.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d5400640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d00d1690 0x7fd8d00c8860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000d800 tx=0x7fd8c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8ca000640 1 -- 172.21.15.47:0/3149528806 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000b6c0 con 0x7fd8d00d1690 2024-04-26T23:45:45.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8ca000640 1 -- 172.21.15.47:0/3149528806 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c0019070 con 0x7fd8d00d1690 2024-04-26T23:45:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8ca000640 1 -- 172.21.15.47:0/3149528806 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000baa0 con 0x7fd8d00d1690 2024-04-26T23:45:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d00c7aa0 con 0x7fd8d00d1690 2024-04-26T23:45:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.181+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d00c8060 con 0x7fd8d00d1690 2024-04-26T23:45:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.185+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d0069700 con 0x7fd8d00d1690 2024-04-26T23:45:45.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.185+0000 7fd8ca000640 1 -- 172.21.15.47:0/3149528806 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd8c000bc40 con 0x7fd8d00d1690 2024-04-26T23:45:45.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.185+0000 7fd8ca000640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd8b4068380 0x7fd8b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.185+0000 7fd8ca000640 1 -- 172.21.15.47:0/3149528806 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd8c0086d50 con 0x7fd8d00d1690 2024-04-26T23:45:45.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.185+0000 7fd8d5e00640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd8b4068380 0x7fd8b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.185+0000 7fd8d5e00640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd8b4068380 0x7fd8b406a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40b2000 tx=0x7fd8c4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.189+0000 7fd8ca000640 1 -- 172.21.15.47:0/3149528806 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd8c008a030 con 0x7fd8d00d1690 2024-04-26T23:45:45.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.357+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8d015b170 con 0x7fd8d00d1690 2024-04-26T23:45:45.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.357+0000 7fd8ca000640 1 -- 172.21.15.47:0/3149528806 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fd8c00573a0 con 0x7fd8d00d1690 2024-04-26T23:45:45.365 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:45.365 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd8b4068380 msgr2=0x7fd8b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd8b4068380 0x7fd8b406a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40b2000 tx=0x7fd8c4008040 comp rx=0 tx=0).stop 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d00d1690 msgr2=0x7fd8d00c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d00d1690 0x7fd8d00c8860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000d800 tx=0x7fd8c000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 shutdown_connections 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd8b4068380 0x7fd8b406a840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd8d0160810 0x7fd8d006ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd8d00d1690 0x7fd8d00c8860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 --2- 172.21.15.47:0/3149528806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd8d0072150 0x7fd8d01534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 >> 172.21.15.47:0/3149528806 conn(0x7fd8d00d2e90 msgr2=0x7fd8d00b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 shutdown_connections 2024-04-26T23:45:45.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.361+0000 7fd8d8800640 1 -- 172.21.15.47:0/3149528806 wait complete. 2024-04-26T23:45:45.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:45:45.387 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:45:45.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.521+0000 7f5912c00640 1 Processor -- start 2024-04-26T23:45:45.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.521+0000 7f5912c00640 1 -- start start 2024-04-26T23:45:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5912c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f590c06c660 0x7f590c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5912c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590c0b0bf0 con 0x7f590c06ca40 2024-04-26T23:45:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5912c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590c0b0e90 con 0x7f590c1601b0 2024-04-26T23:45:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5912c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f590c160640 con 0x7f590c06c660 2024-04-26T23:45:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5911800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f590c06c660 0x7f590c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5911800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f590c06c660 0x7f590c0b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46970/0 (socket says 172.21.15.47:46970) 2024-04-26T23:45:45.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5911800640 1 -- 172.21.15.47:0/2583575963 learned_addr learned my addr 172.21.15.47:0/2583575963 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5911800640 1 -- 172.21.15.47:0/2583575963 >> v1:172.21.15.203:6789/0 conn(0x7f590c1601b0 legacy=0x7f590c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5911800640 1 -- 172.21.15.47:0/2583575963 >> v1:172.21.15.47:6789/0 conn(0x7f590c06ca40 legacy=0x7f590c15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f590be00640 1 -- 172.21.15.47:0/2583575963 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3914796454 0 0) 0x7f590c0b0bf0 con 0x7f590c06ca40 2024-04-26T23:45:45.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.525+0000 7f5911800640 1 -- 172.21.15.47:0/2583575963 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c0b1170 con 0x7f590c06c660 2024-04-26T23:45:45.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5911800640 1 --2- 172.21.15.47:0/2583575963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06c660 0x7f590c0b4c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5900009870 tx=0x7f590001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d341c9d5bb5a01b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f590be00640 1 -- 172.21.15.47:0/2583575963 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59000b0070 con 0x7f590c06c660 2024-04-26T23:45:45.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f590be00640 1 -- 172.21.15.47:0/2583575963 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59000ab600 con 0x7f590c06c660 2024-04-26T23:45:45.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f590be00640 1 -- 172.21.15.47:0/2583575963 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59000ab9d0 con 0x7f590c06c660 2024-04-26T23:45:45.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- 172.21.15.47:0/2583575963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06c660 msgr2=0x7f590c0b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 --2- 172.21.15.47:0/2583575963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06c660 0x7f590c0b4c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5900009870 tx=0x7f590001c520 comp rx=0 tx=0).stop 2024-04-26T23:45:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- 172.21.15.47:0/2583575963 shutdown_connections 2024-04-26T23:45:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 --2- 172.21.15.47:0/2583575963 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06c660 0x7f590c0b4c50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- 172.21.15.47:0/2583575963 >> 172.21.15.47:0/2583575963 conn(0x7f590c06d510 msgr2=0x7f590c06d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- 172.21.15.47:0/2583575963 shutdown_connections 2024-04-26T23:45:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- 172.21.15.47:0/2583575963 wait complete. 2024-04-26T23:45:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 Processor -- start 2024-04-26T23:45:45.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- start start 2024-04-26T23:45:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f590c06c660 0x7f590c14e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06ca40 0x7f590c140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f590c1601b0 0x7f590c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f590c070e60 con 0x7f590c06ca40 2024-04-26T23:45:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f590c070ce0 con 0x7f590c1601b0 2024-04-26T23:45:45.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.529+0000 7f5912c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f590c0b5190 con 0x7f590c06c660 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06ca40 0x7f590c140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06ca40 0x7f590c140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46978/0 (socket says 172.21.15.47:46978) 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 -- 172.21.15.47:0/4065434941 learned_addr learned my addr 172.21.15.47:0/4065434941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5911800640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f590c06c660 0x7f590c14e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5912200640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f590c1601b0 0x7f590c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 -- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f590c06c660 msgr2=0x7f590c14e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f590c06c660 0x7f590c14e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 -- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f590c1601b0 msgr2=0x7f590c157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f590c1601b0 0x7f590c157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 -- 172.21.15.47:0/4065434941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c153080 con 0x7f590c06ca40 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5910e00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06ca40 0x7f590c140520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c520 tx=0x7f58f800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5909600640 1 -- 172.21.15.47:0/4065434941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8017070 con 0x7f590c06ca40 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5909600640 1 -- 172.21.15.47:0/4065434941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f80052d0 con 0x7f590c06ca40 2024-04-26T23:45:45.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f590c153360 con 0x7f590c06ca40 2024-04-26T23:45:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5909600640 1 -- 172.21.15.47:0/4065434941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8012870 con 0x7f590c06ca40 2024-04-26T23:45:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f590c153920 con 0x7f590c06ca40 2024-04-26T23:45:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590c069470 con 0x7f590c06ca40 2024-04-26T23:45:45.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5909600640 1 -- 172.21.15.47:0/4065434941 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58f801a070 con 0x7f590c06ca40 2024-04-26T23:45:45.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5909600640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58ec068380 0x7f58ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.533+0000 7f5909600640 1 -- 172.21.15.47:0/4065434941 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f58f8085db0 con 0x7f590c06ca40 2024-04-26T23:45:45.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.537+0000 7f5911800640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58ec068380 0x7f58ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.537+0000 7f5911800640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58ec068380 0x7f58ec06a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59000ad000 tx=0x7f59000a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.537+0000 7f5909600640 1 -- 172.21.15.47:0/4065434941 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f58f808a070 con 0x7f590c06ca40 2024-04-26T23:45:45.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.701+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f590c163ae0 con 0x7f590c06ca40 2024-04-26T23:45:45.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.701+0000 7f5909600640 1 -- 172.21.15.47:0/4065434941 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f58f8005480 con 0x7f590c06ca40 2024-04-26T23:45:45.710 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58ec068380 msgr2=0x7f58ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58ec068380 0x7f58ec06a840 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f59000ad000 tx=0x7f59000a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06ca40 msgr2=0x7f590c140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06ca40 0x7f590c140520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c520 tx=0x7f58f800c9e0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 shutdown_connections 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58ec068380 0x7f58ec06a840 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f590c1601b0 0x7f590c157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f590c06ca40 0x7f590c140520 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 --2- 172.21.15.47:0/4065434941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f590c06c660 0x7f590c14e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 >> 172.21.15.47:0/4065434941 conn(0x7f590c06d510 msgr2=0x7f590c06d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:45.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 shutdown_connections 2024-04-26T23:45:45.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.705+0000 7f5912c00640 1 -- 172.21.15.47:0/4065434941 wait complete. 2024-04-26T23:45:45.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:45:45.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff36d200640 1 Processor -- start 2024-04-26T23:45:45.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff36d200640 1 -- start start 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff36d200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff368160670 0x7ff36809ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff36d200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff368160a50 0x7ff36809bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff36d200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff368071f90 con 0x7ff3680b2490 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff36d200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff368070ee0 con 0x7ff368160670 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff36d200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff3680cebc0 con 0x7ff368160a50 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff365e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff368160670 0x7ff36809ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff365e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff368160670 0x7ff36809ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46992/0 (socket says 172.21.15.47:46992) 2024-04-26T23:45:45.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff365e00640 1 -- 172.21.15.47:0/3482956111 learned_addr learned my addr 172.21.15.47:0/3482956111 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:45.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff35d400640 1 --2- 172.21.15.47:0/3482956111 >> v2:172.21.15.203:3300/0 conn(0x7ff368160a50 0x7ff36809bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff365e00640 1 -- 172.21.15.47:0/3482956111 >> v2:172.21.15.203:3300/0 conn(0x7ff368160a50 msgr2=0x7ff36809bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:45.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff365e00640 1 --2- 172.21.15.47:0/3482956111 >> v2:172.21.15.203:3300/0 conn(0x7ff368160a50 0x7ff36809bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff365e00640 1 -- 172.21.15.47:0/3482956111 >> v1:172.21.15.203:6789/0 conn(0x7ff3680b2490 legacy=0x7ff3680d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:45.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.869+0000 7ff365e00640 1 -- 172.21.15.47:0/3482956111 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff368072230 con 0x7ff368160670 2024-04-26T23:45:45.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff365e00640 1 --2- 172.21.15.47:0/3482956111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368160670 0x7ff36809ba60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff368076850 tx=0x7ff35801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8885f0fb010a7123 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff365400640 1 -- 172.21.15.47:0/3482956111 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580b0070 con 0x7ff368160670 2024-04-26T23:45:45.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff365400640 1 -- 172.21.15.47:0/3482956111 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3580ab600 con 0x7ff368160670 2024-04-26T23:45:45.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff365400640 1 -- 172.21.15.47:0/3482956111 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580ab9d0 con 0x7ff368160670 2024-04-26T23:45:45.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 -- 172.21.15.47:0/3482956111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368160670 msgr2=0x7ff36809ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 --2- 172.21.15.47:0/3482956111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368160670 0x7ff36809ba60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff368076850 tx=0x7ff35801c370 comp rx=0 tx=0).stop 2024-04-26T23:45:45.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 -- 172.21.15.47:0/3482956111 shutdown_connections 2024-04-26T23:45:45.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 --2- 172.21.15.47:0/3482956111 >> v2:172.21.15.203:3300/0 conn(0x7ff368160a50 0x7ff36809bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 --2- 172.21.15.47:0/3482956111 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff368160670 0x7ff36809ba60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 -- 172.21.15.47:0/3482956111 >> 172.21.15.47:0/3482956111 conn(0x7ff3680b4c00 msgr2=0x7ff3680b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:45.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 -- 172.21.15.47:0/3482956111 shutdown_connections 2024-04-26T23:45:45.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.873+0000 7ff36d200640 1 -- 172.21.15.47:0/3482956111 wait complete. 2024-04-26T23:45:45.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 Processor -- start 2024-04-26T23:45:45.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 -- start start 2024-04-26T23:45:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3680b2490 0x7ff368157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff368160670 0x7ff36815ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff368160a50 0x7ff368159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff3680b5870 con 0x7ff3680b2490 2024-04-26T23:45:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3680b56f0 con 0x7ff368160a50 2024-04-26T23:45:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff3680719a0 con 0x7ff368160670 2024-04-26T23:45:45.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3680b2490 0x7ff368157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3680b2490 0x7ff368157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:46998/0 (socket says 172.21.15.47:46998) 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 -- 172.21.15.47:0/2906897770 learned_addr learned my addr 172.21.15.47:0/2906897770 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff35d400640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff368160670 0x7ff36815ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff366800640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff368160a50 0x7ff368159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 -- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff368160670 msgr2=0x7ff36815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff368160670 0x7ff36815ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 -- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff368160a50 msgr2=0x7ff368159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff368160a50 0x7ff368159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 -- 172.21.15.47:0/2906897770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3680c7080 con 0x7ff3680b2490 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff35d400640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff368160670 0x7ff36815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff366800640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff368160a50 0x7ff368159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:45.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff365e00640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3680b2490 0x7ff368157070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff3580ae040 tx=0x7ff358019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff35ea00640 1 -- 172.21.15.47:0/2906897770 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580b0040 con 0x7ff3680b2490 2024-04-26T23:45:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff35ea00640 1 -- 172.21.15.47:0/2906897770 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3580b9070 con 0x7ff3680b2490 2024-04-26T23:45:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3680c7360 con 0x7ff3680b2490 2024-04-26T23:45:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff35ea00640 1 -- 172.21.15.47:0/2906897770 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580b4680 con 0x7ff3680b2490 2024-04-26T23:45:45.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3680c7920 con 0x7ff3680b2490 2024-04-26T23:45:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.877+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff368069700 con 0x7ff3680b2490 2024-04-26T23:45:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.881+0000 7ff35ea00640 1 -- 172.21.15.47:0/2906897770 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3580b4820 con 0x7ff3680b2490 2024-04-26T23:45:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.881+0000 7ff35ea00640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff344068380 0x7ff34406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.881+0000 7ff35ea00640 1 -- 172.21.15.47:0/2906897770 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff358120700 con 0x7ff3680b2490 2024-04-26T23:45:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.881+0000 7ff35d400640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff344068380 0x7ff34406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:45.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.881+0000 7ff35d400640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff344068380 0x7ff34406a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff350003fd0 tx=0x7ff3500039e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:45.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:45.885+0000 7ff35ea00640 1 -- 172.21.15.47:0/2906897770 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff3580160b0 con 0x7ff3680b2490 2024-04-26T23:45:46.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.049+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff3680b8f90 con 0x7ff3680b2490 2024-04-26T23:45:46.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.049+0000 7ff35ea00640 1 -- 172.21.15.47:0/2906897770 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7ff3580f0c20 con 0x7ff3680b2490 2024-04-26T23:45:46.057 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:45:46.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff344068380 msgr2=0x7ff34406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff344068380 0x7ff34406a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff350003fd0 tx=0x7ff3500039e0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3680b2490 msgr2=0x7ff368157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3680b2490 0x7ff368157070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff3580ae040 tx=0x7ff358019110 comp rx=0 tx=0).stop 2024-04-26T23:45:46.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 shutdown_connections 2024-04-26T23:45:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff344068380 0x7ff34406a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff368160a50 0x7ff368159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff368160670 0x7ff36815ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 --2- 172.21.15.47:0/2906897770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff3680b2490 0x7ff368157070 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 >> 172.21.15.47:0/2906897770 conn(0x7ff3680b4c00 msgr2=0x7ff36815d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 shutdown_connections 2024-04-26T23:45:46.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.053+0000 7ff36d200640 1 -- 172.21.15.47:0/2906897770 wait complete. 2024-04-26T23:45:46.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:45:46.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.213+0000 7f6e0b600640 1 Processor -- start 2024-04-26T23:45:46.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.213+0000 7f6e0b600640 1 -- start start 2024-04-26T23:45:46.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e0b600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6e040af6e0 0x7f6e041603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e0b600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e040ae6a0 con 0x7f6e0406cd40 2024-04-26T23:45:46.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e0b600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e040ae920 con 0x7f6e040d0390 2024-04-26T23:45:46.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e0b600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6e040aec00 con 0x7f6e040af6e0 2024-04-26T23:45:46.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6e0406cd40 0x7f6e0415fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45488/0 (socket says 172.21.15.47:45488) 2024-04-26T23:45:46.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03e00640 1 -- 172.21.15.47:0/508362017 learned_addr learned my addr 172.21.15.47:0/508362017 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:46.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858311270 0 0) 0x7f6df0001120 con 0x7f6e0406cd40 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dec003530 con 0x7f6e0406cd40 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e09600640 1 --2- 172.21.15.47:0/508362017 >> v2:172.21.15.203:3300/0 conn(0x7f6e040af6e0 0x7f6e041603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3994164259 0 0) 0x7f6dec003530 con 0x7f6e0406cd40 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 >> v2:172.21.15.203:3300/0 conn(0x7f6e040af6e0 msgr2=0x7f6e041603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 --2- 172.21.15.47:0/508362017 >> v2:172.21.15.203:3300/0 conn(0x7f6e040af6e0 0x7f6e041603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 >> v1:172.21.15.203:6789/0 conn(0x7f6e040d0390 legacy=0x7f6e0406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e040aeee0 con 0x7f6e0406cd40 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f6df0001850 con 0x7f6e0406cd40 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 >> v1:172.21.15.47:6789/0 conn(0x7f6e0406cd40 legacy=0x7f6e0415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dec0039c0 0x7f6dec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6dec004810 0x7f6dec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0053d0 0x7f6dec00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6e040aec00 con 0x7f6dec0039c0 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec00e480 con 0x7f6dec0053d0 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6dec00e680 con 0x7f6dec004810 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e09600640 1 --2- 172.21.15.47:0/508362017 >> v2:172.21.15.203:3300/0 conn(0x7f6e040af6e0 0x7f6e041603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e08c00640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dec0039c0 0x7f6dec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e03e00640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6dec004810 0x7f6dec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e09600640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0053d0 0x7f6dec00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e08c00640 1 -- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6dec004810 msgr2=0x7f6dec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e08c00640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6dec004810 0x7f6dec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e08c00640 1 -- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0053d0 msgr2=0x7f6dec00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e08c00640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0053d0 0x7f6dec00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e08c00640 1 -- 172.21.15.47:0/508362017 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec003530 con 0x7f6dec0039c0 2024-04-26T23:45:46.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.217+0000 7f6e09600640 1 -- 172.21.15.47:0/508362017 reap_dead start 2024-04-26T23:45:46.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e08c00640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dec0039c0 0x7f6dec003dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6df8003db0 tx=0x7f6df801c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3b7e0626b34222 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df80b0070 con 0x7f6dec0039c0 2024-04-26T23:45:46.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df80ab620 con 0x7f6dec0039c0 2024-04-26T23:45:46.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e03400640 1 -- 172.21.15.47:0/508362017 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df80039b0 con 0x7f6dec0039c0 2024-04-26T23:45:46.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e0b600640 1 -- 172.21.15.47:0/508362017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dec0039c0 msgr2=0x7f6dec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e0b600640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dec0039c0 0x7f6dec003dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6df8003db0 tx=0x7f6df801c2d0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e0b600640 1 -- 172.21.15.47:0/508362017 shutdown_connections 2024-04-26T23:45:46.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e0b600640 1 --2- 172.21.15.47:0/508362017 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6dec0039c0 0x7f6dec003dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e0b600640 1 -- 172.21.15.47:0/508362017 >> 172.21.15.47:0/508362017 conn(0x7f6e040b2b70 msgr2=0x7f6e040b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e0b600640 1 -- 172.21.15.47:0/508362017 shutdown_connections 2024-04-26T23:45:46.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.221+0000 7f6e0b600640 1 -- 172.21.15.47:0/508362017 wait complete. 2024-04-26T23:45:46.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 Processor -- start 2024-04-26T23:45:46.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 -- start start 2024-04-26T23:45:46.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0039c0 0x7f6e0414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e040cdfe0 0x7f6e040ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6e041580b0 0x7f6e04158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6e04160660 con 0x7f6e040cdfe0 2024-04-26T23:45:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6e041604e0 con 0x7f6dec0039c0 2024-04-26T23:45:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6e041607e0 con 0x7f6e041580b0 2024-04-26T23:45:46.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e040cdfe0 0x7f6e040ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e08c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0039c0 0x7f6e0414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e09600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6e041580b0 0x7f6e04158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e040cdfe0 0x7f6e040ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47008/0 (socket says 172.21.15.47:47008) 2024-04-26T23:45:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 -- 172.21.15.47:0/1445251220 learned_addr learned my addr 172.21.15.47:0/1445251220 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 -- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6e041580b0 msgr2=0x7f6e04158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6e041580b0 0x7f6e04158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 -- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0039c0 msgr2=0x7f6e0414f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0039c0 0x7f6e0414f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 -- 172.21.15.47:0/1445251220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e040ce5a0 con 0x7f6e040cdfe0 2024-04-26T23:45:46.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e03e00640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e040cdfe0 0x7f6e040ca9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6df0005ef0 tx=0x7f6df0007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e00c00640 1 -- 172.21.15.47:0/1445251220 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df000e740 con 0x7f6e040cdfe0 2024-04-26T23:45:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e00c00640 1 -- 172.21.15.47:0/1445251220 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6df0018070 con 0x7f6e040cdfe0 2024-04-26T23:45:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e00c00640 1 -- 172.21.15.47:0/1445251220 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df000eb20 con 0x7f6e040cdfe0 2024-04-26T23:45:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e040ce880 con 0x7f6e040cdfe0 2024-04-26T23:45:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.225+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e040cee40 con 0x7f6e040cdfe0 2024-04-26T23:45:46.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.229+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e04069700 con 0x7f6e040cdfe0 2024-04-26T23:45:46.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.229+0000 7f6e00c00640 1 -- 172.21.15.47:0/1445251220 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6df000ecc0 con 0x7f6e040cdfe0 2024-04-26T23:45:46.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.229+0000 7f6e00c00640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6de40683b0 0x7f6de406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.229+0000 7f6e00c00640 1 -- 172.21.15.47:0/1445251220 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6df0086320 con 0x7f6e040cdfe0 2024-04-26T23:45:46.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.229+0000 7f6e08c00640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6de40683b0 0x7f6de406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.229+0000 7f6e08c00640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6de40683b0 0x7f6de406a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6df80ad000 tx=0x7f6df8003770 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.233+0000 7f6e00c00640 1 -- 172.21.15.47:0/1445251220 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6e040ae6a0 con 0x7f6e040cdfe0 2024-04-26T23:45:46.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.397+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e0406ecb0 con 0x7f6e040cdfe0 2024-04-26T23:45:46.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.397+0000 7f6e00c00640 1 -- 172.21.15.47:0/1445251220 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f6df00561f0 con 0x7f6e040cdfe0 2024-04-26T23:45:46.404 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:45:46.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.397+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6de40683b0 msgr2=0x7f6de406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.397+0000 7f6e0b600640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6de40683b0 0x7f6de406a870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6df80ad000 tx=0x7f6df8003770 comp rx=0 tx=0).stop 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.397+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e040cdfe0 msgr2=0x7f6e040ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.397+0000 7f6e0b600640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e040cdfe0 0x7f6e040ca9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6df0005ef0 tx=0x7f6df0007420 comp rx=0 tx=0).stop 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 shutdown_connections 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6de40683b0 0x7f6de406a870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6e041580b0 0x7f6e04158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6e040cdfe0 0x7f6e040ca9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 --2- 172.21.15.47:0/1445251220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6dec0039c0 0x7f6e0414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 >> 172.21.15.47:0/1445251220 conn(0x7f6e040b2b70 msgr2=0x7f6e0415d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 shutdown_connections 2024-04-26T23:45:46.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.401+0000 7f6e0b600640 1 -- 172.21.15.47:0/1445251220 wait complete. 2024-04-26T23:45:46.425 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:46.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.557+0000 7f6032800640 1 Processor -- start 2024-04-26T23:45:46.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.557+0000 7f6032800640 1 -- start start 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f6032800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f602c06f0a0 0x7f602c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f6032800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c09ba60 0x7f602c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f6032800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602c0d2340 con 0x7f602c0ce340 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f6032800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f602c0cd580 con 0x7f602c06f0a0 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f6032800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f602c0cd860 con 0x7f602c09ba60 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f602b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f602c06f0a0 0x7f602c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f602b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f602c06f0a0 0x7f602c0d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47010/0 (socket says 172.21.15.47:47010) 2024-04-26T23:45:46.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f602b400640 1 -- 172.21.15.47:0/4041944335 learned_addr learned my addr 172.21.15.47:0/4041944335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:46.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f6022a00640 1 --2- 172.21.15.47:0/4041944335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c09ba60 0x7f602c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f602b400640 1 -- 172.21.15.47:0/4041944335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c09ba60 msgr2=0x7f602c09bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f602b400640 1 --2- 172.21.15.47:0/4041944335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c09ba60 0x7f602c09bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f602b400640 1 -- 172.21.15.47:0/4041944335 >> v1:172.21.15.203:6789/0 conn(0x7f602c0ce340 legacy=0x7f602c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:46.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f602b400640 1 -- 172.21.15.47:0/4041944335 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c0cdb40 con 0x7f602c06f0a0 2024-04-26T23:45:46.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.561+0000 7f6022a00640 1 --2- 172.21.15.47:0/4041944335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c09ba60 0x7f602c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:46.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f602b400640 1 --2- 172.21.15.47:0/4041944335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c06f0a0 0x7f602c0d0fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f601c0098a0 tx=0x7f601c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d5beb104607bec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f602aa00640 1 -- 172.21.15.47:0/4041944335 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c0b0070 con 0x7f602c06f0a0 2024-04-26T23:45:46.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f602aa00640 1 -- 172.21.15.47:0/4041944335 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601c0ab600 con 0x7f602c06f0a0 2024-04-26T23:45:46.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f602aa00640 1 -- 172.21.15.47:0/4041944335 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c0ab9d0 con 0x7f602c06f0a0 2024-04-26T23:45:46.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- 172.21.15.47:0/4041944335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c06f0a0 msgr2=0x7f602c0d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 --2- 172.21.15.47:0/4041944335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c06f0a0 0x7f602c0d0fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f601c0098a0 tx=0x7f601c01c500 comp rx=0 tx=0).stop 2024-04-26T23:45:46.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- 172.21.15.47:0/4041944335 shutdown_connections 2024-04-26T23:45:46.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 --2- 172.21.15.47:0/4041944335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c09ba60 0x7f602c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 --2- 172.21.15.47:0/4041944335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c06f0a0 0x7f602c0d0fb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- 172.21.15.47:0/4041944335 >> 172.21.15.47:0/4041944335 conn(0x7f602c0d2e90 msgr2=0x7f602c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- 172.21.15.47:0/4041944335 shutdown_connections 2024-04-26T23:45:46.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- 172.21.15.47:0/4041944335 wait complete. 2024-04-26T23:45:46.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 Processor -- start 2024-04-26T23:45:46.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- start start 2024-04-26T23:45:46.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f602c06f0a0 0x7f602c0cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c09ba60 0x7f602c151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c0ce340 0x7f602c152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0d2120 con 0x7f602c09ba60 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f602c0d1fa0 con 0x7f602c06f0a0 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6032800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f602c06d510 con 0x7f602c0ce340 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.565+0000 7f6022a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c09ba60 0x7f602c151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c09ba60 0x7f602c151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47022/0 (socket says 172.21.15.47:47022) 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 -- 172.21.15.47:0/3263408556 learned_addr learned my addr 172.21.15.47:0/3263408556 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f602b400640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f602c06f0a0 0x7f602c0cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f602be00640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c0ce340 0x7f602c152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 -- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c0ce340 msgr2=0x7f602c152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c0ce340 0x7f602c152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 -- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f602c06f0a0 msgr2=0x7f602c0cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f602c06f0a0 0x7f602c0cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 -- 172.21.15.47:0/3263408556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c160530 con 0x7f602c09ba60 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f602be00640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c0ce340 0x7f602c152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:46.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6022a00640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c09ba60 0x7f602c151dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f601400c7f0 tx=0x7f601400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6023e00640 1 -- 172.21.15.47:0/3263408556 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014015070 con 0x7f602c09ba60 2024-04-26T23:45:46.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6023e00640 1 -- 172.21.15.47:0/3263408556 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6014007820 con 0x7f602c09ba60 2024-04-26T23:45:46.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6023e00640 1 -- 172.21.15.47:0/3263408556 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014007c10 con 0x7f602c09ba60 2024-04-26T23:45:46.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c1607f0 con 0x7f602c09ba60 2024-04-26T23:45:46.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c160db0 con 0x7f602c09ba60 2024-04-26T23:45:46.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c069700 con 0x7f602c09ba60 2024-04-26T23:45:46.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6023e00640 1 -- 172.21.15.47:0/3263408556 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6014018070 con 0x7f602c09ba60 2024-04-26T23:45:46.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6023e00640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6008068380 0x7f600806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.569+0000 7f6023e00640 1 -- 172.21.15.47:0/3263408556 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6014086aa0 con 0x7f602c09ba60 2024-04-26T23:45:46.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.573+0000 7f602b400640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6008068380 0x7f600806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.573+0000 7f602b400640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6008068380 0x7f600806a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f601c0ad000 tx=0x7f601c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.573+0000 7f6023e00640 1 -- 172.21.15.47:0/3263408556 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6014056970 con 0x7f602c09ba60 2024-04-26T23:45:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f602c068240 con 0x7f602c09ba60 2024-04-26T23:45:46.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6023e00640 1 -- 172.21.15.47:0/3263408556 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f601405ac70 con 0x7f602c09ba60 2024-04-26T23:45:46.784 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:46.784 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:45:46.784 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:45:46.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6008068380 msgr2=0x7f600806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6008068380 0x7f600806a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f601c0ad000 tx=0x7f601c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:46.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c09ba60 msgr2=0x7f602c151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c09ba60 0x7f602c151dd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f601400c7f0 tx=0x7f601400ccb0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 shutdown_connections 2024-04-26T23:45:46.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6008068380 0x7f600806a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f602c0ce340 0x7f602c152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f602c09ba60 0x7f602c151dd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 --2- 172.21.15.47:0/3263408556 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f602c06f0a0 0x7f602c0cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 >> 172.21.15.47:0/3263408556 conn(0x7f602c0d2e90 msgr2=0x7f602c0d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 shutdown_connections 2024-04-26T23:45:46.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.777+0000 7f6032800640 1 -- 172.21.15.47:0/3263408556 wait complete. 2024-04-26T23:45:46.805 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:46.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.937+0000 7f7e60800640 1 Processor -- start 2024-04-26T23:45:46.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.937+0000 7f7e60800640 1 -- start start 2024-04-26T23:45:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e60800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e580d0fb0 0x7f7e58070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e60800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580d2340 con 0x7f7e5806f0a0 2024-04-26T23:45:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e60800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580cd580 con 0x7f7e5809c170 2024-04-26T23:45:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e60800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7e580cf350 con 0x7f7e580d0fb0 2024-04-26T23:45:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5de00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7e5806f0a0 0x7f7e5809ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45498/0 (socket says 172.21.15.47:45498) 2024-04-26T23:45:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5de00640 1 -- 172.21.15.47:0/342855896 learned_addr learned my addr 172.21.15.47:0/342855896 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:46.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5e800640 1 --2- 172.21.15.47:0/342855896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e580d0fb0 0x7f7e58070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5ca00640 1 -- 172.21.15.47:0/342855896 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998700825 0 0) 0x7f7e580d2340 con 0x7f7e5806f0a0 2024-04-26T23:45:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5ca00640 1 -- 172.21.15.47:0/342855896 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e40003530 con 0x7f7e5806f0a0 2024-04-26T23:45:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5ca00640 1 -- 172.21.15.47:0/342855896 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 706658426 0 0) 0x7f7e580cd580 con 0x7f7e5809c170 2024-04-26T23:45:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5ca00640 1 -- 172.21.15.47:0/342855896 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e580d2340 con 0x7f7e5809c170 2024-04-26T23:45:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5e800640 1 -- 172.21.15.47:0/342855896 >> v1:172.21.15.203:6789/0 conn(0x7f7e5809c170 legacy=0x7f7e58070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5e800640 1 -- 172.21.15.47:0/342855896 >> v1:172.21.15.47:6789/0 conn(0x7f7e5806f0a0 legacy=0x7f7e5809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.941+0000 7f7e5e800640 1 -- 172.21.15.47:0/342855896 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580cd860 con 0x7f7e580d0fb0 2024-04-26T23:45:46.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e5e800640 1 --2- 172.21.15.47:0/342855896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e580d0fb0 0x7f7e58070aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009dc0 tx=0x7f7e5401c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9a8e84919b9f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e5ca00640 1 -- 172.21.15.47:0/342855896 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e540b2070 con 0x7f7e580d0fb0 2024-04-26T23:45:46.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e5ca00640 1 -- 172.21.15.47:0/342855896 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e540a5790 con 0x7f7e580d0fb0 2024-04-26T23:45:46.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e5ca00640 1 -- 172.21.15.47:0/342855896 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e540a5b60 con 0x7f7e580d0fb0 2024-04-26T23:45:46.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- 172.21.15.47:0/342855896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e580d0fb0 msgr2=0x7f7e58070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 --2- 172.21.15.47:0/342855896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e580d0fb0 0x7f7e58070aa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009dc0 tx=0x7f7e5401c8d0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- 172.21.15.47:0/342855896 shutdown_connections 2024-04-26T23:45:46.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 --2- 172.21.15.47:0/342855896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e580d0fb0 0x7f7e58070aa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- 172.21.15.47:0/342855896 >> 172.21.15.47:0/342855896 conn(0x7f7e580d2e90 msgr2=0x7f7e580d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:46.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- 172.21.15.47:0/342855896 shutdown_connections 2024-04-26T23:45:46.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- 172.21.15.47:0/342855896 wait complete. 2024-04-26T23:45:46.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 Processor -- start 2024-04-26T23:45:46.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- start start 2024-04-26T23:45:46.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e5806f0a0 0x7f7e58156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e5809c170 0x7f7e580b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e580d0fb0 0x7f7e580b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580d2120 con 0x7f7e580d0fb0 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580d1fa0 con 0x7f7e5809c170 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.945+0000 7f7e60800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5806d510 con 0x7f7e5806f0a0 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e580d0fb0 0x7f7e580b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e580d0fb0 0x7f7e580b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47030/0 (socket says 172.21.15.47:47030) 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 -- 172.21.15.47:0/461111193 learned_addr learned my addr 172.21.15.47:0/461111193 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5de00640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e5806f0a0 0x7f7e58156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5d400640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e5809c170 0x7f7e580b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 -- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e5806f0a0 msgr2=0x7f7e58156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e5806f0a0 0x7f7e58156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 -- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e5809c170 msgr2=0x7f7e580b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e5809c170 0x7f7e580b71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 -- 172.21.15.47:0/461111193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e580b5bf0 con 0x7f7e580d0fb0 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5d400640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e5809c170 0x7f7e580b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e5e800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e580d0fb0 0x7f7e580b7700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e540194e0 tx=0x7f7e54019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e52000640 1 -- 172.21.15.47:0/461111193 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e540b2050 con 0x7f7e580d0fb0 2024-04-26T23:45:46.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e52000640 1 -- 172.21.15.47:0/461111193 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e540be070 con 0x7f7e580d0fb0 2024-04-26T23:45:46.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e52000640 1 -- 172.21.15.47:0/461111193 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54009450 con 0x7f7e580d0fb0 2024-04-26T23:45:46.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e580b5e60 con 0x7f7e580d0fb0 2024-04-26T23:45:46.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e580b6420 con 0x7f7e580d0fb0 2024-04-26T23:45:46.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e58069700 con 0x7f7e580d0fb0 2024-04-26T23:45:46.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e52000640 1 -- 172.21.15.47:0/461111193 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7e540ad870 con 0x7f7e580d0fb0 2024-04-26T23:45:46.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.949+0000 7f7e52000640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e3c068380 0x7f7e3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:46.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.953+0000 7f7e52000640 1 -- 172.21.15.47:0/461111193 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7e541218c0 con 0x7f7e580d0fb0 2024-04-26T23:45:46.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.953+0000 7f7e5de00640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e3c068380 0x7f7e3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:46.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.953+0000 7f7e5de00640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e3c068380 0x7f7e3c06a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c007fd0 tx=0x7f7e4c007d80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:46.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:46.957+0000 7f7e52000640 1 -- 172.21.15.47:0/461111193 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7e54016580 con 0x7f7e580d0fb0 2024-04-26T23:45:47.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.121+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e580cfa90 con 0x7f7e580d0fb0 2024-04-26T23:45:47.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.121+0000 7f7e52000640 1 -- 172.21.15.47:0/461111193 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f7e540f1f00 con 0x7f7e580d0fb0 2024-04-26T23:45:47.130 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:47.131 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:47.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e3c068380 msgr2=0x7f7e3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e3c068380 0x7f7e3c06a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c007fd0 tx=0x7f7e4c007d80 comp rx=0 tx=0).stop 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e580d0fb0 msgr2=0x7f7e580b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e580d0fb0 0x7f7e580b7700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7e540194e0 tx=0x7f7e54019670 comp rx=0 tx=0).stop 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 shutdown_connections 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e3c068380 0x7f7e3c06a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e580d0fb0 0x7f7e580b7700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e5809c170 0x7f7e580b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 --2- 172.21.15.47:0/461111193 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e5806f0a0 0x7f7e58156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 >> 172.21.15.47:0/461111193 conn(0x7f7e580d2e90 msgr2=0x7f7e580cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:47.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 shutdown_connections 2024-04-26T23:45:47.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.125+0000 7f7e60800640 1 -- 172.21.15.47:0/461111193 wait complete. 2024-04-26T23:45:47.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:45:47.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.285+0000 7fcc4fe00640 1 Processor -- start 2024-04-26T23:45:47.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.285+0000 7fcc4fe00640 1 -- start start 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcc4809c170 0x7fcc480d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc48070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4fe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc480d2340 con 0x7fcc4806f0a0 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcc480cf350 con 0x7fcc4809c170 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc480cd580 con 0x7fcc48070390 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc48070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc48070840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43512/0 (socket says 172.21.15.47:43512) 2024-04-26T23:45:47.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 -- 172.21.15.47:0/3338111514 learned_addr learned my addr 172.21.15.47:0/3338111514 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:47.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4ca00640 1 --2- 172.21.15.47:0/3338111514 >> v2:172.21.15.203:3300/0 conn(0x7fcc4809c170 0x7fcc480d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:47.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 -- 172.21.15.47:0/3338111514 >> v2:172.21.15.203:3300/0 conn(0x7fcc4809c170 msgr2=0x7fcc480d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:47.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 --2- 172.21.15.47:0/3338111514 >> v2:172.21.15.203:3300/0 conn(0x7fcc4809c170 0x7fcc480d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 -- 172.21.15.47:0/3338111514 >> v1:172.21.15.203:6789/0 conn(0x7fcc4806f0a0 legacy=0x7fcc4809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 -- 172.21.15.47:0/3338111514 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc480cd860 con 0x7fcc48070390 2024-04-26T23:45:47.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.289+0000 7fcc4de00640 1 --2- 172.21.15.47:0/3338111514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc48070840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e50 tx=0x7fcc4001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e58a4e36207c41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc47e00640 1 -- 172.21.15.47:0/3338111514 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400a57f0 con 0x7fcc48070390 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc47e00640 1 -- 172.21.15.47:0/3338111514 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400a5990 con 0x7fcc48070390 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc47e00640 1 -- 172.21.15.47:0/3338111514 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400a5d60 con 0x7fcc48070390 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3338111514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 msgr2=0x7fcc48070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3338111514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc48070840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e50 tx=0x7fcc4001ca30 comp rx=0 tx=0).stop 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3338111514 shutdown_connections 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3338111514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc48070840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3338111514 >> v2:172.21.15.203:3300/0 conn(0x7fcc4809c170 0x7fcc480d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3338111514 >> 172.21.15.47:0/3338111514 conn(0x7fcc480d2e90 msgr2=0x7fcc480d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3338111514 shutdown_connections 2024-04-26T23:45:47.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3338111514 wait complete. 2024-04-26T23:45:47.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 Processor -- start 2024-04-26T23:45:47.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- start start 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4806f0a0 0x7fcc4815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc480b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc4809c170 0x7fcc480c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480d2120 con 0x7fcc4806f0a0 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480d1fa0 con 0x7fcc4809c170 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4806d510 con 0x7fcc48070390 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4806f0a0 0x7fcc4815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4806f0a0 0x7fcc4815c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47044/0 (socket says 172.21.15.47:47044) 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4d400640 1 -- 172.21.15.47:0/3800365121 learned_addr learned my addr 172.21.15.47:0/3800365121 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4ca00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc480b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:47.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.293+0000 7fcc4de00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc4809c170 0x7fcc480c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4d400640 1 -- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 msgr2=0x7fcc480b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4d400640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc480b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4d400640 1 -- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc4809c170 msgr2=0x7fcc480c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4d400640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc4809c170 0x7fcc480c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4d400640 1 -- 172.21.15.47:0/3800365121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4806e860 con 0x7fcc4806f0a0 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4d400640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4806f0a0 0x7fcc4815c4b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00c3c0 tx=0x7fcc3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc45600640 1 -- 172.21.15.47:0/3800365121 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c017070 con 0x7fcc4806f0a0 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc45600640 1 -- 172.21.15.47:0/3800365121 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc3c0052d0 con 0x7fcc4806f0a0 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc480b8c10 con 0x7fcc4806f0a0 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc45600640 1 -- 172.21.15.47:0/3800365121 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c003840 con 0x7fcc4806f0a0 2024-04-26T23:45:47.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc480b7190 con 0x7fcc4806f0a0 2024-04-26T23:45:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc48069700 con 0x7fcc4806f0a0 2024-04-26T23:45:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc45600640 1 -- 172.21.15.47:0/3800365121 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc3c01a070 con 0x7fcc4806f0a0 2024-04-26T23:45:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc45600640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc28068380 0x7fcc2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:47.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc45600640 1 -- 172.21.15.47:0/3800365121 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcc3c085cb0 con 0x7fcc4806f0a0 2024-04-26T23:45:47.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.297+0000 7fcc4ca00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc28068380 0x7fcc2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:47.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.301+0000 7fcc4ca00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc28068380 0x7fcc2806a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc4809ca40 tx=0x7fcc34009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:47.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.301+0000 7fcc45600640 1 -- 172.21.15.47:0/3800365121 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcc3c005480 con 0x7fcc4806f0a0 2024-04-26T23:45:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.501+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc480c85f0 con 0x7fcc4806f0a0 2024-04-26T23:45:47.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.501+0000 7fcc45600640 1 -- 172.21.15.47:0/3800365121 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fcc3c055b80 con 0x7fcc4806f0a0 2024-04-26T23:45:47.508 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:47.509 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:45:47.509 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:45:47.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.501+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc28068380 msgr2=0x7fcc2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.501+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc28068380 0x7fcc2806a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcc4809ca40 tx=0x7fcc34009190 comp rx=0 tx=0).stop 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.501+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4806f0a0 msgr2=0x7fcc4815c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.501+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4806f0a0 0x7fcc4815c4b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c00c3c0 tx=0x7fcc3c00c880 comp rx=0 tx=0).stop 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 shutdown_connections 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc28068380 0x7fcc2806a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc4809c170 0x7fcc480c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcc48070390 0x7fcc480b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 --2- 172.21.15.47:0/3800365121 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcc4806f0a0 0x7fcc4815c4b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 >> 172.21.15.47:0/3800365121 conn(0x7fcc480d2e90 msgr2=0x7fcc4806e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 shutdown_connections 2024-04-26T23:45:47.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:47.505+0000 7fcc4fe00640 1 -- 172.21.15.47:0/3800365121 wait complete. 2024-04-26T23:45:47.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:45:32.065076+0000', 'modified': '2024-04-26T23:45:35.081165+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.203:6836/428433298', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6834', 'nonce': 428433298}, {'type': 'v1', 'addr': '172.21.15.203:6836', 'nonce': 428433298}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-04-26T23:45:47.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:45:47.933 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-26T23:45:48.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.069+0000 7fbd67200640 1 Processor -- start 2024-04-26T23:45:48.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.069+0000 7fbd67200640 1 -- start start 2024-04-26T23:45:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.069+0000 7fbd67200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600d1540 0x7fbd600d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.069+0000 7fbd67200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd600cdae0 0x7fbd60166bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.069+0000 7fbd67200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd600d1e60 con 0x7fbd600b21f0 2024-04-26T23:45:48.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.069+0000 7fbd67200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbd600b46f0 con 0x7fbd600cdae0 2024-04-26T23:45:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.069+0000 7fbd67200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbd600b4940 con 0x7fbd600d1540 2024-04-26T23:45:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd600cdae0 0x7fbd60166bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd600cdae0 0x7fbd60166bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47054/0 (socket says 172.21.15.47:47054) 2024-04-26T23:45:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 -- 172.21.15.47:0/57894415 learned_addr learned my addr 172.21.15.47:0/57894415 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/57894415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600d1540 0x7fbd600d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 -- 172.21.15.47:0/57894415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600d1540 msgr2=0x7fbd600d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 --2- 172.21.15.47:0/57894415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600d1540 0x7fbd600d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 -- 172.21.15.47:0/57894415 >> v1:172.21.15.203:6789/0 conn(0x7fbd600b21f0 legacy=0x7fbd600d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 -- 172.21.15.47:0/57894415 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600b4c20 con 0x7fbd600cdae0 2024-04-26T23:45:48.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd65200640 1 --2- 172.21.15.47:0/57894415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd60166bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dd038314b05c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd5f400640 1 -- 172.21.15.47:0/57894415 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd580ab650 con 0x7fbd600cdae0 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd5f400640 1 -- 172.21.15.47:0/57894415 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd580b0070 con 0x7fbd600cdae0 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.073+0000 7fbd5f400640 1 -- 172.21.15.47:0/57894415 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd580aba10 con 0x7fbd600cdae0 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- 172.21.15.47:0/57894415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 msgr2=0x7fbd60166bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 --2- 172.21.15.47:0/57894415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd60166bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5801c560 comp rx=0 tx=0).stop 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- 172.21.15.47:0/57894415 shutdown_connections 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 --2- 172.21.15.47:0/57894415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd60166bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 --2- 172.21.15.47:0/57894415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600d1540 0x7fbd600d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- 172.21.15.47:0/57894415 >> 172.21.15.47:0/57894415 conn(0x7fbd6009ba60 msgr2=0x7fbd6009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- 172.21.15.47:0/57894415 shutdown_connections 2024-04-26T23:45:48.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- 172.21.15.47:0/57894415 wait complete. 2024-04-26T23:45:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 Processor -- start 2024-04-26T23:45:48.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- start start 2024-04-26T23:45:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600b21f0 0x7fbd6006f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd6015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd600d1540 0x7fbd60164f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6015d4c0 con 0x7fbd600cdae0 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6015d340 con 0x7fbd600d1540 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd67200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbd60169950 con 0x7fbd600b21f0 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd6015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd6015a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47066/0 (socket says 172.21.15.47:47066) 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 -- 172.21.15.47:0/2324441301 learned_addr learned my addr 172.21.15.47:0/2324441301 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600b21f0 0x7fbd6006f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd65200640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd600d1540 0x7fbd60164f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 -- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600b21f0 msgr2=0x7fbd6006f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600b21f0 0x7fbd6006f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 -- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd600d1540 msgr2=0x7fbd60164f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd600d1540 0x7fbd60164f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 -- 172.21.15.47:0/2324441301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd600b0110 con 0x7fbd600cdae0 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.077+0000 7fbd57400640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd6015a940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c390 tx=0x7fbd4800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd5cc00640 1 -- 172.21.15.47:0/2324441301 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48017070 con 0x7fbd600cdae0 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd5cc00640 1 -- 172.21.15.47:0/2324441301 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd480052f0 con 0x7fbd600cdae0 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd5cc00640 1 -- 172.21.15.47:0/2324441301 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48003840 con 0x7fbd600cdae0 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd600b03f0 con 0x7fbd600cdae0 2024-04-26T23:45:48.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd600b09b0 con 0x7fbd600cdae0 2024-04-26T23:45:48.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd5cc00640 1 -- 172.21.15.47:0/2324441301 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd4801a070 con 0x7fbd600cdae0 2024-04-26T23:45:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd5cc00640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd3c068380 0x7fbd3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.081+0000 7fbd5cc00640 1 -- 172.21.15.47:0/2324441301 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbd48085d70 con 0x7fbd600cdae0 2024-04-26T23:45:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 Processor -- start 2024-04-26T23:45:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd3c068380 0x7fbd3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- start start 2024-04-26T23:45:48.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd3c068380 0x7fbd3c06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbd500074a0 tx=0x7fbd5000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762c700 0x55d6e762cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75e3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e75e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d6e749b140 con 0x55d6e762d020 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d6e7430e00 con 0x55d6e762c700 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d6e73e9a00 con 0x55d6e75e3740 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75e3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75e3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47082/0 (socket says 172.21.15.47:47082) 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 -- 172.21.15.47:0/1799473097 learned_addr learned my addr 172.21.15.47:0/1799473097 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd65200640 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e75e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762c700 0x55d6e762cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 -- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 msgr2=0x55d6e75e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e75e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 -- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762c700 msgr2=0x55d6e762cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762c700 0x55d6e762cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 -- 172.21.15.47:0/1799473097 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e73ee0e0 con 0x55d6e762d020 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762c700 0x55d6e762cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd65200640 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e75e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd57400640 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75e3200 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd48051ff0 tx=0x7fbd48056350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76fbe2e94a28479 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd54c00640 1 -- 172.21.15.47:0/1799473097 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4806e170 con 0x55d6e762d020 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd54c00640 1 -- 172.21.15.47:0/1799473097 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4805e770 con 0x55d6e762d020 2024-04-26T23:45:48.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd54c00640 1 -- 172.21.15.47:0/1799473097 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd48052200 con 0x55d6e762d020 2024-04-26T23:45:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1799473097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 msgr2=0x55d6e75e3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75e3200 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbd48051ff0 tx=0x7fbd48056350 comp rx=0 tx=0).stop 2024-04-26T23:45:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1799473097 shutdown_connections 2024-04-26T23:45:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e75e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75e3200 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1799473097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762c700 0x55d6e762cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1799473097 >> 172.21.15.47:0/1799473097 conn(0x55d6e75df6f0 msgr2=0x55d6e75e1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1799473097 shutdown_connections 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1799473097 wait complete. 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 -- start start 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.085+0000 7fbd6a6ad000 1 Processor -- start 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e75ee0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e75ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d6e743e200 con 0x55d6e762d020 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d6e73d4e80 con 0x55d6e75e3740 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d6e742bae0 con 0x55d6e762c700 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 10 client.0 _ll_register_callbacks cb 0x55d6e743dda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:45:48.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75eeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47096/0 (socket says 172.21.15.47:47096) 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 -- 172.21.15.47:0/1945404254 learned_addr learned my addr 172.21.15.47:0/1945404254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e75ee0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd57400640 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e75ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 -- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 msgr2=0x55d6e75ee5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e75ee5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 -- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 msgr2=0x55d6e75ee0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e75ee0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 -- 172.21.15.47:0/1945404254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e73d04e0 con 0x55d6e762d020 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd65200640 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75eeb20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbd58008010 tx=0x7fbd580046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824c26242189c39a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd4d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd4d600640 1 -- 172.21.15.47:0/1945404254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd580abaa0 con 0x55d6e762d020 2024-04-26T23:45:48.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd4805e770 con 0x55d6e762d020 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd4d600640 1 -- 172.21.15.47:0/1945404254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbd580abc40 con 0x55d6e762d020 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd4d600640 1 -- 172.21.15.47:0/1945404254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fbd580abe40 con 0x55d6e762d020 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 10 client.4665 fetch_fsmap learned FSMap version 8 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d6e73b6e80 con 0x55d6e762d020 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd4d600640 1 -- 172.21.15.47:0/1945404254 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4805e770 con 0x55d6e762d020 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd4d600640 1 -- 172.21.15.47:0/1945404254 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fbd580bf420 con 0x55d6e762d020 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 10 client.4665 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 20 client.4665 populate_metadata read hostname 'smithi047' 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e763c7a0 0x55d6e763eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 4 client.4665 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:45:48.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 --> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e73c9bc0 con 0x55d6e763c7a0 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.089+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e763c7a0 0x55d6e763eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e763c7a0 0x55d6e763eb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dc8dab763fc8657 server_cookie=ce7eb7f608c77369 in_seq=0 out_seq=0 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd4d600640 10 client.4665 ms_handle_connect on v2:172.21.15.203:6834/428433298 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd4d600640 1 -- 172.21.15.47:0/1945404254 <== mds.0 v2:172.21.15.203:6834/428433298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d6e73c9bc0 con 0x55d6e763c7a0 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd4d600640 10 client.4665 handle_command_reply: tid=0 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 client.4665 shutdown 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 msgr2=0x55d6e75eeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75eeb20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbd58008010 tx=0x7fbd580046d0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 shutdown_connections 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e763c7a0 0x55d6e763eb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e75eeb20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e75ee5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/1945404254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e75ee0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd4d600640 0 client.4665 ms_handle_reset on v2:172.21.15.203:6834/428433298 2024-04-26T23:45:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 >> 172.21.15.47:0/1945404254 conn(0x55d6e75df6f0 msgr2=0x55d6e75e2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 shutdown_connections 2024-04-26T23:45:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/1945404254 wait complete. 2024-04-26T23:45:48.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.093+0000 7fbd6a6ad000 20 client.4665 trim_cache size 0 max 16384 2024-04-26T23:45:48.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.109+0000 7fbd6a6ad000 1 Processor -- start 2024-04-26T23:45:48.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- start start 2024-04-26T23:45:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e7697d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e7698260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e76987a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6006e2d0 con 0x55d6e762d020 2024-04-26T23:45:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbd6006d630 con 0x55d6e75e3740 2024-04-26T23:45:48.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbd6006dc80 con 0x55d6e762c700 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e76987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e76987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47112/0 (socket says 172.21.15.47:47112) 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 -- 172.21.15.47:0/3981479788 learned_addr learned my addr 172.21.15.47:0/3981479788 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e7697d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd57400640 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e7698260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 -- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 msgr2=0x55d6e7698260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e7698260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 -- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 msgr2=0x55d6e7697d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e7697d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 -- 172.21.15.47:0/3981479788 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e73e9c50 con 0x55d6e762d020 2024-04-26T23:45:48.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd65200640 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e76987a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd5801ac10 tx=0x7fbd58009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f770147460e1571f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd4fe00640 1 -- 172.21.15.47:0/3981479788 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd580bfb20 con 0x55d6e762d020 2024-04-26T23:45:48.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd4fe00640 1 -- 172.21.15.47:0/3981479788 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58000e50 con 0x55d6e762d020 2024-04-26T23:45:48.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd4fe00640 1 -- 172.21.15.47:0/3981479788 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58004240 con 0x55d6e762d020 2024-04-26T23:45:48.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/3981479788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 msgr2=0x55d6e76987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e76987a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbd5801ac10 tx=0x7fbd58009240 comp rx=0 tx=0).stop 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/3981479788 shutdown_connections 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762d020 0x55d6e76987a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e762c700 0x55d6e7698260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/3981479788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e75e3740 0x55d6e7697d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/3981479788 >> 172.21.15.47:0/3981479788 conn(0x55d6e75df6f0 msgr2=0x55d6e75ee930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/3981479788 shutdown_connections 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/3981479788 wait complete. 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 -- start start 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.113+0000 7fbd6a6ad000 1 Processor -- start 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e7641700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762c700 0x55d6e7658720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762d020 0x55d6e7658c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d6e7430110 con 0x55d6e762c700 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d6e73c67b0 con 0x55d6e762d020 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d6e7435430 con 0x55d6e75e3740 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 10 client.0 _ll_register_callbacks cb 0x7fbd500095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762c700 0x55d6e7658720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762c700 0x55d6e7658720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47114/0 (socket says 172.21.15.47:47114) 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 -- 172.21.15.47:0/5006436 learned_addr learned my addr 172.21.15.47:0/5006436 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd65200640 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762d020 0x55d6e7658c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e7641700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 -- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 msgr2=0x55d6e7641700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e7641700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 -- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762d020 msgr2=0x55d6e7658c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762d020 0x55d6e7658c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 -- 172.21.15.47:0/5006436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e74b3160 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd57400640 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762c700 0x55d6e7658720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd48001220 tx=0x7fbd48013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bd1afe177a82de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 1 -- 172.21.15.47:0/5006436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4805e770 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 1 -- 172.21.15.47:0/5006436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbd4807db60 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd58000e50 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 1 -- 172.21.15.47:0/5006436 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fbd4807dd60 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 10 client.4671 fetch_fsmap learned FSMap version 8 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55d6e70ea0c0 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 1 -- 172.21.15.47:0/5006436 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd58000e50 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 1 -- 172.21.15.47:0/5006436 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fbd48054fe0 con 0x55d6e762c700 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 10 client.4671 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 20 client.4671 populate_metadata read hostname 'smithi047' 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e769bb50 0x55d6e769bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 4 client.4671 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 --> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] -- command(tid 0: {"prefix": "status"}) -- 0x55d6e743ea10 con 0x55d6e769bb50 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e769bb50 0x55d6e769bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd5fe00640 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e769bb50 0x55d6e769bf30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0ecd7b236da6a0 server_cookie=ed7af1bc8f411bb8 in_seq=0 out_seq=0 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 10 client.4671 ms_handle_connect on v2:172.21.15.203:6834/428433298 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 1 -- 172.21.15.47:0/5006436 <== mds.0 v2:172.21.15.203:6834/428433298 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55d6e743ea10 con 0x55d6e769bb50 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 10 client.4671 handle_command_reply: tid=0 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 client.4671 shutdown 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762c700 msgr2=0x55d6e7658720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762c700 0x55d6e7658720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd48001220 tx=0x7fbd48013000 comp rx=0 tx=0).stop 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 shutdown_connections 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:6834/428433298,v1:172.21.15.203:6836/428433298] conn(0x55d6e769bb50 0x55d6e769bf30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e762d020 0x55d6e7658c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d6e762c700 0x55d6e7658720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 --2- 172.21.15.47:0/5006436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d6e75e3740 0x55d6e7641700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd4d600640 0 client.4671 ms_handle_reset on v2:172.21.15.203:6834/428433298 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 >> 172.21.15.47:0/5006436 conn(0x55d6e75df6f0 msgr2=0x55d6e7639460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 shutdown_connections 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.117+0000 7fbd6a6ad000 1 -- 172.21.15.47:0/5006436 wait complete. 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd6a6ad000 20 client.4671 trim_cache size 0 max 16384 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "b64830b3-1e32-4049-b582-6f8b5018205b", 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-26T23:45:48.131 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4281, 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 15.441575142, 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 8, 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 23, 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 23, 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 22.478024318999999 2024-04-26T23:45:48.132 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd3c068380 msgr2=0x7fbd3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd3c068380 0x7fbd3c06a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbd500074a0 tx=0x7fbd5000b040 comp rx=0 tx=0).stop 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 msgr2=0x7fbd6015a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd6015a940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbd4800c390 tx=0x7fbd4800c850 comp rx=0 tx=0).stop 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 shutdown_connections 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd3c068380 0x7fbd3c06a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd600d1540 0x7fbd60164f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd600cdae0 0x7fbd6015a940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 --2- 172.21.15.47:0/2324441301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd600b21f0 0x7fbd6006f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 >> 172.21.15.47:0/2324441301 conn(0x7fbd6009ba60 msgr2=0x7fbd600cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 shutdown_connections 2024-04-26T23:45:48.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.121+0000 7fbd67200640 1 -- 172.21.15.47:0/2324441301 wait complete. 2024-04-26T23:45:48.146 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T23:45:48.157 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T23:45:48.157 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T23:45:48.157 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T23:45:48.157 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T23:45:48.309 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T23:45:48.310 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-26T23:45:48.310 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T23:45:48.310 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:45:48.310 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:48.310 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-26T23:45:48.310 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:45:48.310 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T23:45:48.310 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-26T23:45:48.311 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:45:48.311 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:48.311 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-26T23:45:48.311 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T23:45:48.311 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T23:45:48.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:48.311 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-26T23:45:48.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:48.321 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-26T23:45:48.385 INFO:teuthology.orchestra.run.smithi047.stderr:Cannot find device "ceph-brx" 2024-04-26T23:45:48.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:45:48.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:48.387 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-26T23:45:48.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:48.398 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-26T23:45:48.464 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2024-04-26T23:45:48.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:45:48.467 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T23:45:48.467 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:45:48.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f0506400640 1 Processor -- start 2024-04-26T23:45:48.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f0506400640 1 -- start start 2024-04-26T23:45:48.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f0506400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f050009c170 0x7f05000d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f0506400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05000d2340 con 0x7f050006f0a0 2024-04-26T23:45:48.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f0506400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05000cd580 con 0x7f0500070390 2024-04-26T23:45:48.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f0506400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f05000cf350 con 0x7f050009c170 2024-04-26T23:45:48.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f04ff400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f050006f0a0 0x7f050009ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45500/0 (socket says 172.21.15.47:45500) 2024-04-26T23:45:48.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f04ff400640 1 -- 172.21.15.47:0/3667458219 learned_addr learned my addr 172.21.15.47:0/3667458219 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:48.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f04f7e00640 1 --2- 172.21.15.47:0/3667458219 >> v2:172.21.15.47:3300/0 conn(0x7f050009c170 0x7f05000d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f04f7e00640 1 -- 172.21.15.47:0/3667458219 >> v1:172.21.15.203:6789/0 conn(0x7f0500070390 legacy=0x7f0500070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f04f7e00640 1 -- 172.21.15.47:0/3667458219 >> v1:172.21.15.47:6789/0 conn(0x7f050006f0a0 legacy=0x7f050009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.601+0000 7f04f7e00640 1 -- 172.21.15.47:0/3667458219 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05000cd860 con 0x7f050009c170 2024-04-26T23:45:48.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f04f7e00640 1 --2- 172.21.15.47:0/3667458219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050009c170 0x7f05000d0fb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04e80097c0 tx=0x7f04e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc41f164c9bfcc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f04fea00640 1 -- 172.21.15.47:0/3667458219 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e80b1070 con 0x7f050009c170 2024-04-26T23:45:48.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f04fea00640 1 -- 172.21.15.47:0/3667458219 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e80ac5f0 con 0x7f050009c170 2024-04-26T23:45:48.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f04fea00640 1 -- 172.21.15.47:0/3667458219 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e80ac9c0 con 0x7f050009c170 2024-04-26T23:45:48.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f0506400640 1 -- 172.21.15.47:0/3667458219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050009c170 msgr2=0x7f05000d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f0506400640 1 --2- 172.21.15.47:0/3667458219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050009c170 0x7f05000d0fb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04e80097c0 tx=0x7f04e801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f0506400640 1 -- 172.21.15.47:0/3667458219 shutdown_connections 2024-04-26T23:45:48.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f0506400640 1 --2- 172.21.15.47:0/3667458219 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050009c170 0x7f05000d0fb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f0506400640 1 -- 172.21.15.47:0/3667458219 >> 172.21.15.47:0/3667458219 conn(0x7f05000d2e90 msgr2=0x7f05000d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f0506400640 1 -- 172.21.15.47:0/3667458219 shutdown_connections 2024-04-26T23:45:48.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.605+0000 7f0506400640 1 -- 172.21.15.47:0/3667458219 wait complete. 2024-04-26T23:45:48.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 Processor -- start 2024-04-26T23:45:48.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 -- start start 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050006f0a0 0x7f0500156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0500070390 0x7f050014e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f050009c170 0x7f0500153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f05000d2120 con 0x7f050006f0a0 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05000d1fa0 con 0x7f050009c170 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f050006d510 con 0x7f0500070390 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050006f0a0 0x7f0500156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050006f0a0 0x7f0500156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:47134/0 (socket says 172.21.15.47:47134) 2024-04-26T23:45:48.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 -- 172.21.15.47:0/4016305315 learned_addr learned my addr 172.21.15.47:0/4016305315 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04f7e00640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0500070390 0x7f050014e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ffe00640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f050009c170 0x7f0500153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 -- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0500070390 msgr2=0x7f050014e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0500070390 0x7f050014e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 -- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f050009c170 msgr2=0x7f0500153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f050009c170 0x7f0500153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 -- 172.21.15.47:0/4016305315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0500069f40 con 0x7f050006f0a0 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04f7e00640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0500070390 0x7f050014e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ffe00640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f050009c170 0x7f0500153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04ff400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050006f0a0 0x7f0500156620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c400 tx=0x7f04f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04f7400640 1 -- 172.21.15.47:0/4016305315 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0017070 con 0x7f050006f0a0 2024-04-26T23:45:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04f7400640 1 -- 172.21.15.47:0/4016305315 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f0005cf0 con 0x7f050006f0a0 2024-04-26T23:45:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f04f7400640 1 -- 172.21.15.47:0/4016305315 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00072d0 con 0x7f050006f0a0 2024-04-26T23:45:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05000b4150 con 0x7f050006f0a0 2024-04-26T23:45:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0500154180 con 0x7f050006f0a0 2024-04-26T23:45:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.609+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0500069700 con 0x7f050006f0a0 2024-04-26T23:45:48.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.613+0000 7f04f7400640 1 -- 172.21.15.47:0/4016305315 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04f001a070 con 0x7f050006f0a0 2024-04-26T23:45:48.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.613+0000 7f04f7400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f04dc068380 0x7f04dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:48.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.613+0000 7f04f7400640 1 -- 172.21.15.47:0/4016305315 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f04f0085ca0 con 0x7f050006f0a0 2024-04-26T23:45:48.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.613+0000 7f04f7e00640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f04dc068380 0x7f04dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:48.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.613+0000 7f04f7e00640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f04dc068380 0x7f04dc06a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04e80ae000 tx=0x7f04e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:48.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.617+0000 7f04f7400640 1 -- 172.21.15.47:0/4016305315 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f04f0055b70 con 0x7f050006f0a0 2024-04-26T23:45:48.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f050014eee0 con 0x7f050006f0a0 2024-04-26T23:45:48.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f04f7400640 1 -- 172.21.15.47:0/4016305315 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f04f0059e70 con 0x7f050006f0a0 2024-04-26T23:45:48.831 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:45:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f04dc068380 msgr2=0x7f04dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f04dc068380 0x7f04dc06a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f04e80ae000 tx=0x7f04e8008040 comp rx=0 tx=0).stop 2024-04-26T23:45:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050006f0a0 msgr2=0x7f0500156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050006f0a0 0x7f0500156620 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f04f000c400 tx=0x7f04f000c8c0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 shutdown_connections 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f04dc068380 0x7f04dc06a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f050009c170 0x7f0500153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0500070390 0x7f050014e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 --2- 172.21.15.47:0/4016305315 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f050006f0a0 0x7f0500156620 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 >> 172.21.15.47:0/4016305315 conn(0x7f05000d2e90 msgr2=0x7f05000b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 shutdown_connections 2024-04-26T23:45:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48.825+0000 7f0506400640 1 -- 172.21.15.47:0/4016305315 wait complete. 2024-04-26T23:45:48.853 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:45:48.853 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:45:48.853 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-26T23:45:48.853 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:45:48.853 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:48.853 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:45:48.854 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:45:48.854 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:45:48.854 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:45:48.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:48.854 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-26T23:45:48.863 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42386sec preferred_lft 42386sec 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:48.864 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-26T23:45:48.865 INFO:teuthology.orchestra.run.smithi047.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:45:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 02:42:b5:29:54:0a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:45:48.865 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:48.866 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:45:48.866 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:48.866 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:48.866 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:45:48.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-04-26T23:45:48.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-04-26T23:45:48.867 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:45:48.867 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:48.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:49.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:49.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:49.029 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:45:49.047 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-26T23:45:49.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:49.050 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-26T23:45:49.120 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-26T23:45:49.120 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:45:49.120 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:45:49.120 INFO:teuthology.orchestra.run.smithi047.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:45:49.120 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:45:49.121 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:45:49.121 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:49.121 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:49.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:45:49.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:45:49.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:45:49.122 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:49.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:49.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:49.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:49.259 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-26T23:45:49.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:49.268 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-04-26T23:45:49.323 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:49.324 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:49.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:49.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T23:45:49.324 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:49.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:49.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:49.454 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T23:45:49.454 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:49.454 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:49.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T23:45:49.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:45:49.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T23:45:49.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T23:45:49.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T23:45:49.455 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:49.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:49.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:49.672 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:49.672 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:49.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-26T23:45:49.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:45:49.672 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:49.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:49.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:49.758 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:45:49.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:49.759 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:49.767 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:45:49.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:49.768 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:49.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:45:49.886 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:49.939 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:45:49.939 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:45:49.940 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:49.941 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:49.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:49.942 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:45:49.994 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:45:49.994 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:45:50.042 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:45:50.063 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:50.115 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:45:50.116 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:45:50.117 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:50.118 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:50.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:50.119 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:45:50.136 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-04-26T23:45:50.129+0000 7fd24ae01580 -1 init, newargv = 0x55d4fd93dad0 newargc=15 2024-04-26T23:45:50.136 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[33436]: starting ceph client 2024-04-26T23:45:50.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[33436]: starting fuse 2024-04-26T23:45:50.145 INFO:teuthology.orchestra.run.smithi047.stdout:44 2024-04-26T23:45:50.146 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:45:50.146 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-04-26T23:45:50.147 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-04-26T23:45:50.148 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:50.148 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-04-26T23:45:50.148 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:45:50.148 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:45:50.148 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:45:50.148 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-04-26T23:45:50.148 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-04-26T23:45:50.149 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-04-26T23:45:50.149 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:45:50.149 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:50.149 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-04-26T23:45:50.149 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-04-26T23:45:50.272 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.33436.asok 2024-04-26T23:45:50.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:50.284 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33436.asok 2024-04-26T23:45:50.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:50.285 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33436.asok status 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "33436", 2024-04-26T23:45:50.458 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4689, 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4689 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:45:50.459 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 968843697 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 968843697 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4689 192.168.0.1:0/968843697", 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/968843697", 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 8, 2024-04-26T23:45:50.460 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 23, 2024-04-26T23:45:50.461 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:45:50.461 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-04-26T23:45:50.461 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-04-26T23:45:50.461 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:45:50.473 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:45:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.605+0000 7f020b200640 1 Processor -- start 2024-04-26T23:45:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.605+0000 7f020b200640 1 -- start start 2024-04-26T23:45:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f020b200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f020409c170 0x7f02040d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f020b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0204070390 0x7f0204070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f020b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02040d2340 con 0x7f020406f0a0 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f020b200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f02040cf350 con 0x7f020409c170 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f020b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02040cd580 con 0x7f0204070390 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f01fbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f020409c170 0x7f02040d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f01fbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f020409c170 0x7f02040d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57014/0 (socket says 172.21.15.47:57014) 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f0203e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f020406f0a0 0x7f020409ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37456/0 (socket says 172.21.15.47:37456) 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f01fbe00640 1 -- 172.21.15.47:0/3925760762 learned_addr learned my addr 172.21.15.47:0/3925760762 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f0209200640 1 --2- 172.21.15.47:0/3925760762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0204070390 0x7f0204070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f01fbe00640 1 -- 172.21.15.47:0/3925760762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0204070390 msgr2=0x7f0204070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f01fbe00640 1 --2- 172.21.15.47:0/3925760762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0204070390 0x7f0204070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f01fbe00640 1 -- 172.21.15.47:0/3925760762 >> v1:172.21.15.47:6789/0 conn(0x7f020406f0a0 legacy=0x7f020409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f01fbe00640 1 -- 172.21.15.47:0/3925760762 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02040cd860 con 0x7f020409c170 2024-04-26T23:45:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.609+0000 7f0209200640 1 --2- 172.21.15.47:0/3925760762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0204070390 0x7f0204070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f01fbe00640 1 --2- 172.21.15.47:0/3925760762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020409c170 0x7f02040d0fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009870 tx=0x7f01ec01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be6dbba932e4e75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f0203400640 1 -- 172.21.15.47:0/3925760762 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0ab650 con 0x7f020409c170 2024-04-26T23:45:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f0203400640 1 -- 172.21.15.47:0/3925760762 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec0b0070 con 0x7f020409c170 2024-04-26T23:45:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f0203400640 1 -- 172.21.15.47:0/3925760762 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0aba10 con 0x7f020409c170 2024-04-26T23:45:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- 172.21.15.47:0/3925760762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020409c170 msgr2=0x7f02040d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 --2- 172.21.15.47:0/3925760762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020409c170 0x7f02040d0fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009870 tx=0x7f01ec01c560 comp rx=0 tx=0).stop 2024-04-26T23:45:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- 172.21.15.47:0/3925760762 shutdown_connections 2024-04-26T23:45:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 --2- 172.21.15.47:0/3925760762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0204070390 0x7f0204070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 --2- 172.21.15.47:0/3925760762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020409c170 0x7f02040d0fb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- 172.21.15.47:0/3925760762 >> 172.21.15.47:0/3925760762 conn(0x7f02040d2e90 msgr2=0x7f02040d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- 172.21.15.47:0/3925760762 shutdown_connections 2024-04-26T23:45:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- 172.21.15.47:0/3925760762 wait complete. 2024-04-26T23:45:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 Processor -- start 2024-04-26T23:45:50.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- start start 2024-04-26T23:45:50.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020406f0a0 0x7f02040c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:50.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0204070390 0x7f0204154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:50.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020409c170 0x7f02040b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:50.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f02040d2120 con 0x7f020406f0a0 2024-04-26T23:45:50.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02040d1fa0 con 0x7f0204070390 2024-04-26T23:45:50.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f020b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f020406d510 con 0x7f020409c170 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f0203e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020406f0a0 0x7f02040c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f0203e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020406f0a0 0x7f02040c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57016/0 (socket says 172.21.15.47:57016) 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f0203e00640 1 -- 172.21.15.47:0/3261223436 learned_addr learned my addr 172.21.15.47:0/3261223436 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f01fbe00640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0204070390 0x7f0204154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.613+0000 7f0209200640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020409c170 0x7f02040b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0203e00640 1 -- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020409c170 msgr2=0x7f02040b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0203e00640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020409c170 0x7f02040b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0203e00640 1 -- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0204070390 msgr2=0x7f0204154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0203e00640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0204070390 0x7f0204154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0203e00640 1 -- 172.21.15.47:0/3261223436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02041559e0 con 0x7f020406f0a0 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0203e00640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020406f0a0 0x7f02040c72f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c370 tx=0x7f01f400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0200c00640 1 -- 172.21.15.47:0/3261223436 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f40074e0 con 0x7f020406f0a0 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0200c00640 1 -- 172.21.15.47:0/3261223436 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f4007680 con 0x7f020406f0a0 2024-04-26T23:45:50.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0200c00640 1 -- 172.21.15.47:0/3261223436 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4004a30 con 0x7f020406f0a0 2024-04-26T23:45:50.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0204155cc0 con 0x7f020406f0a0 2024-04-26T23:45:50.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0204156280 con 0x7f020406f0a0 2024-04-26T23:45:50.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0204069700 con 0x7f020406f0a0 2024-04-26T23:45:50.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0200c00640 1 -- 172.21.15.47:0/3261223436 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01f401a020 con 0x7f020406f0a0 2024-04-26T23:45:50.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0200c00640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f01e00683b0 0x7f01e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:50.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f0200c00640 1 -- 172.21.15.47:0/3261223436 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f01f4086090 con 0x7f020406f0a0 2024-04-26T23:45:50.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.617+0000 7f01fbe00640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f01e00683b0 0x7f01e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:50.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.621+0000 7f01fbe00640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f01e00683b0 0x7f01e006a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0af000 tx=0x7f01ec0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:50.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.621+0000 7f0200c00640 1 -- 172.21.15.47:0/3261223436 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f01f4055f60 con 0x7f020406f0a0 2024-04-26T23:45:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f02040b1bb0 con 0x7f020406f0a0 2024-04-26T23:45:50.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f0200c00640 1 -- 172.21.15.47:0/3261223436 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f01f405a260 con 0x7f020406f0a0 2024-04-26T23:45:50.832 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:45:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f01e00683b0 msgr2=0x7f01e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f01e00683b0 0x7f01e006a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0af000 tx=0x7f01ec0a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020406f0a0 msgr2=0x7f02040c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020406f0a0 0x7f02040c72f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c370 tx=0x7f01f400c830 comp rx=0 tx=0).stop 2024-04-26T23:45:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 shutdown_connections 2024-04-26T23:45:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f01e00683b0 0x7f01e006a870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f020409c170 0x7f02040b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0204070390 0x7f0204154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 --2- 172.21.15.47:0/3261223436 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f020406f0a0 0x7f02040c72f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:50.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 >> 172.21.15.47:0/3261223436 conn(0x7f02040d2e90 msgr2=0x7f02040b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:50.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 shutdown_connections 2024-04-26T23:45:50.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:50.825+0000 7f020b200640 1 -- 172.21.15.47:0/3261223436 wait complete. 2024-04-26T23:45:50.853 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:45:50.853 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:45:50.854 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-26T23:45:50.854 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-26T23:45:50.854 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-26T23:45:50.854 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:45:50.854 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:45:50.854 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:45:50.854 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-26T23:45:50.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:50.854 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-26T23:45:50.864 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:50.864 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42384sec preferred_lft 42384sec 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:50.865 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 02:42:b5:29:54:0a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-26T23:45:50.866 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:50.867 INFO:teuthology.orchestra.run.smithi047.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:45:50.867 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:50.867 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-26T23:45:50.867 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:50.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:50.867 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:45:50.923 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-26T23:45:50.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:50.926 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-26T23:45:50.980 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-26T23:45:50.980 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:45:50.980 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:45:50.980 INFO:teuthology.orchestra.run.smithi047.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:45:50.980 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:45:50.980 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:45:50.981 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:50.981 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:50.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:45:50.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:45:50.981 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:45:50.981 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:51.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:51.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:51.118 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-26T23:45:51.127 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:45:51.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:51.128 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-04-26T23:45:51.177 INFO:teuthology.orchestra.run.smithi047.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-26T23:45:51.179 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:51.179 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:51.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:45:51.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-26T23:45:51.179 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:51.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:51.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:51.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:51.305 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T23:45:51.325 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 3e:38:0e:ad:47:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::3c38:eff:fead:4722/64 scope link tentative 2024-04-26T23:45:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:51.328 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-26T23:45:51.394 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.394 INFO:teuthology.orchestra.run.smithi047.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:45:51.395 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 3e:38:0e:ad:47:22 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:45:51.395 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:45:51.395 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.395 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::3c38:eff:fead:4722/64 scope link 2024-04-26T23:45:51.395 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:51.396 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-26T23:45:51.396 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:51.396 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:51.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-26T23:45:51.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T23:45:51.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-26T23:45:51.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-26T23:45:51.397 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-26T23:45:51.397 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:51.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:51.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:51.578 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:51.578 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:45:51.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.1 up 2024-04-26T23:45:51.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T23:45:51.578 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:45:51.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:51.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:51.662 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-26T23:45:51.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:51.662 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-26T23:45:51.718 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-26T23:45:51.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:51.719 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-26T23:45:51.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:45:51.838 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:51.892 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:45:51.892 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:45:51.892 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:45:51.892 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:45:51.893 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:45:51.894 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:45:51.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:51.895 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:45:51.946 INFO:teuthology.orchestra.run.smithi047.stdout:44 2024-04-26T23:45:51.946 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-26T23:45:51.946 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-26T23:45:51.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:45:52.017 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:52.067 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:45:52.067 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:45:52.068 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:45:52.069 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:52.070 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:45:52.070 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:52.070 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:45:52.070 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:45:52.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:52.071 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:45:52.091 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi047.stderr:2024-04-26T23:45:52.085+0000 7fbf29a5e580 -1 init, newargv = 0x5572d6af6c60 newargc=15 2024-04-26T23:45:52.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi047.stderr:ceph-fuse[33575]: starting ceph client 2024-04-26T23:45:52.098 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi047.stderr:ceph-fuse[33575]: starting fuse 2024-04-26T23:45:52.101 INFO:teuthology.orchestra.run.smithi047.stdout:44 2024-04-26T23:45:52.101 INFO:teuthology.orchestra.run.smithi047.stdout:45 2024-04-26T23:45:52.101 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-26T23:45:52.101 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:45:52.101 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-04-26T23:45:52.102 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.2")) 2024-04-26T23:45:52.103 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-04-26T23:45:52.228 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.2.33575.asok 2024-04-26T23:45:52.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:52.240 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.33575.asok 2024-04-26T23:45:52.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:52.240 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.33575.asok status 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "2", 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "33575", 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-04-26T23:45:52.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4704, 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4704 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3152038015 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:52.419 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3152038015 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4704 192.168.0.2:0/3152038015", 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.2:0/3152038015", 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 8, 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 23, 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-04-26T23:45:52.420 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:45:52.433 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:45:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.565+0000 7fe7ce000640 1 Processor -- start 2024-04-26T23:45:52.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.565+0000 7fe7ce000640 1 -- start start 2024-04-26T23:45:52.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7ce000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe7c80b4360 0x7fe7c80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7ce000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c815e050 con 0x7fe7c815d5b0 2024-04-26T23:45:52.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7ce000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c815e330 con 0x7fe7c80ce310 2024-04-26T23:45:52.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7ce000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c80ceda0 con 0x7fe7c80b4360 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7bfe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe7c815d5b0 0x7fe7c80cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37460/0 (socket says 172.21.15.47:37460) 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7bfe00640 1 -- 172.21.15.47:0/134369464 learned_addr learned my addr 172.21.15.47:0/134369464 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7400640 1 --2- 172.21.15.47:0/134369464 >> v2:172.21.15.203:3300/0 conn(0x7fe7c80b4360 0x7fe7c80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989282753 0 0) 0x7fe7c815e050 con 0x7fe7c815d5b0 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7ac003530 con 0x7fe7c815d5b0 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1054846089 0 0) 0x7fe7ac003530 con 0x7fe7c815d5b0 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 >> v2:172.21.15.203:3300/0 conn(0x7fe7c80b4360 msgr2=0x7fe7c80cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:52.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 --2- 172.21.15.47:0/134369464 >> v2:172.21.15.203:3300/0 conn(0x7fe7c80b4360 0x7fe7c80cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 >> v1:172.21.15.203:6789/0 conn(0x7fe7c80ce310 legacy=0x7fe7c815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c80cf080 con 0x7fe7c815d5b0 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fe7b0001800 con 0x7fe7c815d5b0 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 >> v1:172.21.15.47:6789/0 conn(0x7fe7c815d5b0 legacy=0x7fe7c80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0039c0 0x7fe7ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7ac004810 0x7fe7ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7ac0051d0 0x7fe7ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c80ceda0 con 0x7fe7ac0051d0 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac00c070 con 0x7fe7ac004810 2024-04-26T23:45:52.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac00c270 con 0x7fe7ac0039c0 2024-04-26T23:45:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7e00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7ac0051d0 0x7fe7ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7bfe00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7ac004810 0x7fe7ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7400640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0039c0 0x7fe7ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7e00640 1 -- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0039c0 msgr2=0x7fe7ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7e00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0039c0 0x7fe7ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7e00640 1 -- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7ac004810 msgr2=0x7fe7ac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:52.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7e00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7ac004810 0x7fe7ac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.569+0000 7fe7c7e00640 1 -- 172.21.15.47:0/134369464 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac003530 con 0x7fe7ac0051d0 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7c7e00640 1 -- 172.21.15.47:0/134369464 reap_dead start 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7c7e00640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7ac0051d0 0x7fe7ac00b9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001e70 tx=0x7fe7c001c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b4cc69f2ddb0a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0001a90 con 0x7fe7ac0051d0 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c0003bc0 con 0x7fe7ac0051d0 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7c6a00640 1 -- 172.21.15.47:0/134369464 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0005020 con 0x7fe7ac0051d0 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 -- 172.21.15.47:0/134369464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7ac0051d0 msgr2=0x7fe7ac00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7ac0051d0 0x7fe7ac00b9d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0001e70 tx=0x7fe7c001c780 comp rx=0 tx=0).stop 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 -- 172.21.15.47:0/134369464 shutdown_connections 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 --2- 172.21.15.47:0/134369464 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7ac0051d0 0x7fe7ac00b9d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 -- 172.21.15.47:0/134369464 >> 172.21.15.47:0/134369464 conn(0x7fe7c806c800 msgr2=0x7fe7c806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:52.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 -- 172.21.15.47:0/134369464 shutdown_connections 2024-04-26T23:45:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 -- 172.21.15.47:0/134369464 wait complete. 2024-04-26T23:45:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.573+0000 7fe7ce000640 1 Processor -- start 2024-04-26T23:45:52.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 -- start start 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0051d0 0x7fe7c8155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c81f0470 0x7fe7c8155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7c80737c0 0x7fe7c8073c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c80b60f0 con 0x7fe7c80737c0 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c80b5f70 con 0x7fe7c81f0470 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7c815da40 con 0x7fe7ac0051d0 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7c80737c0 0x7fe7c8073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7c80737c0 0x7fe7c8073c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57024/0 (socket says 172.21.15.47:57024) 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 -- 172.21.15.47:0/3499546073 learned_addr learned my addr 172.21.15.47:0/3499546073 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7400640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0051d0 0x7fe7c8155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7bfe00640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c81f0470 0x7fe7c8155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 -- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0051d0 msgr2=0x7fe7c8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:52.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0051d0 0x7fe7c8155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 -- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c81f0470 msgr2=0x7fe7c8155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c81f0470 0x7fe7c8155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 -- 172.21.15.47:0/3499546073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c80721f0 con 0x7fe7c80737c0 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7bfe00640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c81f0470 0x7fe7c8155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7400640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0051d0 0x7fe7c8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7c7e00640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7c80737c0 0x7fe7c8073c40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7c001cc60 tx=0x7fe7ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7bf400640 1 -- 172.21.15.47:0/3499546073 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0007dc0 con 0x7fe7c80737c0 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7bf400640 1 -- 172.21.15.47:0/3499546073 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c00057f0 con 0x7fe7c80737c0 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c8072490 con 0x7fe7c80737c0 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7bf400640 1 -- 172.21.15.47:0/3499546073 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0006d70 con 0x7fe7c80737c0 2024-04-26T23:45:52.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c8072a50 con 0x7fe7c80737c0 2024-04-26T23:45:52.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.577+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c8069700 con 0x7fe7c80737c0 2024-04-26T23:45:52.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.581+0000 7fe7bf400640 1 -- 172.21.15.47:0/3499546073 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe7c00a6480 con 0x7fe7c80737c0 2024-04-26T23:45:52.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.581+0000 7fe7bf400640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7a4068380 0x7fe7a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:52.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.581+0000 7fe7bf400640 1 -- 172.21.15.47:0/3499546073 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe7c0120510 con 0x7fe7c80737c0 2024-04-26T23:45:52.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.581+0000 7fe7c7400640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7a4068380 0x7fe7a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:52.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.581+0000 7fe7c7400640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7a4068380 0x7fe7a406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009ac0 tx=0x7fe7b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:52.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.585+0000 7fe7bf400640 1 -- 172.21.15.47:0/3499546073 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7c00b8060 con 0x7fe7c80737c0 2024-04-26T23:45:52.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe7c809d380 con 0x7fe7c80737c0 2024-04-26T23:45:52.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7bf400640 1 -- 172.21.15.47:0/3499546073 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fe7c0016490 con 0x7fe7c80737c0 2024-04-26T23:45:52.795 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7a4068380 msgr2=0x7fe7a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7a4068380 0x7fe7a406a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009ac0 tx=0x7fe7b8008040 comp rx=0 tx=0).stop 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7c80737c0 msgr2=0x7fe7c8073c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7c80737c0 0x7fe7c8073c40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7c001cc60 tx=0x7fe7ac005840 comp rx=0 tx=0).stop 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 shutdown_connections 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7a4068380 0x7fe7a406a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7c80737c0 0x7fe7c8073c40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7c81f0470 0x7fe7c8155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 --2- 172.21.15.47:0/3499546073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7ac0051d0 0x7fe7c8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 >> 172.21.15.47:0/3499546073 conn(0x7fe7c806c800 msgr2=0x7fe7c80cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:52.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 shutdown_connections 2024-04-26T23:45:52.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:52.789+0000 7fe7ce000640 1 -- 172.21.15.47:0/3499546073 wait complete. 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:45:52.816 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:45:52.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:52.817 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-04-26T23:45:52.826 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:52.826 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:45:52.827 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 02:42:b9:62:ce:ce brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:45:52.828 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:52.829 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T23:45:52.829 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:52.829 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:52.829 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add name ceph-brx type bridge 2024-04-26T23:45:52.829 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr flush dev ceph-brx 2024-04-26T23:45:52.829 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set ceph-brx up 2024-04-26T23:45:52.830 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T23:45:52.830 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:52.924 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:52.986 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:52.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:52.993 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:45:53.011 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-26T23:45:53.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:53.014 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-04-26T23:45:53.093 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-04-26T23:45:53.093 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:45:53.093 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:45:53.094 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:45:53.095 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:53.095 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:53.095 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:45:53.095 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:45:53.095 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:45:53.096 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:53.183 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:53.224 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:53.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:53.231 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-26T23:45:53.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:53.240 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-04-26T23:45:53.294 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:53.294 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:53.294 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:53.294 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-26T23:45:53.294 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:53.381 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:53.411 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:53.418 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-26T23:45:53.418 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:53.418 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:53.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-26T23:45:53.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T23:45:53.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-26T23:45:53.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-26T23:45:53.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-26T23:45:53.419 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:53.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:53.580 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:53.587 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:53.587 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:53.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2024-04-26T23:45:53.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T23:45:53.587 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:53.677 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:53.709 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:53.716 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T23:45:53.716 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:53.716 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:53.724 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:45:53.725 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:53.725 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:53.776 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:45:53.840 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:53.893 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:45:53.893 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:45:53.893 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:45:53.893 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:45:53.893 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:45:53.894 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:45:53.894 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:45:53.894 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:45:53.894 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:45:53.894 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:45:53.894 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:45:53.894 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:45:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:45:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:45:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:45:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:45:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:45:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:53.896 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:45:53.896 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:53.896 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:45:53.896 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:45:53.896 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:45:53.896 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:45:53.896 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:45:53.897 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:45:53.897 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:45:53.897 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:45:53.897 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:53.897 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:53.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:53.899 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:45:53.947 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:45:53.948 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T23:45:53.991 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:45:54.011 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:54.061 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:45:54.061 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:45:54.061 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:45:54.061 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:45:54.062 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:54.063 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:54.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:54.064 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:45:54.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:2024-04-26T23:45:54.079+0000 7fab7a09b580 -1 init, newargv = 0x561190de2c70 newargc=15 2024-04-26T23:45:54.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33385]: starting ceph client 2024-04-26T23:45:54.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33385]: starting fuse 2024-04-26T23:45:54.095 INFO:teuthology.orchestra.run.smithi203.stdout:44 2024-04-26T23:45:54.095 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:45:54.095 DEBUG:teuthology.orchestra.run.smithi203:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:45:54.095 DEBUG:teuthology.orchestra.run.smithi203:> import glob 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> import re 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> import os 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> import subprocess 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> def _find_admin_socket(client_name): 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> files = glob.glob(asok_path) 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> # Given a non-glob path, it better be there 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> if "*" not in asok_path: 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> assert(len(files) == 1) 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> return files[0] 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:54.096 DEBUG:teuthology.orchestra.run.smithi203:> for f in files: 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> contents = proc_f.read() 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> if mountpoint in contents: 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> return f 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> print(_find_admin_socket("client.1")) 2024-04-26T23:45:54.097 DEBUG:teuthology.orchestra.run.smithi203:> ' 2024-04-26T23:45:54.217 INFO:teuthology.orchestra.run.smithi203.stdout:/var/run/ceph/ceph-client.1.33385.asok 2024-04-26T23:45:54.221 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:54.229 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33385.asok 2024-04-26T23:45:54.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:54.229 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33385.asok status 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "metadata": { 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "entity_id": "1", 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "hostname": "smithi203", 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "pid": "33385", 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: "root": "/" 2024-04-26T23:45:54.402 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_count": 0, 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_pinned_count": 0, 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "id": 4657, 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "inst": { 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "name": { 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "client", 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "num": 4657 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 2598070633 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-04-26T23:45:54.403 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 2598070633 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "inst_str": "client.4657 192.168.0.1:0/2598070633", 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "addr_str": "192.168.0.1:0/2598070633", 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "inode_count": 1, 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_epoch": 8, 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch": 23, 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "blocklisted": false, 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout: "fs_name": "cephfs" 2024-04-26T23:45:54.404 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-04-26T23:45:54.417 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:45:54.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.557+0000 7f06a3200640 1 Processor -- start 2024-04-26T23:45:54.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a3200640 1 -- start start 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06a415bd70 0x7f06a40b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a3200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f06a4070570 0x7f06a4073490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a40b5270 con 0x7f06a40739d0 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f06a4073e20 con 0x7f06a415bd70 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a3200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f06a415c150 con 0x7f06a4070570 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a1e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06a415bd70 0x7f06a40b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a1e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06a415bd70 0x7f06a40b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57032/0 (socket says 172.21.15.47:57032) 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a1e00640 1 -- 172.21.15.47:0/1533636293 learned_addr learned my addr 172.21.15.47:0/1533636293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:54.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f069be00640 1 --2- 172.21.15.47:0/1533636293 >> v2:172.21.15.203:3300/0 conn(0x7f06a4070570 0x7f06a4073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:54.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a1e00640 1 -- 172.21.15.47:0/1533636293 >> v2:172.21.15.203:3300/0 conn(0x7f06a4070570 msgr2=0x7f06a4073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:54.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a1e00640 1 --2- 172.21.15.47:0/1533636293 >> v2:172.21.15.203:3300/0 conn(0x7f06a4070570 0x7f06a4073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a1e00640 1 -- 172.21.15.47:0/1533636293 >> v1:172.21.15.203:6789/0 conn(0x7f06a40739d0 legacy=0x7f06a415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:54.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f06a1e00640 1 -- 172.21.15.47:0/1533636293 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a40b41d0 con 0x7f06a415bd70 2024-04-26T23:45:54.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.561+0000 7f069be00640 1 --2- 172.21.15.47:0/1533636293 >> v2:172.21.15.203:3300/0 conn(0x7f06a4070570 0x7f06a4073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:54.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a1e00640 1 --2- 172.21.15.47:0/1533636293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a40b5e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f06a4070f10 tx=0x7f069401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e5cd76ca93b1c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:54.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a1400640 1 -- 172.21.15.47:0/1533636293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940ab610 con 0x7f06a415bd70 2024-04-26T23:45:54.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a1400640 1 -- 172.21.15.47:0/1533636293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06940b0070 con 0x7f06a415bd70 2024-04-26T23:45:54.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a1400640 1 -- 172.21.15.47:0/1533636293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06940ab9d0 con 0x7f06a415bd70 2024-04-26T23:45:54.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 -- 172.21.15.47:0/1533636293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 msgr2=0x7f06a40b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:54.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 --2- 172.21.15.47:0/1533636293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a40b5e80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f06a4070f10 tx=0x7f069401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 -- 172.21.15.47:0/1533636293 shutdown_connections 2024-04-26T23:45:54.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 --2- 172.21.15.47:0/1533636293 >> v2:172.21.15.203:3300/0 conn(0x7f06a4070570 0x7f06a4073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 --2- 172.21.15.47:0/1533636293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a40b5e80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 -- 172.21.15.47:0/1533636293 >> 172.21.15.47:0/1533636293 conn(0x7f06a406cef0 msgr2=0x7f06a40b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:54.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 -- 172.21.15.47:0/1533636293 shutdown_connections 2024-04-26T23:45:54.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 -- 172.21.15.47:0/1533636293 wait complete. 2024-04-26T23:45:54.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 Processor -- start 2024-04-26T23:45:54.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.565+0000 7f06a3200640 1 -- start start 2024-04-26T23:45:54.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06a4070570 0x7f06a415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:54.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06a40739d0 0x7f06a41f7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:54.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a41460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:54.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06a40d0580 con 0x7f06a415bd70 2024-04-26T23:45:54.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f06a40b4d50 con 0x7f06a40739d0 2024-04-26T23:45:54.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f06a40d0700 con 0x7f06a4070570 2024-04-26T23:45:54.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a41460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:54.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f069be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06a40739d0 0x7f06a41f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:54.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a41460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57034/0 (socket says 172.21.15.47:57034) 2024-04-26T23:45:54.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 -- 172.21.15.47:0/3321418607 learned_addr learned my addr 172.21.15.47:0/3321418607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a1e00640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06a4070570 0x7f06a415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 -- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06a4070570 msgr2=0x7f06a415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06a4070570 0x7f06a415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 -- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06a40739d0 msgr2=0x7f06a41f7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06a40739d0 0x7f06a41f7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 -- 172.21.15.47:0/3321418607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a4146c70 con 0x7f06a415bd70 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f069be00640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06a40739d0 0x7f06a41f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a2800640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a41460a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c770 tx=0x7f069c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f069a000640 1 -- 172.21.15.47:0/3321418607 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c003b80 con 0x7f06a415bd70 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f069a000640 1 -- 172.21.15.47:0/3321418607 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c003d20 con 0x7f06a415bd70 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f069a000640 1 -- 172.21.15.47:0/3321418607 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c00aa90 con 0x7f06a415bd70 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a415e190 con 0x7f06a415bd70 2024-04-26T23:45:54.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a415c370 con 0x7f06a415bd70 2024-04-26T23:45:54.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a4069b80 con 0x7f06a415bd70 2024-04-26T23:45:54.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.569+0000 7f069a000640 1 -- 172.21.15.47:0/3321418607 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f069c00ac30 con 0x7f06a415bd70 2024-04-26T23:45:54.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.573+0000 7f069a000640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06800683b0 0x7f068006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:54.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.573+0000 7f069a000640 1 -- 172.21.15.47:0/3321418607 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f069c086760 con 0x7f06a415bd70 2024-04-26T23:45:54.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.573+0000 7f06a1e00640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06800683b0 0x7f068006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:54.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.573+0000 7f06a1e00640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06800683b0 0x7f068006a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06940af000 tx=0x7f06940a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:54.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.577+0000 7f069a000640 1 -- 172.21.15.47:0/3321418607 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f069c0566c0 con 0x7f06a415bd70 2024-04-26T23:45:54.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.777+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06a4149860 con 0x7f06a415bd70 2024-04-26T23:45:54.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.777+0000 7f069a000640 1 -- 172.21.15.47:0/3321418607 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f069c05a9c0 con 0x7f06a415bd70 2024-04-26T23:45:54.785 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06800683b0 msgr2=0x7f068006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06800683b0 0x7f068006a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06940af000 tx=0x7f06940a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 msgr2=0x7f06a41460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a41460a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f069c00c770 tx=0x7f069c00cc30 comp rx=0 tx=0).stop 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 shutdown_connections 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06800683b0 0x7f068006a870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06a415bd70 0x7f06a41460a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06a40739d0 0x7f06a41f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 --2- 172.21.15.47:0/3321418607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06a4070570 0x7f06a415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:54.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 >> 172.21.15.47:0/3321418607 conn(0x7f06a406cef0 msgr2=0x7f06a414a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:54.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 shutdown_connections 2024-04-26T23:45:54.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:54.781+0000 7f06a3200640 1 -- 172.21.15.47:0/3321418607 wait complete. 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:45:54.807 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-26T23:45:54.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:54.807 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-04-26T23:45:54.817 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:54.817 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:54.817 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:54.817 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:54.817 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42386sec preferred_lft 42386sec 2024-04-26T23:45:54.818 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 02:42:b9:62:ce:ce brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:45:54.819 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:54.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:54.820 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:45:54.881 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-26T23:45:54.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:54.884 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:45:54.940 INFO:teuthology.orchestra.run.smithi203.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:45:54.941 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:45:54.941 INFO:teuthology.orchestra.run.smithi203.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:45:54.941 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:45:54.941 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:54.941 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:54.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:45:54.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:45:54.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:45:54.942 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:55.034 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:55.074 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:55.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:55.082 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-26T23:45:55.094 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:45:55.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:55.094 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2024-04-26T23:45:55.148 INFO:teuthology.orchestra.run.smithi203.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-26T23:45:55.149 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:55.149 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:55.149 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:45:55.149 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-26T23:45:55.149 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:55.239 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:55.269 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:55.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:55.276 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T23:45:55.346 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:55.346 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:55.346 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:55.346 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.346 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:55.347 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.347 INFO:teuthology.orchestra.run.smithi203.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:45:55.347 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether e6:e8:17:16:b6:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:45:55.347 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:45:55.347 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.347 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::e4e8:17ff:fe16:b6ef/64 scope link 2024-04-26T23:45:55.347 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:55.348 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether e6:e8:17:16:b6:ef brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::e4e8:17ff:fe16:b6ef/64 scope link 2024-04-26T23:45:55.417 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:45:55.418 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-26T23:45:55.419 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:55.511 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:55.596 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:55.602 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:45:55.603 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:45:55.603 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.1 up 2024-04-26T23:45:55.603 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.1 master ceph-brx 2024-04-26T23:45:55.603 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:45:55.693 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:45:55.724 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:55.730 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-26T23:45:55.730 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:55.730 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-26T23:45:55.780 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-26T23:45:55.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:45:55.780 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-26T23:45:55.831 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:45:55.892 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:55.945 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:45:55.945 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:45:55.945 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:45:55.945 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:45:55.945 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:45:55.946 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:45:55.947 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:45:55.947 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:45:55.947 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:55.947 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:45:55.947 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:55.947 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:45:55.947 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:45:55.948 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:45:55.948 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:45:55.948 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:45:55.948 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:45:55.949 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:45:55.949 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:45:55.949 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:55.949 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:55.949 INFO:teuthology.orchestra.run.smithi203.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:55.949 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:45:55.949 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:45:55.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:55.950 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:45:55.999 INFO:teuthology.orchestra.run.smithi203.stdout:44 2024-04-26T23:45:56.000 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-04-26T23:45:56.000 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-26T23:45:56.043 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:45:56.063 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:45:56.113 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:45:56.113 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:45:56.114 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:56.115 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:45:56.116 INFO:teuthology.orchestra.run.smithi203.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:56.116 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:45:56.116 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:45:56.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.117 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:45:56.136 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi203.stderr:2024-04-26T23:45:56.126+0000 7fdd3a920580 -1 init, newargv = 0x55e740a71ba0 newargc=15 2024-04-26T23:45:56.136 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi203.stderr:ceph-fuse[33498]: starting ceph client 2024-04-26T23:45:56.142 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi203.stderr:ceph-fuse[33498]: starting fuse 2024-04-26T23:45:56.145 INFO:teuthology.orchestra.run.smithi203.stdout:44 2024-04-26T23:45:56.145 INFO:teuthology.orchestra.run.smithi203.stdout:45 2024-04-26T23:45:56.145 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-04-26T23:45:56.145 DEBUG:teuthology.orchestra.run.smithi203:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:45:56.145 DEBUG:teuthology.orchestra.run.smithi203:> import glob 2024-04-26T23:45:56.145 DEBUG:teuthology.orchestra.run.smithi203:> import re 2024-04-26T23:45:56.145 DEBUG:teuthology.orchestra.run.smithi203:> import os 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> import subprocess 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> def _find_admin_socket(client_name): 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> files = glob.glob(asok_path) 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> # Given a non-glob path, it better be there 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> if "*" not in asok_path: 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> assert(len(files) == 1) 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> return files[0] 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> for f in files: 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:45:56.146 DEBUG:teuthology.orchestra.run.smithi203:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:45:56.147 DEBUG:teuthology.orchestra.run.smithi203:> contents = proc_f.read() 2024-04-26T23:45:56.147 DEBUG:teuthology.orchestra.run.smithi203:> if mountpoint in contents: 2024-04-26T23:45:56.147 DEBUG:teuthology.orchestra.run.smithi203:> return f 2024-04-26T23:45:56.147 DEBUG:teuthology.orchestra.run.smithi203:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:45:56.147 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:45:56.147 DEBUG:teuthology.orchestra.run.smithi203:> print(_find_admin_socket("client.3")) 2024-04-26T23:45:56.147 DEBUG:teuthology.orchestra.run.smithi203:> ' 2024-04-26T23:45:56.272 INFO:teuthology.orchestra.run.smithi203.stdout:/var/run/ceph/ceph-client.3.33498.asok 2024-04-26T23:45:56.275 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:45:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:45:56.283 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33498.asok 2024-04-26T23:45:56.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.283 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33498.asok status 2024-04-26T23:45:56.452 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "metadata": { 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "entity_id": "3", 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "hostname": "smithi203", 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "pid": "33498", 2024-04-26T23:45:56.453 INFO:teuthology.orchestra.run.smithi203.stdout: "root": "/" 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_count": 0, 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_pinned_count": 0, 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: "id": 4675, 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: "inst": { 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: "name": { 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "client", 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: "num": 4675 2024-04-26T23:45:56.454 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 2255800751 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.2:0", 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 2255800751 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "inst_str": "client.4675 192.168.0.2:0/2255800751", 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "addr_str": "192.168.0.2:0/2255800751", 2024-04-26T23:45:56.455 INFO:teuthology.orchestra.run.smithi203.stdout: "inode_count": 1, 2024-04-26T23:45:56.456 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_epoch": 8, 2024-04-26T23:45:56.456 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch": 23, 2024-04-26T23:45:56.456 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:45:56.456 INFO:teuthology.orchestra.run.smithi203.stdout: "blocklisted": false, 2024-04-26T23:45:56.456 INFO:teuthology.orchestra.run.smithi203.stdout: "fs_name": "cephfs" 2024-04-26T23:45:56.456 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-04-26T23:45:56.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.468 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-04-26T23:45:56.468 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:56.479 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-04-26T23:45:56.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:56.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:45:56.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.546 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-04-26T23:45:56.546 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-26T23:45:56.601 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-04-26T23:45:56.602 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-26T23:45:56.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.602 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-26T23:45:56.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.667 DEBUG:teuthology.orchestra.run.smithi203:> stat --file-system '--printf=%T 2024-04-26T23:45:56.667 DEBUG:teuthology.orchestra.run.smithi203:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:56.676 INFO:teuthology.orchestra.run.smithi203.stdout:fuseblk 2024-04-26T23:45:56.677 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:56.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:45:56.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.743 DEBUG:teuthology.orchestra.run.smithi203:> stat --file-system '--printf=%T 2024-04-26T23:45:56.743 DEBUG:teuthology.orchestra.run.smithi203:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-26T23:45:56.792 INFO:teuthology.orchestra.run.smithi203.stdout:fuseblk 2024-04-26T23:45:56.793 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-26T23:45:56.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:45:56.793 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-26T23:45:56.855 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-26T23:45:56.873 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:57.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.017+0000 7f9add400640 1 Processor -- start 2024-04-26T23:45:57.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.017+0000 7f9add400640 1 -- start start 2024-04-26T23:45:57.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9add400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9add400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad80d2340 con 0x7f9ad809ba60 2024-04-26T23:45:57.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9add400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad80cd580 con 0x7f9ad80713a0 2024-04-26T23:45:57.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9add400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad80cd860 con 0x7f9ad806f0a0 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9acde00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9ad809ba60 0x7f9ad80ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37470/0 (socket says 172.21.15.47:37470) 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9acde00640 1 -- 172.21.15.47:0/1409225016 learned_addr learned my addr 172.21.15.47:0/1409225016 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad6800640 1 --2- 172.21.15.47:0/1409225016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad5e00640 1 -- 172.21.15.47:0/1409225016 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101144268 0 0) 0x7f9ad80d2340 con 0x7f9ad809ba60 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad5e00640 1 -- 172.21.15.47:0/1409225016 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9abc003530 con 0x7f9ad809ba60 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad5e00640 1 -- 172.21.15.47:0/1409225016 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198327785 0 0) 0x7f9ad80cd580 con 0x7f9ad80713a0 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad5e00640 1 -- 172.21.15.47:0/1409225016 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ad80d2340 con 0x7f9ad80713a0 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad6800640 1 -- 172.21.15.47:0/1409225016 >> v1:172.21.15.203:6789/0 conn(0x7f9ad80713a0 legacy=0x7f9ad80cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad6800640 1 -- 172.21.15.47:0/1409225016 >> v1:172.21.15.47:6789/0 conn(0x7f9ad809ba60 legacy=0x7f9ad80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.021+0000 7f9ad6800640 1 -- 172.21.15.47:0/1409225016 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad80cdb40 con 0x7f9ad806f0a0 2024-04-26T23:45:57.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9ad6800640 1 --2- 172.21.15.47:0/1409225016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80d0fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009820 tx=0x7f9ac801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df51748cbc334d51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9ad5e00640 1 -- 172.21.15.47:0/1409225016 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80b0070 con 0x7f9ad806f0a0 2024-04-26T23:45:57.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9ad5e00640 1 -- 172.21.15.47:0/1409225016 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac80ab600 con 0x7f9ad806f0a0 2024-04-26T23:45:57.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9ad5e00640 1 -- 172.21.15.47:0/1409225016 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80ab9d0 con 0x7f9ad806f0a0 2024-04-26T23:45:57.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- 172.21.15.47:0/1409225016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 msgr2=0x7f9ad80d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 --2- 172.21.15.47:0/1409225016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80d0fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009820 tx=0x7f9ac801c4c0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- 172.21.15.47:0/1409225016 shutdown_connections 2024-04-26T23:45:57.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 --2- 172.21.15.47:0/1409225016 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80d0fb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- 172.21.15.47:0/1409225016 >> 172.21.15.47:0/1409225016 conn(0x7f9ad80d2e90 msgr2=0x7f9ad80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:57.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- 172.21.15.47:0/1409225016 shutdown_connections 2024-04-26T23:45:57.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- 172.21.15.47:0/1409225016 wait complete. 2024-04-26T23:45:57.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 Processor -- start 2024-04-26T23:45:57.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- start start 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ad80713a0 0x7f9ad806da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad809ba60 0x7f9ad806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad806d510 con 0x7f9ad809ba60 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad809c270 con 0x7f9ad80713a0 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.025+0000 7f9add400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad80b8120 con 0x7f9ad806f0a0 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad809ba60 0x7f9ad806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9acde00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ad80713a0 0x7f9ad806da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:55696/0 (socket says 172.21.15.47:55696) 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 -- 172.21.15.47:0/3134323156 learned_addr learned my addr 172.21.15.47:0/3134323156 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad809ba60 0x7f9ad806dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57044/0 (socket says 172.21.15.47:57044) 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 -- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ad80713a0 msgr2=0x7f9ad806da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ad80713a0 0x7f9ad806da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 -- 172.21.15.47:0/3134323156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad809ba60 msgr2=0x7f9ad806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad809ba60 0x7f9ad806dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 -- 172.21.15.47:0/3134323156 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad80b8400 con 0x7f9ad806f0a0 2024-04-26T23:45:57.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9ad6800640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80c9110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80190d0 tx=0x7f9ac8019260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9acf400640 1 -- 172.21.15.47:0/3134323156 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80b0040 con 0x7f9ad806f0a0 2024-04-26T23:45:57.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9acf400640 1 -- 172.21.15.47:0/3134323156 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac80bb070 con 0x7f9ad806f0a0 2024-04-26T23:45:57.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9acf400640 1 -- 172.21.15.47:0/3134323156 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8006e20 con 0x7f9ad806f0a0 2024-04-26T23:45:57.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad80b86e0 con 0x7f9ad806f0a0 2024-04-26T23:45:57.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad81531f0 con 0x7f9ad806f0a0 2024-04-26T23:45:57.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad8069700 con 0x7f9ad806f0a0 2024-04-26T23:45:57.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.029+0000 7f9acf400640 1 -- 172.21.15.47:0/3134323156 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ac80b3070 con 0x7f9ad806f0a0 2024-04-26T23:45:57.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.033+0000 7f9acf400640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ab4068380 0x7f9ab406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.033+0000 7f9acf400640 1 -- 172.21.15.47:0/3134323156 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9ac81209c0 con 0x7f9ad806f0a0 2024-04-26T23:45:57.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.033+0000 7f9acde00640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ab4068380 0x7f9ab406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.033+0000 7f9acde00640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ab4068380 0x7f9ab406a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ad815bba0 tx=0x7f9ac0007d80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.037+0000 7f9acf400640 1 -- 172.21.15.47:0/3134323156 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9ac80160b0 con 0x7f9ad806f0a0 2024-04-26T23:45:57.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.201+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ad80b8b90 con 0x7f9ad806f0a0 2024-04-26T23:45:57.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.201+0000 7f9acf400640 1 -- 172.21.15.47:0/3134323156 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f9ac80f0a30 con 0x7f9ad806f0a0 2024-04-26T23:45:57.210 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:57.211 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:57.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ab4068380 msgr2=0x7f9ab406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ab4068380 0x7f9ab406a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9ad815bba0 tx=0x7f9ac0007d80 comp rx=0 tx=0).stop 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 msgr2=0x7f9ad80c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80c9110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80190d0 tx=0x7f9ac8019260 comp rx=0 tx=0).stop 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 shutdown_connections 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ab4068380 0x7f9ab406a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ad809ba60 0x7f9ad806dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ad80713a0 0x7f9ad806da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 --2- 172.21.15.47:0/3134323156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ad806f0a0 0x7f9ad80c9110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 >> 172.21.15.47:0/3134323156 conn(0x7f9ad80d2e90 msgr2=0x7f9ad80b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 shutdown_connections 2024-04-26T23:45:57.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.205+0000 7f9add400640 1 -- 172.21.15.47:0/3134323156 wait complete. 2024-04-26T23:45:57.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:45:57.233 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:45:57.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.369+0000 7fddc3200640 1 Processor -- start 2024-04-26T23:45:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.369+0000 7fddc3200640 1 -- start start 2024-04-26T23:45:57.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddc3200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fddbc06cd40 0x7fddbc0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddc3200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddbc0ae6a0 con 0x7fddbc0d0390 2024-04-26T23:45:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddc3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddbc0ae920 con 0x7fddbc15fcd0 2024-04-26T23:45:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddc3200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fddbc0aec00 con 0x7fddbc06cd40 2024-04-26T23:45:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddbbe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fddbc0d0390 0x7fddbc06c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37474/0 (socket says 172.21.15.47:37474) 2024-04-26T23:45:57.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddbbe00640 1 -- 172.21.15.47:0/1056178767 learned_addr learned my addr 172.21.15.47:0/1056178767 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddb3e00640 1 --2- 172.21.15.47:0/1056178767 >> v2:172.21.15.203:3300/0 conn(0x7fddbc06cd40 0x7fddbc0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddbb400640 1 -- 172.21.15.47:0/1056178767 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954482760 0 0) 0x7fddac001120 con 0x7fddbc0d0390 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddbb400640 1 -- 172.21.15.47:0/1056178767 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda0003530 con 0x7fddbc0d0390 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddbb400640 1 -- 172.21.15.47:0/1056178767 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261123001 0 0) 0x7fddbc0ae920 con 0x7fddbc15fcd0 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddbb400640 1 -- 172.21.15.47:0/1056178767 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddac001120 con 0x7fddbc15fcd0 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddb3e00640 1 -- 172.21.15.47:0/1056178767 >> v1:172.21.15.203:6789/0 conn(0x7fddbc15fcd0 legacy=0x7fddbc160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddb3e00640 1 -- 172.21.15.47:0/1056178767 >> v1:172.21.15.47:6789/0 conn(0x7fddbc0d0390 legacy=0x7fddbc06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.373+0000 7fddb3e00640 1 -- 172.21.15.47:0/1056178767 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc0aeee0 con 0x7fddbc06cd40 2024-04-26T23:45:57.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddb3e00640 1 --2- 172.21.15.47:0/1056178767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc06cd40 0x7fddbc0af6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdda40097c0 tx=0x7fdda401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c633208a7471a354 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddbb400640 1 -- 172.21.15.47:0/1056178767 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40b0070 con 0x7fddbc06cd40 2024-04-26T23:45:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddbb400640 1 -- 172.21.15.47:0/1056178767 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40ab600 con 0x7fddbc06cd40 2024-04-26T23:45:57.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddbb400640 1 -- 172.21.15.47:0/1056178767 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40ab9b0 con 0x7fddbc06cd40 2024-04-26T23:45:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- 172.21.15.47:0/1056178767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc06cd40 msgr2=0x7fddbc0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 --2- 172.21.15.47:0/1056178767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc06cd40 0x7fddbc0af6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdda40097c0 tx=0x7fdda401c3e0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- 172.21.15.47:0/1056178767 shutdown_connections 2024-04-26T23:45:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 --2- 172.21.15.47:0/1056178767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc06cd40 0x7fddbc0af6e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- 172.21.15.47:0/1056178767 >> 172.21.15.47:0/1056178767 conn(0x7fddbc0b2b70 msgr2=0x7fddbc0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- 172.21.15.47:0/1056178767 shutdown_connections 2024-04-26T23:45:57.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- 172.21.15.47:0/1056178767 wait complete. 2024-04-26T23:45:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 Processor -- start 2024-04-26T23:45:57.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- start start 2024-04-26T23:45:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddbc06cd40 0x7fddbc09e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0d0390 0x7fddbc14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc15fcd0 0x7fddbc13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc06faf0 con 0x7fddbc0d0390 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fddbc06f970 con 0x7fddbc15fcd0 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddc3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fddbc06fc70 con 0x7fddbc06cd40 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.377+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0d0390 0x7fddbc14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0d0390 0x7fddbc14e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57056/0 (socket says 172.21.15.47:57056) 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 -- 172.21.15.47:0/964735200 learned_addr learned my addr 172.21.15.47:0/964735200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddbbe00640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddbc06cd40 0x7fddbc09e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddc1200640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc15fcd0 0x7fddbc13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 -- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddbc06cd40 msgr2=0x7fddbc09e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddbc06cd40 0x7fddbc09e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 -- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc15fcd0 msgr2=0x7fddbc13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc15fcd0 0x7fddbc13e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 -- 172.21.15.47:0/964735200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddbc14c790 con 0x7fddbc0d0390 2024-04-26T23:45:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb3e00640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0d0390 0x7fddbc14e200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdda401a010 tx=0x7fdda4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb8c00640 1 -- 172.21.15.47:0/964735200 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40ba070 con 0x7fddbc0d0390 2024-04-26T23:45:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb8c00640 1 -- 172.21.15.47:0/964735200 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda40ab9b0 con 0x7fddbc0d0390 2024-04-26T23:45:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb8c00640 1 -- 172.21.15.47:0/964735200 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda40b0040 con 0x7fddbc0d0390 2024-04-26T23:45:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddbc14ec50 con 0x7fddbc0d0390 2024-04-26T23:45:57.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddbc14f210 con 0x7fddbc0d0390 2024-04-26T23:45:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddbc069700 con 0x7fddbc0d0390 2024-04-26T23:45:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb8c00640 1 -- 172.21.15.47:0/964735200 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdda4003620 con 0x7fddbc0d0390 2024-04-26T23:45:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.381+0000 7fddb8c00640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.385+0000 7fddb8c00640 1 -- 172.21.15.47:0/964735200 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdda411fae0 con 0x7fddbc0d0390 2024-04-26T23:45:57.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.385+0000 7fddbbe00640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.385+0000 7fddbbe00640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdd98068380 0x7fdd9806a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddac007fd0 tx=0x7fddac007d80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.389+0000 7fddb8c00640 1 -- 172.21.15.47:0/964735200 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdda4016090 con 0x7fddbc0d0390 2024-04-26T23:45:57.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.549+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fddbc0687b0 con 0x7fddbc0d0390 2024-04-26T23:45:57.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddb8c00640 1 -- 172.21.15.47:0/964735200 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fdda40ef920 con 0x7fddbc0d0390 2024-04-26T23:45:57.559 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:45:57.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdd98068380 msgr2=0x7fdd9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdd98068380 0x7fdd9806a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddac007fd0 tx=0x7fddac007d80 comp rx=0 tx=0).stop 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0d0390 msgr2=0x7fddbc14e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0d0390 0x7fddbc14e200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdda401a010 tx=0x7fdda4019180 comp rx=0 tx=0).stop 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 shutdown_connections 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdd98068380 0x7fdd9806a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fddbc15fcd0 0x7fddbc13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fddbc0d0390 0x7fddbc14e200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 --2- 172.21.15.47:0/964735200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fddbc06cd40 0x7fddbc09e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 >> 172.21.15.47:0/964735200 conn(0x7fddbc0b2b70 msgr2=0x7fddbc15ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 shutdown_connections 2024-04-26T23:45:57.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.553+0000 7fddc3200640 1 -- 172.21.15.47:0/964735200 wait complete. 2024-04-26T23:45:57.580 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:45:57.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed3d400640 1 Processor -- start 2024-04-26T23:45:57.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed3d400640 1 -- start start 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed3d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3815cee0 0x7fed380b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed3d400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fed3806cb10 0x7fed381601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed3d400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed380af510 con 0x7fed380aeda0 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed3d400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fed38160710 con 0x7fed3806cb10 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed3d400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed380af7f0 con 0x7fed3815cee0 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed36800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3815cee0 0x7fed380b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed36800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3815cee0 0x7fed380b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:55718/0 (socket says 172.21.15.47:55718) 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed36800640 1 -- 172.21.15.47:0/4136151212 learned_addr learned my addr 172.21.15.47:0/4136151212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:57.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed37200640 1 --2- 172.21.15.47:0/4136151212 >> v2:172.21.15.203:3300/0 conn(0x7fed3806cb10 0x7fed381601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed36800640 1 -- 172.21.15.47:0/4136151212 >> v2:172.21.15.203:3300/0 conn(0x7fed3806cb10 msgr2=0x7fed381601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed36800640 1 --2- 172.21.15.47:0/4136151212 >> v2:172.21.15.203:3300/0 conn(0x7fed3806cb10 0x7fed381601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed36800640 1 -- 172.21.15.47:0/4136151212 >> v1:172.21.15.203:6789/0 conn(0x7fed380aeda0 legacy=0x7fed3806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed36800640 1 -- 172.21.15.47:0/4136151212 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3815f9d0 con 0x7fed3815cee0 2024-04-26T23:45:57.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.717+0000 7fed35e00640 1 -- 172.21.15.47:0/4136151212 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905205271 0 0) 0x7fed380af510 con 0x7fed380aeda0 2024-04-26T23:45:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed36800640 1 --2- 172.21.15.47:0/4136151212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3815cee0 0x7fed380b1260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed28009870 tx=0x7fed2801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ffdf56ad4006d0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed35e00640 1 -- 172.21.15.47:0/4136151212 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280ab660 con 0x7fed3815cee0 2024-04-26T23:45:57.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed35e00640 1 -- 172.21.15.47:0/4136151212 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280b0070 con 0x7fed3815cee0 2024-04-26T23:45:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed35e00640 1 -- 172.21.15.47:0/4136151212 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280aba20 con 0x7fed3815cee0 2024-04-26T23:45:57.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 -- 172.21.15.47:0/4136151212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3815cee0 msgr2=0x7fed380b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 --2- 172.21.15.47:0/4136151212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3815cee0 0x7fed380b1260 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fed28009870 tx=0x7fed2801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 -- 172.21.15.47:0/4136151212 shutdown_connections 2024-04-26T23:45:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 --2- 172.21.15.47:0/4136151212 >> v2:172.21.15.203:3300/0 conn(0x7fed3806cb10 0x7fed381601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 --2- 172.21.15.47:0/4136151212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed3815cee0 0x7fed380b1260 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 -- 172.21.15.47:0/4136151212 >> 172.21.15.47:0/4136151212 conn(0x7fed380b4400 msgr2=0x7fed380d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 -- 172.21.15.47:0/4136151212 shutdown_connections 2024-04-26T23:45:57.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.721+0000 7fed3d400640 1 -- 172.21.15.47:0/4136151212 wait complete. 2024-04-26T23:45:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 Processor -- start 2024-04-26T23:45:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 -- start start 2024-04-26T23:45:57.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3806cb10 0x7fed38150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed380aeda0 0x7fed3813d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3815cee0 0x7fed3815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fed380b5a80 con 0x7fed3815cee0 2024-04-26T23:45:57.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed380b5900 con 0x7fed3806cb10 2024-04-26T23:45:57.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fed380b5c00 con 0x7fed380aeda0 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3815cee0 0x7fed3815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3815cee0 0x7fed3815db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57058/0 (socket says 172.21.15.47:57058) 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 -- 172.21.15.47:0/264942186 learned_addr learned my addr 172.21.15.47:0/264942186 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed36800640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3806cb10 0x7fed38150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed2de00640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed380aeda0 0x7fed3813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 -- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed380aeda0 msgr2=0x7fed3813d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed380aeda0 0x7fed3813d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 -- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3806cb10 msgr2=0x7fed38150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3806cb10 0x7fed38150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 -- 172.21.15.47:0/264942186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3813de10 con 0x7fed3815cee0 2024-04-26T23:45:57.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed37200640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3815cee0 0x7fed3815db60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed3000efc0 tx=0x7fed3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed2f400640 1 -- 172.21.15.47:0/264942186 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30018020 con 0x7fed3815cee0 2024-04-26T23:45:57.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed2f400640 1 -- 172.21.15.47:0/264942186 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30014480 con 0x7fed3815cee0 2024-04-26T23:45:57.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed2f400640 1 -- 172.21.15.47:0/264942186 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30009e60 con 0x7fed3815cee0 2024-04-26T23:45:57.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3813e0f0 con 0x7fed3815cee0 2024-04-26T23:45:57.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.725+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3815d640 con 0x7fed3815cee0 2024-04-26T23:45:57.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.729+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed38069700 con 0x7fed3815cee0 2024-04-26T23:45:57.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.729+0000 7fed2f400640 1 -- 172.21.15.47:0/264942186 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed3001b020 con 0x7fed3815cee0 2024-04-26T23:45:57.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.729+0000 7fed2f400640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed14068380 0x7fed1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:57.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.729+0000 7fed2f400640 1 -- 172.21.15.47:0/264942186 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fed300876b0 con 0x7fed3815cee0 2024-04-26T23:45:57.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.729+0000 7fed36800640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed14068380 0x7fed1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:57.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.729+0000 7fed36800640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed14068380 0x7fed1406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed280af000 tx=0x7fed280a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:57.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.733+0000 7fed2f400640 1 -- 172.21.15.47:0/264942186 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fed30022030 con 0x7fed3815cee0 2024-04-26T23:45:57.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed380d2930 con 0x7fed3815cee0 2024-04-26T23:45:57.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed2f400640 1 -- 172.21.15.47:0/264942186 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fed30010040 con 0x7fed3815cee0 2024-04-26T23:45:57.908 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed14068380 msgr2=0x7fed1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed14068380 0x7fed1406a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fed280af000 tx=0x7fed280a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3815cee0 msgr2=0x7fed3815db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3815cee0 0x7fed3815db60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed3000efc0 tx=0x7fed3000c490 comp rx=0 tx=0).stop 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 shutdown_connections 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fed14068380 0x7fed1406a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fed3815cee0 0x7fed3815db60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fed380aeda0 0x7fed3813d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 --2- 172.21.15.47:0/264942186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed3806cb10 0x7fed38150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 >> 172.21.15.47:0/264942186 conn(0x7fed380b4400 msgr2=0x7fed3806da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 shutdown_connections 2024-04-26T23:45:57.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:57.901+0000 7fed3d400640 1 -- 172.21.15.47:0/264942186 wait complete. 2024-04-26T23:45:57.929 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:45:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e79e00640 1 Processor -- start 2024-04-26T23:45:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e79e00640 1 -- start start 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e79e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2e7409c170 0x7f2e740cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e79e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e74071f90 con 0x7f2e74160a50 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e79e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e74072230 con 0x7f2e74160670 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e79e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2e74070ee0 con 0x7f2e7409c170 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e73400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2e74160a50 0x7f2e740ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37490/0 (socket says 172.21.15.47:37490) 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e73400640 1 -- 172.21.15.47:0/3029244877 learned_addr learned my addr 172.21.15.47:0/3029244877 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e6be00640 1 --2- 172.21.15.47:0/3029244877 >> v2:172.21.15.203:3300/0 conn(0x7f2e7409c170 0x7f2e740cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e72000640 1 -- 172.21.15.47:0/3029244877 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344591197 0 0) 0x7f2e74071f90 con 0x7f2e74160a50 2024-04-26T23:45:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e72000640 1 -- 172.21.15.47:0/3029244877 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e58003530 con 0x7f2e74160a50 2024-04-26T23:45:58.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e72000640 1 -- 172.21.15.47:0/3029244877 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814817532 0 0) 0x7f2e74072230 con 0x7f2e74160670 2024-04-26T23:45:58.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e72000640 1 -- 172.21.15.47:0/3029244877 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e74071f90 con 0x7f2e74160670 2024-04-26T23:45:58.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e6be00640 1 -- 172.21.15.47:0/3029244877 >> v1:172.21.15.203:6789/0 conn(0x7f2e74160670 legacy=0x7f2e7409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e6be00640 1 -- 172.21.15.47:0/3029244877 >> v1:172.21.15.47:6789/0 conn(0x7f2e74160a50 legacy=0x7f2e740ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.065+0000 7f2e6be00640 1 -- 172.21.15.47:0/3029244877 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e74071130 con 0x7f2e7409c170 2024-04-26T23:45:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e6be00640 1 --2- 172.21.15.47:0/3029244877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e7409c170 0x7f2e740cdbb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bf14ca6edfbf85d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e72000640 1 -- 172.21.15.47:0/3029244877 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ab430 con 0x7f2e7409c170 2024-04-26T23:45:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e72000640 1 -- 172.21.15.47:0/3029244877 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0b0070 con 0x7f2e7409c170 2024-04-26T23:45:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e72000640 1 -- 172.21.15.47:0/3029244877 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ab7f0 con 0x7f2e7409c170 2024-04-26T23:45:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e79e00640 1 -- 172.21.15.47:0/3029244877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e7409c170 msgr2=0x7f2e740cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e79e00640 1 --2- 172.21.15.47:0/3029244877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e7409c170 0x7f2e740cdbb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0097c0 tx=0x7f2e5c01c410 comp rx=0 tx=0).stop 2024-04-26T23:45:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e79e00640 1 -- 172.21.15.47:0/3029244877 shutdown_connections 2024-04-26T23:45:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e79e00640 1 --2- 172.21.15.47:0/3029244877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e7409c170 0x7f2e740cdbb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e79e00640 1 -- 172.21.15.47:0/3029244877 >> 172.21.15.47:0/3029244877 conn(0x7f2e740b4c00 msgr2=0x7f2e740b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e79e00640 1 -- 172.21.15.47:0/3029244877 shutdown_connections 2024-04-26T23:45:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.069+0000 7f2e79e00640 1 -- 172.21.15.47:0/3029244877 wait complete. 2024-04-26T23:45:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 Processor -- start 2024-04-26T23:45:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 -- start start 2024-04-26T23:45:58.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e7409c170 0x7f2e741fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e74160670 0x7f2e7415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e74160a50 0x7f2e7415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2e740719a0 con 0x7f2e7409c170 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e740cec10 con 0x7f2e74160670 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2e74071b20 con 0x7f2e74160a50 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e7409c170 0x7f2e741fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e7409c170 0x7f2e741fa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57074/0 (socket says 172.21.15.47:57074) 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 -- 172.21.15.47:0/485277473 learned_addr learned my addr 172.21.15.47:0/485277473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e6be00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e74160670 0x7f2e7415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e73400640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e74160a50 0x7f2e7415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 -- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e74160a50 msgr2=0x7f2e7415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e74160a50 0x7f2e7415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 -- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e74160670 msgr2=0x7f2e7415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e74160670 0x7f2e7415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 -- 172.21.15.47:0/485277473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e740706e0 con 0x7f2e7409c170 2024-04-26T23:45:58.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e72a00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e7409c170 0x7f2e741fa3b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c430 tx=0x7f2e6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e6b400640 1 -- 172.21.15.47:0/485277473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64017070 con 0x7f2e7409c170 2024-04-26T23:45:58.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e6b400640 1 -- 172.21.15.47:0/485277473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e640052f0 con 0x7f2e7409c170 2024-04-26T23:45:58.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e6b400640 1 -- 172.21.15.47:0/485277473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e64003840 con 0x7f2e7409c170 2024-04-26T23:45:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e741f8f20 con 0x7f2e7409c170 2024-04-26T23:45:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.073+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e7415d070 con 0x7f2e7409c170 2024-04-26T23:45:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.077+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e74069700 con 0x7f2e7409c170 2024-04-26T23:45:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.077+0000 7f2e6b400640 1 -- 172.21.15.47:0/485277473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2e6401a070 con 0x7f2e7409c170 2024-04-26T23:45:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.077+0000 7f2e6b400640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2e50068380 0x7f2e5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.077+0000 7f2e6b400640 1 -- 172.21.15.47:0/485277473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2e64085d30 con 0x7f2e7409c170 2024-04-26T23:45:58.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.077+0000 7f2e6be00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2e50068380 0x7f2e5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.077+0000 7f2e6be00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2e50068380 0x7f2e5006a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0af000 tx=0x7f2e5c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.081+0000 7f2e6b400640 1 -- 172.21.15.47:0/485277473 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2e64055c90 con 0x7f2e7409c170 2024-04-26T23:45:58.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.249+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2e7409bf20 con 0x7f2e7409c170 2024-04-26T23:45:58.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.249+0000 7f2e6b400640 1 -- 172.21.15.47:0/485277473 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f2e64059f90 con 0x7f2e7409c170 2024-04-26T23:45:58.258 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:45:58.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2e50068380 msgr2=0x7f2e5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2e50068380 0x7f2e5006a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c0af000 tx=0x7f2e5c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:45:58.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e7409c170 msgr2=0x7f2e741fa3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e7409c170 0x7f2e741fa3b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c430 tx=0x7f2e6400c8f0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 shutdown_connections 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2e50068380 0x7f2e5006a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2e74160a50 0x7f2e7415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e74160670 0x7f2e7415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 --2- 172.21.15.47:0/485277473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e7409c170 0x7f2e741fa3b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 >> 172.21.15.47:0/485277473 conn(0x7f2e740b4c00 msgr2=0x7f2e740b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 shutdown_connections 2024-04-26T23:45:58.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.253+0000 7f2e79e00640 1 -- 172.21.15.47:0/485277473 wait complete. 2024-04-26T23:45:58.280 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:58.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5fa2000640 1 Processor -- start 2024-04-26T23:45:58.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5fa2000640 1 -- start start 2024-04-26T23:45:58.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5fa2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5f9c15f080 0x7f5f9c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5fa2000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5f9c0731e0 0x7f5f9c073630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5fa2000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f9c0b4db0 con 0x7f5f9c0b6830 2024-04-26T23:45:58.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5fa2000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9c073b70 con 0x7f5f9c15f080 2024-04-26T23:45:58.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5fa2000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5f9c0b5090 con 0x7f5f9c0731e0 2024-04-26T23:45:58.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f9b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5f9c15f080 0x7f5f9c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f92a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5f9c0b6830 0x7f5f9c0cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37506/0 (socket says 172.21.15.47:37506) 2024-04-26T23:45:58.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f92a00640 1 -- 172.21.15.47:0/2170445230 learned_addr learned my addr 172.21.15.47:0/2170445230 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:58.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f9be00640 1 --2- 172.21.15.47:0/2170445230 >> v2:172.21.15.203:3300/0 conn(0x7f5f9c0731e0 0x7f5f9c073630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f9b400640 1 -- 172.21.15.47:0/2170445230 >> v2:172.21.15.203:3300/0 conn(0x7f5f9c0731e0 msgr2=0x7f5f9c073630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:58.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f9b400640 1 --2- 172.21.15.47:0/2170445230 >> v2:172.21.15.203:3300/0 conn(0x7f5f9c0731e0 0x7f5f9c073630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f9b400640 1 -- 172.21.15.47:0/2170445230 >> v1:172.21.15.47:6789/0 conn(0x7f5f9c0b6830 legacy=0x7f5f9c0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.413+0000 7f5f9b400640 1 -- 172.21.15.47:0/2170445230 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c0ce210 con 0x7f5f9c15f080 2024-04-26T23:45:58.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5f9b400640 1 --2- 172.21.15.47:0/2170445230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0b47d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c072aa0 tx=0x7f5f8c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e43fa6388f5d4b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5f9aa00640 1 -- 172.21.15.47:0/2170445230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0b0070 con 0x7f5f9c15f080 2024-04-26T23:45:58.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5f9aa00640 1 -- 172.21.15.47:0/2170445230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c0ab600 con 0x7f5f9c15f080 2024-04-26T23:45:58.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5f9aa00640 1 -- 172.21.15.47:0/2170445230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0ab9d0 con 0x7f5f9c15f080 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 -- 172.21.15.47:0/2170445230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c15f080 msgr2=0x7f5f9c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2170445230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0b47d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c072aa0 tx=0x7f5f8c01c3f0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 -- 172.21.15.47:0/2170445230 shutdown_connections 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2170445230 >> v2:172.21.15.203:3300/0 conn(0x7f5f9c0731e0 0x7f5f9c073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2170445230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0b47d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 -- 172.21.15.47:0/2170445230 >> 172.21.15.47:0/2170445230 conn(0x7f5f9c075c20 msgr2=0x7f5f9c076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 -- 172.21.15.47:0/2170445230 shutdown_connections 2024-04-26T23:45:58.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.417+0000 7f5fa2000640 1 -- 172.21.15.47:0/2170445230 wait complete. 2024-04-26T23:45:58.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 Processor -- start 2024-04-26T23:45:58.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 -- start start 2024-04-26T23:45:58.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c0731e0 0x7f5f9c161910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c0b6830 0x7f5f9c149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c06f120 con 0x7f5f9c0731e0 2024-04-26T23:45:58.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c15f670 con 0x7f5f9c15f080 2024-04-26T23:45:58.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9c06f2a0 con 0x7f5f9c0b6830 2024-04-26T23:45:58.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c0731e0 0x7f5f9c161910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c0731e0 0x7f5f9c161910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57092/0 (socket says 172.21.15.47:57092) 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 -- 172.21.15.47:0/2029193400 learned_addr learned my addr 172.21.15.47:0/2029193400 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9be00640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f92a00640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c0b6830 0x7f5f9c149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 -- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c0b6830 msgr2=0x7f5f9c149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c0b6830 0x7f5f9c149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 -- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c15f080 msgr2=0x7f5f9c0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 -- 172.21.15.47:0/2029193400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c15e030 con 0x7f5f9c0731e0 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9be00640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f92a00640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c0b6830 0x7f5f9c149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f9b400640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c0731e0 0x7f5f9c161910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0ae040 tx=0x7f5f8c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f93e00640 1 -- 172.21.15.47:0/2029193400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0b0050 con 0x7f5f9c0731e0 2024-04-26T23:45:58.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f93e00640 1 -- 172.21.15.47:0/2029193400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c0bc070 con 0x7f5f9c0731e0 2024-04-26T23:45:58.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c149170 con 0x7f5f9c0731e0 2024-04-26T23:45:58.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5f93e00640 1 -- 172.21.15.47:0/2029193400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0b5a70 con 0x7f5f9c0731e0 2024-04-26T23:45:58.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.421+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c149730 con 0x7f5f9c0731e0 2024-04-26T23:45:58.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.425+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c148f60 con 0x7f5f9c0731e0 2024-04-26T23:45:58.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.425+0000 7f5f93e00640 1 -- 172.21.15.47:0/2029193400 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5f8c0ab4c0 con 0x7f5f9c0731e0 2024-04-26T23:45:58.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.425+0000 7f5f93e00640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5f78068380 0x7f5f7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.425+0000 7f5f93e00640 1 -- 172.21.15.47:0/2029193400 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5f8c1211f0 con 0x7f5f9c0731e0 2024-04-26T23:45:58.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.425+0000 7f5f92a00640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5f78068380 0x7f5f7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.425+0000 7f5f92a00640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5f78068380 0x7f5f7806a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f84007fd0 tx=0x7f5f84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.429+0000 7f5f93e00640 1 -- 172.21.15.47:0/2029193400 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5f8c016070 con 0x7f5f9c0731e0 2024-04-26T23:45:58.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.593+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f9c069700 con 0x7f5f9c0731e0 2024-04-26T23:45:58.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5f93e00640 1 -- 172.21.15.47:0/2029193400 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f5f8c0f1960 con 0x7f5f9c0731e0 2024-04-26T23:45:58.603 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:58.603 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:45:58.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5f78068380 msgr2=0x7f5f7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5f78068380 0x7f5f7806a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5f84007fd0 tx=0x7f5f84009040 comp rx=0 tx=0).stop 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c0731e0 msgr2=0x7f5f9c161910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c0731e0 0x7f5f9c161910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c0ae040 tx=0x7f5f8c01ac30 comp rx=0 tx=0).stop 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 shutdown_connections 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5f78068380 0x7f5f7806a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f9c15f080 0x7f5f9c0d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5f9c0b6830 0x7f5f9c149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 --2- 172.21.15.47:0/2029193400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f9c0731e0 0x7f5f9c161910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 >> 172.21.15.47:0/2029193400 conn(0x7f5f9c075c20 msgr2=0x7f5f9c1697a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 shutdown_connections 2024-04-26T23:45:58.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.597+0000 7f5fa2000640 1 -- 172.21.15.47:0/2029193400 wait complete. 2024-04-26T23:45:58.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:45:58.624 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:45:58.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809fa00640 1 Processor -- start 2024-04-26T23:45:58.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809fa00640 1 -- start start 2024-04-26T23:45:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809fa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f809806cd40 0x7f80980af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809fa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80980ae6a0 con 0x7f809815fcd0 2024-04-26T23:45:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809fa00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80980ae920 con 0x7f80980d0390 2024-04-26T23:45:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809fa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f80980aec00 con 0x7f809806cd40 2024-04-26T23:45:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809da00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f809815fcd0 0x7f8098160180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37508/0 (socket says 172.21.15.47:37508) 2024-04-26T23:45:58.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f809da00640 1 -- 172.21.15.47:0/1024943675 learned_addr learned my addr 172.21.15.47:0/1024943675 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:58.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097e00640 1 --2- 172.21.15.47:0/1024943675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f809806cd40 0x7f80980af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097400640 1 -- 172.21.15.47:0/1024943675 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1290432948 0 0) 0x7f80900014a0 con 0x7f809815fcd0 2024-04-26T23:45:58.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097400640 1 -- 172.21.15.47:0/1024943675 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8080003530 con 0x7f809815fcd0 2024-04-26T23:45:58.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097400640 1 -- 172.21.15.47:0/1024943675 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067546417 0 0) 0x7f80980ae920 con 0x7f80980d0390 2024-04-26T23:45:58.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097400640 1 -- 172.21.15.47:0/1024943675 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80900014a0 con 0x7f80980d0390 2024-04-26T23:45:58.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097e00640 1 -- 172.21.15.47:0/1024943675 >> v1:172.21.15.203:6789/0 conn(0x7f80980d0390 legacy=0x7f809806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097e00640 1 -- 172.21.15.47:0/1024943675 >> v1:172.21.15.47:6789/0 conn(0x7f809815fcd0 legacy=0x7f8098160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.761+0000 7f8097e00640 1 -- 172.21.15.47:0/1024943675 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80980aeee0 con 0x7f809806cd40 2024-04-26T23:45:58.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f8097e00640 1 --2- 172.21.15.47:0/1024943675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f809806cd40 0x7f80980af6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f80840097f0 tx=0x7f808401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89655c0f956ae375 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f8097400640 1 -- 172.21.15.47:0/1024943675 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80840b1070 con 0x7f809806cd40 2024-04-26T23:45:58.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f8097400640 1 -- 172.21.15.47:0/1024943675 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80840ac410 con 0x7f809806cd40 2024-04-26T23:45:58.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f8097400640 1 -- 172.21.15.47:0/1024943675 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80840ac7e0 con 0x7f809806cd40 2024-04-26T23:45:58.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f809fa00640 1 -- 172.21.15.47:0/1024943675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f809806cd40 msgr2=0x7f80980af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f809fa00640 1 --2- 172.21.15.47:0/1024943675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f809806cd40 0x7f80980af6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f80840097f0 tx=0x7f808401c420 comp rx=0 tx=0).stop 2024-04-26T23:45:58.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f809fa00640 1 -- 172.21.15.47:0/1024943675 shutdown_connections 2024-04-26T23:45:58.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f809fa00640 1 --2- 172.21.15.47:0/1024943675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f809806cd40 0x7f80980af6e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f809fa00640 1 -- 172.21.15.47:0/1024943675 >> 172.21.15.47:0/1024943675 conn(0x7f80980b2b70 msgr2=0x7f80980b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:58.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f809fa00640 1 -- 172.21.15.47:0/1024943675 shutdown_connections 2024-04-26T23:45:58.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.765+0000 7f809fa00640 1 -- 172.21.15.47:0/1024943675 wait complete. 2024-04-26T23:45:58.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 Processor -- start 2024-04-26T23:45:58.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 -- start start 2024-04-26T23:45:58.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f809806cd40 0x7f8098156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80980d0390 0x7f8098154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f809815fcd0 0x7f8098157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f809806fa70 con 0x7f809815fcd0 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f809806f8f0 con 0x7f809806cd40 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809fa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f809806fbf0 con 0x7f80980d0390 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f809815fcd0 0x7f8098157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f809815fcd0 0x7f8098157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57100/0 (socket says 172.21.15.47:57100) 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809d000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f809806cd40 0x7f8098156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 -- 172.21.15.47:0/4203199386 learned_addr learned my addr 172.21.15.47:0/4203199386 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f8097e00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80980d0390 0x7f8098154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 -- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80980d0390 msgr2=0x7f8098154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80980d0390 0x7f8098154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 -- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f809806cd40 msgr2=0x7f8098156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f809806cd40 0x7f8098156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 -- 172.21.15.47:0/4203199386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80980b5130 con 0x7f809815fcd0 2024-04-26T23:45:58.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.769+0000 7f809da00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f809815fcd0 0x7f8098157ef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8090001f80 tx=0x7f809000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f8094c00640 1 -- 172.21.15.47:0/4203199386 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090017070 con 0x7f809815fcd0 2024-04-26T23:45:58.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f8094c00640 1 -- 172.21.15.47:0/4203199386 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8090012400 con 0x7f809815fcd0 2024-04-26T23:45:58.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f8094c00640 1 -- 172.21.15.47:0/4203199386 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090012830 con 0x7f809815fcd0 2024-04-26T23:45:58.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809815a9d0 con 0x7f809815fcd0 2024-04-26T23:45:58.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809815af30 con 0x7f809815fcd0 2024-04-26T23:45:58.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809815b8d0 con 0x7f809815fcd0 2024-04-26T23:45:58.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f8094c00640 1 -- 172.21.15.47:0/4203199386 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f809001a070 con 0x7f809815fcd0 2024-04-26T23:45:58.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f8094c00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8078068380 0x7f807806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:58.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f8094c00640 1 -- 172.21.15.47:0/4203199386 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f80900869a0 con 0x7f809815fcd0 2024-04-26T23:45:58.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.773+0000 7f809d000640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8078068380 0x7f807806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:58.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.777+0000 7f809d000640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8078068380 0x7f807806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f808c0011f0 tx=0x7f808c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:58.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.777+0000 7f8094c00640 1 -- 172.21.15.47:0/4203199386 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f809815b8d0 con 0x7f809815fcd0 2024-04-26T23:45:58.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.941+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f809806c9f0 con 0x7f809815fcd0 2024-04-26T23:45:58.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f8094c00640 1 -- 172.21.15.47:0/4203199386 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f809815a9d0 con 0x7f809815fcd0 2024-04-26T23:45:58.951 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:45:58.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8078068380 msgr2=0x7f807806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8078068380 0x7f807806a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f808c0011f0 tx=0x7f808c009040 comp rx=0 tx=0).stop 2024-04-26T23:45:58.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f809815fcd0 msgr2=0x7f8098157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f809815fcd0 0x7f8098157ef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8090001f80 tx=0x7f809000a430 comp rx=0 tx=0).stop 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 shutdown_connections 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8078068380 0x7f807806a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f809815fcd0 0x7f8098157ef0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f80980d0390 0x7f8098154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 --2- 172.21.15.47:0/4203199386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f809806cd40 0x7f8098156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 >> 172.21.15.47:0/4203199386 conn(0x7f80980b2b70 msgr2=0x7f80980b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 shutdown_connections 2024-04-26T23:45:58.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:58.945+0000 7f809fa00640 1 -- 172.21.15.47:0/4203199386 wait complete. 2024-04-26T23:45:58.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:45:59.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59f1e00640 1 Processor -- start 2024-04-26T23:45:59.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59f1e00640 1 -- start start 2024-04-26T23:45:59.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59f1e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f59ec09c170 0x7f59ec0d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59f1e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f59ec0b56f0 0x7f59ec0d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59f1e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec071620 con 0x7f59ec162ab0 2024-04-26T23:45:59.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59f1e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec162e90 con 0x7f59ec09c170 2024-04-26T23:45:59.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59f1e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec0d2d40 con 0x7f59ec0b56f0 2024-04-26T23:45:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59e2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f59ec09c170 0x7f59ec0d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59e2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f59ec09c170 0x7f59ec0d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53334/0 (socket says 172.21.15.47:53334) 2024-04-26T23:45:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59e2000640 1 -- 172.21.15.47:0/1335361584 learned_addr learned my addr 172.21.15.47:0/1335361584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59e2000640 1 -- 172.21.15.47:0/1335361584 >> v2:172.21.15.203:3300/0 conn(0x7f59ec0b56f0 msgr2=0x7f59ec0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59e2000640 1 --2- 172.21.15.47:0/1335361584 >> v2:172.21.15.203:3300/0 conn(0x7f59ec0b56f0 0x7f59ec0d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59e2000640 1 -- 172.21.15.47:0/1335361584 >> v1:172.21.15.203:6789/0 conn(0x7f59ec162ab0 legacy=0x7f59ec09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:59.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.109+0000 7f59e2000640 1 -- 172.21.15.47:0/1335361584 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec06dfc0 con 0x7f59ec09c170 2024-04-26T23:45:59.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59e2000640 1 --2- 172.21.15.47:0/1335361584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0d1310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0d0ff0 tx=0x7f59d401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422ccacd0cbad0bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59ea000640 1 -- 172.21.15.47:0/1335361584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d40b0070 con 0x7f59ec09c170 2024-04-26T23:45:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59ea000640 1 -- 172.21.15.47:0/1335361584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d40ab600 con 0x7f59ec09c170 2024-04-26T23:45:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59ea000640 1 -- 172.21.15.47:0/1335361584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d40ab9d0 con 0x7f59ec09c170 2024-04-26T23:45:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 -- 172.21.15.47:0/1335361584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 msgr2=0x7f59ec0d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 --2- 172.21.15.47:0/1335361584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0d1310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0d0ff0 tx=0x7f59d401c450 comp rx=0 tx=0).stop 2024-04-26T23:45:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 -- 172.21.15.47:0/1335361584 shutdown_connections 2024-04-26T23:45:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 --2- 172.21.15.47:0/1335361584 >> v2:172.21.15.203:3300/0 conn(0x7f59ec0b56f0 0x7f59ec0d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 --2- 172.21.15.47:0/1335361584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0d1310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 -- 172.21.15.47:0/1335361584 >> 172.21.15.47:0/1335361584 conn(0x7f59ec0b4c00 msgr2=0x7f59ec0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 -- 172.21.15.47:0/1335361584 shutdown_connections 2024-04-26T23:45:59.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.113+0000 7f59f1e00640 1 -- 172.21.15.47:0/1335361584 wait complete. 2024-04-26T23:45:59.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 Processor -- start 2024-04-26T23:45:59.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 -- start start 2024-04-26T23:45:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59ec0b56f0 0x7f59ec15e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59ec162ab0 0x7f59ec15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec072330 con 0x7f59ec09c170 2024-04-26T23:45:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0721b0 con 0x7f59ec162ab0 2024-04-26T23:45:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f59ec071be0 con 0x7f59ec0b56f0 2024-04-26T23:45:59.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53344/0 (socket says 172.21.15.47:53344) 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59e2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59ec0b56f0 0x7f59ec15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 -- 172.21.15.47:0/3707299770 learned_addr learned my addr 172.21.15.47:0/3707299770 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eb400640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59ec162ab0 0x7f59ec15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 -- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59ec0b56f0 msgr2=0x7f59ec15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59ec0b56f0 0x7f59ec15e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 -- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59ec162ab0 msgr2=0x7f59ec15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59ec162ab0 0x7f59ec15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 -- 172.21.15.47:0/3707299770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec0b73d0 con 0x7f59ec09c170 2024-04-26T23:45:59.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59eaa00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0b69c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00b410 tx=0x7f59dc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59e3e00640 1 -- 172.21.15.47:0/3707299770 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc015030 con 0x7f59ec09c170 2024-04-26T23:45:59.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59e3e00640 1 -- 172.21.15.47:0/3707299770 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59dc004020 con 0x7f59ec09c170 2024-04-26T23:45:59.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec0b76b0 con 0x7f59ec09c170 2024-04-26T23:45:59.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59e3e00640 1 -- 172.21.15.47:0/3707299770 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc004450 con 0x7f59ec09c170 2024-04-26T23:45:59.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.117+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec0b7c70 con 0x7f59ec09c170 2024-04-26T23:45:59.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.121+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec069700 con 0x7f59ec09c170 2024-04-26T23:45:59.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.121+0000 7f59e3e00640 1 -- 172.21.15.47:0/3707299770 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59dc018070 con 0x7f59ec09c170 2024-04-26T23:45:59.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.121+0000 7f59e3e00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59c8068380 0x7f59c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.121+0000 7f59e3e00640 1 -- 172.21.15.47:0/3707299770 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f59dc0864c0 con 0x7f59ec09c170 2024-04-26T23:45:59.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.121+0000 7f59e2000640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59c8068380 0x7f59c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.121+0000 7f59e2000640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59c8068380 0x7f59c806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59d40ad000 tx=0x7f59d40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.125+0000 7f59e3e00640 1 -- 172.21.15.47:0/3707299770 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f59dc056390 con 0x7f59ec09c170 2024-04-26T23:45:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f59ec0b25e0 con 0x7f59ec09c170 2024-04-26T23:45:59.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59e3e00640 1 -- 172.21.15.47:0/3707299770 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f59dc05a690 con 0x7f59ec09c170 2024-04-26T23:45:59.299 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:45:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59c8068380 msgr2=0x7f59c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59c8068380 0x7f59c806a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f59d40ad000 tx=0x7f59d40a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 msgr2=0x7f59ec0b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0b69c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f59dc00b410 tx=0x7f59dc00b8d0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 shutdown_connections 2024-04-26T23:45:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59c8068380 0x7f59c806a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59ec162ab0 0x7f59ec15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59ec0b56f0 0x7f59ec15e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 --2- 172.21.15.47:0/3707299770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59ec09c170 0x7f59ec0b69c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 >> 172.21.15.47:0/3707299770 conn(0x7f59ec0b4c00 msgr2=0x7f59ec0cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 shutdown_connections 2024-04-26T23:45:59.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.293+0000 7f59f1e00640 1 -- 172.21.15.47:0/3707299770 wait complete. 2024-04-26T23:45:59.321 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb67200640 1 Processor -- start 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb67200640 1 -- start start 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb67200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffb600d0390 0x7ffb600af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb67200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ffb6006c630 0x7ffb6006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb67200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb600ae6a0 con 0x7ffb6015fcd0 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb67200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ffb600ae920 con 0x7ffb600d0390 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb67200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ffb600aec00 con 0x7ffb6006c630 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb5fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffb600d0390 0x7ffb600af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb65200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ffb6015fcd0 0x7ffb60160110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44036/0 (socket says 172.21.15.47:44036) 2024-04-26T23:45:59.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb65200640 1 -- 172.21.15.47:0/1998984324 learned_addr learned my addr 172.21.15.47:0/1998984324 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb57e00640 1 --2- 172.21.15.47:0/1998984324 >> v2:172.21.15.203:3300/0 conn(0x7ffb6006c630 0x7ffb6006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb5fe00640 1 -- 172.21.15.47:0/1998984324 >> v2:172.21.15.203:3300/0 conn(0x7ffb6006c630 msgr2=0x7ffb6006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb5fe00640 1 --2- 172.21.15.47:0/1998984324 >> v2:172.21.15.203:3300/0 conn(0x7ffb6006c630 0x7ffb6006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb5fe00640 1 -- 172.21.15.47:0/1998984324 >> v1:172.21.15.47:6789/0 conn(0x7ffb6015fcd0 legacy=0x7ffb60160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.457+0000 7ffb5fe00640 1 -- 172.21.15.47:0/1998984324 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb600aeee0 con 0x7ffb600d0390 2024-04-26T23:45:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb5fe00640 1 --2- 172.21.15.47:0/1998984324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb600d0390 0x7ffb600af6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb6006e9e0 tx=0x7ffb5001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24f7ca097c3e22b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb5f400640 1 -- 172.21.15.47:0/1998984324 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb500b0070 con 0x7ffb600d0390 2024-04-26T23:45:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb5f400640 1 -- 172.21.15.47:0/1998984324 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb500ab600 con 0x7ffb600d0390 2024-04-26T23:45:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb5f400640 1 -- 172.21.15.47:0/1998984324 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb500ab9d0 con 0x7ffb600d0390 2024-04-26T23:45:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 -- 172.21.15.47:0/1998984324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb600d0390 msgr2=0x7ffb600af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 --2- 172.21.15.47:0/1998984324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb600d0390 0x7ffb600af6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffb6006e9e0 tx=0x7ffb5001c3f0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 -- 172.21.15.47:0/1998984324 shutdown_connections 2024-04-26T23:45:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 --2- 172.21.15.47:0/1998984324 >> v2:172.21.15.203:3300/0 conn(0x7ffb6006c630 0x7ffb6006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 --2- 172.21.15.47:0/1998984324 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb600d0390 0x7ffb600af6e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 -- 172.21.15.47:0/1998984324 >> 172.21.15.47:0/1998984324 conn(0x7ffb600b2b70 msgr2=0x7ffb600b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 -- 172.21.15.47:0/1998984324 shutdown_connections 2024-04-26T23:45:59.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.461+0000 7ffb67200640 1 -- 172.21.15.47:0/1998984324 wait complete. 2024-04-26T23:45:59.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 Processor -- start 2024-04-26T23:45:59.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 -- start start 2024-04-26T23:45:59.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb6006c630 0x7ffb60153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb600d0390 0x7ffb6014a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb6015fcd0 0x7ffb60148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6006faf0 con 0x7ffb6015fcd0 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6006f970 con 0x7ffb6006c630 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6006fc70 con 0x7ffb600d0390 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb65200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb6015fcd0 0x7ffb60148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb5fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb6006c630 0x7ffb60153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb5fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb6006c630 0x7ffb60153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:49832/0 (socket says 172.21.15.47:49832) 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb5fe00640 1 -- 172.21.15.47:0/1905209169 learned_addr learned my addr 172.21.15.47:0/1905209169 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:59.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb57e00640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb600d0390 0x7ffb6014a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb65200640 1 -- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb600d0390 msgr2=0x7ffb6014a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb65200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb600d0390 0x7ffb6014a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb65200640 1 -- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb6006c630 msgr2=0x7ffb60153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb65200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb6006c630 0x7ffb60153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb65200640 1 -- 172.21.15.47:0/1905209169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6014b300 con 0x7ffb6015fcd0 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb5fe00640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb6006c630 0x7ffb60153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb65200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb6015fcd0 0x7ffb60148810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800caa0 tx=0x7ffb5800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb5cc00640 1 -- 172.21.15.47:0/1905209169 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58017070 con 0x7ffb6015fcd0 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb5cc00640 1 -- 172.21.15.47:0/1905209169 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5800ab40 con 0x7ffb6015fcd0 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb5cc00640 1 -- 172.21.15.47:0/1905209169 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58012400 con 0x7ffb6015fcd0 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6015ac50 con 0x7ffb6015fcd0 2024-04-26T23:45:59.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.465+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6015daa0 con 0x7ffb6015fcd0 2024-04-26T23:45:59.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.469+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb60069700 con 0x7ffb6015fcd0 2024-04-26T23:45:59.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.469+0000 7ffb5cc00640 1 -- 172.21.15.47:0/1905209169 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb5801a070 con 0x7ffb6015fcd0 2024-04-26T23:45:59.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.469+0000 7ffb5cc00640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffb3c068380 0x7ffb3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.469+0000 7ffb5cc00640 1 -- 172.21.15.47:0/1905209169 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffb58086580 con 0x7ffb6015fcd0 2024-04-26T23:45:59.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.469+0000 7ffb5fe00640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffb3c068380 0x7ffb3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.469+0000 7ffb5fe00640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffb3c068380 0x7ffb3c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb5001c430 tx=0x7ffb500a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.473+0000 7ffb5cc00640 1 -- 172.21.15.47:0/1905209169 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffb6014b300 con 0x7ffb6015fcd0 2024-04-26T23:45:59.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.641+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffb600d1970 con 0x7ffb6015fcd0 2024-04-26T23:45:59.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.641+0000 7ffb5cc00640 1 -- 172.21.15.47:0/1905209169 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7ffb600ae6a0 con 0x7ffb6015fcd0 2024-04-26T23:45:59.649 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:45:59.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffb3c068380 msgr2=0x7ffb3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffb3c068380 0x7ffb3c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb5001c430 tx=0x7ffb500a6000 comp rx=0 tx=0).stop 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb6015fcd0 msgr2=0x7ffb60148810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb6015fcd0 0x7ffb60148810 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800caa0 tx=0x7ffb5800cf60 comp rx=0 tx=0).stop 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 shutdown_connections 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffb3c068380 0x7ffb3c06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffb6015fcd0 0x7ffb60148810 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffb600d0390 0x7ffb6014a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 --2- 172.21.15.47:0/1905209169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb6006c630 0x7ffb60153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 >> 172.21.15.47:0/1905209169 conn(0x7ffb600b2b70 msgr2=0x7ffb60157480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 shutdown_connections 2024-04-26T23:45:59.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.645+0000 7ffb67200640 1 -- 172.21.15.47:0/1905209169 wait complete. 2024-04-26T23:45:59.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:45:59.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd87600640 1 Processor -- start 2024-04-26T23:45:59.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd87600640 1 -- start start 2024-04-26T23:45:59.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd87600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd800ce310 0x7fbd8015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd87600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbd8006fcd0 0x7fbd800b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd87600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd8015fc50 con 0x7fbd8015c100 2024-04-26T23:45:59.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd87600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbd80160860 con 0x7fbd800ce310 2024-04-26T23:45:59.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd87600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8015d4a0 con 0x7fbd8006fcd0 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd77e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd800ce310 0x7fbd8015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd84c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbd8015c100 0x7fbd800cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44048/0 (socket says 172.21.15.47:44048) 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd84c00640 1 -- 172.21.15.47:0/1245893140 learned_addr learned my addr 172.21.15.47:0/1245893140 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd85600640 1 --2- 172.21.15.47:0/1245893140 >> v2:172.21.15.203:3300/0 conn(0x7fbd8006fcd0 0x7fbd800b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd77e00640 1 -- 172.21.15.47:0/1245893140 >> v2:172.21.15.203:3300/0 conn(0x7fbd8006fcd0 msgr2=0x7fbd800b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd77e00640 1 --2- 172.21.15.47:0/1245893140 >> v2:172.21.15.203:3300/0 conn(0x7fbd8006fcd0 0x7fbd800b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd77e00640 1 -- 172.21.15.47:0/1245893140 >> v1:172.21.15.47:6789/0 conn(0x7fbd8015c100 legacy=0x7fbd800cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd77e00640 1 -- 172.21.15.47:0/1245893140 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8015ff30 con 0x7fbd800ce310 2024-04-26T23:45:59.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.805+0000 7fbd7fe00640 1 -- 172.21.15.47:0/1245893140 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1546274410 0 0) 0x7fbd8015fc50 con 0x7fbd8015c100 2024-04-26T23:45:59.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd77e00640 1 --2- 172.21.15.47:0/1245893140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd800ce310 0x7fbd8015cf60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd801609e0 tx=0x7fbd6801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aefea924ea29c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd7fe00640 1 -- 172.21.15.47:0/1245893140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680ab640 con 0x7fbd800ce310 2024-04-26T23:45:59.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd7fe00640 1 -- 172.21.15.47:0/1245893140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd680b0070 con 0x7fbd800ce310 2024-04-26T23:45:59.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd7fe00640 1 -- 172.21.15.47:0/1245893140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd680aba00 con 0x7fbd800ce310 2024-04-26T23:45:59.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 -- 172.21.15.47:0/1245893140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd800ce310 msgr2=0x7fbd8015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 --2- 172.21.15.47:0/1245893140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd800ce310 0x7fbd8015cf60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbd801609e0 tx=0x7fbd6801c440 comp rx=0 tx=0).stop 2024-04-26T23:45:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 -- 172.21.15.47:0/1245893140 shutdown_connections 2024-04-26T23:45:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 --2- 172.21.15.47:0/1245893140 >> v2:172.21.15.203:3300/0 conn(0x7fbd8006fcd0 0x7fbd800b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 --2- 172.21.15.47:0/1245893140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd800ce310 0x7fbd8015cf60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 -- 172.21.15.47:0/1245893140 >> 172.21.15.47:0/1245893140 conn(0x7fbd8006c800 msgr2=0x7fbd8006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:45:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 -- 172.21.15.47:0/1245893140 shutdown_connections 2024-04-26T23:45:59.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.809+0000 7fbd87600640 1 -- 172.21.15.47:0/1245893140 wait complete. 2024-04-26T23:45:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 Processor -- start 2024-04-26T23:45:59.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 -- start start 2024-04-26T23:45:59.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd8006fcd0 0x7fbd80157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd800ce310 0x7fbd80152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd8015c100 0x7fbd8009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800b5f30 con 0x7fbd8006fcd0 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbd800b5db0 con 0x7fbd8015c100 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbd800b60b0 con 0x7fbd800ce310 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd8006fcd0 0x7fbd80157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd8006fcd0 0x7fbd80157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53372/0 (socket says 172.21.15.47:53372) 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 -- 172.21.15.47:0/3634090009 learned_addr learned my addr 172.21.15.47:0/3634090009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd77e00640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd800ce310 0x7fbd80152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd85600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd8015c100 0x7fbd8009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 -- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd800ce310 msgr2=0x7fbd80152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd800ce310 0x7fbd80152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 -- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd8015c100 msgr2=0x7fbd8009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd8015c100 0x7fbd8009ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 -- 172.21.15.47:0/3634090009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8009c3d0 con 0x7fbd8006fcd0 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd77e00640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd800ce310 0x7fbd80152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:59.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd85600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd8015c100 0x7fbd8009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:45:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd84c00640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd8006fcd0 0x7fbd80157380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000c480 tx=0x7fbd7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd7d600640 1 -- 172.21.15.47:0/3634090009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70018070 con 0x7fbd8006fcd0 2024-04-26T23:45:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd7d600640 1 -- 172.21.15.47:0/3634090009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd70007500 con 0x7fbd8006fcd0 2024-04-26T23:45:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd801568a0 con 0x7fbd8006fcd0 2024-04-26T23:45:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd7d600640 1 -- 172.21.15.47:0/3634090009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70004a30 con 0x7fbd8006fcd0 2024-04-26T23:45:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.813+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd801578c0 con 0x7fbd8006fcd0 2024-04-26T23:45:59.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.817+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd80069700 con 0x7fbd8006fcd0 2024-04-26T23:45:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.817+0000 7fbd7d600640 1 -- 172.21.15.47:0/3634090009 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd7001b070 con 0x7fbd8006fcd0 2024-04-26T23:45:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.817+0000 7fbd7d600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd5c0683b0 0x7fbd5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:45:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.817+0000 7fbd7d600640 1 -- 172.21.15.47:0/3634090009 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbd70085d30 con 0x7fbd8006fcd0 2024-04-26T23:45:59.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.817+0000 7fbd77e00640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd5c0683b0 0x7fbd5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:45:59.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.817+0000 7fbd77e00640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd5c0683b0 0x7fbd5c06a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd680af000 tx=0x7fbd680a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:45:59.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.821+0000 7fbd7d600640 1 -- 172.21.15.47:0/3634090009 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbd700562e0 con 0x7fbd8006fcd0 2024-04-26T23:45:59.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.989+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd800d08b0 con 0x7fbd8006fcd0 2024-04-26T23:45:59.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.989+0000 7fbd7d600640 1 -- 172.21.15.47:0/3634090009 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fbd70055be0 con 0x7fbd8006fcd0 2024-04-26T23:45:59.998 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:45:59.998 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd5c0683b0 msgr2=0x7fbd5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd5c0683b0 0x7fbd5c06a870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbd680af000 tx=0x7fbd680a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd8006fcd0 msgr2=0x7fbd80157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd8006fcd0 0x7fbd80157380 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbd7000c480 tx=0x7fbd7000c940 comp rx=0 tx=0).stop 2024-04-26T23:46:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 shutdown_connections 2024-04-26T23:46:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbd5c0683b0 0x7fbd5c06a870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbd8015c100 0x7fbd8009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbd800ce310 0x7fbd80152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 --2- 172.21.15.47:0/3634090009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd8006fcd0 0x7fbd80157380 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 >> 172.21.15.47:0/3634090009 conn(0x7fbd8006c800 msgr2=0x7fbd80072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 shutdown_connections 2024-04-26T23:46:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:45:59.993+0000 7fbd87600640 1 -- 172.21.15.47:0/3634090009 wait complete. 2024-04-26T23:46:00.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:00.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.157+0000 7f9e98c00640 1 Processor -- start 2024-04-26T23:46:00.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.157+0000 7f9e98c00640 1 -- start start 2024-04-26T23:46:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e98c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9e940d0390 0x7f9e940af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e98c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e9406c630 0x7f9e9406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e98c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9e9415fcd0 0x7f9e94160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e98c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9e940ae6a0 con 0x7f9e940d0390 2024-04-26T23:46:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e98c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9e940ae920 con 0x7f9e9415fcd0 2024-04-26T23:46:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e98c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940aec00 con 0x7f9e9406c630 2024-04-26T23:46:00.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9e940d0390 0x7f9e940af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9e940d0390 0x7f9e940af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53376/0 (socket says 172.21.15.47:53376) 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 -- 172.21.15.47:0/2431668308 learned_addr learned my addr 172.21.15.47:0/2431668308 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e8be00640 1 --2- 172.21.15.47:0/2431668308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e9406c630 0x7f9e9406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 -- 172.21.15.47:0/2431668308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e9406c630 msgr2=0x7f9e9406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 --2- 172.21.15.47:0/2431668308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e9406c630 0x7f9e9406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 -- 172.21.15.47:0/2431668308 >> v2:172.21.15.203:3300/0 conn(0x7f9e9415fcd0 msgr2=0x7f9e94160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 --2- 172.21.15.47:0/2431668308 >> v2:172.21.15.203:3300/0 conn(0x7f9e9415fcd0 0x7f9e94160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.161+0000 7f9e91e00640 1 -- 172.21.15.47:0/2431668308 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e940aeee0 con 0x7f9e940d0390 2024-04-26T23:46:00.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e91e00640 1 --2- 172.21.15.47:0/2431668308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e940d0390 0x7f9e940af6e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e940b0380 tx=0x7f9e8401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e1de69be1af020 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e91400640 1 -- 172.21.15.47:0/2431668308 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b0070 con 0x7f9e940d0390 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e91400640 1 -- 172.21.15.47:0/2431668308 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e840ab600 con 0x7f9e940d0390 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e91400640 1 -- 172.21.15.47:0/2431668308 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840ab9d0 con 0x7f9e940d0390 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 -- 172.21.15.47:0/2431668308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e940d0390 msgr2=0x7f9e940af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 --2- 172.21.15.47:0/2431668308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e940d0390 0x7f9e940af6e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9e940b0380 tx=0x7f9e8401c490 comp rx=0 tx=0).stop 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 -- 172.21.15.47:0/2431668308 shutdown_connections 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 --2- 172.21.15.47:0/2431668308 >> v2:172.21.15.203:3300/0 conn(0x7f9e9415fcd0 0x7f9e94160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 --2- 172.21.15.47:0/2431668308 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e9406c630 0x7f9e9406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 --2- 172.21.15.47:0/2431668308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e940d0390 0x7f9e940af6e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 -- 172.21.15.47:0/2431668308 >> 172.21.15.47:0/2431668308 conn(0x7f9e940b2b70 msgr2=0x7f9e940b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 -- 172.21.15.47:0/2431668308 shutdown_connections 2024-04-26T23:46:00.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 -- 172.21.15.47:0/2431668308 wait complete. 2024-04-26T23:46:00.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 Processor -- start 2024-04-26T23:46:00.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.165+0000 7f9e98c00640 1 -- start start 2024-04-26T23:46:00.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e9406c630 0x7f9e94159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e940d0390 0x7f9e9414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e9415fcd0 0x7f9e940b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9406f860 con 0x7f9e9415fcd0 2024-04-26T23:46:00.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9406f6e0 con 0x7f9e9406c630 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9e9406f9e0 con 0x7f9e940d0390 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e9415fcd0 0x7f9e940b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e9415fcd0 0x7f9e940b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53384/0 (socket says 172.21.15.47:53384) 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 -- 172.21.15.47:0/104269005 learned_addr learned my addr 172.21.15.47:0/104269005 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e91e00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e9406c630 0x7f9e94159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e8be00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e940d0390 0x7f9e9414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 -- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e940d0390 msgr2=0x7f9e9414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e940d0390 0x7f9e9414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 -- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e9406c630 msgr2=0x7f9e94159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e9406c630 0x7f9e94159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 -- 172.21.15.47:0/104269005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9415b490 con 0x7f9e9415fcd0 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e92800640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e9415fcd0 0x7f9e940b10f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00b970 tx=0x7f9e8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e8a000640 1 -- 172.21.15.47:0/104269005 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c019070 con 0x7f9e9415fcd0 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e8a000640 1 -- 172.21.15.47:0/104269005 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c00cb60 con 0x7f9e9415fcd0 2024-04-26T23:46:00.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9415b770 con 0x7f9e9415fcd0 2024-04-26T23:46:00.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e8a000640 1 -- 172.21.15.47:0/104269005 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c014440 con 0x7f9e9415fcd0 2024-04-26T23:46:00.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9415bd30 con 0x7f9e9415fcd0 2024-04-26T23:46:00.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.169+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e94069700 con 0x7f9e9415fcd0 2024-04-26T23:46:00.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.173+0000 7f9e8a000640 1 -- 172.21.15.47:0/104269005 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e8c01c070 con 0x7f9e9415fcd0 2024-04-26T23:46:00.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.173+0000 7f9e8a000640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e700683d0 0x7f9e7006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.173+0000 7f9e8a000640 1 -- 172.21.15.47:0/104269005 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9e8c086660 con 0x7f9e9415fcd0 2024-04-26T23:46:00.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.173+0000 7f9e91e00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e700683d0 0x7f9e7006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.173+0000 7f9e91e00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e700683d0 0x7f9e7006a890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ad000 tx=0x7f9e840a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.177+0000 7f9e8a000640 1 -- 172.21.15.47:0/104269005 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9e8c056640 con 0x7f9e9415fcd0 2024-04-26T23:46:00.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9e940b0ed0 con 0x7f9e9415fcd0 2024-04-26T23:46:00.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e8a000640 1 -- 172.21.15.47:0/104269005 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f9e8c05a940 con 0x7f9e9415fcd0 2024-04-26T23:46:00.352 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e700683d0 msgr2=0x7f9e7006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e700683d0 0x7f9e7006a890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9e840ad000 tx=0x7f9e840a6000 comp rx=0 tx=0).stop 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e9415fcd0 msgr2=0x7f9e940b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e9415fcd0 0x7f9e940b10f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00b970 tx=0x7f9e8c00be30 comp rx=0 tx=0).stop 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 shutdown_connections 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e700683d0 0x7f9e7006a890 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9e9415fcd0 0x7f9e940b10f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9e940d0390 0x7f9e9414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 --2- 172.21.15.47:0/104269005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e9406c630 0x7f9e94159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 >> 172.21.15.47:0/104269005 conn(0x7f9e940b2b70 msgr2=0x7f9e9415c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:00.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 shutdown_connections 2024-04-26T23:46:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.345+0000 7f9e98c00640 1 -- 172.21.15.47:0/104269005 wait complete. 2024-04-26T23:46:00.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:00.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc74da00640 1 Processor -- start 2024-04-26T23:46:00.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc74da00640 1 -- start start 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc74da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7480d0390 0x7fc7480af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc74da00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc74806c630 0x7fc74806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc74da00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7480ae6a0 con 0x7fc74815fcd0 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc74da00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc7480ae920 con 0x7fc74806c630 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc74da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc7480aec00 con 0x7fc7480d0390 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc746a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7480d0390 0x7fc7480af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc746a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7480d0390 0x7fc7480af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:55576/0 (socket says 172.21.15.47:55576) 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc746a00640 1 -- 172.21.15.47:0/4238779669 learned_addr learned my addr 172.21.15.47:0/4238779669 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:00.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.509+0000 7fc73fe00640 1 --2- 172.21.15.47:0/4238779669 >> v2:172.21.15.203:3300/0 conn(0x7fc74806c630 0x7fc74806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746a00640 1 -- 172.21.15.47:0/4238779669 >> v2:172.21.15.203:3300/0 conn(0x7fc74806c630 msgr2=0x7fc74806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:00.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746a00640 1 --2- 172.21.15.47:0/4238779669 >> v2:172.21.15.203:3300/0 conn(0x7fc74806c630 0x7fc74806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746a00640 1 -- 172.21.15.47:0/4238779669 >> v1:172.21.15.203:6789/0 conn(0x7fc74815fcd0 legacy=0x7fc748160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746a00640 1 -- 172.21.15.47:0/4238779669 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7480aeee0 con 0x7fc7480d0390 2024-04-26T23:46:00.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746a00640 1 --2- 172.21.15.47:0/4238779669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7480d0390 0x7fc7480af6e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc738009870 tx=0x7fc73801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c537971a74838ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746000640 1 -- 172.21.15.47:0/4238779669 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7380b0070 con 0x7fc7480d0390 2024-04-26T23:46:00.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746000640 1 -- 172.21.15.47:0/4238779669 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc738004230 con 0x7fc7480d0390 2024-04-26T23:46:00.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc746000640 1 -- 172.21.15.47:0/4238779669 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc738003620 con 0x7fc7480d0390 2024-04-26T23:46:00.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc74da00640 1 -- 172.21.15.47:0/4238779669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7480d0390 msgr2=0x7fc7480af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc74da00640 1 --2- 172.21.15.47:0/4238779669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7480d0390 0x7fc7480af6e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc738009870 tx=0x7fc73801c4d0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc74da00640 1 -- 172.21.15.47:0/4238779669 shutdown_connections 2024-04-26T23:46:00.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc74da00640 1 --2- 172.21.15.47:0/4238779669 >> v2:172.21.15.203:3300/0 conn(0x7fc74806c630 0x7fc74806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc74da00640 1 --2- 172.21.15.47:0/4238779669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7480d0390 0x7fc7480af6e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc74da00640 1 -- 172.21.15.47:0/4238779669 >> 172.21.15.47:0/4238779669 conn(0x7fc7480b2b70 msgr2=0x7fc7480b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.513+0000 7fc74da00640 1 -- 172.21.15.47:0/4238779669 shutdown_connections 2024-04-26T23:46:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 -- 172.21.15.47:0/4238779669 wait complete. 2024-04-26T23:46:00.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 Processor -- start 2024-04-26T23:46:00.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 -- start start 2024-04-26T23:46:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc74806c630 0x7fc74809e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7480d0390 0x7fc7480720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc74815fcd0 0x7fc74809bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc74806fa70 con 0x7fc7480d0390 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc74806f8f0 con 0x7fc74806c630 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc74806fbf0 con 0x7fc74815fcd0 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7480d0390 0x7fc7480720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc746a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc74806c630 0x7fc74809e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7480d0390 0x7fc7480720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53390/0 (socket says 172.21.15.47:53390) 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 -- 172.21.15.47:0/422716596 learned_addr learned my addr 172.21.15.47:0/422716596 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc747400640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc74815fcd0 0x7fc74809bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 -- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc74815fcd0 msgr2=0x7fc74809bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc74815fcd0 0x7fc74809bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 -- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc74806c630 msgr2=0x7fc74809e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc74806c630 0x7fc74809e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 -- 172.21.15.47:0/422716596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc748072600 con 0x7fc7480d0390 2024-04-26T23:46:00.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73fe00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7480d0390 0x7fc7480720c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc73000e870 tx=0x7fc73000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73ea00640 1 -- 172.21.15.47:0/422716596 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc730017070 con 0x7fc7480d0390 2024-04-26T23:46:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73ea00640 1 -- 172.21.15.47:0/422716596 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73000c940 con 0x7fc7480d0390 2024-04-26T23:46:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc73ea00640 1 -- 172.21.15.47:0/422716596 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73000ccf0 con 0x7fc7480d0390 2024-04-26T23:46:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.517+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc748072880 con 0x7fc7480d0390 2024-04-26T23:46:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.521+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc748072e40 con 0x7fc7480d0390 2024-04-26T23:46:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.521+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc748069700 con 0x7fc7480d0390 2024-04-26T23:46:00.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.521+0000 7fc73ea00640 1 -- 172.21.15.47:0/422716596 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc73001a070 con 0x7fc7480d0390 2024-04-26T23:46:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.521+0000 7fc73ea00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc724068380 0x7fc72406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.521+0000 7fc73ea00640 1 -- 172.21.15.47:0/422716596 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc7300868f0 con 0x7fc7480d0390 2024-04-26T23:46:00.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.521+0000 7fc746a00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc724068380 0x7fc72406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.521+0000 7fc746a00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc724068380 0x7fc72406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ad000 tx=0x7fc7380a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.525+0000 7fc73ea00640 1 -- 172.21.15.47:0/422716596 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc748072600 con 0x7fc7480d0390 2024-04-26T23:46:00.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.689+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc74806ecb0 con 0x7fc7480d0390 2024-04-26T23:46:00.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.689+0000 7fc73ea00640 1 -- 172.21.15.47:0/422716596 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fc730073e20 con 0x7fc7480d0390 2024-04-26T23:46:00.697 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc724068380 msgr2=0x7fc72406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc724068380 0x7fc72406a840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7380ad000 tx=0x7fc7380a6000 comp rx=0 tx=0).stop 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7480d0390 msgr2=0x7fc7480720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7480d0390 0x7fc7480720c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc73000e870 tx=0x7fc73000ec70 comp rx=0 tx=0).stop 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 shutdown_connections 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc724068380 0x7fc72406a840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc74815fcd0 0x7fc74809bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7480d0390 0x7fc7480720c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 --2- 172.21.15.47:0/422716596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc74806c630 0x7fc74809e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 >> 172.21.15.47:0/422716596 conn(0x7fc7480b2b70 msgr2=0x7fc74815e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:00.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 shutdown_connections 2024-04-26T23:46:00.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.693+0000 7fc74da00640 1 -- 172.21.15.47:0/422716596 wait complete. 2024-04-26T23:46:00.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:00.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.853+0000 7f4298c00640 1 Processor -- start 2024-04-26T23:46:00.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.853+0000 7f4298c00640 1 -- start start 2024-04-26T23:46:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4298c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f42940d0390 0x7f42940af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4298c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f42941603e0 0x7f429406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4298c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42940ae6a0 con 0x7f429406c630 2024-04-26T23:46:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4298c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f42940ae920 con 0x7f42940d0390 2024-04-26T23:46:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4298c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f42940aec00 con 0x7f42941603e0 2024-04-26T23:46:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f429406c630 0x7f429415fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44056/0 (socket says 172.21.15.47:44056) 2024-04-26T23:46:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291400640 1 -- 172.21.15.47:0/3060746406 learned_addr learned my addr 172.21.15.47:0/3060746406 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:00.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f42940d0390 0x7f42940af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4292800640 1 --2- 172.21.15.47:0/3060746406 >> v2:172.21.15.203:3300/0 conn(0x7f42941603e0 0x7f429406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291e00640 1 -- 172.21.15.47:0/3060746406 >> v2:172.21.15.203:3300/0 conn(0x7f42941603e0 msgr2=0x7f429406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291e00640 1 --2- 172.21.15.47:0/3060746406 >> v2:172.21.15.203:3300/0 conn(0x7f42941603e0 0x7f429406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291e00640 1 -- 172.21.15.47:0/3060746406 >> v1:172.21.15.47:6789/0 conn(0x7f429406c630 legacy=0x7f429415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291e00640 1 -- 172.21.15.47:0/3060746406 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42940aeee0 con 0x7f42940d0390 2024-04-26T23:46:00.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4291e00640 1 --2- 172.21.15.47:0/3060746406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42940d0390 0x7f42940af6e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4294159f90 tx=0x7f428401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b3f3ace9b649cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.857+0000 7f4290a00640 1 -- 172.21.15.47:0/3060746406 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42840b0070 con 0x7f42940d0390 2024-04-26T23:46:00.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4290a00640 1 -- 172.21.15.47:0/3060746406 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42840ab600 con 0x7f42940d0390 2024-04-26T23:46:00.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4290a00640 1 -- 172.21.15.47:0/3060746406 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42840ab9d0 con 0x7f42940d0390 2024-04-26T23:46:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- 172.21.15.47:0/3060746406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42940d0390 msgr2=0x7f42940af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 --2- 172.21.15.47:0/3060746406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42940d0390 0x7f42940af6e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4294159f90 tx=0x7f428401c3f0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- 172.21.15.47:0/3060746406 shutdown_connections 2024-04-26T23:46:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 --2- 172.21.15.47:0/3060746406 >> v2:172.21.15.203:3300/0 conn(0x7f42941603e0 0x7f429406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 --2- 172.21.15.47:0/3060746406 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42940d0390 0x7f42940af6e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- 172.21.15.47:0/3060746406 >> 172.21.15.47:0/3060746406 conn(0x7f42940b2b70 msgr2=0x7f42940b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:00.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- 172.21.15.47:0/3060746406 shutdown_connections 2024-04-26T23:46:00.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- 172.21.15.47:0/3060746406 wait complete. 2024-04-26T23:46:00.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 Processor -- start 2024-04-26T23:46:00.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- start start 2024-04-26T23:46:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f429406c630 0x7f42940b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42940d0390 0x7f42940b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42941603e0 0x7f42941581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f429406faf0 con 0x7f42941603e0 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f429406f970 con 0x7f42940d0390 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4298c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f429406fc70 con 0x7f429406c630 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4292800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42941603e0 0x7f42941581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4292800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42941603e0 0x7f42941581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53412/0 (socket says 172.21.15.47:53412) 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4292800640 1 -- 172.21.15.47:0/168172048 learned_addr learned my addr 172.21.15.47:0/168172048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4291400640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42940d0390 0x7f42940b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.861+0000 7f4291e00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f429406c630 0x7f42940b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4292800640 1 -- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f429406c630 msgr2=0x7f42940b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4292800640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f429406c630 0x7f42940b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4292800640 1 -- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42940d0390 msgr2=0x7f42940b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4292800640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42940d0390 0x7f42940b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4292800640 1 -- 172.21.15.47:0/168172048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42940b1da0 con 0x7f42941603e0 2024-04-26T23:46:00.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4292800640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42941603e0 0x7f42941581c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f428c007e60 tx=0x7f428c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f428a000640 1 -- 172.21.15.47:0/168172048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c014420 con 0x7f42941603e0 2024-04-26T23:46:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f428a000640 1 -- 172.21.15.47:0/168172048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c019070 con 0x7f42941603e0 2024-04-26T23:46:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f428a000640 1 -- 172.21.15.47:0/168172048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c014820 con 0x7f42941603e0 2024-04-26T23:46:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42940b2080 con 0x7f42941603e0 2024-04-26T23:46:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4294155750 con 0x7f42941603e0 2024-04-26T23:46:00.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42940b2250 con 0x7f42941603e0 2024-04-26T23:46:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f428a000640 1 -- 172.21.15.47:0/168172048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f428c0149c0 con 0x7f42941603e0 2024-04-26T23:46:00.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f428a000640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f42740683d0 0x7f427406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f428a000640 1 -- 172.21.15.47:0/168172048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f428c087280 con 0x7f42941603e0 2024-04-26T23:46:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.865+0000 7f4291e00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f42740683d0 0x7f427406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:00.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.869+0000 7f4291e00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f42740683d0 0x7f427406a890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42840ad000 tx=0x7f42840a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:00.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:00.869+0000 7f428a000640 1 -- 172.21.15.47:0/168172048 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f428c057820 con 0x7f42941603e0 2024-04-26T23:46:01.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.033+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4294155920 con 0x7f42941603e0 2024-04-26T23:46:01.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.033+0000 7f428a000640 1 -- 172.21.15.47:0/168172048 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f428c057120 con 0x7f42941603e0 2024-04-26T23:46:01.041 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:01.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f42740683d0 msgr2=0x7f427406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f42740683d0 0x7f427406a890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42840ad000 tx=0x7f42840a6000 comp rx=0 tx=0).stop 2024-04-26T23:46:01.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42941603e0 msgr2=0x7f42941581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42941603e0 0x7f42941581c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f428c007e60 tx=0x7f428c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 shutdown_connections 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f42740683d0 0x7f427406a890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42941603e0 0x7f42941581c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42940d0390 0x7f42940b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 --2- 172.21.15.47:0/168172048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f429406c630 0x7f42940b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 >> 172.21.15.47:0/168172048 conn(0x7f42940b2b70 msgr2=0x7f429415c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 shutdown_connections 2024-04-26T23:46:01.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.037+0000 7f4298c00640 1 -- 172.21.15.47:0/168172048 wait complete. 2024-04-26T23:46:01.063 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:01.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea6a00640 1 Processor -- start 2024-04-26T23:46:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea6a00640 1 -- start start 2024-04-26T23:46:01.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea6a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea6a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdea00b5550 0x7fdea00ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea6a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea00d0220 con 0x7fdea00706e0 2024-04-26T23:46:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea6a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fdea00d0500 con 0x7fdea00b5550 2024-04-26T23:46:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea6a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdea00cdb10 con 0x7fdea015d190 2024-04-26T23:46:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea4c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdea00b5550 0x7fdea00ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea4c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdea00b5550 0x7fdea00ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53418/0 (socket says 172.21.15.47:53418) 2024-04-26T23:46:01.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea4c00640 1 -- 172.21.15.47:0/1174846606 learned_addr learned my addr 172.21.15.47:0/1174846606 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea5600640 1 --2- 172.21.15.47:0/1174846606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea4c00640 1 -- 172.21.15.47:0/1174846606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 msgr2=0x7fdea00701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea4c00640 1 --2- 172.21.15.47:0/1174846606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea00701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea4c00640 1 -- 172.21.15.47:0/1174846606 >> v1:172.21.15.203:6789/0 conn(0x7fdea00706e0 legacy=0x7fdea00d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea4c00640 1 -- 172.21.15.47:0/1174846606 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea00cddf0 con 0x7fdea00b5550 2024-04-26T23:46:01.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.197+0000 7fdea5600640 1 --2- 172.21.15.47:0/1174846606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea00701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:01.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea4c00640 1 --2- 172.21.15.47:0/1174846606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00ce310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009870 tx=0x7fde8c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89a4e9ab2d6824b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fde9fe00640 1 -- 172.21.15.47:0/1174846606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0b5070 con 0x7fdea00b5550 2024-04-26T23:46:01.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fde9fe00640 1 -- 172.21.15.47:0/1174846606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8c0a89d0 con 0x7fdea00b5550 2024-04-26T23:46:01.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fde9fe00640 1 -- 172.21.15.47:0/1174846606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0a8da0 con 0x7fdea00b5550 2024-04-26T23:46:01.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 -- 172.21.15.47:0/1174846606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 msgr2=0x7fdea00ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 --2- 172.21.15.47:0/1174846606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00ce310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009870 tx=0x7fde8c01ed10 comp rx=0 tx=0).stop 2024-04-26T23:46:01.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 -- 172.21.15.47:0/1174846606 shutdown_connections 2024-04-26T23:46:01.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 --2- 172.21.15.47:0/1174846606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00ce310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 --2- 172.21.15.47:0/1174846606 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea00701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 -- 172.21.15.47:0/1174846606 >> 172.21.15.47:0/1174846606 conn(0x7fdea00b4870 msgr2=0x7fdea00b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:01.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 -- 172.21.15.47:0/1174846606 shutdown_connections 2024-04-26T23:46:01.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 -- 172.21.15.47:0/1174846606 wait complete. 2024-04-26T23:46:01.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 Processor -- start 2024-04-26T23:46:01.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.201+0000 7fdea6a00640 1 -- start start 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdea00706e0 0x7fdea00b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea0155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdea00ce9d0 con 0x7fdea00b5550 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdea00ce850 con 0x7fdea00706e0 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdea00ceb50 con 0x7fdea015d190 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53428/0 (socket says 172.21.15.47:53428) 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 -- 172.21.15.47:0/4176238761 learned_addr learned my addr 172.21.15.47:0/4176238761 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:01.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea5600640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdea00706e0 0x7fdea00b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6000640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea0155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 -- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 msgr2=0x7fdea0155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea0155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 -- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdea00706e0 msgr2=0x7fdea00b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdea00706e0 0x7fdea00b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 -- 172.21.15.47:0/4176238761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea00ca530 con 0x7fdea00b5550 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea4c00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00c9e30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0b3040 tx=0x7fde8c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fde9d600640 1 -- 172.21.15.47:0/4176238761 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0b5070 con 0x7fdea00b5550 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fde9d600640 1 -- 172.21.15.47:0/4176238761 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8c0b0b90 con 0x7fdea00b5550 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea00ca810 con 0x7fdea00b5550 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fde9d600640 1 -- 172.21.15.47:0/4176238761 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0bb410 con 0x7fdea00b5550 2024-04-26T23:46:01.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea00cb310 con 0x7fdea00b5550 2024-04-26T23:46:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea0069b80 con 0x7fdea00b5550 2024-04-26T23:46:01.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.205+0000 7fde9d600640 1 -- 172.21.15.47:0/4176238761 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fde8c0c2060 con 0x7fdea00b5550 2024-04-26T23:46:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.209+0000 7fde9d600640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde80068380 0x7fde8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.209+0000 7fde9d600640 1 -- 172.21.15.47:0/4176238761 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fde8c123c90 con 0x7fdea00b5550 2024-04-26T23:46:01.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.209+0000 7fdea5600640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde80068380 0x7fde8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.209+0000 7fdea5600640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde80068380 0x7fde8006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde9400a9a0 tx=0x7fde94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.213+0000 7fde9d600640 1 -- 172.21.15.47:0/4176238761 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fde8c018870 con 0x7fdea00b5550 2024-04-26T23:46:01.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.377+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdea00c9af0 con 0x7fdea00b5550 2024-04-26T23:46:01.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.377+0000 7fde9d600640 1 -- 172.21.15.47:0/4176238761 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fde8c0f41b0 con 0x7fdea00b5550 2024-04-26T23:46:01.385 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:01.385 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde80068380 msgr2=0x7fde8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde80068380 0x7fde8006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fde9400a9a0 tx=0x7fde94008040 comp rx=0 tx=0).stop 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 msgr2=0x7fdea00c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00c9e30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0b3040 tx=0x7fde8c01bab0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 shutdown_connections 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde80068380 0x7fde8006a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdea015d190 0x7fdea0155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdea00b5550 0x7fdea00c9e30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 --2- 172.21.15.47:0/4176238761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdea00706e0 0x7fdea00b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 >> 172.21.15.47:0/4176238761 conn(0x7fdea00b4870 msgr2=0x7fdea00cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 shutdown_connections 2024-04-26T23:46:01.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.381+0000 7fdea6a00640 1 -- 172.21.15.47:0/4176238761 wait complete. 2024-04-26T23:46:01.406 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:01.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.541+0000 7efdf1400640 1 Processor -- start 2024-04-26T23:46:01.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.541+0000 7efdf1400640 1 -- start start 2024-04-26T23:46:01.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efdf1400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efdec06c630 0x7efdec06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efdf1400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efdec160b50 0x7efdec160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efdf1400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec0ae030 con 0x7efdec15cf50 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efdf1400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efdec0af7a0 con 0x7efdec06c630 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efdf1400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7efdec06d000 con 0x7efdec160b50 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efde1e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efdec06c630 0x7efdec06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efde1e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efdec06c630 0x7efdec06cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53436/0 (socket says 172.21.15.47:53436) 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efde1e00640 1 -- 172.21.15.47:0/1183524210 learned_addr learned my addr 172.21.15.47:0/1183524210 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:01.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efdeb200640 1 --2- 172.21.15.47:0/1183524210 >> v2:172.21.15.203:3300/0 conn(0x7efdec160b50 0x7efdec160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efde1e00640 1 -- 172.21.15.47:0/1183524210 >> v2:172.21.15.203:3300/0 conn(0x7efdec160b50 msgr2=0x7efdec160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:01.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efde1e00640 1 --2- 172.21.15.47:0/1183524210 >> v2:172.21.15.203:3300/0 conn(0x7efdec160b50 0x7efdec160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efde1e00640 1 -- 172.21.15.47:0/1183524210 >> v1:172.21.15.203:6789/0 conn(0x7efdec15cf50 legacy=0x7efdec0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.545+0000 7efde1e00640 1 -- 172.21.15.47:0/1183524210 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec0d0ae0 con 0x7efdec06c630 2024-04-26T23:46:01.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efde1e00640 1 --2- 172.21.15.47:0/1183524210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec06cac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efdec074510 tx=0x7efdd401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2087f01cf7cae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efde9e00640 1 -- 172.21.15.47:0/1183524210 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd40ab610 con 0x7efdec06c630 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efde9e00640 1 -- 172.21.15.47:0/1183524210 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd40b0070 con 0x7efdec06c630 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efde9e00640 1 -- 172.21.15.47:0/1183524210 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd40ab9d0 con 0x7efdec06c630 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 -- 172.21.15.47:0/1183524210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 msgr2=0x7efdec06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 --2- 172.21.15.47:0/1183524210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec06cac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efdec074510 tx=0x7efdd401c520 comp rx=0 tx=0).stop 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 -- 172.21.15.47:0/1183524210 shutdown_connections 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 --2- 172.21.15.47:0/1183524210 >> v2:172.21.15.203:3300/0 conn(0x7efdec160b50 0x7efdec160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 --2- 172.21.15.47:0/1183524210 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec06cac0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 -- 172.21.15.47:0/1183524210 >> 172.21.15.47:0/1183524210 conn(0x7efdec0b2b70 msgr2=0x7efdec0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 -- 172.21.15.47:0/1183524210 shutdown_connections 2024-04-26T23:46:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 -- 172.21.15.47:0/1183524210 wait complete. 2024-04-26T23:46:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 Processor -- start 2024-04-26T23:46:01.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.549+0000 7efdf1400640 1 -- start start 2024-04-26T23:46:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efdec15cf50 0x7efdec15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdec160b50 0x7efdec148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efdec161910 con 0x7efdec06c630 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efdec15d330 con 0x7efdec160b50 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efdec161a90 con 0x7efdec15cf50 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53440/0 (socket says 172.21.15.47:53440) 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 -- 172.21.15.47:0/3245838912 learned_addr learned my addr 172.21.15.47:0/3245838912 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efde1e00640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efdec15cf50 0x7efdec15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdeb200640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdec160b50 0x7efdec148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 -- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efdec15cf50 msgr2=0x7efdec15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efdec15cf50 0x7efdec15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 -- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdec160b50 msgr2=0x7efdec148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdec160b50 0x7efdec148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 -- 172.21.15.47:0/3245838912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec15af10 con 0x7efdec06c630 2024-04-26T23:46:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdea800640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec15d830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c420 tx=0x7efddc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efde3400640 1 -- 172.21.15.47:0/3245838912 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0052d0 con 0x7efdec06c630 2024-04-26T23:46:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efde3400640 1 -- 172.21.15.47:0/3245838912 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc005470 con 0x7efdec06c630 2024-04-26T23:46:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdec15b1f0 con 0x7efdec06c630 2024-04-26T23:46:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efde3400640 1 -- 172.21.15.47:0/3245838912 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc007260 con 0x7efdec06c630 2024-04-26T23:46:01.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdec15b7b0 con 0x7efdec06c630 2024-04-26T23:46:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.553+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdec069700 con 0x7efdec06c630 2024-04-26T23:46:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.557+0000 7efde3400640 1 -- 172.21.15.47:0/3245838912 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efddc007400 con 0x7efdec06c630 2024-04-26T23:46:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.557+0000 7efde3400640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efdc80683b0 0x7efdc806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.557+0000 7efde3400640 1 -- 172.21.15.47:0/3245838912 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efddc086670 con 0x7efdec06c630 2024-04-26T23:46:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.557+0000 7efde1e00640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efdc80683b0 0x7efdc806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.557+0000 7efde1e00640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efdc80683b0 0x7efdc806a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efdd40af000 tx=0x7efdd40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.561+0000 7efde3400640 1 -- 172.21.15.47:0/3245838912 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efddc0565c0 con 0x7efdec06c630 2024-04-26T23:46:01.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efdec0b3230 con 0x7efdec06c630 2024-04-26T23:46:01.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efde3400640 1 -- 172.21.15.47:0/3245838912 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7efddc05a8c0 con 0x7efdec06c630 2024-04-26T23:46:01.735 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:01.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efdc80683b0 msgr2=0x7efdc806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efdc80683b0 0x7efdc806a870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efdd40af000 tx=0x7efdd40a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 msgr2=0x7efdec15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec15d830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c420 tx=0x7efddc00c8e0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 shutdown_connections 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efdc80683b0 0x7efdc806a870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdec160b50 0x7efdec148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efdec15cf50 0x7efdec15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 --2- 172.21.15.47:0/3245838912 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efdec06c630 0x7efdec15d830 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 >> 172.21.15.47:0/3245838912 conn(0x7efdec0b2b70 msgr2=0x7efdec0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 shutdown_connections 2024-04-26T23:46:01.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.729+0000 7efdf1400640 1 -- 172.21.15.47:0/3245838912 wait complete. 2024-04-26T23:46:01.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:01.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b3e00640 1 Processor -- start 2024-04-26T23:46:01.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b3e00640 1 -- start start 2024-04-26T23:46:01.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91ac06c630 0x7f91ac06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b3e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac0ae030 con 0x7f91ac15cf50 2024-04-26T23:46:01.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b3e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91ac0d0ae0 con 0x7f91ac160b50 2024-04-26T23:46:01.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b3e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f91ac0af7a0 con 0x7f91ac06c630 2024-04-26T23:46:01.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b0a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91ac06c630 0x7f91ac06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b1400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f91ac15cf50 0x7f91ac0cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44070/0 (socket says 172.21.15.47:44070) 2024-04-26T23:46:01.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.893+0000 7f91b1400640 1 -- 172.21.15.47:0/956838812 learned_addr learned my addr 172.21.15.47:0/956838812 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:01.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b0a00640 1 -- 172.21.15.47:0/956838812 >> v1:172.21.15.203:6789/0 conn(0x7f91ac160b50 legacy=0x7f91ac160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b0a00640 1 -- 172.21.15.47:0/956838812 >> v1:172.21.15.47:6789/0 conn(0x7f91ac15cf50 legacy=0x7f91ac0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b0a00640 1 -- 172.21.15.47:0/956838812 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac0af9d0 con 0x7f91ac06c630 2024-04-26T23:46:01.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b0a00640 1 --2- 172.21.15.47:0/956838812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac06c630 0x7f91ac06cac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91980097c0 tx=0x7f919801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed549042e04da7e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91abe00640 1 -- 172.21.15.47:0/956838812 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980b0070 con 0x7f91ac06c630 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91abe00640 1 -- 172.21.15.47:0/956838812 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91980ab600 con 0x7f91ac06c630 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91abe00640 1 -- 172.21.15.47:0/956838812 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980ab9d0 con 0x7f91ac06c630 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b3e00640 1 -- 172.21.15.47:0/956838812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac06c630 msgr2=0x7f91ac06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b3e00640 1 --2- 172.21.15.47:0/956838812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac06c630 0x7f91ac06cac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91980097c0 tx=0x7f919801c330 comp rx=0 tx=0).stop 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b3e00640 1 -- 172.21.15.47:0/956838812 shutdown_connections 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b3e00640 1 --2- 172.21.15.47:0/956838812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac06c630 0x7f91ac06cac0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b3e00640 1 -- 172.21.15.47:0/956838812 >> 172.21.15.47:0/956838812 conn(0x7f91ac0b2b70 msgr2=0x7f91ac0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b3e00640 1 -- 172.21.15.47:0/956838812 shutdown_connections 2024-04-26T23:46:01.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.897+0000 7f91b3e00640 1 -- 172.21.15.47:0/956838812 wait complete. 2024-04-26T23:46:01.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 Processor -- start 2024-04-26T23:46:01.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 -- start start 2024-04-26T23:46:01.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91ac06c630 0x7f91ac142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac15cf50 0x7f91ac1685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91ac160b50 0x7f91ac149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac0b3c40 con 0x7f91ac15cf50 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac15d330 con 0x7f91ac06c630 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac0b3dc0 con 0x7f91ac160b50 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac15cf50 0x7f91ac1685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac15cf50 0x7f91ac1685e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53450/0 (socket says 172.21.15.47:53450) 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 -- 172.21.15.47:0/127218293 learned_addr learned my addr 172.21.15.47:0/127218293 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b1400640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91ac06c630 0x7f91ac142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b1e00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91ac160b50 0x7f91ac149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 -- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91ac160b50 msgr2=0x7f91ac149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91ac160b50 0x7f91ac149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 -- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91ac06c630 msgr2=0x7f91ac142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91ac06c630 0x7f91ac142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 -- 172.21.15.47:0/127218293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac14f8e0 con 0x7f91ac15cf50 2024-04-26T23:46:01.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b0a00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac15cf50 0x7f91ac1685e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91980ae040 tx=0x7f919801ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91a9600640 1 -- 172.21.15.47:0/127218293 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980b0050 con 0x7f91ac15cf50 2024-04-26T23:46:01.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91a9600640 1 -- 172.21.15.47:0/127218293 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91980bc070 con 0x7f91ac15cf50 2024-04-26T23:46:01.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91a9600640 1 -- 172.21.15.47:0/127218293 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980b5a50 con 0x7f91ac15cf50 2024-04-26T23:46:01.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac14fbc0 con 0x7f91ac15cf50 2024-04-26T23:46:01.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.901+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac150180 con 0x7f91ac15cf50 2024-04-26T23:46:01.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.905+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ac069700 con 0x7f91ac15cf50 2024-04-26T23:46:01.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.905+0000 7f91a9600640 1 -- 172.21.15.47:0/127218293 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91980ab4a0 con 0x7f91ac15cf50 2024-04-26T23:46:01.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.905+0000 7f91a9600640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f918c0683b0 0x7f918c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:01.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.905+0000 7f91a9600640 1 -- 172.21.15.47:0/127218293 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9198121130 con 0x7f91ac15cf50 2024-04-26T23:46:01.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.905+0000 7f91b1400640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f918c0683b0 0x7f918c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:01.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.905+0000 7f91b1400640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f918c0683b0 0x7f918c06a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000f70 tx=0x7f91a0007e10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:01.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:01.909+0000 7f91a9600640 1 -- 172.21.15.47:0/127218293 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9198015fb0 con 0x7f91ac15cf50 2024-04-26T23:46:02.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.073+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f91ac143c80 con 0x7f91ac15cf50 2024-04-26T23:46:02.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.073+0000 7f91a9600640 1 -- 172.21.15.47:0/127218293 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f91980f1130 con 0x7f91ac15cf50 2024-04-26T23:46:02.082 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:02.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f918c0683b0 msgr2=0x7f918c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f918c0683b0 0x7f918c06a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91a0000f70 tx=0x7f91a0007e10 comp rx=0 tx=0).stop 2024-04-26T23:46:02.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac15cf50 msgr2=0x7f91ac1685e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac15cf50 0x7f91ac1685e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91980ae040 tx=0x7f919801ab70 comp rx=0 tx=0).stop 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 shutdown_connections 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f918c0683b0 0x7f918c06a870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f91ac160b50 0x7f91ac149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91ac15cf50 0x7f91ac1685e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 --2- 172.21.15.47:0/127218293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91ac06c630 0x7f91ac142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 >> 172.21.15.47:0/127218293 conn(0x7f91ac0b2b70 msgr2=0x7f91ac0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 shutdown_connections 2024-04-26T23:46:02.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.077+0000 7f91b3e00640 1 -- 172.21.15.47:0/127218293 wait complete. 2024-04-26T23:46:02.104 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:02.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:02.154 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:02.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.241+0000 7f99ec200640 1 Processor -- start 2024-04-26T23:46:02.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.241+0000 7f99ec200640 1 -- start start 2024-04-26T23:46:02.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ec200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f99e4162d20 0x7f99e40b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ec200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99e40b1250 0x7f99e40b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ec200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99e40b2e30 con 0x7f99e40b2690 2024-04-26T23:46:02.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ec200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f99e40b3110 con 0x7f99e40b1250 2024-04-26T23:46:02.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ec200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f99e40b33f0 con 0x7f99e4162d20 2024-04-26T23:46:02.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99e40b1250 0x7f99e40b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f99e40b1250 0x7f99e40b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53460/0 (socket says 172.21.15.47:53460) 2024-04-26T23:46:02.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 -- 172.21.15.47:0/2884274996 learned_addr learned my addr 172.21.15.47:0/2884274996 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:02.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99e9800640 1 --2- 172.21.15.47:0/2884274996 >> v2:172.21.15.203:3300/0 conn(0x7f99e4162d20 0x7f99e40b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 -- 172.21.15.47:0/2884274996 >> v2:172.21.15.203:3300/0 conn(0x7f99e4162d20 msgr2=0x7f99e40b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:02.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 --2- 172.21.15.47:0/2884274996 >> v2:172.21.15.203:3300/0 conn(0x7f99e4162d20 0x7f99e40b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 -- 172.21.15.47:0/2884274996 >> v1:172.21.15.203:6789/0 conn(0x7f99e40b2690 legacy=0x7f99e4163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:02.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 -- 172.21.15.47:0/2884274996 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e40b36d0 con 0x7f99e40b1250 2024-04-26T23:46:02.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.245+0000 7f99ea200640 1 --2- 172.21.15.47:0/2884274996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e40b1250 0x7f99e40b16e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99e40d21d0 tx=0x7f99dc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a664991f9385d87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:02.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99e3e00640 1 -- 172.21.15.47:0/2884274996 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0a5730 con 0x7f99e40b1250 2024-04-26T23:46:02.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99e3e00640 1 -- 172.21.15.47:0/2884274996 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc0a58d0 con 0x7f99e40b1250 2024-04-26T23:46:02.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99e3e00640 1 -- 172.21.15.47:0/2884274996 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0a5ca0 con 0x7f99e40b1250 2024-04-26T23:46:02.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- 172.21.15.47:0/2884274996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e40b1250 msgr2=0x7f99e40b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 --2- 172.21.15.47:0/2884274996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e40b1250 0x7f99e40b16e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f99e40d21d0 tx=0x7f99dc01c960 comp rx=0 tx=0).stop 2024-04-26T23:46:02.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- 172.21.15.47:0/2884274996 shutdown_connections 2024-04-26T23:46:02.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 --2- 172.21.15.47:0/2884274996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e40b1250 0x7f99e40b16e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.255 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 --2- 172.21.15.47:0/2884274996 >> v2:172.21.15.203:3300/0 conn(0x7f99e4162d20 0x7f99e40b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- 172.21.15.47:0/2884274996 >> 172.21.15.47:0/2884274996 conn(0x7f99e4072a00 msgr2=0x7f99e40b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:02.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- 172.21.15.47:0/2884274996 shutdown_connections 2024-04-26T23:46:02.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- 172.21.15.47:0/2884274996 wait complete. 2024-04-26T23:46:02.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 Processor -- start 2024-04-26T23:46:02.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- start start 2024-04-26T23:46:02.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99e40b1250 0x7f99e40b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99e40b2690 0x7f99e4160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e4162d20 0x7f99e4163100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f99e40af150 con 0x7f99e4162d20 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99e40aefd0 con 0x7f99e40b1250 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ec200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f99e40af2d0 con 0x7f99e40b2690 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ea200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e4162d20 0x7f99e4163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99e9800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99e40b1250 0x7f99e40b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ea200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e4162d20 0x7f99e4163100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53464/0 (socket says 172.21.15.47:53464) 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99ea200640 1 -- 172.21.15.47:0/2925776643 learned_addr learned my addr 172.21.15.47:0/2925776643 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.249+0000 7f99e8e00640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99e40b2690 0x7f99e4160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ea200640 1 -- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99e40b2690 msgr2=0x7f99e4160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ea200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99e40b2690 0x7f99e4160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ea200640 1 -- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99e40b1250 msgr2=0x7f99e40b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ea200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99e40b1250 0x7f99e40b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ea200640 1 -- 172.21.15.47:0/2925776643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e415a140 con 0x7f99e4162d20 2024-04-26T23:46:02.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ea200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e4162d20 0x7f99e4163100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99dc019570 tx=0x7f99dc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:02.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99e1600640 1 -- 172.21.15.47:0/2925776643 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0bc020 con 0x7f99e4162d20 2024-04-26T23:46:02.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99e1600640 1 -- 172.21.15.47:0/2925776643 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc0b8670 con 0x7f99e4162d20 2024-04-26T23:46:02.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99e1600640 1 -- 172.21.15.47:0/2925776643 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99dc0b8a60 con 0x7f99e4162d20 2024-04-26T23:46:02.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e415a420 con 0x7f99e4162d20 2024-04-26T23:46:02.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e4161830 con 0x7f99e4162d20 2024-04-26T23:46:02.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e4161a30 con 0x7f99e4162d20 2024-04-26T23:46:02.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99e1600640 1 -- 172.21.15.47:0/2925776643 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f99dc0bf020 con 0x7f99e4162d20 2024-04-26T23:46:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99e1600640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f99c4068380 0x7f99c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.253+0000 7f99e1600640 1 -- 172.21.15.47:0/2925776643 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f99dc1218a0 con 0x7f99e4162d20 2024-04-26T23:46:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.257+0000 7f99e9800640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f99c4068380 0x7f99c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.257+0000 7f99e9800640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f99c4068380 0x7f99c406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f99d80079c0 tx=0x7f99d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:02.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.257+0000 7f99e1600640 1 -- 172.21.15.47:0/2925776643 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f99e4161a30 con 0x7f99e4162d20 2024-04-26T23:46:02.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f99e416aea0 con 0x7f99e4162d20 2024-04-26T23:46:02.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99e1600640 1 -- 172.21.15.47:0/2925776643 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f99dc0c6030 con 0x7f99e4162d20 2024-04-26T23:46:02.432 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:02.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f99c4068380 msgr2=0x7f99c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f99c4068380 0x7f99c406a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f99d80079c0 tx=0x7f99d8008040 comp rx=0 tx=0).stop 2024-04-26T23:46:02.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e4162d20 msgr2=0x7f99e4163100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e4162d20 0x7f99e4163100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f99dc019570 tx=0x7f99dc019700 comp rx=0 tx=0).stop 2024-04-26T23:46:02.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 shutdown_connections 2024-04-26T23:46:02.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f99c4068380 0x7f99c406a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f99e4162d20 0x7f99e4163100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f99e40b2690 0x7f99e4160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 --2- 172.21.15.47:0/2925776643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99e40b1250 0x7f99e40b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 >> 172.21.15.47:0/2925776643 conn(0x7f99e4072a00 msgr2=0x7f99e415d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:02.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 shutdown_connections 2024-04-26T23:46:02.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.425+0000 7f99ec200640 1 -- 172.21.15.47:0/2925776643 wait complete. 2024-04-26T23:46:02.521 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is in failed state and validate the reason 2024-04-26T23:46:02.521 INFO:tasks.cephfs_test_runner:test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-26T23:46:02.522 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:02.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.653+0000 7f577b200640 1 Processor -- start 2024-04-26T23:46:02.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.653+0000 7f577b200640 1 -- start start 2024-04-26T23:46:02.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f577b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 0x7f577415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f577b200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f577406fcd0 0x7f57740b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f577b200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577415fc50 con 0x7f577415c100 2024-04-26T23:46:02.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f577b200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5774160860 con 0x7f577406fcd0 2024-04-26T23:46:02.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f577b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f577415d4a0 con 0x7f57740ce310 2024-04-26T23:46:02.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f577415c100 0x7f57740cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44086/0 (socket says 172.21.15.47:44086) 2024-04-26T23:46:02.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773e00640 1 -- 172.21.15.47:0/1863321938 learned_addr learned my addr 172.21.15.47:0/1863321938 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f576b400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 0x7f577415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5779200640 1 --2- 172.21.15.47:0/1863321938 >> v2:172.21.15.203:3300/0 conn(0x7f577406fcd0 0x7f57740b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471068100 0 0) 0x7f577415fc50 con 0x7f577415c100 2024-04-26T23:46:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5758003530 con 0x7f577415c100 2024-04-26T23:46:02.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3624022392 0 0) 0x7f5758003530 con 0x7f577415c100 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 msgr2=0x7f577415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 0x7f577415cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 >> v2:172.21.15.203:3300/0 conn(0x7f577406fcd0 msgr2=0x7f57740b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 --2- 172.21.15.47:0/1863321938 >> v2:172.21.15.203:3300/0 conn(0x7f577406fcd0 0x7f57740b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577415ff30 con 0x7f577415c100 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f5764001680 con 0x7f577415c100 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 >> v1:172.21.15.47:6789/0 conn(0x7f577415c100 legacy=0x7f57740cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 0x7f57580039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5758003f40 0x7f5758004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758004d50 0x7f57580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5774160860 con 0x7f5758003f40 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f577415d4a0 con 0x7f5758004d50 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f575800b9d0 con 0x7f57740ce310 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f576b400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5758003f40 0x7f5758004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5773e00640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 0x7f57580039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5779200640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758004d50 0x7f57580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f576b400640 1 -- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 msgr2=0x7f57580039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f576b400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f57740ce310 0x7f57580039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f576b400640 1 -- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758004d50 msgr2=0x7f57580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:02.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f576b400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758004d50 0x7f57580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f576b400640 1 -- 172.21.15.47:0/1863321938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5758003530 con 0x7f5758003f40 2024-04-26T23:46:02.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.657+0000 7f5779200640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5758004d50 0x7f57580051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f576b400640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5758003f40 0x7f5758004810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f575c009ac0 tx=0x7f575c01c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ae7881761cd8b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c009690 con 0x7f5758003f40 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575c0a4a50 con 0x7f5758003f40 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f5773400640 1 -- 172.21.15.47:0/1863321938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c0a4e40 con 0x7f5758003f40 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f577b200640 1 -- 172.21.15.47:0/1863321938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5758003f40 msgr2=0x7f5758004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f577b200640 1 --2- 172.21.15.47:0/1863321938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5758003f40 0x7f5758004810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f575c009ac0 tx=0x7f575c01c6d0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f5779200640 1 -- 172.21.15.47:0/1863321938 reap_dead start 2024-04-26T23:46:02.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f577b200640 1 -- 172.21.15.47:0/1863321938 shutdown_connections 2024-04-26T23:46:02.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f577b200640 1 -- 172.21.15.47:0/1863321938 >> 172.21.15.47:0/1863321938 conn(0x7f577406c800 msgr2=0x7f577406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:02.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f577b200640 1 -- 172.21.15.47:0/1863321938 shutdown_connections 2024-04-26T23:46:02.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.661+0000 7f577b200640 1 -- 172.21.15.47:0/1863321938 wait complete. 2024-04-26T23:46:02.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 Processor -- start 2024-04-26T23:46:02.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 -- start start 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5758003f40 0x7f57740b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57740b2120 0x7f577409de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f577414fdf0 0x7f57740ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f57740b5af0 con 0x7f57740b2120 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f57740b5970 con 0x7f577414fdf0 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f57740b5c70 con 0x7f5758003f40 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57740b2120 0x7f577409de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57740b2120 0x7f577409de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53476/0 (socket says 172.21.15.47:53476) 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 -- 172.21.15.47:0/541627133 learned_addr learned my addr 172.21.15.47:0/541627133 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:02.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f5773e00640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5758003f40 0x7f57740b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f5779200640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f577414fdf0 0x7f57740ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 -- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5758003f40 msgr2=0x7f57740b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5758003f40 0x7f57740b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 -- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f577414fdf0 msgr2=0x7f57740ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f577414fdf0 0x7f57740ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 -- 172.21.15.47:0/541627133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577415a9d0 con 0x7f57740b2120 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f576b400640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57740b2120 0x7f577409de90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f575c01cf70 tx=0x7f575c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f5770c00640 1 -- 172.21.15.47:0/541627133 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c00f000 con 0x7f57740b2120 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f5770c00640 1 -- 172.21.15.47:0/541627133 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575c0bd070 con 0x7f57740b2120 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f5770c00640 1 -- 172.21.15.47:0/541627133 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c006270 con 0x7f57740b2120 2024-04-26T23:46:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57740b2690 con 0x7f57740b2120 2024-04-26T23:46:02.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577414f5f0 con 0x7f57740b2120 2024-04-26T23:46:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.665+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5774069700 con 0x7f57740b2120 2024-04-26T23:46:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.669+0000 7f5770c00640 1 -- 172.21.15.47:0/541627133 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f575c006410 con 0x7f57740b2120 2024-04-26T23:46:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.669+0000 7f5770c00640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5750068380 0x7f575006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.669+0000 7f5770c00640 1 -- 172.21.15.47:0/541627133 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f575c1205e0 con 0x7f57740b2120 2024-04-26T23:46:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.669+0000 7f5773e00640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5750068380 0x7f575006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:02.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.669+0000 7f5773e00640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5750068380 0x7f575006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5764005180 tx=0x7f5764007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:02.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.673+0000 7f5770c00640 1 -- 172.21.15.47:0/541627133 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f575c016760 con 0x7f57740b2120 2024-04-26T23:46:02.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.841+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57740d08b0 con 0x7f57740b2120 2024-04-26T23:46:02.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.841+0000 7f5770c00640 1 -- 172.21.15.47:0/541627133 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f575c0f05d0 con 0x7f57740b2120 2024-04-26T23:46:02.849 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:02.849 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:02.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5750068380 msgr2=0x7f575006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5750068380 0x7f575006a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5764005180 tx=0x7f5764007900 comp rx=0 tx=0).stop 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57740b2120 msgr2=0x7f577409de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57740b2120 0x7f577409de90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f575c01cf70 tx=0x7f575c0197f0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 shutdown_connections 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5750068380 0x7f575006a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f577414fdf0 0x7f57740ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57740b2120 0x7f577409de90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 --2- 172.21.15.47:0/541627133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5758003f40 0x7f57740b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 >> 172.21.15.47:0/541627133 conn(0x7f577406c800 msgr2=0x7f57740aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 shutdown_connections 2024-04-26T23:46:02.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:02.845+0000 7f577b200640 1 -- 172.21.15.47:0/541627133 wait complete. 2024-04-26T23:46:02.870 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:02.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:03.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f96a2800640 1 Processor -- start 2024-04-26T23:46:03.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f96a2800640 1 -- start start 2024-04-26T23:46:03.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f96a2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f96a2800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c071f90 con 0x7f969c160670 2024-04-26T23:46:03.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f96a2800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c072230 con 0x7f969c09c170 2024-04-26T23:46:03.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f96a2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f969c070ee0 con 0x7f969c160a50 2024-04-26T23:46:03.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969b400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f969c160670 0x7f969c09ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44096/0 (socket says 172.21.15.47:44096) 2024-04-26T23:46:03.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969b400640 1 -- 172.21.15.47:0/4205597903 learned_addr learned my addr 172.21.15.47:0/4205597903 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:03.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969be00640 1 --2- 172.21.15.47:0/4205597903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431546642 0 0) 0x7f969c071f90 con 0x7f969c160670 2024-04-26T23:46:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9680003530 con 0x7f969c160670 2024-04-26T23:46:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216587550 0 0) 0x7f969c072230 con 0x7f969c09c170 2024-04-26T23:46:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f969c071f90 con 0x7f969c09c170 2024-04-26T23:46:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969be00640 1 -- 172.21.15.47:0/4205597903 >> v1:172.21.15.203:6789/0 conn(0x7f969c09c170 legacy=0x7f969c0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969be00640 1 -- 172.21.15.47:0/4205597903 >> v1:172.21.15.47:6789/0 conn(0x7f969c160670 legacy=0x7f969c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2597774513 0 0) 0x7f9680003530 con 0x7f969c160670 2024-04-26T23:46:03.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.009+0000 7f969be00640 1 -- 172.21.15.47:0/4205597903 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c071130 con 0x7f969c160a50 2024-04-26T23:46:03.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f969be00640 1 --2- 172.21.15.47:0/4205597903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0ce2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9694009dc0 tx=0x7f969401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=376c9fba9b23578f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96940b2070 con 0x7f969c160a50 2024-04-26T23:46:03.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96940a5640 con 0x7f969c160a50 2024-04-26T23:46:03.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f969aa00640 1 -- 172.21.15.47:0/4205597903 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c0016a0 con 0x7f969c160a50 2024-04-26T23:46:03.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 -- 172.21.15.47:0/4205597903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 msgr2=0x7f969c0ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 --2- 172.21.15.47:0/4205597903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0ce2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9694009dc0 tx=0x7f969401c820 comp rx=0 tx=0).stop 2024-04-26T23:46:03.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 -- 172.21.15.47:0/4205597903 shutdown_connections 2024-04-26T23:46:03.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 --2- 172.21.15.47:0/4205597903 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0ce2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 -- 172.21.15.47:0/4205597903 >> 172.21.15.47:0/4205597903 conn(0x7f969c0b4c00 msgr2=0x7f969c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:03.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 -- 172.21.15.47:0/4205597903 shutdown_connections 2024-04-26T23:46:03.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 -- 172.21.15.47:0/4205597903 wait complete. 2024-04-26T23:46:03.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 Processor -- start 2024-04-26T23:46:03.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.013+0000 7f96a2800640 1 -- start start 2024-04-26T23:46:03.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f969c09c170 0x7f969c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c160670 0x7f969c0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f969c0719a0 con 0x7f969c160670 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f969c0cec10 con 0x7f969c09c170 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f969c071b20 con 0x7f969c160a50 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c160670 0x7f969c0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c160670 0x7f969c0c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53484/0 (socket says 172.21.15.47:53484) 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 -- 172.21.15.47:0/3165881653 learned_addr learned my addr 172.21.15.47:0/3165881653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f969b400640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f969c09c170 0x7f969c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f969be00640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 -- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 msgr2=0x7f969c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 -- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f969c09c170 msgr2=0x7f969c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f969c09c170 0x7f969c159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 -- 172.21.15.47:0/3165881653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c06d510 con 0x7f969c160670 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9692a00640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c160670 0x7f969c0c6c20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f968400c460 tx=0x7f968400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9693e00640 1 -- 172.21.15.47:0/3165881653 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684017070 con 0x7f969c160670 2024-04-26T23:46:03.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9693e00640 1 -- 172.21.15.47:0/3165881653 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96840052f0 con 0x7f969c160670 2024-04-26T23:46:03.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f9693e00640 1 -- 172.21.15.47:0/3165881653 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684003840 con 0x7f969c160670 2024-04-26T23:46:03.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c06d7f0 con 0x7f969c160670 2024-04-26T23:46:03.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c06ddb0 con 0x7f969c160670 2024-04-26T23:46:03.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.017+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969c069700 con 0x7f969c160670 2024-04-26T23:46:03.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.021+0000 7f9693e00640 1 -- 172.21.15.47:0/3165881653 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f968401a070 con 0x7f969c160670 2024-04-26T23:46:03.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.021+0000 7f9693e00640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9678068380 0x7f967806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.021+0000 7f9693e00640 1 -- 172.21.15.47:0/3165881653 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9684085d70 con 0x7f969c160670 2024-04-26T23:46:03.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.021+0000 7f969b400640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9678068380 0x7f967806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.021+0000 7f969b400640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9678068380 0x7f967806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f969c072160 tx=0x7f968c001090 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.025+0000 7f9693e00640 1 -- 172.21.15.47:0/3165881653 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9684056320 con 0x7f969c160670 2024-04-26T23:46:03.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f969c0b8f90 con 0x7f969c160670 2024-04-26T23:46:03.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f9693e00640 1 -- 172.21.15.47:0/3165881653 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f9684055c20 con 0x7f969c160670 2024-04-26T23:46:03.195 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9678068380 msgr2=0x7f967806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9678068380 0x7f967806a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f969c072160 tx=0x7f968c001090 comp rx=0 tx=0).stop 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c160670 msgr2=0x7f969c0c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c160670 0x7f969c0c6c20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f968400c460 tx=0x7f968400c920 comp rx=0 tx=0).stop 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 shutdown_connections 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9678068380 0x7f967806a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f969c160a50 0x7f969c0b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f969c160670 0x7f969c0c6c20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 --2- 172.21.15.47:0/3165881653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f969c09c170 0x7f969c159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 >> 172.21.15.47:0/3165881653 conn(0x7f969c0b4c00 msgr2=0x7f969c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 shutdown_connections 2024-04-26T23:46:03.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.189+0000 7f96a2800640 1 -- 172.21.15.47:0/3165881653 wait complete. 2024-04-26T23:46:03.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd953600640 1 Processor -- start 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd953600640 1 -- start start 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd953600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd953600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94c071620 con 0x7fd94c0b56f0 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd953600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94c162e90 con 0x7fd94c162ab0 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd953600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c0d2d40 con 0x7fd94c09c170 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd951600640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd94c0b56f0 0x7fd94c0d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44098/0 (socket says 172.21.15.47:44098) 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd951600640 1 -- 172.21.15.47:0/3203240040 learned_addr learned my addr 172.21.15.47:0/3203240040 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94be00640 1 --2- 172.21.15.47:0/3203240040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94b400640 1 -- 172.21.15.47:0/3203240040 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018105133 0 0) 0x7fd94c071620 con 0x7fd94c0b56f0 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94b400640 1 -- 172.21.15.47:0/3203240040 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd934003530 con 0x7fd94c0b56f0 2024-04-26T23:46:03.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94b400640 1 -- 172.21.15.47:0/3203240040 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 33183735 0 0) 0x7fd94c162e90 con 0x7fd94c162ab0 2024-04-26T23:46:03.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94b400640 1 -- 172.21.15.47:0/3203240040 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd94c071620 con 0x7fd94c162ab0 2024-04-26T23:46:03.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94be00640 1 -- 172.21.15.47:0/3203240040 >> v1:172.21.15.203:6789/0 conn(0x7fd94c162ab0 legacy=0x7fd94c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94be00640 1 -- 172.21.15.47:0/3203240040 >> v1:172.21.15.47:6789/0 conn(0x7fd94c0b56f0 legacy=0x7fd94c0d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.353+0000 7fd94be00640 1 -- 172.21.15.47:0/3203240040 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c06dfc0 con 0x7fd94c09c170 2024-04-26T23:46:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd94be00640 1 --2- 172.21.15.47:0/3203240040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0d1310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9380097f0 tx=0x7fd93801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f2cf01981dbdc18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd94b400640 1 -- 172.21.15.47:0/3203240040 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380b0070 con 0x7fd94c09c170 2024-04-26T23:46:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd94b400640 1 -- 172.21.15.47:0/3203240040 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9380ab600 con 0x7fd94c09c170 2024-04-26T23:46:03.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd94b400640 1 -- 172.21.15.47:0/3203240040 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380ab9d0 con 0x7fd94c09c170 2024-04-26T23:46:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd953600640 1 -- 172.21.15.47:0/3203240040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 msgr2=0x7fd94c0d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd953600640 1 --2- 172.21.15.47:0/3203240040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0d1310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9380097f0 tx=0x7fd93801c450 comp rx=0 tx=0).stop 2024-04-26T23:46:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd953600640 1 -- 172.21.15.47:0/3203240040 shutdown_connections 2024-04-26T23:46:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd953600640 1 --2- 172.21.15.47:0/3203240040 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0d1310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd953600640 1 -- 172.21.15.47:0/3203240040 >> 172.21.15.47:0/3203240040 conn(0x7fd94c0b4c00 msgr2=0x7fd94c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd953600640 1 -- 172.21.15.47:0/3203240040 shutdown_connections 2024-04-26T23:46:03.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.357+0000 7fd953600640 1 -- 172.21.15.47:0/3203240040 wait complete. 2024-04-26T23:46:03.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 Processor -- start 2024-04-26T23:46:03.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 -- start start 2024-04-26T23:46:03.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd94c0b56f0 0x7fd94c070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c162ab0 0x7fd94c0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0721b0 con 0x7fd94c0b56f0 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c0718e0 con 0x7fd94c162ab0 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c072330 con 0x7fd94c09c170 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd94c0b56f0 0x7fd94c070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd94c0b56f0 0x7fd94c070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53490/0 (socket says 172.21.15.47:53490) 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 -- 172.21.15.47:0/339627310 learned_addr learned my addr 172.21.15.47:0/339627310 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd951600640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c162ab0 0x7fd94c0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd950c00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 -- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 msgr2=0x7fd94c0b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 -- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c162ab0 msgr2=0x7fd94c0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c162ab0 0x7fd94c0b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 -- 172.21.15.47:0/339627310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c0b37d0 con 0x7fd94c0b56f0 2024-04-26T23:46:03.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd950c00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:03.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd94be00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd94c0b56f0 0x7fd94c070b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9380097f0 tx=0x7fd9380191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd948c00640 1 -- 172.21.15.47:0/339627310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380b8020 con 0x7fd94c0b56f0 2024-04-26T23:46:03.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd948c00640 1 -- 172.21.15.47:0/339627310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9380b4410 con 0x7fd94c0b56f0 2024-04-26T23:46:03.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd948c00640 1 -- 172.21.15.47:0/339627310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9380b0040 con 0x7fd94c0b56f0 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c0b3b10 con 0x7fd94c0b56f0 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.361+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c156080 con 0x7fd94c0b56f0 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.365+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd94c069700 con 0x7fd94c0b56f0 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.365+0000 7fd948c00640 1 -- 172.21.15.47:0/339627310 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd9380bb020 con 0x7fd94c0b56f0 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.365+0000 7fd948c00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd92c068380 0x7fd92c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.365+0000 7fd948c00640 1 -- 172.21.15.47:0/339627310 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd9381203f0 con 0x7fd94c0b56f0 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.365+0000 7fd950c00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd92c068380 0x7fd92c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.365+0000 7fd950c00640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd92c068380 0x7fd92c06a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd940001640 tx=0x7fd940009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.369+0000 7fd948c00640 1 -- 172.21.15.47:0/339627310 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd9380c2030 con 0x7fd94c0b56f0 2024-04-26T23:46:03.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.533+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd94c0b1e10 con 0x7fd94c0b56f0 2024-04-26T23:46:03.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.533+0000 7fd948c00640 1 -- 172.21.15.47:0/339627310 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fd94c0b3b10 con 0x7fd94c0b56f0 2024-04-26T23:46:03.541 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd92c068380 msgr2=0x7fd92c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd92c068380 0x7fd92c06a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd940001640 tx=0x7fd940009040 comp rx=0 tx=0).stop 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd94c0b56f0 msgr2=0x7fd94c070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd94c0b56f0 0x7fd94c070b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9380097f0 tx=0x7fd9380191f0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 shutdown_connections 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd92c068380 0x7fd92c06a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd94c162ab0 0x7fd94c0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd94c0b56f0 0x7fd94c070b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 --2- 172.21.15.47:0/339627310 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd94c09c170 0x7fd94c0b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 >> 172.21.15.47:0/339627310 conn(0x7fd94c0b4c00 msgr2=0x7fd94c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:03.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 shutdown_connections 2024-04-26T23:46:03.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.537+0000 7fd953600640 1 -- 172.21.15.47:0/339627310 wait complete. 2024-04-26T23:46:03.562 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:03.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756ec00640 1 Processor -- start 2024-04-26T23:46:03.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756ec00640 1 -- start start 2024-04-26T23:46:03.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756ec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f756809c170 0x7f75680cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756ec00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7568071f90 con 0x7f7568160a50 2024-04-26T23:46:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756ec00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7568072230 con 0x7f7568160670 2024-04-26T23:46:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756ec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7568070ee0 con 0x7f756809c170 2024-04-26T23:46:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756cc00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7568160a50 0x7f75680ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44112/0 (socket says 172.21.15.47:44112) 2024-04-26T23:46:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f756cc00640 1 -- 172.21.15.47:0/2423919233 learned_addr learned my addr 172.21.15.47:0/2423919233 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f755f400640 1 --2- 172.21.15.47:0/2423919233 >> v2:172.21.15.203:3300/0 conn(0x7f756809c170 0x7f75680cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f7567400640 1 -- 172.21.15.47:0/2423919233 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225264582 0 0) 0x7f7568071f90 con 0x7f7568160a50 2024-04-26T23:46:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f7567400640 1 -- 172.21.15.47:0/2423919233 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f754c003530 con 0x7f7568160a50 2024-04-26T23:46:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f7567400640 1 -- 172.21.15.47:0/2423919233 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102348030 0 0) 0x7f7568072230 con 0x7f7568160670 2024-04-26T23:46:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f7567400640 1 -- 172.21.15.47:0/2423919233 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7568071f90 con 0x7f7568160670 2024-04-26T23:46:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f755f400640 1 -- 172.21.15.47:0/2423919233 >> v1:172.21.15.203:6789/0 conn(0x7f7568160670 legacy=0x7f756809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f755f400640 1 -- 172.21.15.47:0/2423919233 >> v1:172.21.15.47:6789/0 conn(0x7f7568160a50 legacy=0x7f75680ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.701+0000 7f755f400640 1 -- 172.21.15.47:0/2423919233 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7568071130 con 0x7f756809c170 2024-04-26T23:46:03.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f755f400640 1 --2- 172.21.15.47:0/2423919233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756809c170 0x7f75680cdbb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75500097c0 tx=0x7f755001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77b1aaea83d4b44 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f7567400640 1 -- 172.21.15.47:0/2423919233 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75500ab430 con 0x7f756809c170 2024-04-26T23:46:03.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f7567400640 1 -- 172.21.15.47:0/2423919233 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75500b0070 con 0x7f756809c170 2024-04-26T23:46:03.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f7567400640 1 -- 172.21.15.47:0/2423919233 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75500ab7f0 con 0x7f756809c170 2024-04-26T23:46:03.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f756ec00640 1 -- 172.21.15.47:0/2423919233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756809c170 msgr2=0x7f75680cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f756ec00640 1 --2- 172.21.15.47:0/2423919233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756809c170 0x7f75680cdbb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75500097c0 tx=0x7f755001c410 comp rx=0 tx=0).stop 2024-04-26T23:46:03.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f756ec00640 1 -- 172.21.15.47:0/2423919233 shutdown_connections 2024-04-26T23:46:03.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f756ec00640 1 --2- 172.21.15.47:0/2423919233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756809c170 0x7f75680cdbb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f756ec00640 1 -- 172.21.15.47:0/2423919233 >> 172.21.15.47:0/2423919233 conn(0x7f75680b4c00 msgr2=0x7f75680b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:03.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f756ec00640 1 -- 172.21.15.47:0/2423919233 shutdown_connections 2024-04-26T23:46:03.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.705+0000 7f756ec00640 1 -- 172.21.15.47:0/2423919233 wait complete. 2024-04-26T23:46:03.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 Processor -- start 2024-04-26T23:46:03.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 -- start start 2024-04-26T23:46:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756809c170 0x7f7568153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7568160670 0x7f75680d0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7568160a50 0x7f75680d0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f75680719a0 con 0x7f756809c170 2024-04-26T23:46:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75680cec10 con 0x7f7568160670 2024-04-26T23:46:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7568071b20 con 0x7f7568160a50 2024-04-26T23:46:03.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756809c170 0x7f7568153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756809c170 0x7f7568153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53492/0 (socket says 172.21.15.47:53492) 2024-04-26T23:46:03.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 -- 172.21.15.47:0/1056714180 learned_addr learned my addr 172.21.15.47:0/1056714180 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:03.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f755f400640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7568160670 0x7f75680d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756cc00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7568160a50 0x7f75680d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 -- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7568160a50 msgr2=0x7f75680d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7568160a50 0x7f75680d0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 -- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7568160670 msgr2=0x7f75680d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7568160670 0x7f75680d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 -- 172.21.15.47:0/1056714180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756815e2f0 con 0x7f756809c170 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7567e00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756809c170 0x7f7568153fd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f755800c430 tx=0x7f755800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7564c00640 1 -- 172.21.15.47:0/1056714180 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558017070 con 0x7f756809c170 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7564c00640 1 -- 172.21.15.47:0/1056714180 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75580052f0 con 0x7f756809c170 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756815e5d0 con 0x7f756809c170 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f7564c00640 1 -- 172.21.15.47:0/1056714180 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558003840 con 0x7f756809c170 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.709+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756815eb90 con 0x7f756809c170 2024-04-26T23:46:03.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.713+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7568069700 con 0x7f756809c170 2024-04-26T23:46:03.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.713+0000 7f7564c00640 1 -- 172.21.15.47:0/1056714180 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f755801a070 con 0x7f756809c170 2024-04-26T23:46:03.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.713+0000 7f7564c00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75440683b0 0x7f754406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:03.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.713+0000 7f7564c00640 1 -- 172.21.15.47:0/1056714180 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7558085cc0 con 0x7f756809c170 2024-04-26T23:46:03.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.713+0000 7f755f400640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75440683b0 0x7f754406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:03.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.713+0000 7f755f400640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75440683b0 0x7f754406a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75500af000 tx=0x7f75500a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:03.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.717+0000 7f7564c00640 1 -- 172.21.15.47:0/1056714180 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f755808c080 con 0x7f756809c170 2024-04-26T23:46:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.881+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75680b8f90 con 0x7f756809c170 2024-04-26T23:46:03.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.881+0000 7f7564c00640 1 -- 172.21.15.47:0/1056714180 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f7558055c20 con 0x7f756809c170 2024-04-26T23:46:03.890 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:03.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75440683b0 msgr2=0x7f754406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75440683b0 0x7f754406a870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75500af000 tx=0x7f75500a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:03.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756809c170 msgr2=0x7f7568153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:03.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756809c170 0x7f7568153fd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f755800c430 tx=0x7f755800c8f0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 shutdown_connections 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75440683b0 0x7f754406a870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7568160a50 0x7f75680d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7568160670 0x7f75680d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 --2- 172.21.15.47:0/1056714180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756809c170 0x7f7568153fd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 >> 172.21.15.47:0/1056714180 conn(0x7f75680b4c00 msgr2=0x7f75680d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 shutdown_connections 2024-04-26T23:46:03.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:03.885+0000 7f756ec00640 1 -- 172.21.15.47:0/1056714180 wait complete. 2024-04-26T23:46:03.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2024-04-26T23:46:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f69200640 1 Processor -- start 2024-04-26T23:46:04.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f69200640 1 -- start start 2024-04-26T23:46:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f69200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6406f0a0 0x7f6f640d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f69200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f640713a0 0x7f6f6409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f69200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f640d2340 con 0x7f6f6409ba60 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f69200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6f640cd580 con 0x7f6f640713a0 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f69200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f640cd860 con 0x7f6f6406f0a0 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f62800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f640713a0 0x7f6f6409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f59400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6f6409ba60 0x7f6f640ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44118/0 (socket says 172.21.15.47:44118) 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f59400640 1 -- 172.21.15.47:0/2604515200 learned_addr learned my addr 172.21.15.47:0/2604515200 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f61e00640 1 --2- 172.21.15.47:0/2604515200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6406f0a0 0x7f6f640d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f62800640 1 -- 172.21.15.47:0/2604515200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6406f0a0 msgr2=0x7f6f640d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f62800640 1 --2- 172.21.15.47:0/2604515200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6406f0a0 0x7f6f640d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f62800640 1 -- 172.21.15.47:0/2604515200 >> v1:172.21.15.47:6789/0 conn(0x7f6f6409ba60 legacy=0x7f6f640ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f62800640 1 -- 172.21.15.47:0/2604515200 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f640cdb40 con 0x7f6f640713a0 2024-04-26T23:46:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f61400640 1 -- 172.21.15.47:0/2604515200 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 431828607 0 0) 0x7f6f640d2340 con 0x7f6f6409ba60 2024-04-26T23:46:04.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.045+0000 7f6f61e00640 1 --2- 172.21.15.47:0/2604515200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6406f0a0 0x7f6f640d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f62800640 1 --2- 172.21.15.47:0/2604515200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f6409bee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009dc0 tx=0x7f6f5c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7cf1f335ef53da server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f61400640 1 -- 172.21.15.47:0/2604515200 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0b2070 con 0x7f6f640713a0 2024-04-26T23:46:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f61400640 1 -- 172.21.15.47:0/2604515200 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0a5810 con 0x7f6f640713a0 2024-04-26T23:46:04.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f61400640 1 -- 172.21.15.47:0/2604515200 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0a5be0 con 0x7f6f640713a0 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 -- 172.21.15.47:0/2604515200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 msgr2=0x7f6f6409bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 --2- 172.21.15.47:0/2604515200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f6409bee0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009dc0 tx=0x7f6f5c01c950 comp rx=0 tx=0).stop 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 -- 172.21.15.47:0/2604515200 shutdown_connections 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 --2- 172.21.15.47:0/2604515200 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f6409bee0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 --2- 172.21.15.47:0/2604515200 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6406f0a0 0x7f6f640d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 -- 172.21.15.47:0/2604515200 >> 172.21.15.47:0/2604515200 conn(0x7f6f640d2e90 msgr2=0x7f6f640d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 -- 172.21.15.47:0/2604515200 shutdown_connections 2024-04-26T23:46:04.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.049+0000 7f6f69200640 1 -- 172.21.15.47:0/2604515200 wait complete. 2024-04-26T23:46:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 Processor -- start 2024-04-26T23:46:04.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 -- start start 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f6406f0a0 0x7f6f64159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f640c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6409ba60 0x7f6f6415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6406d510 con 0x7f6f640713a0 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6416c140 con 0x7f6f6406f0a0 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f640b81c0 con 0x7f6f6409ba60 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f640c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f640c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53498/0 (socket says 172.21.15.47:53498) 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 -- 172.21.15.47:0/370725987 learned_addr learned my addr 172.21.15.47:0/370725987 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f61e00640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f6406f0a0 0x7f6f64159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f62800640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6409ba60 0x7f6f6415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 -- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6409ba60 msgr2=0x7f6f6415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6409ba60 0x7f6f6415d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 -- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f6406f0a0 msgr2=0x7f6f64159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f6406f0a0 0x7f6f64159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 -- 172.21.15.47:0/370725987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f640b8460 con 0x7f6f640713a0 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f61e00640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f6406f0a0 0x7f6f64159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f59400640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f640c9440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0011f0 tx=0x7f6f4c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f5aa00640 1 -- 172.21.15.47:0/370725987 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c018070 con 0x7f6f640713a0 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f5aa00640 1 -- 172.21.15.47:0/370725987 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0074e0 con 0x7f6f640713a0 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f5aa00640 1 -- 172.21.15.47:0/370725987 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c004a10 con 0x7f6f640713a0 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f640b8740 con 0x7f6f640713a0 2024-04-26T23:46:04.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f640c8f20 con 0x7f6f640713a0 2024-04-26T23:46:04.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.053+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f64069700 con 0x7f6f640713a0 2024-04-26T23:46:04.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.057+0000 7f6f5aa00640 1 -- 172.21.15.47:0/370725987 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f4c004bb0 con 0x7f6f640713a0 2024-04-26T23:46:04.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.057+0000 7f6f5aa00640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f40068380 0x7f6f4006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.057+0000 7f6f5aa00640 1 -- 172.21.15.47:0/370725987 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4c085dd0 con 0x7f6f640713a0 2024-04-26T23:46:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.057+0000 7f6f61e00640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f40068380 0x7f6f4006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.057+0000 7f6f61e00640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f40068380 0x7f6f4006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6f640c7d80 tx=0x7f6f54008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:04.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.061+0000 7f6f5aa00640 1 -- 172.21.15.47:0/370725987 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6f4c0562f0 con 0x7f6f640713a0 2024-04-26T23:46:04.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.289+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) -- 0x7f6f640d1ae0 con 0x7f6f640713a0 2024-04-26T23:46:04.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.789+0000 7f6f5aa00640 1 -- 172.21.15.47:0/370725987 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v52) ==== 168+0+0 (secure 0 0 0) 0x7f6f4c055bf0 con 0x7f6f640713a0 2024-04-26T23:46:04.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f40068380 msgr2=0x7f6f4006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f40068380 0x7f6f4006a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6f640c7d80 tx=0x7f6f54008040 comp rx=0 tx=0).stop 2024-04-26T23:46:04.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 msgr2=0x7f6f640c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f640c9440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0011f0 tx=0x7f6f4c00c9b0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 shutdown_connections 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f40068380 0x7f6f4006a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f6409ba60 0x7f6f6415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f640713a0 0x7f6f640c9440 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 --2- 172.21.15.47:0/370725987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f6406f0a0 0x7f6f64159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 >> 172.21.15.47:0/370725987 conn(0x7f6f640d2e90 msgr2=0x7f6f640b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 shutdown_connections 2024-04-26T23:46:04.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.793+0000 7f6f69200640 1 -- 172.21.15.47:0/370725987 wait complete. 2024-04-26T23:46:04.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:46:04.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8ab2000640 1 Processor -- start 2024-04-26T23:46:04.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8ab2000640 1 -- start start 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8ab2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac0b5fa0 0x7f8aac0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8ab2000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8aac0b1250 0x7f8aac0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8ab2000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac0b2e30 con 0x7f8aac162d20 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8ab2000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0b2bd0 con 0x7f8aac0b1250 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8ab2000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0b3110 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aab400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8aac162d20 0x7f8aac163100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44134/0 (socket says 172.21.15.47:44134) 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aab400640 1 -- 172.21.15.47:0/1695684689 learned_addr learned my addr 172.21.15.47:0/1695684689 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:04.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aabe00640 1 --2- 172.21.15.47:0/1695684689 >> v2:172.21.15.47:3300/0 conn(0x7f8aac0b1250 0x7f8aac0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aa2a00640 1 --2- 172.21.15.47:0/1695684689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac0b5fa0 0x7f8aac0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aaaa00640 1 -- 172.21.15.47:0/1695684689 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689241077 0 0) 0x7f8aac0b2e30 con 0x7f8aac162d20 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aaaa00640 1 -- 172.21.15.47:0/1695684689 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a90003530 con 0x7f8aac162d20 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aabe00640 1 -- 172.21.15.47:0/1695684689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac0b5fa0 msgr2=0x7f8aac0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aabe00640 1 --2- 172.21.15.47:0/1695684689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac0b5fa0 0x7f8aac0b2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aabe00640 1 -- 172.21.15.47:0/1695684689 >> v1:172.21.15.47:6789/0 conn(0x7f8aac162d20 legacy=0x7f8aac163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aabe00640 1 -- 172.21.15.47:0/1695684689 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0b33f0 con 0x7f8aac0b1250 2024-04-26T23:46:04.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.961+0000 7f8aa2a00640 1 --2- 172.21.15.47:0/1695684689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac0b5fa0 0x7f8aac0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:04.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8aabe00640 1 --2- 172.21.15.47:0/1695684689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b1250 0x7f8aac0b16e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009dc0 tx=0x7f8aa401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45adec3e2461af8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:04.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8aaaa00640 1 -- 172.21.15.47:0/1695684689 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40b2070 con 0x7f8aac0b1250 2024-04-26T23:46:04.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8aaaa00640 1 -- 172.21.15.47:0/1695684689 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa40a5810 con 0x7f8aac0b1250 2024-04-26T23:46:04.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8aaaa00640 1 -- 172.21.15.47:0/1695684689 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40a5be0 con 0x7f8aac0b1250 2024-04-26T23:46:04.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 -- 172.21.15.47:0/1695684689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b1250 msgr2=0x7f8aac0b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 --2- 172.21.15.47:0/1695684689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b1250 0x7f8aac0b16e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009dc0 tx=0x7f8aa401c950 comp rx=0 tx=0).stop 2024-04-26T23:46:04.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 -- 172.21.15.47:0/1695684689 shutdown_connections 2024-04-26T23:46:04.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 --2- 172.21.15.47:0/1695684689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b1250 0x7f8aac0b16e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 --2- 172.21.15.47:0/1695684689 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac0b5fa0 0x7f8aac0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 -- 172.21.15.47:0/1695684689 >> 172.21.15.47:0/1695684689 conn(0x7f8aac072a00 msgr2=0x7f8aac0b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:04.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 -- 172.21.15.47:0/1695684689 shutdown_connections 2024-04-26T23:46:04.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.965+0000 7f8ab2000640 1 -- 172.21.15.47:0/1695684689 wait complete. 2024-04-26T23:46:04.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 Processor -- start 2024-04-26T23:46:04.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 -- start start 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aac0b1250 0x7f8aac09e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b5fa0 0x7f8aac158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac162d20 0x7f8aac158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0af150 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0aefd0 con 0x7f8aac0b1250 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0af2d0 con 0x7f8aac162d20 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b5fa0 0x7f8aac158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b5fa0 0x7f8aac158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53518/0 (socket says 172.21.15.47:53518) 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 -- 172.21.15.47:0/2613437132 learned_addr learned my addr 172.21.15.47:0/2613437132 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aab400640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aac0b1250 0x7f8aac09e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aabe00640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac162d20 0x7f8aac158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 -- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac162d20 msgr2=0x7f8aac158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac162d20 0x7f8aac158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 -- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aac0b1250 msgr2=0x7f8aac09e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:04.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aac0b1250 0x7f8aac09e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:04.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 -- 172.21.15.47:0/2613437132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac158f50 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aab400640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aac0b1250 0x7f8aac09e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:04.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa2a00640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b5fa0 0x7f8aac158400 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400e810 tx=0x7f8a9400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:04.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa3e00640 1 -- 172.21.15.47:0/2613437132 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a94017070 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa3e00640 1 -- 172.21.15.47:0/2613437132 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9400c8d0 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac159230 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8aa3e00640 1 -- 172.21.15.47:0/2613437132 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400f040 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.969+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac09ebd0 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.973+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac069700 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.973+0000 7f8aa3e00640 1 -- 172.21.15.47:0/2613437132 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a9401a070 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.973+0000 7f8aa3e00640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8a88068380 0x7f8a8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:04.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.973+0000 7f8aa3e00640 1 -- 172.21.15.47:0/2613437132 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8a940865b0 con 0x7f8aac0b5fa0 2024-04-26T23:46:04.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.973+0000 7f8aab400640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8a88068380 0x7f8a8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:04.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.973+0000 7f8aab400640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8a88068380 0x7f8a8806a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c005890 tx=0x7f8a9c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:04.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:04.977+0000 7f8aa3e00640 1 -- 172.21.15.47:0/2613437132 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8a94056480 con 0x7f8aac0b5fa0 2024-04-26T23:46:05.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.145+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8aac0b3930 con 0x7f8aac0b5fa0 2024-04-26T23:46:05.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.145+0000 7f8aa3e00640 1 -- 172.21.15.47:0/2613437132 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f8a9405a780 con 0x7f8aac0b5fa0 2024-04-26T23:46:05.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8a88068380 msgr2=0x7f8a8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8a88068380 0x7f8a8806a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c005890 tx=0x7f8a9c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b5fa0 msgr2=0x7f8aac158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b5fa0 0x7f8aac158400 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400e810 tx=0x7f8a9400ecd0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 shutdown_connections 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8a88068380 0x7f8a8806a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8aac162d20 0x7f8aac158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8aac0b5fa0 0x7f8aac158400 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 --2- 172.21.15.47:0/2613437132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aac0b1250 0x7f8aac09e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 >> 172.21.15.47:0/2613437132 conn(0x7f8aac072a00 msgr2=0x7f8aac15d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 shutdown_connections 2024-04-26T23:46:05.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.149+0000 7f8ab2000640 1 -- 172.21.15.47:0/2613437132 wait complete. 2024-04-26T23:46:05.176 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:46:05.177 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:46:05.269 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:46:05.355 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:46:05.355 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:05.355 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:05.364 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:05.364 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:05.414 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:05.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9568e00640 1 Processor -- start 2024-04-26T23:46:05.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9568e00640 1 -- start start 2024-04-26T23:46:05.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9568e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f956406fcd0 0x7f956415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9568e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956415fc50 con 0x7f956415c100 2024-04-26T23:46:05.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9568e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956415ff30 con 0x7f95640ce310 2024-04-26T23:46:05.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9568e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9564160860 con 0x7f956406fcd0 2024-04-26T23:46:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9562800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f956406fcd0 0x7f956415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9562800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f956406fcd0 0x7f956415cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53534/0 (socket says 172.21.15.47:53534) 2024-04-26T23:46:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9562800640 1 -- 172.21.15.47:0/2465039098 learned_addr learned my addr 172.21.15.47:0/2465039098 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9562800640 1 -- 172.21.15.47:0/2465039098 >> v1:172.21.15.203:6789/0 conn(0x7f95640ce310 legacy=0x7f95640b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9562800640 1 -- 172.21.15.47:0/2465039098 >> v1:172.21.15.47:6789/0 conn(0x7f956415c100 legacy=0x7f95640cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9562800640 1 -- 172.21.15.47:0/2465039098 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9564160210 con 0x7f956406fcd0 2024-04-26T23:46:05.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.593+0000 7f9561400640 1 -- 172.21.15.47:0/2465039098 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444556249 0 0) 0x7f956415fc50 con 0x7f956415c100 2024-04-26T23:46:05.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9562800640 1 --2- 172.21.15.47:0/2465039098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956406fcd0 0x7f956415cf60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f955c009e50 tx=0x7f955c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c413d260d640a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9561400640 1 -- 172.21.15.47:0/2465039098 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c0a5810 con 0x7f956406fcd0 2024-04-26T23:46:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9561400640 1 -- 172.21.15.47:0/2465039098 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c0a59b0 con 0x7f956406fcd0 2024-04-26T23:46:05.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9561400640 1 -- 172.21.15.47:0/2465039098 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c0a5d80 con 0x7f956406fcd0 2024-04-26T23:46:05.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9568e00640 1 -- 172.21.15.47:0/2465039098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956406fcd0 msgr2=0x7f956415cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9568e00640 1 --2- 172.21.15.47:0/2465039098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956406fcd0 0x7f956415cf60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f955c009e50 tx=0x7f955c01ca30 comp rx=0 tx=0).stop 2024-04-26T23:46:05.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9568e00640 1 -- 172.21.15.47:0/2465039098 shutdown_connections 2024-04-26T23:46:05.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9568e00640 1 --2- 172.21.15.47:0/2465039098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956406fcd0 0x7f956415cf60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9568e00640 1 -- 172.21.15.47:0/2465039098 >> 172.21.15.47:0/2465039098 conn(0x7f956406c800 msgr2=0x7f956406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:05.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9568e00640 1 -- 172.21.15.47:0/2465039098 shutdown_connections 2024-04-26T23:46:05.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.597+0000 7f9568e00640 1 -- 172.21.15.47:0/2465039098 wait complete. 2024-04-26T23:46:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 Processor -- start 2024-04-26T23:46:05.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 -- start start 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f956406fcd0 0x7f95640b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95640ce310 0x7f956415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956415c100 0x7f95641585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f95640b6140 con 0x7f956415c100 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95640b5fc0 con 0x7f956406fcd0 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9564169e60 con 0x7f95640ce310 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956415c100 0x7f95641585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956415c100 0x7f95641585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53548/0 (socket says 172.21.15.47:53548) 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 -- 172.21.15.47:0/717285650 learned_addr learned my addr 172.21.15.47:0/717285650 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f955be00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95640ce310 0x7f956415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9561e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f956406fcd0 0x7f95640b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 -- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95640ce310 msgr2=0x7f956415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95640ce310 0x7f956415a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 -- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f956406fcd0 msgr2=0x7f95640b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f956406fcd0 0x7f95640b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 -- 172.21.15.47:0/717285650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9564166800 con 0x7f956415c100 2024-04-26T23:46:05.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9561e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f956406fcd0 0x7f95640b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:05.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9562800640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956415c100 0x7f95641585f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f955c0af040 tx=0x7f955c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:05.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f955a000640 1 -- 172.21.15.47:0/717285650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c0bc020 con 0x7f956415c100 2024-04-26T23:46:05.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f955a000640 1 -- 172.21.15.47:0/717285650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c0b8880 con 0x7f956415c100 2024-04-26T23:46:05.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f955a000640 1 -- 172.21.15.47:0/717285650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c0b8c70 con 0x7f956415c100 2024-04-26T23:46:05.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9564166ae0 con 0x7f956415c100 2024-04-26T23:46:05.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95641670a0 con 0x7f956415c100 2024-04-26T23:46:05.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.601+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9564069700 con 0x7f956415c100 2024-04-26T23:46:05.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.605+0000 7f955a000640 1 -- 172.21.15.47:0/717285650 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f955c0bf020 con 0x7f956415c100 2024-04-26T23:46:05.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.605+0000 7f955a000640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9540068380 0x7f954006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.605+0000 7f955a000640 1 -- 172.21.15.47:0/717285650 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f955c121cc0 con 0x7f956415c100 2024-04-26T23:46:05.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.605+0000 7f9561e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9540068380 0x7f954006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.605+0000 7f9561e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9540068380 0x7f954006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9554000f70 tx=0x7f9554009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:05.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.609+0000 7f955a000640 1 -- 172.21.15.47:0/717285650 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f955c128080 con 0x7f956415c100 2024-04-26T23:46:05.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.773+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95640d08b0 con 0x7f956415c100 2024-04-26T23:46:05.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.773+0000 7f955a000640 1 -- 172.21.15.47:0/717285650 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f955c0c6030 con 0x7f956415c100 2024-04-26T23:46:05.781 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:05.781 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9540068380 msgr2=0x7f954006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9540068380 0x7f954006a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9554000f70 tx=0x7f9554009040 comp rx=0 tx=0).stop 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956415c100 msgr2=0x7f95641585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956415c100 0x7f95641585f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f955c0af040 tx=0x7f955c0197d0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 shutdown_connections 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9540068380 0x7f954006a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f956415c100 0x7f95641585f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f95640ce310 0x7f956415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 --2- 172.21.15.47:0/717285650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f956406fcd0 0x7f95640b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 >> 172.21.15.47:0/717285650 conn(0x7f956406c800 msgr2=0x7f95640b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:05.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 shutdown_connections 2024-04-26T23:46:05.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.777+0000 7f9568e00640 1 -- 172.21.15.47:0/717285650 wait complete. 2024-04-26T23:46:05.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:05.803 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:05.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade8800640 1 Processor -- start 2024-04-26T23:46:05.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade8800640 1 -- start start 2024-04-26T23:46:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade8800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fade009c170 0x7fade00d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade8800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade0071620 con 0x7fade00b56f0 2024-04-26T23:46:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade8800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade0162e90 con 0x7fade0162ab0 2024-04-26T23:46:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade8800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fade00d2d40 con 0x7fade009c170 2024-04-26T23:46:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade6800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fade00b56f0 0x7fade00d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44146/0 (socket says 172.21.15.47:44146) 2024-04-26T23:46:05.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade6800640 1 -- 172.21.15.47:0/4149478188 learned_addr learned my addr 172.21.15.47:0/4149478188 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade5400640 1 --2- 172.21.15.47:0/4149478188 >> v2:172.21.15.203:3300/0 conn(0x7fade009c170 0x7fade00d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907542801 0 0) 0x7fade0071620 con 0x7fade00b56f0 2024-04-26T23:46:05.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc8003530 con 0x7fade00b56f0 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009430473 0 0) 0x7fade0162e90 con 0x7fade0162ab0 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fade0071620 con 0x7fade0162ab0 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3206274896 0 0) 0x7fadc8003530 con 0x7fade00b56f0 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 >> v2:172.21.15.203:3300/0 conn(0x7fade009c170 msgr2=0x7fade00d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 --2- 172.21.15.47:0/4149478188 >> v2:172.21.15.203:3300/0 conn(0x7fade009c170 0x7fade00d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 >> v1:172.21.15.203:6789/0 conn(0x7fade0162ab0 legacy=0x7fade009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade006dfc0 con 0x7fade00b56f0 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7faddc001a00 con 0x7fade00b56f0 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.941+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 >> v1:172.21.15.47:6789/0 conn(0x7fade00b56f0 legacy=0x7fade00d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadc8003b50 0x7fadc8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc80051d0 0x7fadc800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fade00d2d40 con 0x7fadc8004810 2024-04-26T23:46:05.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fadc800c100 con 0x7fadc80051d0 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fadc800c300 con 0x7fadc8003b50 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5400640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade6800640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc80051d0 0x7fadc800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5e00640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadc8003b50 0x7fadc8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5400640 1 -- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadc8003b50 msgr2=0x7fadc8003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5400640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadc8003b50 0x7fadc8003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5400640 1 -- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc80051d0 msgr2=0x7fadc800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5400640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc80051d0 0x7fadc800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5400640 1 -- 172.21.15.47:0/4149478188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc8003530 con 0x7fadc8004810 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade6800640 1 -- 172.21.15.47:0/4149478188 reap_dead start 2024-04-26T23:46:05.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5e00640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadc8003b50 0x7fadc8003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade5400640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009ae0 tx=0x7fadd001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abdf41c0ed499d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:05.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd00096b0 con 0x7fadc8004810 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd00a6500 con 0x7fadc8004810 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.945+0000 7fade4a00640 1 -- 172.21.15.47:0/4149478188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd00a68f0 con 0x7fadc8004810 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- 172.21.15.47:0/4149478188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc8004810 msgr2=0x7fadc8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009ae0 tx=0x7fadd001ca70 comp rx=0 tx=0).stop 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- 172.21.15.47:0/4149478188 shutdown_connections 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 --2- 172.21.15.47:0/4149478188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadc8004810 0x7fadc8004c90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- 172.21.15.47:0/4149478188 >> 172.21.15.47:0/4149478188 conn(0x7fade00b4c00 msgr2=0x7fade00b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- 172.21.15.47:0/4149478188 shutdown_connections 2024-04-26T23:46:05.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- 172.21.15.47:0/4149478188 wait complete. 2024-04-26T23:46:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 Processor -- start 2024-04-26T23:46:05.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- start start 2024-04-26T23:46:05.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc8004810 0x7fade00b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fade00b1710 0x7fade01fbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade00b7c70 0x7fade00c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fade009bff0 con 0x7fade00b7c70 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fade009be70 con 0x7fadc8004810 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade8800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fade00721b0 con 0x7fade00b1710 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade00b7c70 0x7fade00c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade00b7c70 0x7fade00c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53576/0 (socket says 172.21.15.47:53576) 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 -- 172.21.15.47:0/1875492218 learned_addr learned my addr 172.21.15.47:0/1875492218 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade5400640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fade00b1710 0x7fade01fbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade5e00640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc8004810 0x7fade00b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 -- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fade00b1710 msgr2=0x7fade01fbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fade00b1710 0x7fade01fbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 -- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc8004810 msgr2=0x7fade00b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:05.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc8004810 0x7fade00b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade6800640 1 -- 172.21.15.47:0/1875492218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade00b0670 con 0x7fade00b7c70 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade5e00640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc8004810 0x7fade00b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.949+0000 7fade5400640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fade00b1710 0x7fade01fbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fade6800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade00b7c70 0x7fade00c8f70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fade006f6f0 tx=0x7faddc007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fadda000640 1 -- 172.21.15.47:0/1875492218 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc00aaf0 con 0x7fade00b7c70 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fadda000640 1 -- 172.21.15.47:0/1875492218 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faddc018070 con 0x7fade00b7c70 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade00b0950 con 0x7fade00b7c70 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fadda000640 1 -- 172.21.15.47:0/1875492218 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faddc0133f0 con 0x7fade00b7c70 2024-04-26T23:46:05.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade00b0f10 con 0x7fade00b7c70 2024-04-26T23:46:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade00b1af0 con 0x7fade00b7c70 2024-04-26T23:46:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fadda000640 1 -- 172.21.15.47:0/1875492218 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faddc013590 con 0x7fade00b7c70 2024-04-26T23:46:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fadda000640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fadc40683b0 0x7fadc406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:05.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fadda000640 1 -- 172.21.15.47:0/1875492218 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7faddc086e50 con 0x7fade00b7c70 2024-04-26T23:46:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.953+0000 7fade5e00640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fadc40683b0 0x7fadc406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:05.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.957+0000 7fade5e00640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fadc40683b0 0x7fadc406a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fadd4007af0 tx=0x7fadd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:05.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:05.957+0000 7fadda000640 1 -- 172.21.15.47:0/1875492218 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faddc0574a0 con 0x7fade00b7c70 2024-04-26T23:46:06.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fade0069700 con 0x7fade00b7c70 2024-04-26T23:46:06.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fadda000640 1 -- 172.21.15.47:0/1875492218 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7faddc056da0 con 0x7fade00b7c70 2024-04-26T23:46:06.132 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fadc40683b0 msgr2=0x7fadc406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fadc40683b0 0x7fadc406a870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fadd4007af0 tx=0x7fadd4009040 comp rx=0 tx=0).stop 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade00b7c70 msgr2=0x7fade00c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade00b7c70 0x7fade00c8f70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fade006f6f0 tx=0x7faddc007a90 comp rx=0 tx=0).stop 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 shutdown_connections 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fadc40683b0 0x7fadc406a870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fade00b7c70 0x7fade00c8f70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fade00b1710 0x7fade01fbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 --2- 172.21.15.47:0/1875492218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadc8004810 0x7fade00b0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 >> 172.21.15.47:0/1875492218 conn(0x7fade00b4c00 msgr2=0x7fade00d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:06.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 shutdown_connections 2024-04-26T23:46:06.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.125+0000 7fade8800640 1 -- 172.21.15.47:0/1875492218 wait complete. 2024-04-26T23:46:06.153 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:06.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffacca00640 1 Processor -- start 2024-04-26T23:46:06.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffacca00640 1 -- start start 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffacca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac80af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffacca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffac806c630 0x7ffac806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffacca00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac80ae6a0 con 0x7ffac815fcd0 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffacca00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ffac80ae920 con 0x7ffac806c630 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffacca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffac80aec00 con 0x7ffac80d0390 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffabfe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffac806c630 0x7ffac806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffabfe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffac806c630 0x7ffac806cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53582/0 (socket says 172.21.15.47:53582) 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffabfe00640 1 -- 172.21.15.47:0/3888375800 learned_addr learned my addr 172.21.15.47:0/3888375800 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:06.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffac5e00640 1 --2- 172.21.15.47:0/3888375800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac80af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffabfe00640 1 -- 172.21.15.47:0/3888375800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 msgr2=0x7ffac80af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:06.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffabfe00640 1 --2- 172.21.15.47:0/3888375800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac80af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffabfe00640 1 -- 172.21.15.47:0/3888375800 >> v1:172.21.15.203:6789/0 conn(0x7ffac815fcd0 legacy=0x7ffac8160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.289+0000 7ffabfe00640 1 -- 172.21.15.47:0/3888375800 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac80aeee0 con 0x7ffac806c630 2024-04-26T23:46:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffabfe00640 1 --2- 172.21.15.47:0/3888375800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac806c630 0x7ffac806cab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009870 tx=0x7ffab001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a60b5ea3d0d0900 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffac5400640 1 -- 172.21.15.47:0/3888375800 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00b0070 con 0x7ffac806c630 2024-04-26T23:46:06.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffac5400640 1 -- 172.21.15.47:0/3888375800 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab0004230 con 0x7ffac806c630 2024-04-26T23:46:06.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffac5400640 1 -- 172.21.15.47:0/3888375800 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0003620 con 0x7ffac806c630 2024-04-26T23:46:06.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 -- 172.21.15.47:0/3888375800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac806c630 msgr2=0x7ffac806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 --2- 172.21.15.47:0/3888375800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac806c630 0x7ffac806cab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009870 tx=0x7ffab001c4d0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 -- 172.21.15.47:0/3888375800 shutdown_connections 2024-04-26T23:46:06.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 --2- 172.21.15.47:0/3888375800 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac806c630 0x7ffac806cab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 --2- 172.21.15.47:0/3888375800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac80af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 -- 172.21.15.47:0/3888375800 >> 172.21.15.47:0/3888375800 conn(0x7ffac80b2b70 msgr2=0x7ffac80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 -- 172.21.15.47:0/3888375800 shutdown_connections 2024-04-26T23:46:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.293+0000 7ffacca00640 1 -- 172.21.15.47:0/3888375800 wait complete. 2024-04-26T23:46:06.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 Processor -- start 2024-04-26T23:46:06.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 -- start start 2024-04-26T23:46:06.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffac806c630 0x7ffac8150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac81586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac815fcd0 0x7ffac8158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ffac806fa70 con 0x7ffac815fcd0 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffac806f8f0 con 0x7ffac806c630 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ffac806fbf0 con 0x7ffac80d0390 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac815fcd0 0x7ffac8158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac815fcd0 0x7ffac8158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53586/0 (socket says 172.21.15.47:53586) 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 -- 172.21.15.47:0/3475309004 learned_addr learned my addr 172.21.15.47:0/3475309004 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac5e00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffac806c630 0x7ffac8150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffabfe00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac81586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 -- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 msgr2=0x7ffac81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac81586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 -- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffac806c630 msgr2=0x7ffac8150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffac806c630 0x7ffac8150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 -- 172.21.15.47:0/3475309004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac809e010 con 0x7ffac815fcd0 2024-04-26T23:46:06.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffac6800640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac815fcd0 0x7ffac8158c30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffac000c760 tx=0x7ffac000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffabe000640 1 -- 172.21.15.47:0/3475309004 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0003b80 con 0x7ffac815fcd0 2024-04-26T23:46:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffabe000640 1 -- 172.21.15.47:0/3475309004 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac0003d20 con 0x7ffac815fcd0 2024-04-26T23:46:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffabe000640 1 -- 172.21.15.47:0/3475309004 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac000aa30 con 0x7ffac815fcd0 2024-04-26T23:46:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac809e2f0 con 0x7ffac815fcd0 2024-04-26T23:46:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac809e8b0 con 0x7ffac815fcd0 2024-04-26T23:46:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.297+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac8069700 con 0x7ffac815fcd0 2024-04-26T23:46:06.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.301+0000 7ffabe000640 1 -- 172.21.15.47:0/3475309004 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffac000abd0 con 0x7ffac815fcd0 2024-04-26T23:46:06.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.301+0000 7ffabe000640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffaa4068380 0x7ffaa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.301+0000 7ffabe000640 1 -- 172.21.15.47:0/3475309004 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffac00866c0 con 0x7ffac815fcd0 2024-04-26T23:46:06.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.301+0000 7ffac5e00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffaa4068380 0x7ffaa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.301+0000 7ffac5e00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffaa4068380 0x7ffaa406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffac815c700 tx=0x7ffab8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.305+0000 7ffabe000640 1 -- 172.21.15.47:0/3475309004 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ffac80ae6a0 con 0x7ffac815fcd0 2024-04-26T23:46:06.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.469+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffac806ecb0 con 0x7ffac815fcd0 2024-04-26T23:46:06.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.469+0000 7ffabe000640 1 -- 172.21.15.47:0/3475309004 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7ffac0056620 con 0x7ffac815fcd0 2024-04-26T23:46:06.477 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffaa4068380 msgr2=0x7ffaa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffaa4068380 0x7ffaa406a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffac815c700 tx=0x7ffab8008040 comp rx=0 tx=0).stop 2024-04-26T23:46:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac815fcd0 msgr2=0x7ffac8158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac815fcd0 0x7ffac8158c30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffac000c760 tx=0x7ffac000cc20 comp rx=0 tx=0).stop 2024-04-26T23:46:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 shutdown_connections 2024-04-26T23:46:06.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ffaa4068380 0x7ffaa406a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffac815fcd0 0x7ffac8158c30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ffac80d0390 0x7ffac81586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 --2- 172.21.15.47:0/3475309004 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffac806c630 0x7ffac8150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 >> 172.21.15.47:0/3475309004 conn(0x7ffac80b2b70 msgr2=0x7ffac8164f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 shutdown_connections 2024-04-26T23:46:06.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.473+0000 7ffacca00640 1 -- 172.21.15.47:0/3475309004 wait complete. 2024-04-26T23:46:06.498 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:06.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.633+0000 7f31bec00640 1 Processor -- start 2024-04-26T23:46:06.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.633+0000 7f31bec00640 1 -- start start 2024-04-26T23:46:06.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31bec00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31b80d0390 0x7f31b80af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31bec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31bec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f31b815fcd0 0x7f31b8160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31bec00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f31b80ae6a0 con 0x7f31b80d0390 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31bec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f31b80ae920 con 0x7f31b815fcd0 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31bec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f31b80aec00 con 0x7f31b806c630 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31b80d0390 0x7f31b80af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31b80d0390 0x7f31b80af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53600/0 (socket says 172.21.15.47:53600) 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 -- 172.21.15.47:0/1540039735 learned_addr learned my addr 172.21.15.47:0/1540039735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31af400640 1 --2- 172.21.15.47:0/1540039735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31bcc00640 1 --2- 172.21.15.47:0/1540039735 >> v2:172.21.15.203:3300/0 conn(0x7f31b815fcd0 0x7f31b8160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 -- 172.21.15.47:0/1540039735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 msgr2=0x7f31b806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 --2- 172.21.15.47:0/1540039735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 -- 172.21.15.47:0/1540039735 >> v2:172.21.15.203:3300/0 conn(0x7f31b815fcd0 msgr2=0x7f31b8160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 --2- 172.21.15.47:0/1540039735 >> v2:172.21.15.203:3300/0 conn(0x7f31b815fcd0 0x7f31b8160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.637+0000 7f31b7e00640 1 -- 172.21.15.47:0/1540039735 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b80aeee0 con 0x7f31b80d0390 2024-04-26T23:46:06.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31b7e00640 1 --2- 172.21.15.47:0/1540039735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b80af6e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b0380 tx=0x7f31a801eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c31287b4e27bca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31b7400640 1 -- 172.21.15.47:0/1540039735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80b4070 con 0x7f31b80d0390 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31b7400640 1 -- 172.21.15.47:0/1540039735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a80a7960 con 0x7f31b80d0390 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31b7400640 1 -- 172.21.15.47:0/1540039735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80a7d30 con 0x7f31b80d0390 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- 172.21.15.47:0/1540039735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 msgr2=0x7f31b80af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 --2- 172.21.15.47:0/1540039735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b80af6e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b0380 tx=0x7f31a801eb60 comp rx=0 tx=0).stop 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- 172.21.15.47:0/1540039735 shutdown_connections 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 --2- 172.21.15.47:0/1540039735 >> v2:172.21.15.203:3300/0 conn(0x7f31b815fcd0 0x7f31b8160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 --2- 172.21.15.47:0/1540039735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 --2- 172.21.15.47:0/1540039735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b80af6e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- 172.21.15.47:0/1540039735 >> 172.21.15.47:0/1540039735 conn(0x7f31b80b2b70 msgr2=0x7f31b80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:06.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- 172.21.15.47:0/1540039735 shutdown_connections 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- 172.21.15.47:0/1540039735 wait complete. 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 Processor -- start 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- start start 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b81f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b81544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31b815fcd0 0x7f31b81f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f31b806f860 con 0x7f31b80d0390 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31b806f6e0 con 0x7f31b815fcd0 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.641+0000 7f31bec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f31b806f9e0 con 0x7f31b806c630 2024-04-26T23:46:06.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b81544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b81544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53608/0 (socket says 172.21.15.47:53608) 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 -- 172.21.15.47:0/2706859255 learned_addr learned my addr 172.21.15.47:0/2706859255 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31b7e00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b81f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31bcc00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31b815fcd0 0x7f31b81f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 -- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 msgr2=0x7f31b81f7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b81f7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 -- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31b815fcd0 msgr2=0x7f31b81f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31b815fcd0 0x7f31b81f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 -- 172.21.15.47:0/2706859255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b8154db0 con 0x7f31b80d0390 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31bcc00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31b815fcd0 0x7f31b81f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31af400640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b81544d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d830 tx=0x7f31a000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31b4c00640 1 -- 172.21.15.47:0/2706859255 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0018020 con 0x7f31b80d0390 2024-04-26T23:46:06.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31b4c00640 1 -- 172.21.15.47:0/2706859255 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a00096a0 con 0x7f31b80d0390 2024-04-26T23:46:06.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b8155090 con 0x7f31b80d0390 2024-04-26T23:46:06.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31b4c00640 1 -- 172.21.15.47:0/2706859255 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0009a50 con 0x7f31b80d0390 2024-04-26T23:46:06.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b8155650 con 0x7f31b80d0390 2024-04-26T23:46:06.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b8069700 con 0x7f31b80d0390 2024-04-26T23:46:06.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.645+0000 7f31b4c00640 1 -- 172.21.15.47:0/2706859255 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31a001b020 con 0x7f31b80d0390 2024-04-26T23:46:06.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.649+0000 7f31b4c00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3194068380 0x7f319406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.649+0000 7f31b4c00640 1 -- 172.21.15.47:0/2706859255 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f31a0086ef0 con 0x7f31b80d0390 2024-04-26T23:46:06.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.649+0000 7f31b7e00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3194068380 0x7f319406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.649+0000 7f31b7e00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3194068380 0x7f319406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31a80b1000 tx=0x7f31a80a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:06.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.653+0000 7f31b4c00640 1 -- 172.21.15.47:0/2706859255 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f31a0022020 con 0x7f31b80d0390 2024-04-26T23:46:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.821+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f31b806ecb0 con 0x7f31b80d0390 2024-04-26T23:46:06.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.821+0000 7f31b4c00640 1 -- 172.21.15.47:0/2706859255 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f31a00574a0 con 0x7f31b80d0390 2024-04-26T23:46:06.830 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3194068380 msgr2=0x7f319406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3194068380 0x7f319406a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f31a80b1000 tx=0x7f31a80a9070 comp rx=0 tx=0).stop 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 msgr2=0x7f31b81544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b81544d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d830 tx=0x7f31a000dcf0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 shutdown_connections 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3194068380 0x7f319406a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31b815fcd0 0x7f31b81f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31b80d0390 0x7f31b81544d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 --2- 172.21.15.47:0/2706859255 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f31b806c630 0x7f31b81f7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 >> 172.21.15.47:0/2706859255 conn(0x7f31b80b2b70 msgr2=0x7f31b8159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 shutdown_connections 2024-04-26T23:46:06.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.825+0000 7f31bec00640 1 -- 172.21.15.47:0/2706859255 wait complete. 2024-04-26T23:46:06.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:06.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe649a00640 1 Processor -- start 2024-04-26T23:46:06.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe649a00640 1 -- start start 2024-04-26T23:46:06.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe649a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe64406cd40 0x7fe64415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe649a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6441601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:06.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe649a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe644160720 con 0x7fe644159b70 2024-04-26T23:46:06.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe649a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe6440af360 con 0x7fe64406cd40 2024-04-26T23:46:06.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe649a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe6440aea30 con 0x7fe6440af7f0 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe643400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6441601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe643400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6441601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:55832/0 (socket says 172.21.15.47:55832) 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe642a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fe644159b70 0x7fe64406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:37638/0 (socket says 172.21.15.47:37638) 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe63be00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe64406cd40 0x7fe64415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe643400640 1 -- 172.21.15.47:0/3650536049 learned_addr learned my addr 172.21.15.47:0/3650536049 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe63be00640 1 -- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 msgr2=0x7fe6441601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe63be00640 1 --2- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6441601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:06.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe63be00640 1 -- 172.21.15.47:0/3650536049 >> v1:172.21.15.203:6789/0 conn(0x7fe644159b70 legacy=0x7fe64406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:06.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe63be00640 1 -- 172.21.15.47:0/3650536049 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6440aed10 con 0x7fe64406cd40 2024-04-26T23:46:06.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.989+0000 7fe643400640 1 --2- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6441601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:07.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe63be00640 1 --2- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 0x7fe64415fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097c0 tx=0x7fe62c01e680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72b394008ca6c78b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe642000640 1 -- 172.21.15.47:0/3650536049 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0ae070 con 0x7fe64406cd40 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe642000640 1 -- 172.21.15.47:0/3650536049 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe62c0a8670 con 0x7fe64406cd40 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe642000640 1 -- 172.21.15.47:0/3650536049 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0a8a40 con 0x7fe64406cd40 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 -- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 msgr2=0x7fe64415fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 --2- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 0x7fe64415fca0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe62c0097c0 tx=0x7fe62c01e680 comp rx=0 tx=0).stop 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 -- 172.21.15.47:0/3650536049 shutdown_connections 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 --2- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6441601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 --2- 172.21.15.47:0/3650536049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 0x7fe64415fca0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 -- 172.21.15.47:0/3650536049 >> 172.21.15.47:0/3650536049 conn(0x7fe6440b2d40 msgr2=0x7fe6440b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 -- 172.21.15.47:0/3650536049 shutdown_connections 2024-04-26T23:46:07.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.993+0000 7fe649a00640 1 -- 172.21.15.47:0/3650536049 wait complete. 2024-04-26T23:46:07.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 Processor -- start 2024-04-26T23:46:07.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 -- start start 2024-04-26T23:46:07.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 0x7fe6440cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6440b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe644159b70 0x7fe644146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe64406fa60 con 0x7fe644159b70 2024-04-26T23:46:07.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe64406f8e0 con 0x7fe64406cd40 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe64406fbe0 con 0x7fe6440af7f0 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe644159b70 0x7fe644146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe644159b70 0x7fe644146220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53622/0 (socket says 172.21.15.47:53622) 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 -- 172.21.15.47:0/3005496679 learned_addr learned my addr 172.21.15.47:0/3005496679 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe63be00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6440b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe642a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 0x7fe6440cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 -- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 msgr2=0x7fe6440b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6440b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 -- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 msgr2=0x7fe6440cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 0x7fe6440cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 -- 172.21.15.47:0/3005496679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe644073ee0 con 0x7fe644159b70 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe63be00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6440b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:07.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe643400640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe644159b70 0x7fe644146220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00efc0 tx=0x7fe63c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe63aa00640 1 -- 172.21.15.47:0/3005496679 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c00cdc0 con 0x7fe644159b70 2024-04-26T23:46:07.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe63aa00640 1 -- 172.21.15.47:0/3005496679 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63c019070 con 0x7fe644159b70 2024-04-26T23:46:07.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe63aa00640 1 -- 172.21.15.47:0/3005496679 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0146c0 con 0x7fe644159b70 2024-04-26T23:46:07.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe644166b50 con 0x7fe644159b70 2024-04-26T23:46:07.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6440d0340 con 0x7fe644159b70 2024-04-26T23:46:07.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:06.997+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6440695f0 con 0x7fe644159b70 2024-04-26T23:46:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.001+0000 7fe63aa00640 1 -- 172.21.15.47:0/3005496679 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe63c012050 con 0x7fe644159b70 2024-04-26T23:46:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.001+0000 7fe63aa00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe620068380 0x7fe62006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.001+0000 7fe63aa00640 1 -- 172.21.15.47:0/3005496679 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe63c086ed0 con 0x7fe644159b70 2024-04-26T23:46:07.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.001+0000 7fe642a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe620068380 0x7fe62006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.001+0000 7fe642a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe620068380 0x7fe62006a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe634000f70 tx=0x7fe634007e30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.005+0000 7fe63aa00640 1 -- 172.21.15.47:0/3005496679 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe63c010040 con 0x7fe644159b70 2024-04-26T23:46:07.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.185+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe6440cd440 con 0x7fe644159b70 2024-04-26T23:46:07.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.185+0000 7fe63aa00640 1 -- 172.21.15.47:0/3005496679 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fe63c0573f0 con 0x7fe644159b70 2024-04-26T23:46:07.194 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:07.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe620068380 msgr2=0x7fe62006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe620068380 0x7fe62006a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe634000f70 tx=0x7fe634007e30 comp rx=0 tx=0).stop 2024-04-26T23:46:07.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe644159b70 msgr2=0x7fe644146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe644159b70 0x7fe644146220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00efc0 tx=0x7fe63c00c490 comp rx=0 tx=0).stop 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 shutdown_connections 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe620068380 0x7fe62006a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe644159b70 0x7fe644146220 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe6440af7f0 0x7fe6440b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 --2- 172.21.15.47:0/3005496679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe64406cd40 0x7fe6440cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 >> 172.21.15.47:0/3005496679 conn(0x7fe6440b2d40 msgr2=0x7fe644159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 shutdown_connections 2024-04-26T23:46:07.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.189+0000 7fe649a00640 1 -- 172.21.15.47:0/3005496679 wait complete. 2024-04-26T23:46:07.216 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:07.216 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:07.225 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:07.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.401+0000 7f1acc200640 1 Processor -- start 2024-04-26T23:46:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.401+0000 7f1acc200640 1 -- start start 2024-04-26T23:46:07.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1acc200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac40b4360 0x7f1ac40cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1acc200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ac40ce310 0x7f1ac415da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1acc200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac415e050 con 0x7f1ac415d5b0 2024-04-26T23:46:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1acc200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac415e330 con 0x7f1ac40ce310 2024-04-26T23:46:07.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1acc200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac40ceda0 con 0x7f1ac40b4360 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1aca200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ac40ce310 0x7f1ac415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1aca200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ac40ce310 0x7f1ac415da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53634/0 (socket says 172.21.15.47:53634) 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1aca200640 1 -- 172.21.15.47:0/3830317517 learned_addr learned my addr 172.21.15.47:0/3830317517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1ac9800640 1 --2- 172.21.15.47:0/3830317517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac40b4360 0x7f1ac40cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1aca200640 1 -- 172.21.15.47:0/3830317517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac40b4360 msgr2=0x7f1ac40cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1aca200640 1 --2- 172.21.15.47:0/3830317517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac40b4360 0x7f1ac40cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1aca200640 1 -- 172.21.15.47:0/3830317517 >> v1:172.21.15.47:6789/0 conn(0x7f1ac415d5b0 legacy=0x7f1ac40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1aca200640 1 -- 172.21.15.47:0/3830317517 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac40cf080 con 0x7f1ac40ce310 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1ac3e00640 1 -- 172.21.15.47:0/3830317517 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701707844 0 0) 0x7f1ac415e050 con 0x7f1ac415d5b0 2024-04-26T23:46:07.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.405+0000 7f1ac9800640 1 --2- 172.21.15.47:0/3830317517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac40b4360 0x7f1ac40cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:07.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1aca200640 1 --2- 172.21.15.47:0/3830317517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac415da10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009e50 tx=0x7f1abc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2509a774a57bae77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1ac3e00640 1 -- 172.21.15.47:0/3830317517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0a5810 con 0x7f1ac40ce310 2024-04-26T23:46:07.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1ac3e00640 1 -- 172.21.15.47:0/3830317517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1abc0a59b0 con 0x7f1ac40ce310 2024-04-26T23:46:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1ac3e00640 1 -- 172.21.15.47:0/3830317517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0a5d80 con 0x7f1ac40ce310 2024-04-26T23:46:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- 172.21.15.47:0/3830317517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 msgr2=0x7f1ac415da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 --2- 172.21.15.47:0/3830317517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac415da10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009e50 tx=0x7f1abc01ca30 comp rx=0 tx=0).stop 2024-04-26T23:46:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- 172.21.15.47:0/3830317517 shutdown_connections 2024-04-26T23:46:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 --2- 172.21.15.47:0/3830317517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac415da10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 --2- 172.21.15.47:0/3830317517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac40b4360 0x7f1ac40cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- 172.21.15.47:0/3830317517 >> 172.21.15.47:0/3830317517 conn(0x7f1ac406c800 msgr2=0x7f1ac406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- 172.21.15.47:0/3830317517 shutdown_connections 2024-04-26T23:46:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- 172.21.15.47:0/3830317517 wait complete. 2024-04-26T23:46:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 Processor -- start 2024-04-26T23:46:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- start start 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac40b4360 0x7f1ac41437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac413ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac415d5b0 0x7f1ac409ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac415f100 con 0x7f1ac40ce310 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac415ef80 con 0x7f1ac40b4360 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1acc200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac415f280 con 0x7f1ac415d5b0 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1ac8e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac413ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1ac8e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac413ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53650/0 (socket says 172.21.15.47:53650) 2024-04-26T23:46:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.409+0000 7f1ac8e00640 1 -- 172.21.15.47:0/1115925648 learned_addr learned my addr 172.21.15.47:0/1115925648 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac8e00640 1 -- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac415d5b0 msgr2=0x7f1ac409ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac8e00640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac415d5b0 0x7f1ac409ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac8e00640 1 -- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac40b4360 msgr2=0x7f1ac41437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac8e00640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac40b4360 0x7f1ac41437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac8e00640 1 -- 172.21.15.47:0/1115925648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac409c610 con 0x7f1ac40ce310 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac8e00640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac413ecd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c3c0 tx=0x7f1ab000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac1600640 1 -- 172.21.15.47:0/1115925648 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0017070 con 0x7f1ac40ce310 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac1600640 1 -- 172.21.15.47:0/1115925648 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab0003600 con 0x7f1ac40ce310 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac409c8f0 con 0x7f1ac40ce310 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac1600640 1 -- 172.21.15.47:0/1115925648 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00039f0 con 0x7f1ac40ce310 2024-04-26T23:46:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac409ceb0 con 0x7f1ac40ce310 2024-04-26T23:46:07.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac4069700 con 0x7f1ac40ce310 2024-04-26T23:46:07.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.413+0000 7f1ac1600640 1 -- 172.21.15.47:0/1115925648 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ab001a070 con 0x7f1ac40ce310 2024-04-26T23:46:07.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.417+0000 7f1ac1600640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1aa4068380 0x7f1aa406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.417+0000 7f1ac1600640 1 -- 172.21.15.47:0/1115925648 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1ab0085d40 con 0x7f1ac40ce310 2024-04-26T23:46:07.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.417+0000 7f1ac9800640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1aa4068380 0x7f1aa406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.417+0000 7f1ac9800640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1aa4068380 0x7f1aa406a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40cf7a0 tx=0x7f1ab8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.421+0000 7f1ac1600640 1 -- 172.21.15.47:0/1115925648 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1ab00562f0 con 0x7f1ac40ce310 2024-04-26T23:46:07.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.585+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ac409eca0 con 0x7f1ac40ce310 2024-04-26T23:46:07.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1ac1600640 1 -- 172.21.15.47:0/1115925648 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7f1ab0055bf0 con 0x7f1ac40ce310 2024-04-26T23:46:07.594 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:07.595 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1aa4068380 msgr2=0x7f1aa406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1aa4068380 0x7f1aa406a840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40cf7a0 tx=0x7f1ab8008040 comp rx=0 tx=0).stop 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 msgr2=0x7f1ac413ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac413ecd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ab000c3c0 tx=0x7f1ab000c880 comp rx=0 tx=0).stop 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 shutdown_connections 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1aa4068380 0x7f1aa406a840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1ac415d5b0 0x7f1ac409ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ac40ce310 0x7f1ac413ecd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 --2- 172.21.15.47:0/1115925648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ac40b4360 0x7f1ac41437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 >> 172.21.15.47:0/1115925648 conn(0x7f1ac406c800 msgr2=0x7f1ac415ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 shutdown_connections 2024-04-26T23:46:07.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.589+0000 7f1acc200640 1 -- 172.21.15.47:0/1115925648 wait complete. 2024-04-26T23:46:07.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:07.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe29600640 1 Processor -- start 2024-04-26T23:46:07.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe29600640 1 -- start start 2024-04-26T23:46:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe29600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbe240b56f0 0x7fbe240d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe29600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe24071620 con 0x7fbe24162ab0 2024-04-26T23:46:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe29600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe24162e90 con 0x7fbe2409c170 2024-04-26T23:46:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe29600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbe240d2d40 con 0x7fbe240b56f0 2024-04-26T23:46:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe22a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbe24162ab0 0x7fbe2409ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44178/0 (socket says 172.21.15.47:44178) 2024-04-26T23:46:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe22a00640 1 -- 172.21.15.47:0/3558140490 learned_addr learned my addr 172.21.15.47:0/3558140490 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:07.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe23400640 1 --2- 172.21.15.47:0/3558140490 >> v2:172.21.15.203:3300/0 conn(0x7fbe240b56f0 0x7fbe240d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe22000640 1 -- 172.21.15.47:0/3558140490 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230070754 0 0) 0x7fbe24071620 con 0x7fbe24162ab0 2024-04-26T23:46:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe22000640 1 -- 172.21.15.47:0/3558140490 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe08003530 con 0x7fbe24162ab0 2024-04-26T23:46:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe22000640 1 -- 172.21.15.47:0/3558140490 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258782715 0 0) 0x7fbe24162e90 con 0x7fbe2409c170 2024-04-26T23:46:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe22000640 1 -- 172.21.15.47:0/3558140490 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe24071620 con 0x7fbe2409c170 2024-04-26T23:46:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe23400640 1 -- 172.21.15.47:0/3558140490 >> v1:172.21.15.203:6789/0 conn(0x7fbe2409c170 legacy=0x7fbe240d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe23400640 1 -- 172.21.15.47:0/3558140490 >> v1:172.21.15.47:6789/0 conn(0x7fbe24162ab0 legacy=0x7fbe2409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.753+0000 7fbe23400640 1 -- 172.21.15.47:0/3558140490 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2406dfc0 con 0x7fbe240b56f0 2024-04-26T23:46:07.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe23400640 1 --2- 172.21.15.47:0/3558140490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 0x7fbe240d1a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009d90 tx=0x7fbe1c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aa60634a92c4de7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe22000640 1 -- 172.21.15.47:0/3558140490 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0b2070 con 0x7fbe240b56f0 2024-04-26T23:46:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe22000640 1 -- 172.21.15.47:0/3558140490 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0a5850 con 0x7fbe240b56f0 2024-04-26T23:46:07.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe22000640 1 -- 172.21.15.47:0/3558140490 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0a5c00 con 0x7fbe240b56f0 2024-04-26T23:46:07.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe29600640 1 -- 172.21.15.47:0/3558140490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 msgr2=0x7fbe240d1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe29600640 1 --2- 172.21.15.47:0/3558140490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 0x7fbe240d1a20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009d90 tx=0x7fbe1c01c8e0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe29600640 1 -- 172.21.15.47:0/3558140490 shutdown_connections 2024-04-26T23:46:07.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe29600640 1 --2- 172.21.15.47:0/3558140490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 0x7fbe240d1a20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe29600640 1 -- 172.21.15.47:0/3558140490 >> 172.21.15.47:0/3558140490 conn(0x7fbe240b4c00 msgr2=0x7fbe240b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:07.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe29600640 1 -- 172.21.15.47:0/3558140490 shutdown_connections 2024-04-26T23:46:07.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.757+0000 7fbe29600640 1 -- 172.21.15.47:0/3558140490 wait complete. 2024-04-26T23:46:07.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 Processor -- start 2024-04-26T23:46:07.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 -- start start 2024-04-26T23:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe2409c170 0x7fbe2415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 0x7fbe241528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe24162ab0 0x7fbe24153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe240721b0 con 0x7fbe24162ab0 2024-04-26T23:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe240718e0 con 0x7fbe240b56f0 2024-04-26T23:46:07.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe24072330 con 0x7fbe2409c170 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe24162ab0 0x7fbe24153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe24162ab0 0x7fbe24153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53658/0 (socket says 172.21.15.47:53658) 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 -- 172.21.15.47:0/155491023 learned_addr learned my addr 172.21.15.47:0/155491023 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe1be00640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 0x7fbe241528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe22a00640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe2409c170 0x7fbe2415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 -- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe2409c170 msgr2=0x7fbe2415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe2409c170 0x7fbe2415f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 -- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 msgr2=0x7fbe241528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 0x7fbe241528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 -- 172.21.15.47:0/155491023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe24162240 con 0x7fbe24162ab0 2024-04-26T23:46:07.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe23400640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe24162ab0 0x7fbe24153bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0b0040 tx=0x7fbe1c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe1aa00640 1 -- 172.21.15.47:0/155491023 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0b2050 con 0x7fbe24162ab0 2024-04-26T23:46:07.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe1aa00640 1 -- 172.21.15.47:0/155491023 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0be070 con 0x7fbe24162ab0 2024-04-26T23:46:07.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe1aa00640 1 -- 172.21.15.47:0/155491023 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c003db0 con 0x7fbe24162ab0 2024-04-26T23:46:07.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe24159030 con 0x7fbe24162ab0 2024-04-26T23:46:07.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.761+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe24159860 con 0x7fbe24162ab0 2024-04-26T23:46:07.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.765+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe24069700 con 0x7fbe24162ab0 2024-04-26T23:46:07.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.765+0000 7fbe1aa00640 1 -- 172.21.15.47:0/155491023 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe1c004040 con 0x7fbe24162ab0 2024-04-26T23:46:07.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.765+0000 7fbe1aa00640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe00068380 0x7fbe0006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:07.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.765+0000 7fbe1aa00640 1 -- 172.21.15.47:0/155491023 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbe1c121830 con 0x7fbe24162ab0 2024-04-26T23:46:07.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.765+0000 7fbe22a00640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe00068380 0x7fbe0006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:07.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.765+0000 7fbe22a00640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe00068380 0x7fbe0006a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe14000f70 tx=0x7fbe14007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:07.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.769+0000 7fbe1aa00640 1 -- 172.21.15.47:0/155491023 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbe1c016560 con 0x7fbe24162ab0 2024-04-26T23:46:07.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbe240b4410 con 0x7fbe24162ab0 2024-04-26T23:46:07.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe1aa00640 1 -- 172.21.15.47:0/155491023 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fbe1c0f18d0 con 0x7fbe24162ab0 2024-04-26T23:46:07.944 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:07.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe00068380 msgr2=0x7fbe0006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe00068380 0x7fbe0006a840 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe14000f70 tx=0x7fbe14007d40 comp rx=0 tx=0).stop 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe24162ab0 msgr2=0x7fbe24153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe24162ab0 0x7fbe24153bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c0b0040 tx=0x7fbe1c019680 comp rx=0 tx=0).stop 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 shutdown_connections 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe00068380 0x7fbe0006a840 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe24162ab0 0x7fbe24153bb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe240b56f0 0x7fbe241528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 --2- 172.21.15.47:0/155491023 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe2409c170 0x7fbe2415f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 >> 172.21.15.47:0/155491023 conn(0x7fbe240b4c00 msgr2=0x7fbe240b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 shutdown_connections 2024-04-26T23:46:07.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:07.937+0000 7fbe29600640 1 -- 172.21.15.47:0/155491023 wait complete. 2024-04-26T23:46:07.966 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:08.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.101+0000 7fd285600640 1 Processor -- start 2024-04-26T23:46:08.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.101+0000 7fd285600640 1 -- start start 2024-04-26T23:46:08.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.101+0000 7fd285600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd28006cd40 0x7fd2800af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.101+0000 7fd285600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2800ae6a0 con 0x7fd28015fcd0 2024-04-26T23:46:08.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.101+0000 7fd285600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2800ae920 con 0x7fd2800d0390 2024-04-26T23:46:08.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.101+0000 7fd285600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd2800aec00 con 0x7fd28006cd40 2024-04-26T23:46:08.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd276000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd28006cd40 0x7fd2800af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd27f400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd28015fcd0 0x7fd280160160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44188/0 (socket says 172.21.15.47:44188) 2024-04-26T23:46:08.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd276000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd28006cd40 0x7fd2800af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53668/0 (socket says 172.21.15.47:53668) 2024-04-26T23:46:08.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd27f400640 1 -- 172.21.15.47:0/3871443370 learned_addr learned my addr 172.21.15.47:0/3871443370 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:08.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd276000640 1 -- 172.21.15.47:0/3871443370 >> v1:172.21.15.203:6789/0 conn(0x7fd2800d0390 legacy=0x7fd28006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:08.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd276000640 1 -- 172.21.15.47:0/3871443370 >> v1:172.21.15.47:6789/0 conn(0x7fd28015fcd0 legacy=0x7fd280160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd276000640 1 -- 172.21.15.47:0/3871443370 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2800aeee0 con 0x7fd28006cd40 2024-04-26T23:46:08.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd276000640 1 --2- 172.21.15.47:0/3871443370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd28006cd40 0x7fd2800af6e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd2680097c0 tx=0x7fd26801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf3641e4096fb0d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd27e000640 1 -- 172.21.15.47:0/3871443370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b0070 con 0x7fd28006cd40 2024-04-26T23:46:08.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd27e000640 1 -- 172.21.15.47:0/3871443370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2680ab600 con 0x7fd28006cd40 2024-04-26T23:46:08.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.105+0000 7fd27e000640 1 -- 172.21.15.47:0/3871443370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680ab9d0 con 0x7fd28006cd40 2024-04-26T23:46:08.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- 172.21.15.47:0/3871443370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd28006cd40 msgr2=0x7fd2800af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 --2- 172.21.15.47:0/3871443370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd28006cd40 0x7fd2800af6e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd2680097c0 tx=0x7fd26801c3a0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- 172.21.15.47:0/3871443370 shutdown_connections 2024-04-26T23:46:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 --2- 172.21.15.47:0/3871443370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd28006cd40 0x7fd2800af6e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- 172.21.15.47:0/3871443370 >> 172.21.15.47:0/3871443370 conn(0x7fd2800b2b70 msgr2=0x7fd2800b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- 172.21.15.47:0/3871443370 shutdown_connections 2024-04-26T23:46:08.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- 172.21.15.47:0/3871443370 wait complete. 2024-04-26T23:46:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 Processor -- start 2024-04-26T23:46:08.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- start start 2024-04-26T23:46:08.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd28006cd40 0x7fd28014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2800d0390 0x7fd28009c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd28015fcd0 0x7fd28009e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd28006faf0 con 0x7fd2800d0390 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd28006f970 con 0x7fd28015fcd0 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd285600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd28006fc70 con 0x7fd28006cd40 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2800d0390 0x7fd28009c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2800d0390 0x7fd28009c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53676/0 (socket says 172.21.15.47:53676) 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 -- 172.21.15.47:0/3467317228 learned_addr learned my addr 172.21.15.47:0/3467317228 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 -- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd28006cd40 msgr2=0x7fd28014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd28006cd40 0x7fd28014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 -- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd28015fcd0 msgr2=0x7fd28009e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd28015fcd0 0x7fd28009e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 -- 172.21.15.47:0/3467317228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28006e3e0 con 0x7fd2800d0390 2024-04-26T23:46:08.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.109+0000 7fd276000640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2800d0390 0x7fd28009c450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd268018fb0 tx=0x7fd26801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd277400640 1 -- 172.21.15.47:0/3467317228 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b0050 con 0x7fd2800d0390 2024-04-26T23:46:08.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd277400640 1 -- 172.21.15.47:0/3467317228 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2680bc070 con 0x7fd2800d0390 2024-04-26T23:46:08.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd277400640 1 -- 172.21.15.47:0/3467317228 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680b5a70 con 0x7fd2800d0390 2024-04-26T23:46:08.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd280150370 con 0x7fd2800d0390 2024-04-26T23:46:08.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd280152fe0 con 0x7fd2800d0390 2024-04-26T23:46:08.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd280069700 con 0x7fd2800d0390 2024-04-26T23:46:08.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd277400640 1 -- 172.21.15.47:0/3467317228 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2680ab4c0 con 0x7fd2800d0390 2024-04-26T23:46:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd277400640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd25c0683b0 0x7fd25c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd277400640 1 -- 172.21.15.47:0/3467317228 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd268121360 con 0x7fd2800d0390 2024-04-26T23:46:08.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.113+0000 7fd27ea00640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd25c0683b0 0x7fd25c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.117+0000 7fd27ea00640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd25c0683b0 0x7fd25c06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd270003cf0 tx=0x7fd2700079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.117+0000 7fd277400640 1 -- 172.21.15.47:0/3467317228 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd268016050 con 0x7fd2800d0390 2024-04-26T23:46:08.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.285+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd28006ecb0 con 0x7fd2800d0390 2024-04-26T23:46:08.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.285+0000 7fd277400640 1 -- 172.21.15.47:0/3467317228 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fd2680f1880 con 0x7fd2800d0390 2024-04-26T23:46:08.294 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:08.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd25c0683b0 msgr2=0x7fd25c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd25c0683b0 0x7fd25c06a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd270003cf0 tx=0x7fd2700079c0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2800d0390 msgr2=0x7fd28009c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2800d0390 0x7fd28009c450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd268018fb0 tx=0x7fd26801abe0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 shutdown_connections 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd25c0683b0 0x7fd25c06a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd28015fcd0 0x7fd28009e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd2800d0390 0x7fd28009c450 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 --2- 172.21.15.47:0/3467317228 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd28006cd40 0x7fd28014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 >> 172.21.15.47:0/3467317228 conn(0x7fd2800b2b70 msgr2=0x7fd28015ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 shutdown_connections 2024-04-26T23:46:08.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.289+0000 7fd285600640 1 -- 172.21.15.47:0/3467317228 wait complete. 2024-04-26T23:46:08.316 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:08.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1102e00640 1 Processor -- start 2024-04-26T23:46:08.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1102e00640 1 -- start start 2024-04-26T23:46:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1102e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f10fc0b56f0 0x7f10fc0d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1102e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10fc071620 con 0x7f10fc09c170 2024-04-26T23:46:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1102e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10fc162e90 con 0x7f10fc162ab0 2024-04-26T23:46:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1102e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f10fc0d2d40 con 0x7f10fc0b56f0 2024-04-26T23:46:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10fb400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f10fc09c170 0x7f10fc0d1310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44194/0 (socket says 172.21.15.47:44194) 2024-04-26T23:46:08.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10fb400640 1 -- 172.21.15.47:0/2811373901 learned_addr learned my addr 172.21.15.47:0/2811373901 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 --2- 172.21.15.47:0/2811373901 >> v2:172.21.15.203:3300/0 conn(0x7f10fc0b56f0 0x7f10fc0d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095576130 0 0) 0x7f10fc071620 con 0x7f10fc09c170 2024-04-26T23:46:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10e0003530 con 0x7f10fc09c170 2024-04-26T23:46:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344169855 0 0) 0x7f10fc162e90 con 0x7f10fc162ab0 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10fc071620 con 0x7f10fc162ab0 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 183627004 0 0) 0x7f10e0003530 con 0x7f10fc09c170 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 >> v2:172.21.15.203:3300/0 conn(0x7f10fc0b56f0 msgr2=0x7f10fc0d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 --2- 172.21.15.47:0/2811373901 >> v2:172.21.15.203:3300/0 conn(0x7f10fc0b56f0 0x7f10fc0d1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 >> v1:172.21.15.203:6789/0 conn(0x7f10fc162ab0 legacy=0x7f10fc09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc06dfc0 con 0x7f10fc09c170 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f10e8001680 con 0x7f10fc09c170 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 --2- 172.21.15.47:0/2811373901 >> v2:172.21.15.203:3300/0 conn(0x7f10fc0b56f0 0x7f10fc0d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 >> v1:172.21.15.47:6789/0 conn(0x7f10fc09c170 legacy=0x7f10fc0d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10e0003b50 0x7f10e0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10e0004810 0x7f10e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc0d2d40 con 0x7f10e00051d0 2024-04-26T23:46:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f10e000c100 con 0x7f10e0004810 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10e000c300 con 0x7f10e0003b50 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10fb400640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10e0004810 0x7f10e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f10fbe00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10e0003b50 0x7f10e0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 -- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10e0003b50 msgr2=0x7f10e0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10e0003b50 0x7f10e0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 -- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10e0004810 msgr2=0x7f10e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10e0004810 0x7f10e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.453+0000 7f1100e00640 1 -- 172.21.15.47:0/2811373901 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e0003530 con 0x7f10e00051d0 2024-04-26T23:46:08.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1100e00640 1 -- 172.21.15.47:0/2811373901 reap_dead start 2024-04-26T23:46:08.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1100e00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10e000b9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10f400e350 tx=0x7f10f401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c1f80b1402b39f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4009de0 con 0x7f10e00051d0 2024-04-26T23:46:08.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f40039a0 con 0x7f10e00051d0 2024-04-26T23:46:08.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f10faa00640 1 -- 172.21.15.47:0/2811373901 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f4003d90 con 0x7f10e00051d0 2024-04-26T23:46:08.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1102e00640 1 -- 172.21.15.47:0/2811373901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 msgr2=0x7f10e000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1102e00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10e000b9d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f10f400e350 tx=0x7f10f401ce80 comp rx=0 tx=0).stop 2024-04-26T23:46:08.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1102e00640 1 -- 172.21.15.47:0/2811373901 shutdown_connections 2024-04-26T23:46:08.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1102e00640 1 --2- 172.21.15.47:0/2811373901 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10e000b9d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1102e00640 1 -- 172.21.15.47:0/2811373901 >> 172.21.15.47:0/2811373901 conn(0x7f10fc0b4c00 msgr2=0x7f10fc0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:08.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1102e00640 1 -- 172.21.15.47:0/2811373901 shutdown_connections 2024-04-26T23:46:08.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.457+0000 7f1102e00640 1 -- 172.21.15.47:0/2811373901 wait complete. 2024-04-26T23:46:08.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 Processor -- start 2024-04-26T23:46:08.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 -- start start 2024-04-26T23:46:08.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10fc1f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10fc161d20 0x7f10fc0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10fc0c8590 0x7f10fc0cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc0718e0 con 0x7f10e00051d0 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc06e7c0 con 0x7f10fc0c8590 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10fc0721b0 con 0x7f10fc161d20 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10fc1f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10fc1f8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53694/0 (socket says 172.21.15.47:53694) 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 -- 172.21.15.47:0/3693154827 learned_addr learned my addr 172.21.15.47:0/3693154827 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fb400640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10fc161d20 0x7f10fc0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1100e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10fc0c8590 0x7f10fc0cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 -- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10fc161d20 msgr2=0x7f10fc0cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10fc161d20 0x7f10fc0cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 -- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10fc0c8590 msgr2=0x7f10fc0cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10fc0c8590 0x7f10fc0cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 -- 172.21.15.47:0/3693154827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc09c8d0 con 0x7f10e00051d0 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fb400640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10fc161d20 0x7f10fc0cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10fbe00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10fc1f8c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10ec012830 tx=0x7f10ec012cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10f3e00640 1 -- 172.21.15.47:0/3693154827 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec010b70 con 0x7f10e00051d0 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10f3e00640 1 -- 172.21.15.47:0/3693154827 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec01b070 con 0x7f10e00051d0 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f10f3e00640 1 -- 172.21.15.47:0/3693154827 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec016480 con 0x7f10e00051d0 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc1f4e50 con 0x7f10e00051d0 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.461+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc1f5410 con 0x7f10e00051d0 2024-04-26T23:46:08.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.465+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10fc1f5a20 con 0x7f10e00051d0 2024-04-26T23:46:08.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.465+0000 7f10f3e00640 1 -- 172.21.15.47:0/3693154827 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10ec016620 con 0x7f10e00051d0 2024-04-26T23:46:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.465+0000 7f10f3e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10dc0683b0 0x7f10dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.465+0000 7f10f3e00640 1 -- 172.21.15.47:0/3693154827 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f10ec08a060 con 0x7f10e00051d0 2024-04-26T23:46:08.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.465+0000 7f10fb400640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10dc0683b0 0x7f10dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.465+0000 7f10fb400640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10dc0683b0 0x7f10dc06a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0d0db0 tx=0x7f10e8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.469+0000 7f10f3e00640 1 -- 172.21.15.47:0/3693154827 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f10ec05a610 con 0x7f10e00051d0 2024-04-26T23:46:08.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f10fc069700 con 0x7f10e00051d0 2024-04-26T23:46:08.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f10f3e00640 1 -- 172.21.15.47:0/3693154827 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f10ec059f10 con 0x7f10e00051d0 2024-04-26T23:46:08.640 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10dc0683b0 msgr2=0x7f10dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10dc0683b0 0x7f10dc06a870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0d0db0 tx=0x7f10e8009040 comp rx=0 tx=0).stop 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 msgr2=0x7f10fc1f8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10fc1f8c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f10ec012830 tx=0x7f10ec012cf0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 shutdown_connections 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10dc0683b0 0x7f10dc06a870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10fc0c8590 0x7f10fc0cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f10fc161d20 0x7f10fc0cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 --2- 172.21.15.47:0/3693154827 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10e00051d0 0x7f10fc1f8c40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 >> 172.21.15.47:0/3693154827 conn(0x7f10fc0b4c00 msgr2=0x7f10fc1e7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:08.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 shutdown_connections 2024-04-26T23:46:08.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.633+0000 7f1102e00640 1 -- 172.21.15.47:0/3693154827 wait complete. 2024-04-26T23:46:08.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:08.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e7e00640 1 Processor -- start 2024-04-26T23:46:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e7e00640 1 -- start start 2024-04-26T23:46:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87e0159b70 0x7f87e006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e7e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e00aea30 con 0x7f87e00af7f0 2024-04-26T23:46:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e7e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e00aed10 con 0x7f87e01603b0 2024-04-26T23:46:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e7e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87e00af360 con 0x7f87e0159b70 2024-04-26T23:46:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e5400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87e0159b70 0x7f87e006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e4a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f87e00af7f0 0x7f87e015fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44200/0 (socket says 172.21.15.47:44200) 2024-04-26T23:46:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.797+0000 7f87e4a00640 1 -- 172.21.15.47:0/2291468533 learned_addr learned my addr 172.21.15.47:0/2291468533 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.801+0000 7f87e5400640 1 -- 172.21.15.47:0/2291468533 >> v1:172.21.15.203:6789/0 conn(0x7f87e01603b0 legacy=0x7f87e006eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.801+0000 7f87e5400640 1 -- 172.21.15.47:0/2291468533 >> v1:172.21.15.47:6789/0 conn(0x7f87e00af7f0 legacy=0x7f87e015fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.801+0000 7f87e5400640 1 -- 172.21.15.47:0/2291468533 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e00aeff0 con 0x7f87e0159b70 2024-04-26T23:46:08.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.801+0000 7f87e5400640 1 --2- 172.21.15.47:0/2291468533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e0159b70 0x7f87e006c630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87e00af4e0 tx=0x7f87d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8140ff279f98433 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87dfe00640 1 -- 172.21.15.47:0/2291468533 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d40b0070 con 0x7f87e0159b70 2024-04-26T23:46:08.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87dfe00640 1 -- 172.21.15.47:0/2291468533 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d40ab600 con 0x7f87e0159b70 2024-04-26T23:46:08.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87dfe00640 1 -- 172.21.15.47:0/2291468533 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d40ab9d0 con 0x7f87e0159b70 2024-04-26T23:46:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 -- 172.21.15.47:0/2291468533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e0159b70 msgr2=0x7f87e006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2291468533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e0159b70 0x7f87e006c630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f87e00af4e0 tx=0x7f87d401c460 comp rx=0 tx=0).stop 2024-04-26T23:46:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 -- 172.21.15.47:0/2291468533 shutdown_connections 2024-04-26T23:46:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2291468533 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e0159b70 0x7f87e006c630 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 -- 172.21.15.47:0/2291468533 >> 172.21.15.47:0/2291468533 conn(0x7f87e00b2d40 msgr2=0x7f87e00b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 -- 172.21.15.47:0/2291468533 shutdown_connections 2024-04-26T23:46:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 -- 172.21.15.47:0/2291468533 wait complete. 2024-04-26T23:46:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.805+0000 7f87e7e00640 1 Processor -- start 2024-04-26T23:46:08.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 -- start start 2024-04-26T23:46:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87e00af7f0 0x7f87e00ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87e0159b70 0x7f87e00ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e01603b0 0x7f87e014e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f87e016a0d0 con 0x7f87e01603b0 2024-04-26T23:46:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0169f50 con 0x7f87e0159b70 2024-04-26T23:46:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f87e016a250 con 0x7f87e00af7f0 2024-04-26T23:46:08.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e01603b0 0x7f87e014e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e01603b0 0x7f87e014e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:53702/0 (socket says 172.21.15.47:53702) 2024-04-26T23:46:08.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 -- 172.21.15.47:0/2949019514 learned_addr learned my addr 172.21.15.47:0/2949019514 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:08.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5400640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87e00af7f0 0x7f87e00ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e4a00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87e0159b70 0x7f87e00ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 -- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87e00af7f0 msgr2=0x7f87e00ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87e00af7f0 0x7f87e00ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 -- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87e0159b70 msgr2=0x7f87e00ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87e0159b70 0x7f87e00ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 -- 172.21.15.47:0/2949019514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e0150ce0 con 0x7f87e01603b0 2024-04-26T23:46:08.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e5e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e01603b0 0x7f87e014e2e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f87d800b970 tx=0x7f87d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87dd600640 1 -- 172.21.15.47:0/2949019514 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8019070 con 0x7f87e01603b0 2024-04-26T23:46:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87dd600640 1 -- 172.21.15.47:0/2949019514 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d800cb40 con 0x7f87e01603b0 2024-04-26T23:46:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e0150f50 con 0x7f87e01603b0 2024-04-26T23:46:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87dd600640 1 -- 172.21.15.47:0/2949019514 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d8014440 con 0x7f87e01603b0 2024-04-26T23:46:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e0151510 con 0x7f87e01603b0 2024-04-26T23:46:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.809+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e00695f0 con 0x7f87e01603b0 2024-04-26T23:46:08.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.813+0000 7f87dd600640 1 -- 172.21.15.47:0/2949019514 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87d801c070 con 0x7f87e01603b0 2024-04-26T23:46:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.813+0000 7f87dd600640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f87c0068380 0x7f87c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.813+0000 7f87dd600640 1 -- 172.21.15.47:0/2949019514 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f87d80865c0 con 0x7f87e01603b0 2024-04-26T23:46:08.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.813+0000 7f87e5400640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f87c0068380 0x7f87c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:08.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.813+0000 7f87e5400640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f87c0068380 0x7f87c006a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87d40ad000 tx=0x7f87d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:08.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.817+0000 7f87dd600640 1 -- 172.21.15.47:0/2949019514 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f87d8056490 con 0x7f87e01603b0 2024-04-26T23:46:08.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f87e006eca0 con 0x7f87e01603b0 2024-04-26T23:46:08.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87dd600640 1 -- 172.21.15.47:0/2949019514 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f87d805a790 con 0x7f87e01603b0 2024-04-26T23:46:08.999 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:09.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f87c0068380 msgr2=0x7f87c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f87c0068380 0x7f87c006a840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87d40ad000 tx=0x7f87d4008040 comp rx=0 tx=0).stop 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e01603b0 msgr2=0x7f87e014e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e01603b0 0x7f87e014e2e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f87d800b970 tx=0x7f87d800be30 comp rx=0 tx=0).stop 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 shutdown_connections 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f87c0068380 0x7f87c006a840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87e01603b0 0x7f87e014e2e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87e0159b70 0x7f87e00ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 --2- 172.21.15.47:0/2949019514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87e00af7f0 0x7f87e00ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 >> 172.21.15.47:0/2949019514 conn(0x7f87e00b2d40 msgr2=0x7f87e006eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 shutdown_connections 2024-04-26T23:46:09.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:08.993+0000 7f87e7e00640 1 -- 172.21.15.47:0/2949019514 wait complete. 2024-04-26T23:46:09.020 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-04-26T23:46:09.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:09.020 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:46:09.053 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:09.053 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:46:09.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:09.053 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:46:09.112 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:46:09.112 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:09.122 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:46:09.122 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:09.173 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:09.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.305+0000 7fe0d5800640 1 Processor -- start 2024-04-26T23:46:09.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.305+0000 7fe0d5800640 1 -- start start 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0d5800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0d0162a30 0x7fe0d00d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0d5800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d006c400 0x7fe0d00d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0d5800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0d00cf840 con 0x7fe0d00b1690 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0d5800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe0d00d1c70 con 0x7fe0d0162a30 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0d5800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d00ce830 con 0x7fe0d006c400 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0d0162a30 0x7fe0d00d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe0d0162a30 0x7fe0d00d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58968/0 (socket says 172.21.15.47:58968) 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 -- 172.21.15.47:0/3559288570 learned_addr learned my addr 172.21.15.47:0/3559288570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:09.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cf400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe0d00b1690 0x7fe0d0073260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34458/0 (socket says 172.21.15.47:34458) 2024-04-26T23:46:09.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0c6000640 1 --2- 172.21.15.47:0/3559288570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d006c400 0x7fe0d00d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 -- 172.21.15.47:0/3559288570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d006c400 msgr2=0x7fe0d00d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:09.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 --2- 172.21.15.47:0/3559288570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d006c400 0x7fe0d00d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 -- 172.21.15.47:0/3559288570 >> v1:172.21.15.47:6789/0 conn(0x7fe0d00b1690 legacy=0x7fe0d0073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 -- 172.21.15.47:0/3559288570 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d00cea80 con 0x7fe0d0162a30 2024-04-26T23:46:09.317 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0c6000640 1 --2- 172.21.15.47:0/3559288570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d006c400 0x7fe0d00d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:09.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.309+0000 7fe0cea00640 1 --2- 172.21.15.47:0/3559288570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0162a30 0x7fe0d00d03e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009e50 tx=0x7fe0c001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58df4e8a75bef54b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0ce000640 1 -- 172.21.15.47:0/3559288570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00a5830 con 0x7fe0d0162a30 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0ce000640 1 -- 172.21.15.47:0/3559288570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c00a59d0 con 0x7fe0d0162a30 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0ce000640 1 -- 172.21.15.47:0/3559288570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00a5da0 con 0x7fe0d0162a30 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- 172.21.15.47:0/3559288570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0162a30 msgr2=0x7fe0d00d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 --2- 172.21.15.47:0/3559288570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0162a30 0x7fe0d00d03e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009e50 tx=0x7fe0c001c970 comp rx=0 tx=0).stop 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- 172.21.15.47:0/3559288570 shutdown_connections 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 --2- 172.21.15.47:0/3559288570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d006c400 0x7fe0d00d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 --2- 172.21.15.47:0/3559288570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0162a30 0x7fe0d00d03e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- 172.21.15.47:0/3559288570 >> 172.21.15.47:0/3559288570 conn(0x7fe0d00d1df0 msgr2=0x7fe0d00d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:09.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- 172.21.15.47:0/3559288570 shutdown_connections 2024-04-26T23:46:09.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- 172.21.15.47:0/3559288570 wait complete. 2024-04-26T23:46:09.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 Processor -- start 2024-04-26T23:46:09.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- start start 2024-04-26T23:46:09.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d00b1690 0x7fe0d014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d014ec40 0x7fe0d0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0153310 0x7fe0d0157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d00b1230 con 0x7fe0d0153310 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d00b10b0 con 0x7fe0d00b1690 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0d5800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe0d016bee0 con 0x7fe0d014ec40 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0cf400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0153310 0x7fe0d0157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0cf400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0153310 0x7fe0d0157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58972/0 (socket says 172.21.15.47:58972) 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0cf400640 1 -- 172.21.15.47:0/448262382 learned_addr learned my addr 172.21.15.47:0/448262382 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0c6000640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d014ec40 0x7fe0d0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.313+0000 7fe0cea00640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d00b1690 0x7fe0d014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0cf400640 1 -- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d014ec40 msgr2=0x7fe0d0152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0cf400640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d014ec40 0x7fe0d0152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0cf400640 1 -- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d00b1690 msgr2=0x7fe0d014d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0cf400640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d00b1690 0x7fe0d014d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0cf400640 1 -- 172.21.15.47:0/448262382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d0150460 con 0x7fe0d0153310 2024-04-26T23:46:09.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0cf400640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0153310 0x7fe0d0157500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c3e0 tx=0x7fe0c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:09.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0c7400640 1 -- 172.21.15.47:0/448262382 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80074e0 con 0x7fe0d0153310 2024-04-26T23:46:09.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0c7400640 1 -- 172.21.15.47:0/448262382 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c8007680 con 0x7fe0d0153310 2024-04-26T23:46:09.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0c7400640 1 -- 172.21.15.47:0/448262382 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80049f0 con 0x7fe0d0153310 2024-04-26T23:46:09.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d0150740 con 0x7fe0d0153310 2024-04-26T23:46:09.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d0150d00 con 0x7fe0d0153310 2024-04-26T23:46:09.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d0150f00 con 0x7fe0d0153310 2024-04-26T23:46:09.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.317+0000 7fe0c7400640 1 -- 172.21.15.47:0/448262382 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe0c801a020 con 0x7fe0d0153310 2024-04-26T23:46:09.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.321+0000 7fe0c7400640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe0ac068380 0x7fe0ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.321+0000 7fe0c7400640 1 -- 172.21.15.47:0/448262382 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe0c80861a0 con 0x7fe0d0153310 2024-04-26T23:46:09.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.321+0000 7fe0cea00640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe0ac068380 0x7fe0ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.321+0000 7fe0cea00640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe0ac068380 0x7fe0ac06a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ae000 tx=0x7fe0c00a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:09.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.325+0000 7fe0c7400640 1 -- 172.21.15.47:0/448262382 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe0d0150f00 con 0x7fe0d0153310 2024-04-26T23:46:09.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.489+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0d0153880 con 0x7fe0d0153310 2024-04-26T23:46:09.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.489+0000 7fe0c7400640 1 -- 172.21.15.47:0/448262382 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fe0c8056760 con 0x7fe0d0153310 2024-04-26T23:46:09.497 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:09.498 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe0ac068380 msgr2=0x7fe0ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe0ac068380 0x7fe0ac06a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ae000 tx=0x7fe0c00a7070 comp rx=0 tx=0).stop 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0153310 msgr2=0x7fe0d0157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0153310 0x7fe0d0157500 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe0c800c3e0 tx=0x7fe0c800c8a0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 shutdown_connections 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe0ac068380 0x7fe0ac06a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe0d0153310 0x7fe0d0157500 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe0d014ec40 0x7fe0d0152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 --2- 172.21.15.47:0/448262382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d00b1690 0x7fe0d014d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 >> 172.21.15.47:0/448262382 conn(0x7fe0d00d1df0 msgr2=0x7fe0d00aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:09.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 shutdown_connections 2024-04-26T23:46:09.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.493+0000 7fe0d5800640 1 -- 172.21.15.47:0/448262382 wait complete. 2024-04-26T23:46:09.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:09.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36fba00640 1 Processor -- start 2024-04-26T23:46:09.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36fba00640 1 -- start start 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36fba00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f36f409c170 0x7f36f40d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36fba00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f36f40b56f0 0x7f36f40d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36fba00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f4071620 con 0x7f36f4162ab0 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36fba00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f36f4162e90 con 0x7f36f409c170 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36fba00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f36f40d2d40 con 0x7f36f40b56f0 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f36f409c170 0x7f36f40d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f9000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f36f4162ab0 0x7f36f409ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34460/0 (socket says 172.21.15.47:34460) 2024-04-26T23:46:09.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f9000640 1 -- 172.21.15.47:0/2418674412 learned_addr learned my addr 172.21.15.47:0/2418674412 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:09.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f9a00640 1 --2- 172.21.15.47:0/2418674412 >> v2:172.21.15.203:3300/0 conn(0x7f36f40b56f0 0x7f36f40d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f3e00640 1 -- 172.21.15.47:0/2418674412 >> v2:172.21.15.203:3300/0 conn(0x7f36f40b56f0 msgr2=0x7f36f40d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:09.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f3e00640 1 --2- 172.21.15.47:0/2418674412 >> v2:172.21.15.203:3300/0 conn(0x7f36f40b56f0 0x7f36f40d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f3e00640 1 -- 172.21.15.47:0/2418674412 >> v1:172.21.15.47:6789/0 conn(0x7f36f4162ab0 legacy=0x7f36f409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f3e00640 1 -- 172.21.15.47:0/2418674412 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f406dfc0 con 0x7f36f409c170 2024-04-26T23:46:09.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f3400640 1 -- 172.21.15.47:0/2418674412 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070427720 0 0) 0x7f36f4071620 con 0x7f36f4162ab0 2024-04-26T23:46:09.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.657+0000 7f36f9a00640 1 --2- 172.21.15.47:0/2418674412 >> v2:172.21.15.203:3300/0 conn(0x7f36f40b56f0 0x7f36f40d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:09.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36f3e00640 1 --2- 172.21.15.47:0/2418674412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f409c170 0x7f36f40d1310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36f40d0ff0 tx=0x7f36e001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103d7efea9c34360 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:09.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36f3400640 1 -- 172.21.15.47:0/2418674412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00b0070 con 0x7f36f409c170 2024-04-26T23:46:09.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36f3400640 1 -- 172.21.15.47:0/2418674412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e00ab600 con 0x7f36f409c170 2024-04-26T23:46:09.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36f3400640 1 -- 172.21.15.47:0/2418674412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00ab9d0 con 0x7f36f409c170 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 -- 172.21.15.47:0/2418674412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f409c170 msgr2=0x7f36f40d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 --2- 172.21.15.47:0/2418674412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f409c170 0x7f36f40d1310 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f36f40d0ff0 tx=0x7f36e001c3f0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 -- 172.21.15.47:0/2418674412 shutdown_connections 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 --2- 172.21.15.47:0/2418674412 >> v2:172.21.15.203:3300/0 conn(0x7f36f40b56f0 0x7f36f40d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 --2- 172.21.15.47:0/2418674412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f409c170 0x7f36f40d1310 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 -- 172.21.15.47:0/2418674412 >> 172.21.15.47:0/2418674412 conn(0x7f36f40b4c00 msgr2=0x7f36f40b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 -- 172.21.15.47:0/2418674412 shutdown_connections 2024-04-26T23:46:09.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 -- 172.21.15.47:0/2418674412 wait complete. 2024-04-26T23:46:09.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.661+0000 7f36fba00640 1 Processor -- start 2024-04-26T23:46:09.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 -- start start 2024-04-26T23:46:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36f409c170 0x7f36f415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f40b56f0 0x7f36f409cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36f4162ab0 0x7f36f40b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36f4072330 con 0x7f36f40b56f0 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36f40721b0 con 0x7f36f4162ab0 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36f4071be0 con 0x7f36f409c170 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f40b56f0 0x7f36f409cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f40b56f0 0x7f36f409cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59004/0 (socket says 172.21.15.47:59004) 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 -- 172.21.15.47:0/3834692896 learned_addr learned my addr 172.21.15.47:0/3834692896 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f9000640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36f409c170 0x7f36f415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f9a00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36f4162ab0 0x7f36f40b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 -- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36f409c170 msgr2=0x7f36f415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36f409c170 0x7f36f415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 -- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36f4162ab0 msgr2=0x7f36f40b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36f4162ab0 0x7f36f40b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 -- 172.21.15.47:0/3834692896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f40c6e50 con 0x7f36f40b56f0 2024-04-26T23:46:09.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f9a00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36f4162ab0 0x7f36f40b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f3e00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f40b56f0 0x7f36f409cf10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36e00ae040 tx=0x7f36e0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f0c00640 1 -- 172.21.15.47:0/3834692896 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00b8020 con 0x7f36f40b56f0 2024-04-26T23:46:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f0c00640 1 -- 172.21.15.47:0/3834692896 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e00b4630 con 0x7f36f40b56f0 2024-04-26T23:46:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36f0c00640 1 -- 172.21.15.47:0/3834692896 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00b0040 con 0x7f36f40b56f0 2024-04-26T23:46:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f40c7130 con 0x7f36f40b56f0 2024-04-26T23:46:09.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f40c76f0 con 0x7f36f40b56f0 2024-04-26T23:46:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.665+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f4069700 con 0x7f36f40b56f0 2024-04-26T23:46:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.669+0000 7f36f0c00640 1 -- 172.21.15.47:0/3834692896 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36e00bb020 con 0x7f36f40b56f0 2024-04-26T23:46:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.669+0000 7f36f0c00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f36d4068380 0x7f36d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:09.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.669+0000 7f36f0c00640 1 -- 172.21.15.47:0/3834692896 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f36e0120760 con 0x7f36f40b56f0 2024-04-26T23:46:09.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.669+0000 7f36f9000640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f36d4068380 0x7f36d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:09.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.669+0000 7f36f9000640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f36d4068380 0x7f36d406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36e8000f70 tx=0x7f36e8007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:09.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.673+0000 7f36f0c00640 1 -- 172.21.15.47:0/3834692896 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f36e00c2030 con 0x7f36f40b56f0 2024-04-26T23:46:09.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.837+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f36f40c78c0 con 0x7f36f40b56f0 2024-04-26T23:46:09.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.837+0000 7f36f0c00640 1 -- 172.21.15.47:0/3834692896 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f36e0016070 con 0x7f36f40b56f0 2024-04-26T23:46:09.845 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f36d4068380 msgr2=0x7f36d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f36d4068380 0x7f36d406a840 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f36e8000f70 tx=0x7f36e8007c10 comp rx=0 tx=0).stop 2024-04-26T23:46:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f40b56f0 msgr2=0x7f36f409cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f40b56f0 0x7f36f409cf10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f36e00ae040 tx=0x7f36e0019190 comp rx=0 tx=0).stop 2024-04-26T23:46:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 shutdown_connections 2024-04-26T23:46:09.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f36d4068380 0x7f36d406a840 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f36f4162ab0 0x7f36f40b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f36f40b56f0 0x7f36f409cf10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 --2- 172.21.15.47:0/3834692896 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36f409c170 0x7f36f415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 >> 172.21.15.47:0/3834692896 conn(0x7f36f40b4c00 msgr2=0x7f36f40b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 shutdown_connections 2024-04-26T23:46:09.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:09.841+0000 7f36fba00640 1 -- 172.21.15.47:0/3834692896 wait complete. 2024-04-26T23:46:09.866 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:10.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.001+0000 7f7195c00640 1 Processor -- start 2024-04-26T23:46:10.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.001+0000 7f7195c00640 1 -- start start 2024-04-26T23:46:10.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f7195c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71900d0390 0x7f71900af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f7195c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f71901603e0 0x7f719006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f7195c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71900ae6a0 con 0x7f719006c630 2024-04-26T23:46:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f7195c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f71900ae920 con 0x7f71900d0390 2024-04-26T23:46:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f7195c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f71900aec00 con 0x7f71901603e0 2024-04-26T23:46:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f71900d0390 0x7f71900af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718e000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f719006c630 0x7f719015fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34468/0 (socket says 172.21.15.47:34468) 2024-04-26T23:46:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718e000640 1 -- 172.21.15.47:0/2596769230 learned_addr learned my addr 172.21.15.47:0/2596769230 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:10.012 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718f400640 1 --2- 172.21.15.47:0/2596769230 >> v2:172.21.15.203:3300/0 conn(0x7f71901603e0 0x7f719006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718ea00640 1 -- 172.21.15.47:0/2596769230 >> v2:172.21.15.203:3300/0 conn(0x7f71901603e0 msgr2=0x7f719006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718ea00640 1 --2- 172.21.15.47:0/2596769230 >> v2:172.21.15.203:3300/0 conn(0x7f71901603e0 0x7f719006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718ea00640 1 -- 172.21.15.47:0/2596769230 >> v1:172.21.15.47:6789/0 conn(0x7f719006c630 legacy=0x7f719015fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718ea00640 1 -- 172.21.15.47:0/2596769230 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71900aeee0 con 0x7f71900d0390 2024-04-26T23:46:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718f400640 1 --2- 172.21.15.47:0/2596769230 >> v2:172.21.15.203:3300/0 conn(0x7f71901603e0 0x7f719006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:10.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.005+0000 7f718d600640 1 -- 172.21.15.47:0/2596769230 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149334741 0 0) 0x7f717c001120 con 0x7f719006c630 2024-04-26T23:46:10.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f718ea00640 1 --2- 172.21.15.47:0/2596769230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71900d0390 0x7f71900af6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7190159f90 tx=0x7f718001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896ce489f26f0666 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f718d600640 1 -- 172.21.15.47:0/2596769230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71800b0070 con 0x7f71900d0390 2024-04-26T23:46:10.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f718d600640 1 -- 172.21.15.47:0/2596769230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71800ab600 con 0x7f71900d0390 2024-04-26T23:46:10.015 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f718d600640 1 -- 172.21.15.47:0/2596769230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71800ab9d0 con 0x7f71900d0390 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 -- 172.21.15.47:0/2596769230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71900d0390 msgr2=0x7f71900af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 --2- 172.21.15.47:0/2596769230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71900d0390 0x7f71900af6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7190159f90 tx=0x7f718001c3f0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 -- 172.21.15.47:0/2596769230 shutdown_connections 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 --2- 172.21.15.47:0/2596769230 >> v2:172.21.15.203:3300/0 conn(0x7f71901603e0 0x7f719006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 --2- 172.21.15.47:0/2596769230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f71900d0390 0x7f71900af6e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 -- 172.21.15.47:0/2596769230 >> 172.21.15.47:0/2596769230 conn(0x7f71900b2b70 msgr2=0x7f71900b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 -- 172.21.15.47:0/2596769230 shutdown_connections 2024-04-26T23:46:10.016 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 -- 172.21.15.47:0/2596769230 wait complete. 2024-04-26T23:46:10.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 Processor -- start 2024-04-26T23:46:10.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.009+0000 7f7195c00640 1 -- start start 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f719006c630 0x7f71900b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71900d0390 0x7f7190159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71901603e0 0x7f719015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f719006faf0 con 0x7f719006c630 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f719006f970 con 0x7f71900d0390 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f719006fc70 con 0x7f71901603e0 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f719006c630 0x7f71900b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f719006c630 0x7f71900b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59016/0 (socket says 172.21.15.47:59016) 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 -- 172.21.15.47:0/2553546392 learned_addr learned my addr 172.21.15.47:0/2553546392 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718f400640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71901603e0 0x7f719015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718e000640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71900d0390 0x7f7190159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 -- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71901603e0 msgr2=0x7f719015b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71901603e0 0x7f719015b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 -- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71900d0390 msgr2=0x7f7190159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71900d0390 0x7f7190159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 -- 172.21.15.47:0/2553546392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719015bd40 con 0x7f719006c630 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718f400640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71901603e0 0x7f719015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718e000640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71900d0390 0x7f7190159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f718ea00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f719006c630 0x7f71900b1d20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f71800ae040 tx=0x7f718001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7186a00640 1 -- 172.21.15.47:0/2553546392 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71800b0050 con 0x7f719006c630 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7186a00640 1 -- 172.21.15.47:0/2553546392 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71800bc070 con 0x7f719006c630 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7186a00640 1 -- 172.21.15.47:0/2553546392 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71800b5a70 con 0x7f719006c630 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719015a760 con 0x7f719006c630 2024-04-26T23:46:10.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719015ad20 con 0x7f719006c630 2024-04-26T23:46:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7190069700 con 0x7f719006c630 2024-04-26T23:46:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.013+0000 7f7186a00640 1 -- 172.21.15.47:0/2553546392 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f71800ab480 con 0x7f719006c630 2024-04-26T23:46:10.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.017+0000 7f7186a00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7170068380 0x7f717006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.017+0000 7f7186a00640 1 -- 172.21.15.47:0/2553546392 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f71801212a0 con 0x7f719006c630 2024-04-26T23:46:10.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.017+0000 7f718e000640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7170068380 0x7f717006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.017+0000 7f718e000640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7170068380 0x7f717006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f717c000f70 tx=0x7f717c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.021+0000 7f7186a00640 1 -- 172.21.15.47:0/2553546392 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7180016070 con 0x7f719006c630 2024-04-26T23:46:10.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f719006ecb0 con 0x7f719006c630 2024-04-26T23:46:10.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7186a00640 1 -- 172.21.15.47:0/2553546392 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f71800f1850 con 0x7f719006c630 2024-04-26T23:46:10.192 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7170068380 msgr2=0x7f717006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7170068380 0x7f717006a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f717c000f70 tx=0x7f717c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f719006c630 msgr2=0x7f71900b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f719006c630 0x7f71900b1d20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f71800ae040 tx=0x7f718001ac30 comp rx=0 tx=0).stop 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 shutdown_connections 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7170068380 0x7f717006a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71901603e0 0x7f719015b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71900d0390 0x7f7190159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 --2- 172.21.15.47:0/2553546392 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f719006c630 0x7f71900b1d20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 >> 172.21.15.47:0/2553546392 conn(0x7f71900b2b70 msgr2=0x7f71900b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 shutdown_connections 2024-04-26T23:46:10.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.185+0000 7f7195c00640 1 -- 172.21.15.47:0/2553546392 wait complete. 2024-04-26T23:46:10.214 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.349+0000 7f4b50c00640 1 Processor -- start 2024-04-26T23:46:10.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.349+0000 7f4b50c00640 1 -- start start 2024-04-26T23:46:10.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.349+0000 7f4b50c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c15cf50 0x7f4b4c0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.349+0000 7f4b50c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4b4c06cd40 0x7f4b4c160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.349+0000 7f4b50c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b4c0ae030 con 0x7f4b4c0d04b0 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.349+0000 7f4b50c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4b4c0af7a0 con 0x7f4b4c06cd40 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.349+0000 7f4b50c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4c0d0ae0 con 0x7f4b4c15cf50 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b4a800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4b4c06cd40 0x7f4b4c160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b41400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4b4c0d04b0 0x7f4b4c06c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34484/0 (socket says 172.21.15.47:34484) 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b41400640 1 -- 172.21.15.47:0/400187418 learned_addr learned my addr 172.21.15.47:0/400187418 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b4a800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4b4c06cd40 0x7f4b4c160b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59020/0 (socket says 172.21.15.47:59020) 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b49e00640 1 --2- 172.21.15.47:0/400187418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c15cf50 0x7f4b4c0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b4a800640 1 -- 172.21.15.47:0/400187418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c15cf50 msgr2=0x7f4b4c0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b4a800640 1 --2- 172.21.15.47:0/400187418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c15cf50 0x7f4b4c0cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b4a800640 1 -- 172.21.15.47:0/400187418 >> v1:172.21.15.47:6789/0 conn(0x7f4b4c0d04b0 legacy=0x7f4b4c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b49400640 1 -- 172.21.15.47:0/400187418 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768921960 0 0) 0x7f4b4c0ae030 con 0x7f4b4c0d04b0 2024-04-26T23:46:10.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b4a800640 1 -- 172.21.15.47:0/400187418 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c0af9d0 con 0x7f4b4c06cd40 2024-04-26T23:46:10.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b4a800640 1 --2- 172.21.15.47:0/400187418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c160b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4b440097c0 tx=0x7f4b4401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e57d47a5759874 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b49400640 1 -- 172.21.15.47:0/400187418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b440b2070 con 0x7f4b4c06cd40 2024-04-26T23:46:10.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b49400640 1 -- 172.21.15.47:0/400187418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b440ad640 con 0x7f4b4c06cd40 2024-04-26T23:46:10.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.353+0000 7f4b49400640 1 -- 172.21.15.47:0/400187418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b440ada10 con 0x7f4b4c06cd40 2024-04-26T23:46:10.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- 172.21.15.47:0/400187418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 msgr2=0x7f4b4c160b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 --2- 172.21.15.47:0/400187418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c160b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4b440097c0 tx=0x7f4b4401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- 172.21.15.47:0/400187418 shutdown_connections 2024-04-26T23:46:10.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 --2- 172.21.15.47:0/400187418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c160b50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 --2- 172.21.15.47:0/400187418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c15cf50 0x7f4b4c0cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- 172.21.15.47:0/400187418 >> 172.21.15.47:0/400187418 conn(0x7f4b4c0b2b70 msgr2=0x7f4b4c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:10.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- 172.21.15.47:0/400187418 shutdown_connections 2024-04-26T23:46:10.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- 172.21.15.47:0/400187418 wait complete. 2024-04-26T23:46:10.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 Processor -- start 2024-04-26T23:46:10.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- start start 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c09cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c0d04b0 0x7f4b4c14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b4c15cf50 0x7f4b4c156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c0b3c40 con 0x7f4b4c06cd40 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c15d330 con 0x7f4b4c15cf50 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b50c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4c0b3dc0 con 0x7f4b4c0d04b0 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c09cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c09cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59024/0 (socket says 172.21.15.47:59024) 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 -- 172.21.15.47:0/773599241 learned_addr learned my addr 172.21.15.47:0/773599241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b4a800640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b4c15cf50 0x7f4b4c156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b41400640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c0d04b0 0x7f4b4c14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 -- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c0d04b0 msgr2=0x7f4b4c14f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c0d04b0 0x7f4b4c14f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 -- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b4c15cf50 msgr2=0x7f4b4c156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b4c15cf50 0x7f4b4c156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b49e00640 1 -- 172.21.15.47:0/773599241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c157510 con 0x7f4b4c06cd40 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b4a800640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b4c15cf50 0x7f4b4c156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.357+0000 7f4b41400640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c0d04b0 0x7f4b4c14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b49e00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c09cff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00efc0 tx=0x7f4b3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b42a00640 1 -- 172.21.15.47:0/773599241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c018020 con 0x7f4b4c06cd40 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b42a00640 1 -- 172.21.15.47:0/773599241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c014480 con 0x7f4b4c06cd40 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b42a00640 1 -- 172.21.15.47:0/773599241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c014850 con 0x7f4b4c06cd40 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4c1577b0 con 0x7f4b4c06cd40 2024-04-26T23:46:10.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4c157d70 con 0x7f4b4c06cd40 2024-04-26T23:46:10.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b4c069700 con 0x7f4b4c06cd40 2024-04-26T23:46:10.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b42a00640 1 -- 172.21.15.47:0/773599241 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b3c01b020 con 0x7f4b4c06cd40 2024-04-26T23:46:10.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b42a00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b28068380 0x7f4b2806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b42a00640 1 -- 172.21.15.47:0/773599241 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4b3c0874d0 con 0x7f4b4c06cd40 2024-04-26T23:46:10.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.361+0000 7f4b41400640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b28068380 0x7f4b2806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.365+0000 7f4b41400640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b28068380 0x7f4b2806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c09ea60 tx=0x7f4b34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.365+0000 7f4b42a00640 1 -- 172.21.15.47:0/773599241 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4b3c022070 con 0x7f4b4c06cd40 2024-04-26T23:46:10.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.529+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4b4c073d50 con 0x7f4b4c06cd40 2024-04-26T23:46:10.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.529+0000 7f4b42a00640 1 -- 172.21.15.47:0/773599241 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f4b3c010040 con 0x7f4b4c06cd40 2024-04-26T23:46:10.536 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:10.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b28068380 msgr2=0x7f4b2806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b28068380 0x7f4b2806a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c09ea60 tx=0x7f4b34009040 comp rx=0 tx=0).stop 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 msgr2=0x7f4b4c09cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c09cff0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00efc0 tx=0x7f4b3c00c490 comp rx=0 tx=0).stop 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 shutdown_connections 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b28068380 0x7f4b2806a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b4c15cf50 0x7f4b4c156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b4c0d04b0 0x7f4b4c14f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 --2- 172.21.15.47:0/773599241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b4c06cd40 0x7f4b4c09cff0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 >> 172.21.15.47:0/773599241 conn(0x7f4b4c0b2b70 msgr2=0x7f4b4c0d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 shutdown_connections 2024-04-26T23:46:10.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.533+0000 7f4b50c00640 1 -- 172.21.15.47:0/773599241 wait complete. 2024-04-26T23:46:10.558 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daaa00640 1 Processor -- start 2024-04-26T23:46:10.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daaa00640 1 -- start start 2024-04-26T23:46:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7da40d08e0 0x7f7da40b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daaa00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7da40cd740 0x7f7da40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daaa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7da40cf8c0 con 0x7f7da40d1140 2024-04-26T23:46:10.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daaa00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7da40b2300 con 0x7f7da40cd740 2024-04-26T23:46:10.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daaa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7da40d0e30 con 0x7f7da40d08e0 2024-04-26T23:46:10.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da9600640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7da40d1140 0x7f7da40d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34498/0 (socket says 172.21.15.47:34498) 2024-04-26T23:46:10.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da9600640 1 -- 172.21.15.47:0/3722987350 learned_addr learned my addr 172.21.15.47:0/3722987350 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:10.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da8c00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7da40d08e0 0x7f7da40b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daa000640 1 --2- 172.21.15.47:0/3722987350 >> v2:172.21.15.203:3300/0 conn(0x7f7da40cd740 0x7f7da40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156899654 0 0) 0x7f7da40cf8c0 con 0x7f7da40d1140 2024-04-26T23:46:10.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d8c003530 con 0x7f7da40d1140 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 905365710 0 0) 0x7f7d8c003530 con 0x7f7da40d1140 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7da40d08e0 msgr2=0x7f7da40b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7da40d08e0 0x7f7da40b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 >> v2:172.21.15.203:3300/0 conn(0x7f7da40cd740 msgr2=0x7f7da40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 --2- 172.21.15.47:0/3722987350 >> v2:172.21.15.203:3300/0 conn(0x7f7da40cd740 0x7f7da40cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da40cfba0 con 0x7f7da40d1140 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f7d98001680 con 0x7f7da40d1140 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 >> v1:172.21.15.47:6789/0 conn(0x7f7da40d1140 legacy=0x7f7da40d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0039f0 0x7f7d8c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d8c0043e0 0x7f7d8c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d8c004f20 0x7f7d8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40b2300 con 0x7f7d8c0043e0 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40d0e30 con 0x7f7d8c004f20 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7d8c00bf10 con 0x7f7d8c0039f0 2024-04-26T23:46:10.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da8c00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d8c0043e0 0x7f7d8c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7da9600640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0039f0 0x7f7d8c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.693+0000 7f7daa000640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d8c004f20 0x7f7d8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da8c00640 1 -- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0039f0 msgr2=0x7f7d8c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da8c00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0039f0 0x7f7d8c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da8c00640 1 -- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d8c004f20 msgr2=0x7f7d8c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da8c00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d8c004f20 0x7f7d8c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da8c00640 1 -- 172.21.15.47:0/3722987350 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8c003530 con 0x7f7d8c0043e0 2024-04-26T23:46:10.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da8c00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d8c0043e0 0x7f7d8c0048b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7da406cda0 tx=0x7f7d9001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b733e76a046eebc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d900b2070 con 0x7f7d8c0043e0 2024-04-26T23:46:10.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d900a5540 con 0x7f7d8c0043e0 2024-04-26T23:46:10.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7da3e00640 1 -- 172.21.15.47:0/3722987350 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d90009670 con 0x7f7d8c0043e0 2024-04-26T23:46:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7daaa00640 1 -- 172.21.15.47:0/3722987350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d8c0043e0 msgr2=0x7f7d8c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7daaa00640 1 --2- 172.21.15.47:0/3722987350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7d8c0043e0 0x7f7d8c0048b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7da406cda0 tx=0x7f7d9001c8f0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7daa000640 1 -- 172.21.15.47:0/3722987350 reap_dead start 2024-04-26T23:46:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7daaa00640 1 -- 172.21.15.47:0/3722987350 shutdown_connections 2024-04-26T23:46:10.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7daaa00640 1 -- 172.21.15.47:0/3722987350 >> 172.21.15.47:0/3722987350 conn(0x7f7da409ba60 msgr2=0x7f7da409be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7daaa00640 1 -- 172.21.15.47:0/3722987350 shutdown_connections 2024-04-26T23:46:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.697+0000 7f7daaa00640 1 -- 172.21.15.47:0/3722987350 wait complete. 2024-04-26T23:46:10.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 Processor -- start 2024-04-26T23:46:10.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 -- start start 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0043e0 0x7f7da40c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7da4158010 0x7f7da4157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7da415c9e0 0x7f7da41ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7da4160690 con 0x7f7da4158010 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40d0160 con 0x7f7da415c9e0 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7da4160810 con 0x7f7d8c0043e0 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7da4158010 0x7f7da4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7da4158010 0x7f7da4157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59032/0 (socket says 172.21.15.47:59032) 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 -- 172.21.15.47:0/123521275 learned_addr learned my addr 172.21.15.47:0/123521275 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da9600640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0043e0 0x7f7da40c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daa000640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7da415c9e0 0x7f7da41ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 -- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0043e0 msgr2=0x7f7da40c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0043e0 0x7f7da40c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 -- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7da415c9e0 msgr2=0x7f7da41ea180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7da415c9e0 0x7f7da41ea180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 -- 172.21.15.47:0/123521275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da40c8f10 con 0x7f7da4158010 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da8c00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7da4158010 0x7f7da4157910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d900b0040 tx=0x7f7d8c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da1600640 1 -- 172.21.15.47:0/123521275 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d900b2040 con 0x7f7da4158010 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da1600640 1 -- 172.21.15.47:0/123521275 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d900bd070 con 0x7f7da4158010 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da40c91f0 con 0x7f7da4158010 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.701+0000 7f7da1600640 1 -- 172.21.15.47:0/123521275 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d900a5910 con 0x7f7da4158010 2024-04-26T23:46:10.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.705+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da415ce60 con 0x7f7da4158010 2024-04-26T23:46:10.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.705+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da4069470 con 0x7f7da4158010 2024-04-26T23:46:10.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.705+0000 7f7da1600640 1 -- 172.21.15.47:0/123521275 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d900a5ab0 con 0x7f7da4158010 2024-04-26T23:46:10.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.705+0000 7f7da1600640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d840683b0 0x7f7d8406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:10.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.705+0000 7f7da1600640 1 -- 172.21.15.47:0/123521275 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7d90120720 con 0x7f7da4158010 2024-04-26T23:46:10.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.705+0000 7f7da9600640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d840683b0 0x7f7d8406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:10.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.705+0000 7f7da9600640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d840683b0 0x7f7d8406a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d98001060 tx=0x7f7d98009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:10.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.709+0000 7f7da1600640 1 -- 172.21.15.47:0/123521275 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7d900c6020 con 0x7f7da4158010 2024-04-26T23:46:10.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7da409c760 con 0x7f7da4158010 2024-04-26T23:46:10.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7da1600640 1 -- 172.21.15.47:0/123521275 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f7d90016660 con 0x7f7da4158010 2024-04-26T23:46:10.896 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:10.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d840683b0 msgr2=0x7f7d8406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d840683b0 0x7f7d8406a870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7d98001060 tx=0x7f7d98009040 comp rx=0 tx=0).stop 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7da4158010 msgr2=0x7f7da4157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7da4158010 0x7f7da4157910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7d900b0040 tx=0x7f7d8c005840 comp rx=0 tx=0).stop 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 shutdown_connections 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7d840683b0 0x7f7d8406a870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7da415c9e0 0x7f7da41ea180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7da4158010 0x7f7da4157910 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 --2- 172.21.15.47:0/123521275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7d8c0043e0 0x7f7da40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 >> 172.21.15.47:0/123521275 conn(0x7f7da409ba60 msgr2=0x7f7da40b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 shutdown_connections 2024-04-26T23:46:10.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:10.889+0000 7f7daaa00640 1 -- 172.21.15.47:0/123521275 wait complete. 2024-04-26T23:46:10.918 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:46:10.918 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:10.928 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:11.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76fc00640 1 Processor -- start 2024-04-26T23:46:11.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76fc00640 1 -- start start 2024-04-26T23:46:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76fc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc7680d1860 0x7fc768167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76fc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7680cd830 con 0x7fc768160810 2024-04-26T23:46:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76fc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc768071080 con 0x7fc768072150 2024-04-26T23:46:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76fc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc768071360 con 0x7fc7680d1860 2024-04-26T23:46:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76d200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc768160810 0x7fc768071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34504/0 (socket says 172.21.15.47:34504) 2024-04-26T23:46:11.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76d200640 1 -- 172.21.15.47:0/2638242127 learned_addr learned my addr 172.21.15.47:0/2638242127 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76dc00640 1 --2- 172.21.15.47:0/2638242127 >> v2:172.21.15.203:3300/0 conn(0x7fc7680d1860 0x7fc768167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832013991 0 0) 0x7fc7680cd830 con 0x7fc768160810 2024-04-26T23:46:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc750003530 con 0x7fc768160810 2024-04-26T23:46:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2000462719 0 0) 0x7fc750003530 con 0x7fc768160810 2024-04-26T23:46:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 >> v2:172.21.15.203:3300/0 conn(0x7fc7680d1860 msgr2=0x7fc768167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 --2- 172.21.15.47:0/2638242127 >> v2:172.21.15.203:3300/0 conn(0x7fc7680d1860 0x7fc768167fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 >> v1:172.21.15.203:6789/0 conn(0x7fc768072150 legacy=0x7fc7680d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7680cdad0 con 0x7fc768160810 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fc75c001680 con 0x7fc768160810 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76dc00640 1 --2- 172.21.15.47:0/2638242127 >> v2:172.21.15.203:3300/0 conn(0x7fc7680d1860 0x7fc768167fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 >> v1:172.21.15.47:6789/0 conn(0x7fc768160810 legacy=0x7fc768071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7500039c0 0x7fc750003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc750004810 0x7fc750004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7500051d0 0x7fc75000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc768071360 con 0x7fc7500039c0 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc75000c100 con 0x7fc750004810 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc75000c300 con 0x7fc7500051d0 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.061+0000 7fc76d200640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7500039c0 0x7fc750003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc767e00640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc750004810 0x7fc750004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76dc00640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7500051d0 0x7fc75000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76d200640 1 -- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7500051d0 msgr2=0x7fc75000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:11.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76d200640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc7500051d0 0x7fc75000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76d200640 1 -- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc750004810 msgr2=0x7fc750004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:11.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76d200640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc750004810 0x7fc750004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76d200640 1 -- 172.21.15.47:0/2638242127 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc750003530 con 0x7fc7500039c0 2024-04-26T23:46:11.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc767e00640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc750004810 0x7fc750004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:11.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76dc00640 1 -- 172.21.15.47:0/2638242127 reap_dead start 2024-04-26T23:46:11.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76d200640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7500039c0 0x7fc750003de0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c210 tx=0x7fc75c01f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc0f5b4d7840c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c007d40 con 0x7fc7500039c0 2024-04-26T23:46:11.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc75c005b00 con 0x7fc7500039c0 2024-04-26T23:46:11.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc767400640 1 -- 172.21.15.47:0/2638242127 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c007070 con 0x7fc7500039c0 2024-04-26T23:46:11.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76fc00640 1 -- 172.21.15.47:0/2638242127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7500039c0 msgr2=0x7fc750003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7500039c0 0x7fc750003de0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00c210 tx=0x7fc75c01f370 comp rx=0 tx=0).stop 2024-04-26T23:46:11.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76fc00640 1 -- 172.21.15.47:0/2638242127 shutdown_connections 2024-04-26T23:46:11.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2638242127 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7500039c0 0x7fc750003de0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.065+0000 7fc76fc00640 1 -- 172.21.15.47:0/2638242127 >> 172.21.15.47:0/2638242127 conn(0x7fc7680d2e90 msgr2=0x7fc7680d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:11.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 -- 172.21.15.47:0/2638242127 shutdown_connections 2024-04-26T23:46:11.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 -- 172.21.15.47:0/2638242127 wait complete. 2024-04-26T23:46:11.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 Processor -- start 2024-04-26T23:46:11.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 -- start start 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7500039c0 0x7fc76815c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7681534b0 0x7fc76815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc76806e8b0 0x7fc76806ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc768160d70 con 0x7fc7681534b0 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc768160bf0 con 0x7fc7500039c0 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc7680d1150 con 0x7fc76806e8b0 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7681534b0 0x7fc76815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7681534b0 0x7fc76815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59056/0 (socket says 172.21.15.47:59056) 2024-04-26T23:46:11.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 -- 172.21.15.47:0/2498527815 learned_addr learned my addr 172.21.15.47:0/2498527815 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:11.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 -- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc76806e8b0 msgr2=0x7fc76806ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc76806e8b0 0x7fc76806ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 -- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7500039c0 msgr2=0x7fc76815c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7500039c0 0x7fc76815c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 -- 172.21.15.47:0/2498527815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc76815a770 con 0x7fc7681534b0 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc767e00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7681534b0 0x7fc76815c580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc75400e5b0 tx=0x7fc75400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc764c00640 1 -- 172.21.15.47:0/2498527815 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7540052e0 con 0x7fc7681534b0 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc764c00640 1 -- 172.21.15.47:0/2498527815 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc754018070 con 0x7fc7681534b0 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc764c00640 1 -- 172.21.15.47:0/2498527815 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc754005480 con 0x7fc7681534b0 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.069+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc76815aa10 con 0x7fc7681534b0 2024-04-26T23:46:11.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.073+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc76815afd0 con 0x7fc7681534b0 2024-04-26T23:46:11.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.073+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc768069700 con 0x7fc7681534b0 2024-04-26T23:46:11.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.073+0000 7fc764c00640 1 -- 172.21.15.47:0/2498527815 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc754003840 con 0x7fc7681534b0 2024-04-26T23:46:11.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.073+0000 7fc764c00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc748068380 0x7fc74806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.073+0000 7fc764c00640 1 -- 172.21.15.47:0/2498527815 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc754086670 con 0x7fc7681534b0 2024-04-26T23:46:11.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.073+0000 7fc76d200640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc748068380 0x7fc74806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.073+0000 7fc76d200640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc748068380 0x7fc74806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0af000 tx=0x7fc75c001a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.077+0000 7fc764c00640 1 -- 172.21.15.47:0/2498527815 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc754056c20 con 0x7fc7681534b0 2024-04-26T23:46:11.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.245+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7680b13a0 con 0x7fc7681534b0 2024-04-26T23:46:11.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc764c00640 1 -- 172.21.15.47:0/2498527815 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16593 (secure 0 0 0) 0x7fc754056520 con 0x7fc7681534b0 2024-04-26T23:46:11.254 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:11.255 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":23,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:45:33.677057+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc748068380 msgr2=0x7fc74806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc748068380 0x7fc74806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0af000 tx=0x7fc75c001a50 comp rx=0 tx=0).stop 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7681534b0 msgr2=0x7fc76815c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7681534b0 0x7fc76815c580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc75400e5b0 tx=0x7fc75400ea70 comp rx=0 tx=0).stop 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 shutdown_connections 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc748068380 0x7fc74806a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc76806e8b0 0x7fc76806ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc7681534b0 0x7fc76815c580 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 --2- 172.21.15.47:0/2498527815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7500039c0 0x7fc76815c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 >> 172.21.15.47:0/2498527815 conn(0x7fc7680d2e90 msgr2=0x7fc7680b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 shutdown_connections 2024-04-26T23:46:11.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.249+0000 7fc76fc00640 1 -- 172.21.15.47:0/2498527815 wait complete. 2024-04-26T23:46:11.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:11.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:11.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 Processor -- start 2024-04-26T23:46:11.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 -- start start 2024-04-26T23:46:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f21a80d0390 0x7f21a80af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f21a815fcd0 0x7f21a8160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f21a80ae6a0 con 0x7f21a815fcd0 2024-04-26T23:46:11.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f21a80ae920 con 0x7f21a80d0390 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21af400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f21a80aec00 con 0x7f21a806c630 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f21a815fcd0 0x7f21a8160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f21a815fcd0 0x7f21a8160160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59070/0 (socket says 172.21.15.47:59070) 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 -- 172.21.15.47:0/1930241948 learned_addr learned my addr 172.21.15.47:0/1930241948 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f219fe00640 1 --2- 172.21.15.47:0/1930241948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21aca00640 1 --2- 172.21.15.47:0/1930241948 >> v2:172.21.15.203:3300/0 conn(0x7f21a80d0390 0x7f21a80af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 -- 172.21.15.47:0/1930241948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 msgr2=0x7f21a806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 --2- 172.21.15.47:0/1930241948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 -- 172.21.15.47:0/1930241948 >> v2:172.21.15.203:3300/0 conn(0x7f21a80d0390 msgr2=0x7f21a80af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 --2- 172.21.15.47:0/1930241948 >> v2:172.21.15.203:3300/0 conn(0x7f21a80d0390 0x7f21a80af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.413+0000 7f21ad400640 1 -- 172.21.15.47:0/1930241948 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a80aeee0 con 0x7f21a815fcd0 2024-04-26T23:46:11.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21ad400640 1 --2- 172.21.15.47:0/1930241948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a815fcd0 0x7f21a8160160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f21a80742c0 tx=0x7f21a001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d58314bfcd0cff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21a7e00640 1 -- 172.21.15.47:0/1930241948 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a00a5660 con 0x7f21a815fcd0 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21a7e00640 1 -- 172.21.15.47:0/1930241948 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a00a5800 con 0x7f21a815fcd0 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21a7e00640 1 -- 172.21.15.47:0/1930241948 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a00a5bd0 con 0x7f21a815fcd0 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 -- 172.21.15.47:0/1930241948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a815fcd0 msgr2=0x7f21a8160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 --2- 172.21.15.47:0/1930241948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a815fcd0 0x7f21a8160160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f21a80742c0 tx=0x7f21a001c960 comp rx=0 tx=0).stop 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 -- 172.21.15.47:0/1930241948 shutdown_connections 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 --2- 172.21.15.47:0/1930241948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a815fcd0 0x7f21a8160160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 --2- 172.21.15.47:0/1930241948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 --2- 172.21.15.47:0/1930241948 >> v2:172.21.15.203:3300/0 conn(0x7f21a80d0390 0x7f21a80af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 -- 172.21.15.47:0/1930241948 >> 172.21.15.47:0/1930241948 conn(0x7f21a80b2b70 msgr2=0x7f21a80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 -- 172.21.15.47:0/1930241948 shutdown_connections 2024-04-26T23:46:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.417+0000 7f21af400640 1 -- 172.21.15.47:0/1930241948 wait complete. 2024-04-26T23:46:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 Processor -- start 2024-04-26T23:46:11.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 -- start start 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a814d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a80d0390 0x7f21a80b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21a815fcd0 0x7f21a815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21a806f860 con 0x7f21a80d0390 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21a806f6e0 con 0x7f21a815fcd0 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f21a806f9e0 con 0x7f21a806c630 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a80d0390 0x7f21a80b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a80d0390 0x7f21a80b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59078/0 (socket says 172.21.15.47:59078) 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 -- 172.21.15.47:0/1072188428 learned_addr learned my addr 172.21.15.47:0/1072188428 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21aca00640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a814d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21ad400640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21a815fcd0 0x7f21a815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 -- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 msgr2=0x7f21a814d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a814d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 -- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21a815fcd0 msgr2=0x7f21a815b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21a815fcd0 0x7f21a815b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 -- 172.21.15.47:0/1072188428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a80b0a90 con 0x7f21a80d0390 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f219fe00640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a80d0390 0x7f21a80b1b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f219000e8e0 tx=0x7f219000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21a5600640 1 -- 172.21.15.47:0/1072188428 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2190017070 con 0x7f21a80d0390 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21a5600640 1 -- 172.21.15.47:0/1072188428 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219000ca00 con 0x7f21a80d0390 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21a5600640 1 -- 172.21.15.47:0/1072188428 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219000cdd0 con 0x7f21a80d0390 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a80b0d70 con 0x7f21a80d0390 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a80b1330 con 0x7f21a80d0390 2024-04-26T23:46:11.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.421+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a8069700 con 0x7f21a80d0390 2024-04-26T23:46:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.425+0000 7f21a5600640 1 -- 172.21.15.47:0/1072188428 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f219001a070 con 0x7f21a80d0390 2024-04-26T23:46:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.425+0000 7f21a5600640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21840683b0 0x7f218406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.425+0000 7f21a5600640 1 -- 172.21.15.47:0/1072188428 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2190086dc0 con 0x7f21a80d0390 2024-04-26T23:46:11.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.425+0000 7f21aca00640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21840683b0 0x7f218406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.425+0000 7f21aca00640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21840683b0 0x7f218406a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21a81fb1f0 tx=0x7f2198008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.429+0000 7f21a5600640 1 -- 172.21.15.47:0/1072188428 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f21900572e0 con 0x7f21a80d0390 2024-04-26T23:46:11.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.593+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f21a806e400 con 0x7f21a80d0390 2024-04-26T23:46:11.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.593+0000 7f21a5600640 1 -- 172.21.15.47:0/1072188428 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f2190056be0 con 0x7f21a80d0390 2024-04-26T23:46:11.600 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:11.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21840683b0 msgr2=0x7f218406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21840683b0 0x7f218406a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21a81fb1f0 tx=0x7f2198008040 comp rx=0 tx=0).stop 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a80d0390 msgr2=0x7f21a80b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a80d0390 0x7f21a80b1b30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f219000e8e0 tx=0x7f219000eda0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 shutdown_connections 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21840683b0 0x7f218406a870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21a815fcd0 0x7f21a815b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21a80d0390 0x7f21a80b1b30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 --2- 172.21.15.47:0/1072188428 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21a806c630 0x7f21a814d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 >> 172.21.15.47:0/1072188428 conn(0x7f21a80b2b70 msgr2=0x7f21a815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:11.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 shutdown_connections 2024-04-26T23:46:11.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.597+0000 7f21af400640 1 -- 172.21.15.47:0/1072188428 wait complete. 2024-04-26T23:46:11.621 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:11.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb498c00640 1 Processor -- start 2024-04-26T23:46:11.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb498c00640 1 -- start start 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb498c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb49409c170 0x7fb4940d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb498c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940d1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb498c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb494071620 con 0x7fb494162ab0 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb498c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb494162e90 con 0x7fb49409c170 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb498c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb4940d2d40 con 0x7fb4940b56f0 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb491e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb494162ab0 0x7fb49409ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34506/0 (socket says 172.21.15.47:34506) 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb491e00640 1 -- 172.21.15.47:0/261941274 learned_addr learned my addr 172.21.15.47:0/261941274 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb48be00640 1 --2- 172.21.15.47:0/261941274 >> v2:172.21.15.47:3300/0 conn(0x7fb49409c170 0x7fb4940d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb492800640 1 --2- 172.21.15.47:0/261941274 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940d1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb491400640 1 -- 172.21.15.47:0/261941274 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165472234 0 0) 0x7fb494071620 con 0x7fb494162ab0 2024-04-26T23:46:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb491400640 1 -- 172.21.15.47:0/261941274 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb478003530 con 0x7fb494162ab0 2024-04-26T23:46:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb48be00640 1 -- 172.21.15.47:0/261941274 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 msgr2=0x7fb4940d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb48be00640 1 --2- 172.21.15.47:0/261941274 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940d1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb48be00640 1 -- 172.21.15.47:0/261941274 >> v1:172.21.15.47:6789/0 conn(0x7fb494162ab0 legacy=0x7fb49409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb48be00640 1 -- 172.21.15.47:0/261941274 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49406dfc0 con 0x7fb49409c170 2024-04-26T23:46:11.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.761+0000 7fb492800640 1 --2- 172.21.15.47:0/261941274 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:11.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb48be00640 1 --2- 172.21.15.47:0/261941274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb49409c170 0x7fb4940d1310 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0097c0 tx=0x7fb47c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad502c431fd5d355 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb491400640 1 -- 172.21.15.47:0/261941274 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0b0070 con 0x7fb49409c170 2024-04-26T23:46:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb491400640 1 -- 172.21.15.47:0/261941274 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb47c0ab600 con 0x7fb49409c170 2024-04-26T23:46:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb491400640 1 -- 172.21.15.47:0/261941274 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0ab9d0 con 0x7fb49409c170 2024-04-26T23:46:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 -- 172.21.15.47:0/261941274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb49409c170 msgr2=0x7fb4940d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 --2- 172.21.15.47:0/261941274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb49409c170 0x7fb4940d1310 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0097c0 tx=0x7fb47c01c410 comp rx=0 tx=0).stop 2024-04-26T23:46:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 -- 172.21.15.47:0/261941274 shutdown_connections 2024-04-26T23:46:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 --2- 172.21.15.47:0/261941274 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940d1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 --2- 172.21.15.47:0/261941274 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb49409c170 0x7fb4940d1310 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 -- 172.21.15.47:0/261941274 >> 172.21.15.47:0/261941274 conn(0x7fb4940b4c00 msgr2=0x7fb4940b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 -- 172.21.15.47:0/261941274 shutdown_connections 2024-04-26T23:46:11.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 -- 172.21.15.47:0/261941274 wait complete. 2024-04-26T23:46:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 Processor -- start 2024-04-26T23:46:11.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.765+0000 7fb498c00640 1 -- start start 2024-04-26T23:46:11.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb49409c170 0x7fb494158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb494162ab0 0x7fb4940b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb494072330 con 0x7fb494162ab0 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4940721b0 con 0x7fb49409c170 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb494071be0 con 0x7fb4940b56f0 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb494162ab0 0x7fb4940b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb494162ab0 0x7fb4940b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59108/0 (socket says 172.21.15.47:59108) 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 -- 172.21.15.47:0/4110451833 learned_addr learned my addr 172.21.15.47:0/4110451833 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb491e00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb49409c170 0x7fb494158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb48be00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 -- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 msgr2=0x7fb4940afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940afe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 -- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb49409c170 msgr2=0x7fb494158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb49409c170 0x7fb494158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 -- 172.21.15.47:0/4110451833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4940b0880 con 0x7fb494162ab0 2024-04-26T23:46:11.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb492800640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb494162ab0 0x7fb4940b0340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007df0 tx=0x7fb48c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb48a000640 1 -- 172.21.15.47:0/4110451833 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c01a070 con 0x7fb494162ab0 2024-04-26T23:46:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb48a000640 1 -- 172.21.15.47:0/4110451833 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c0039a0 con 0x7fb494162ab0 2024-04-26T23:46:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb494156fe0 con 0x7fb494162ab0 2024-04-26T23:46:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb48a000640 1 -- 172.21.15.47:0/4110451833 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c003d90 con 0x7fb494162ab0 2024-04-26T23:46:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4941575a0 con 0x7fb494162ab0 2024-04-26T23:46:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.769+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb494069700 con 0x7fb494162ab0 2024-04-26T23:46:11.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.773+0000 7fb48a000640 1 -- 172.21.15.47:0/4110451833 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb48c01d070 con 0x7fb494162ab0 2024-04-26T23:46:11.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.773+0000 7fb48a000640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb470068380 0x7fb47006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:11.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.773+0000 7fb48a000640 1 -- 172.21.15.47:0/4110451833 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb48c086c90 con 0x7fb494162ab0 2024-04-26T23:46:11.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.773+0000 7fb491e00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb470068380 0x7fb47006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:11.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.773+0000 7fb491e00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb470068380 0x7fb47006a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb484005890 tx=0x7fb484009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:11.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.777+0000 7fb48a000640 1 -- 172.21.15.47:0/4110451833 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb48c010070 con 0x7fb494162ab0 2024-04-26T23:46:11.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.941+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb494159340 con 0x7fb494162ab0 2024-04-26T23:46:11.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.941+0000 7fb48a000640 1 -- 172.21.15.47:0/4110451833 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb48c0571b0 con 0x7fb494162ab0 2024-04-26T23:46:11.949 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:11.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb470068380 msgr2=0x7fb47006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb470068380 0x7fb47006a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb484005890 tx=0x7fb484009040 comp rx=0 tx=0).stop 2024-04-26T23:46:11.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb494162ab0 msgr2=0x7fb4940b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb494162ab0 0x7fb4940b0340 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb48c007df0 tx=0x7fb48c00d4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 shutdown_connections 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb470068380 0x7fb47006a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb494162ab0 0x7fb4940b0340 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb4940b56f0 0x7fb4940afe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 --2- 172.21.15.47:0/4110451833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb49409c170 0x7fb494158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 >> 172.21.15.47:0/4110451833 conn(0x7fb4940b4c00 msgr2=0x7fb4940b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 shutdown_connections 2024-04-26T23:46:11.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:11.945+0000 7fb498c00640 1 -- 172.21.15.47:0/4110451833 wait complete. 2024-04-26T23:46:11.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:12.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c84000640 1 Processor -- start 2024-04-26T23:46:12.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c84000640 1 -- start start 2024-04-26T23:46:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c84000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6c7c06cb10 0x7f6c7c0b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c84000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c84000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c7c0af510 con 0x7f6c7c15cee0 2024-04-26T23:46:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c84000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7c160710 con 0x7f6c7c06cb10 2024-04-26T23:46:12.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c84000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c0af7f0 con 0x7f6c7c0aeda0 2024-04-26T23:46:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c81600640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6c7c15cee0 0x7f6c7c06c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34512/0 (socket says 172.21.15.47:34512) 2024-04-26T23:46:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c81600640 1 -- 172.21.15.47:0/3009583344 learned_addr learned my addr 172.21.15.47:0/3009583344 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c80c00640 1 --2- 172.21.15.47:0/3009583344 >> v2:172.21.15.47:3300/0 conn(0x7f6c7c06cb10 0x7f6c7c0b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c82000640 1 --2- 172.21.15.47:0/3009583344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c7be00640 1 -- 172.21.15.47:0/3009583344 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229615482 0 0) 0x7f6c7c0af510 con 0x7f6c7c15cee0 2024-04-26T23:46:12.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c7be00640 1 -- 172.21.15.47:0/3009583344 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c64003530 con 0x7f6c7c15cee0 2024-04-26T23:46:12.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c80c00640 1 -- 172.21.15.47:0/3009583344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 msgr2=0x7f6c7c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:12.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c80c00640 1 --2- 172.21.15.47:0/3009583344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c1601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c80c00640 1 -- 172.21.15.47:0/3009583344 >> v1:172.21.15.47:6789/0 conn(0x7f6c7c15cee0 legacy=0x7f6c7c06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c80c00640 1 -- 172.21.15.47:0/3009583344 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c15f9d0 con 0x7f6c7c06cb10 2024-04-26T23:46:12.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.109+0000 7f6c82000640 1 --2- 172.21.15.47:0/3009583344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c80c00640 1 --2- 172.21.15.47:0/3009583344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c0b1260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6c680097c0 tx=0x7f6c6801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaedda6a9f885ece server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c7be00640 1 -- 172.21.15.47:0/3009583344 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c680b1070 con 0x7f6c7c06cb10 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c7be00640 1 -- 172.21.15.47:0/3009583344 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c680ac600 con 0x7f6c7c06cb10 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c7be00640 1 -- 172.21.15.47:0/3009583344 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c680ac9d0 con 0x7f6c7c06cb10 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 -- 172.21.15.47:0/3009583344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 msgr2=0x7f6c7c0b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 --2- 172.21.15.47:0/3009583344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c0b1260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6c680097c0 tx=0x7f6c6801c3e0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 -- 172.21.15.47:0/3009583344 shutdown_connections 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 --2- 172.21.15.47:0/3009583344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 --2- 172.21.15.47:0/3009583344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c0b1260 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 -- 172.21.15.47:0/3009583344 >> 172.21.15.47:0/3009583344 conn(0x7f6c7c0b4400 msgr2=0x7f6c7c0d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:12.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 -- 172.21.15.47:0/3009583344 shutdown_connections 2024-04-26T23:46:12.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 -- 172.21.15.47:0/3009583344 wait complete. 2024-04-26T23:46:12.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.113+0000 7f6c84000640 1 Processor -- start 2024-04-26T23:46:12.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 -- start start 2024-04-26T23:46:12.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c7c15cee0 0x7f6c7c0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c0b5a80 con 0x7f6c7c06cb10 2024-04-26T23:46:12.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c0b5900 con 0x7f6c7c15cee0 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c0b5c00 con 0x7f6c7c0aeda0 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59126/0 (socket says 172.21.15.47:59126) 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 -- 172.21.15.47:0/462111612 learned_addr learned my addr 172.21.15.47:0/462111612 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c80c00640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c82000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c7c15cee0 0x7f6c7c0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 -- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 msgr2=0x7f6c7c070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c070b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 -- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c7c15cee0 msgr2=0x7f6c7c0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c7c15cee0 0x7f6c7c0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 -- 172.21.15.47:0/462111612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c153d50 con 0x7f6c7c06cb10 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c82000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c7c15cee0 0x7f6c7c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c81600640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c153650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c450 tx=0x7f6c7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:12.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c79600640 1 -- 172.21.15.47:0/462111612 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70017070 con 0x7f6c7c06cb10 2024-04-26T23:46:12.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c79600640 1 -- 172.21.15.47:0/462111612 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c70005cf0 con 0x7f6c7c06cb10 2024-04-26T23:46:12.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c154030 con 0x7f6c7c06cb10 2024-04-26T23:46:12.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c79600640 1 -- 172.21.15.47:0/462111612 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70007290 con 0x7f6c7c06cb10 2024-04-26T23:46:12.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c1545f0 con 0x7f6c7c06cb10 2024-04-26T23:46:12.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.117+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c069700 con 0x7f6c7c06cb10 2024-04-26T23:46:12.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.121+0000 7f6c79600640 1 -- 172.21.15.47:0/462111612 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c7001a070 con 0x7f6c7c06cb10 2024-04-26T23:46:12.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.121+0000 7f6c79600640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c5c068380 0x7f6c5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.121+0000 7f6c79600640 1 -- 172.21.15.47:0/462111612 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6c70085e60 con 0x7f6c7c06cb10 2024-04-26T23:46:12.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.121+0000 7f6c80c00640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c5c068380 0x7f6c5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.121+0000 7f6c80c00640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c5c068380 0x7f6c5c06a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c680ae000 tx=0x7f6c68008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:12.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.125+0000 7f6c79600640 1 -- 172.21.15.47:0/462111612 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c70056390 con 0x7f6c7c06cb10 2024-04-26T23:46:12.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.289+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6c7c14c570 con 0x7f6c7c06cb10 2024-04-26T23:46:12.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.289+0000 7f6c79600640 1 -- 172.21.15.47:0/462111612 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f6c70055c90 con 0x7f6c7c06cb10 2024-04-26T23:46:12.298 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c5c068380 msgr2=0x7f6c5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c5c068380 0x7f6c5c06a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c680ae000 tx=0x7f6c68008040 comp rx=0 tx=0).stop 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 msgr2=0x7f6c7c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c153650 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000c450 tx=0x7f6c7000c910 comp rx=0 tx=0).stop 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 shutdown_connections 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c5c068380 0x7f6c5c06a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c7c15cee0 0x7f6c7c0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c7c0aeda0 0x7f6c7c070b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 --2- 172.21.15.47:0/462111612 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c7c06cb10 0x7f6c7c153650 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 >> 172.21.15.47:0/462111612 conn(0x7f6c7c0b4400 msgr2=0x7f6c7c0d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:12.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 shutdown_connections 2024-04-26T23:46:12.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.293+0000 7f6c84000640 1 -- 172.21.15.47:0/462111612 wait complete. 2024-04-26T23:46:12.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:12.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6b5a00640 1 Processor -- start 2024-04-26T23:46:12.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6b5a00640 1 -- start start 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6b5a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb6b0159b70 0x7fb6b006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6b5a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb6b01603b0 0x7fb6b006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6b5a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b00aea30 con 0x7fb6b00af7f0 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6b5a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b00af360 con 0x7fb6b0159b70 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6b5a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b00aed10 con 0x7fb6b01603b0 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6aea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb6b0159b70 0x7fb6b006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6ae000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb6b00af7f0 0x7fb6b015fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34522/0 (socket says 172.21.15.47:34522) 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.453+0000 7fb6ae000640 1 -- 172.21.15.47:0/520020898 learned_addr learned my addr 172.21.15.47:0/520020898 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:12.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6af400640 1 --2- 172.21.15.47:0/520020898 >> v2:172.21.15.203:3300/0 conn(0x7fb6b01603b0 0x7fb6b006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6aea00640 1 -- 172.21.15.47:0/520020898 >> v2:172.21.15.203:3300/0 conn(0x7fb6b01603b0 msgr2=0x7fb6b006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:12.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6aea00640 1 --2- 172.21.15.47:0/520020898 >> v2:172.21.15.203:3300/0 conn(0x7fb6b01603b0 0x7fb6b006cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6aea00640 1 -- 172.21.15.47:0/520020898 >> v1:172.21.15.47:6789/0 conn(0x7fb6b00af7f0 legacy=0x7fb6b015fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6aea00640 1 -- 172.21.15.47:0/520020898 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b00aeff0 con 0x7fb6b0159b70 2024-04-26T23:46:12.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6ad600640 1 -- 172.21.15.47:0/520020898 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685488116 0 0) 0x7fb6b00aea30 con 0x7fb6b00af7f0 2024-04-26T23:46:12.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6aea00640 1 --2- 172.21.15.47:0/520020898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b0159b70 0x7fb6b006c630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb6b006ec70 tx=0x7fb6a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545fe77c772efca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:12.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6ad600640 1 -- 172.21.15.47:0/520020898 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00b1070 con 0x7fb6b0159b70 2024-04-26T23:46:12.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6ad600640 1 -- 172.21.15.47:0/520020898 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a00ac5f0 con 0x7fb6b0159b70 2024-04-26T23:46:12.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6ad600640 1 -- 172.21.15.47:0/520020898 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a00ac9c0 con 0x7fb6b0159b70 2024-04-26T23:46:12.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6b5a00640 1 -- 172.21.15.47:0/520020898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b0159b70 msgr2=0x7fb6b006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/520020898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b0159b70 0x7fb6b006c630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb6b006ec70 tx=0x7fb6a001c480 comp rx=0 tx=0).stop 2024-04-26T23:46:12.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6b5a00640 1 -- 172.21.15.47:0/520020898 shutdown_connections 2024-04-26T23:46:12.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/520020898 >> v2:172.21.15.203:3300/0 conn(0x7fb6b01603b0 0x7fb6b006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/520020898 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b0159b70 0x7fb6b006c630 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.457+0000 7fb6b5a00640 1 -- 172.21.15.47:0/520020898 >> 172.21.15.47:0/520020898 conn(0x7fb6b00b2d40 msgr2=0x7fb6b00b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:12.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 -- 172.21.15.47:0/520020898 shutdown_connections 2024-04-26T23:46:12.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 -- 172.21.15.47:0/520020898 wait complete. 2024-04-26T23:46:12.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 Processor -- start 2024-04-26T23:46:12.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 -- start start 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b00af7f0 0x7fb6b014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6b0159b70 0x7fb6b0166270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b01603b0 0x7fb6b015b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b006faa0 con 0x7fb6b01603b0 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b006f920 con 0x7fb6b00af7f0 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6b5a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b006fc20 con 0x7fb6b0159b70 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b01603b0 0x7fb6b015b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b01603b0 0x7fb6b015b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59144/0 (socket says 172.21.15.47:59144) 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 -- 172.21.15.47:0/1343008984 learned_addr learned my addr 172.21.15.47:0/1343008984 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:12.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6ae000640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6b0159b70 0x7fb6b0166270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6aea00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b00af7f0 0x7fb6b014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 -- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6b0159b70 msgr2=0x7fb6b0166270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6b0159b70 0x7fb6b0166270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 -- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b00af7f0 msgr2=0x7fb6b014f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b00af7f0 0x7fb6b014f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 -- 172.21.15.47:0/1343008984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b00b5020 con 0x7fb6b01603b0 2024-04-26T23:46:12.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6af400640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b01603b0 0x7fb6b015b010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8007e90 tx=0x7fb6a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:12.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.461+0000 7fb6a6a00640 1 -- 172.21.15.47:0/1343008984 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8014420 con 0x7fb6b01603b0 2024-04-26T23:46:12.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6a6a00640 1 -- 172.21.15.47:0/1343008984 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8019070 con 0x7fb6b01603b0 2024-04-26T23:46:12.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6a6a00640 1 -- 172.21.15.47:0/1343008984 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8014800 con 0x7fb6b01603b0 2024-04-26T23:46:12.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b00b3f80 con 0x7fb6b01603b0 2024-04-26T23:46:12.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b00b4540 con 0x7fb6b01603b0 2024-04-26T23:46:12.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b00695f0 con 0x7fb6b01603b0 2024-04-26T23:46:12.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6a6a00640 1 -- 172.21.15.47:0/1343008984 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6a80149a0 con 0x7fb6b01603b0 2024-04-26T23:46:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6a6a00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb6900683b0 0x7fb69006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6a6a00640 1 -- 172.21.15.47:0/1343008984 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb6a8087070 con 0x7fb6b01603b0 2024-04-26T23:46:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.465+0000 7fb6aea00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb6900683b0 0x7fb69006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:12.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.469+0000 7fb6aea00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb6900683b0 0x7fb69006a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00ae000 tx=0x7fb6a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:12.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.469+0000 7fb6a6a00640 1 -- 172.21.15.47:0/1343008984 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb6a8056f40 con 0x7fb6b01603b0 2024-04-26T23:46:12.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6b00cd440 con 0x7fb6b01603b0 2024-04-26T23:46:12.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6a6a00640 1 -- 172.21.15.47:0/1343008984 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fb6a805b240 con 0x7fb6b01603b0 2024-04-26T23:46:12.656 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb6900683b0 msgr2=0x7fb69006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb6900683b0 0x7fb69006a870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00ae000 tx=0x7fb6a0008040 comp rx=0 tx=0).stop 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b01603b0 msgr2=0x7fb6b015b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b01603b0 0x7fb6b015b010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8007e90 tx=0x7fb6a800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 shutdown_connections 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb6900683b0 0x7fb69006a870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb6b01603b0 0x7fb6b015b010 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb6b0159b70 0x7fb6b0166270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 --2- 172.21.15.47:0/1343008984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb6b00af7f0 0x7fb6b014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 >> 172.21.15.47:0/1343008984 conn(0x7fb6b00b2d40 msgr2=0x7fb6b015fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:12.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 shutdown_connections 2024-04-26T23:46:12.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:12.649+0000 7fb6b5a00640 1 -- 172.21.15.47:0/1343008984 wait complete. 2024-04-26T23:46:12.678 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi203.front.sepia.ceph.com... 2024-04-26T23:46:12.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:12.678 DEBUG:teuthology.orchestra.run.smithi203:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:12.713 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:12.714 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:46:12.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:12.714 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:46:12.771 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:12.771 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:12.783 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:12.783 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:12.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c49800640 1 Processor -- start 2024-04-26T23:46:13.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c49800640 1 -- start start 2024-04-26T23:46:13.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c49800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0c4415d5b0 0x7f0c4415da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c49800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f0c440cdc00 0x7f0c440ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c49800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4415e050 con 0x7f0c440b4360 2024-04-26T23:46:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c49800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4415e330 con 0x7f0c4415d5b0 2024-04-26T23:46:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c49800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0c440ceda0 con 0x7f0c440cdc00 2024-04-26T23:46:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c42a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0c440b4360 0x7f0c440cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34536/0 (socket says 172.21.15.47:34536) 2024-04-26T23:46:13.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c42a00640 1 -- 172.21.15.47:0/1109338363 learned_addr learned my addr 172.21.15.47:0/1109338363 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:13.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c3a000640 1 --2- 172.21.15.47:0/1109338363 >> v2:172.21.15.47:3300/0 conn(0x7f0c4415d5b0 0x7f0c4415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c43400640 1 --2- 172.21.15.47:0/1109338363 >> v2:172.21.15.203:3300/0 conn(0x7f0c440cdc00 0x7f0c440ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c3a000640 1 -- 172.21.15.47:0/1109338363 >> v2:172.21.15.203:3300/0 conn(0x7f0c440cdc00 msgr2=0x7f0c440ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c3a000640 1 --2- 172.21.15.47:0/1109338363 >> v2:172.21.15.203:3300/0 conn(0x7f0c440cdc00 0x7f0c440ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c3a000640 1 -- 172.21.15.47:0/1109338363 >> v1:172.21.15.47:6789/0 conn(0x7f0c440b4360 legacy=0x7f0c440cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c3a000640 1 -- 172.21.15.47:0/1109338363 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440cf080 con 0x7f0c4415d5b0 2024-04-26T23:46:13.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.013+0000 7f0c42000640 1 -- 172.21.15.47:0/1109338363 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900770679 0 0) 0x7f0c4415e050 con 0x7f0c440b4360 2024-04-26T23:46:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c3a000640 1 --2- 172.21.15.47:0/1109338363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c4415d5b0 0x7f0c4415da40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c440d0cd0 tx=0x7f0c2c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aeefaca936b81e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c42000640 1 -- 172.21.15.47:0/1109338363 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0b0070 con 0x7f0c4415d5b0 2024-04-26T23:46:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c42000640 1 -- 172.21.15.47:0/1109338363 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c0ab600 con 0x7f0c4415d5b0 2024-04-26T23:46:13.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c42000640 1 -- 172.21.15.47:0/1109338363 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0ab9d0 con 0x7f0c4415d5b0 2024-04-26T23:46:13.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 -- 172.21.15.47:0/1109338363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c4415d5b0 msgr2=0x7f0c4415da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 --2- 172.21.15.47:0/1109338363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c4415d5b0 0x7f0c4415da40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0c440d0cd0 tx=0x7f0c2c01c460 comp rx=0 tx=0).stop 2024-04-26T23:46:13.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 -- 172.21.15.47:0/1109338363 shutdown_connections 2024-04-26T23:46:13.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 --2- 172.21.15.47:0/1109338363 >> v2:172.21.15.203:3300/0 conn(0x7f0c440cdc00 0x7f0c440ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 --2- 172.21.15.47:0/1109338363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c4415d5b0 0x7f0c4415da40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 -- 172.21.15.47:0/1109338363 >> 172.21.15.47:0/1109338363 conn(0x7f0c4406c800 msgr2=0x7f0c4406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:13.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 -- 172.21.15.47:0/1109338363 shutdown_connections 2024-04-26T23:46:13.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.017+0000 7f0c49800640 1 -- 172.21.15.47:0/1109338363 wait complete. 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 Processor -- start 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 -- start start 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c440b4360 0x7f0c44163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c440cdc00 0x7f0c440b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0c4415d5b0 0x7f0c44142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0c44169f40 con 0x7f0c440cdc00 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4415f190 con 0x7f0c440b4360 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4416a0c0 con 0x7f0c4415d5b0 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c440cdc00 0x7f0c440b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c440cdc00 0x7f0c440b1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59156/0 (socket says 172.21.15.47:59156) 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 -- 172.21.15.47:0/853577144 learned_addr learned my addr 172.21.15.47:0/853577144 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:13.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c42a00640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c440b4360 0x7f0c44163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c43400640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0c4415d5b0 0x7f0c44142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 -- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0c4415d5b0 msgr2=0x7f0c44142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0c4415d5b0 0x7f0c44142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 -- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c440b4360 msgr2=0x7f0c44163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c440b4360 0x7f0c44163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 -- 172.21.15.47:0/853577144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c441432f0 con 0x7f0c440cdc00 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3a000640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c440cdc00 0x7f0c440b1120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0ae040 tx=0x7f0c2c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3b400640 1 -- 172.21.15.47:0/853577144 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0ba020 con 0x7f0c440cdc00 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3b400640 1 -- 172.21.15.47:0/853577144 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c0059a0 con 0x7f0c440cdc00 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c3b400640 1 -- 172.21.15.47:0/853577144 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0b0040 con 0x7f0c440cdc00 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4406e8e0 con 0x7f0c440cdc00 2024-04-26T23:46:13.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.021+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4406eea0 con 0x7f0c440cdc00 2024-04-26T23:46:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.025+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c44069700 con 0x7f0c440cdc00 2024-04-26T23:46:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.025+0000 7f0c3b400640 1 -- 172.21.15.47:0/853577144 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c2c0bd020 con 0x7f0c440cdc00 2024-04-26T23:46:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.025+0000 7f0c3b400640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0c200683b0 0x7f0c2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.025+0000 7f0c3b400640 1 -- 172.21.15.47:0/853577144 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5854+0+0 (secure 0 0 0) 0x7f0c2c120a60 con 0x7f0c440cdc00 2024-04-26T23:46:13.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.025+0000 7f0c42a00640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0c200683b0 0x7f0c2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.025+0000 7f0c42a00640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0c200683b0 0x7f0c2006a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c34000f70 tx=0x7f0c34007b60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.029+0000 7f0c3b400640 1 -- 172.21.15.47:0/853577144 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0c2c0c4030 con 0x7f0c440cdc00 2024-04-26T23:46:13.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.197+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c440d06a0 con 0x7f0c440cdc00 2024-04-26T23:46:13.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.197+0000 7f0c3b400640 1 -- 172.21.15.47:0/853577144 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16828 (secure 0 0 0) 0x7f0c2c016050 con 0x7f0c440cdc00 2024-04-26T23:46:13.205 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:13.205 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":24,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:12.821910+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:13.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0c200683b0 msgr2=0x7f0c2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0c200683b0 0x7f0c2006a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c34000f70 tx=0x7f0c34007b60 comp rx=0 tx=0).stop 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c440cdc00 msgr2=0x7f0c440b1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c440cdc00 0x7f0c440b1120 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0ae040 tx=0x7f0c2c019200 comp rx=0 tx=0).stop 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 shutdown_connections 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0c200683b0 0x7f0c2006a870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0c4415d5b0 0x7f0c44142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0c440cdc00 0x7f0c440b1120 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 --2- 172.21.15.47:0/853577144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0c440b4360 0x7f0c44163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 >> 172.21.15.47:0/853577144 conn(0x7f0c4406c800 msgr2=0x7f0c4415ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 shutdown_connections 2024-04-26T23:46:13.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.201+0000 7f0c49800640 1 -- 172.21.15.47:0/853577144 wait complete. 2024-04-26T23:46:13.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:13.228 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:13.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1ca0a00640 1 Processor -- start 2024-04-26T23:46:13.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1ca0a00640 1 -- start start 2024-04-26T23:46:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1ca0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c160670 0x7f1c9c09ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1ca0a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1c9c160a50 0x7f1c9c09bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1ca0a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c9c071f90 con 0x7f1c9c0b2490 2024-04-26T23:46:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1ca0a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1c9c070ee0 con 0x7f1c9c160a50 2024-04-26T23:46:13.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1ca0a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c0cebc0 con 0x7f1c9c160670 2024-04-26T23:46:13.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c91400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1c9c160a50 0x7f1c9c09bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c9a800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1c9c0b2490 0x7f1c9c0d1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34538/0 (socket says 172.21.15.47:34538) 2024-04-26T23:46:13.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c9a800640 1 -- 172.21.15.47:0/1555706583 learned_addr learned my addr 172.21.15.47:0/1555706583 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:13.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c99e00640 1 --2- 172.21.15.47:0/1555706583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c160670 0x7f1c9c09ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c91400640 1 -- 172.21.15.47:0/1555706583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c160670 msgr2=0x7f1c9c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:13.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c91400640 1 --2- 172.21.15.47:0/1555706583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c160670 0x7f1c9c09ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c91400640 1 -- 172.21.15.47:0/1555706583 >> v1:172.21.15.47:6789/0 conn(0x7f1c9c0b2490 legacy=0x7f1c9c0d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c91400640 1 -- 172.21.15.47:0/1555706583 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c072230 con 0x7f1c9c160a50 2024-04-26T23:46:13.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.365+0000 7f1c99400640 1 -- 172.21.15.47:0/1555706583 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458444030 0 0) 0x7f1c9c071f90 con 0x7f1c9c0b2490 2024-04-26T23:46:13.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1c91400640 1 --2- 172.21.15.47:0/1555706583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160a50 0x7f1c9c09bfa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c840097c0 tx=0x7f1c8401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b3ff8749cf8fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1c99400640 1 -- 172.21.15.47:0/1555706583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840b0070 con 0x7f1c9c160a50 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1c99400640 1 -- 172.21.15.47:0/1555706583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c840ab600 con 0x7f1c9c160a50 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1c99400640 1 -- 172.21.15.47:0/1555706583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840ab9d0 con 0x7f1c9c160a50 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 -- 172.21.15.47:0/1555706583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160a50 msgr2=0x7f1c9c09bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/1555706583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160a50 0x7f1c9c09bfa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1c840097c0 tx=0x7f1c8401c3e0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 -- 172.21.15.47:0/1555706583 shutdown_connections 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/1555706583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160a50 0x7f1c9c09bfa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/1555706583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c160670 0x7f1c9c09ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 -- 172.21.15.47:0/1555706583 >> 172.21.15.47:0/1555706583 conn(0x7f1c9c0b4c00 msgr2=0x7f1c9c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 -- 172.21.15.47:0/1555706583 shutdown_connections 2024-04-26T23:46:13.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.369+0000 7f1ca0a00640 1 -- 172.21.15.47:0/1555706583 wait complete. 2024-04-26T23:46:13.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 Processor -- start 2024-04-26T23:46:13.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 -- start start 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c0b2490 0x7f1c9c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160670 0x7f1c9c0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c9c160a50 0x7f1c9c15de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c0b5870 con 0x7f1c9c160670 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c0b56f0 con 0x7f1c9c160a50 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1c9c0719a0 con 0x7f1c9c0b2490 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160670 0x7f1c9c0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160670 0x7f1c9c0afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59174/0 (socket says 172.21.15.47:59174) 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 -- 172.21.15.47:0/762393792 learned_addr learned my addr 172.21.15.47:0/762393792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c99e00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c0b2490 0x7f1c9c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c9a800640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c9c160a50 0x7f1c9c15de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 -- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c0b2490 msgr2=0x7f1c9c158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c0b2490 0x7f1c9c158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 -- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c9c160a50 msgr2=0x7f1c9c15de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c9c160a50 0x7f1c9c15de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 -- 172.21.15.47:0/762393792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c0b08c0 con 0x7f1c9c160670 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c99e00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c0b2490 0x7f1c9c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c91400640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160670 0x7f1c9c0afe00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c840097c0 tx=0x7f1c8401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c92a00640 1 -- 172.21.15.47:0/762393792 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840bc070 con 0x7f1c9c160670 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c92a00640 1 -- 172.21.15.47:0/762393792 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c840b1040 con 0x7f1c9c160670 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1c92a00640 1 -- 172.21.15.47:0/762393792 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c840b0050 con 0x7f1c9c160670 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c0b0ba0 con 0x7f1c9c160670 2024-04-26T23:46:13.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.373+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1592a0 con 0x7f1c9c160670 2024-04-26T23:46:13.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.377+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c069700 con 0x7f1c9c160670 2024-04-26T23:46:13.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.377+0000 7f1c92a00640 1 -- 172.21.15.47:0/762393792 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1c840bf070 con 0x7f1c9c160670 2024-04-26T23:46:13.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.377+0000 7f1c92a00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1c780683b0 0x7f1c7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.377+0000 7f1c92a00640 1 -- 172.21.15.47:0/762393792 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5854+0+0 (secure 0 0 0) 0x7f1c84120500 con 0x7f1c9c160670 2024-04-26T23:46:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.377+0000 7f1c99e00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1c780683b0 0x7f1c7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.377+0000 7f1c99e00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1c780683b0 0x7f1c7806a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c007a70 tx=0x7f1c8c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.381+0000 7f1c92a00640 1 -- 172.21.15.47:0/762393792 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1c84016090 con 0x7f1c9c160670 2024-04-26T23:46:13.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.545+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1c9c0d2540 con 0x7f1c9c160670 2024-04-26T23:46:13.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.545+0000 7f1c92a00640 1 -- 172.21.15.47:0/762393792 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f1c840f0ac0 con 0x7f1c9c160670 2024-04-26T23:46:13.553 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1c780683b0 msgr2=0x7f1c7806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1c780683b0 0x7f1c7806a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c007a70 tx=0x7f1c8c008040 comp rx=0 tx=0).stop 2024-04-26T23:46:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160670 msgr2=0x7f1c9c0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160670 0x7f1c9c0afe00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1c840097c0 tx=0x7f1c8401ac20 comp rx=0 tx=0).stop 2024-04-26T23:46:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 shutdown_connections 2024-04-26T23:46:13.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1c780683b0 0x7f1c7806a870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1c9c160a50 0x7f1c9c15de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c9c160670 0x7f1c9c0afe00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 --2- 172.21.15.47:0/762393792 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1c9c0b2490 0x7f1c9c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 >> 172.21.15.47:0/762393792 conn(0x7f1c9c0b4c00 msgr2=0x7f1c9c0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:13.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 shutdown_connections 2024-04-26T23:46:13.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.549+0000 7f1ca0a00640 1 -- 172.21.15.47:0/762393792 wait complete. 2024-04-26T23:46:13.575 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:13.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.709+0000 7fe728a00640 1 Processor -- start 2024-04-26T23:46:13.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe728a00640 1 -- start start 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe728a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe72415cf50 0x7fe7240cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe728a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7240d04b0 0x7fe72406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe728a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7240ae030 con 0x7fe72406cb70 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe728a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe7240af7a0 con 0x7fe72415cf50 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe728a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe72406d000 con 0x7fe7240d04b0 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe721e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe72415cf50 0x7fe7240cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe721e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe72415cf50 0x7fe7240cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59180/0 (socket says 172.21.15.47:59180) 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe721e00640 1 -- 172.21.15.47:0/3970052817 learned_addr learned my addr 172.21.15.47:0/3970052817 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe722800640 1 --1- 172.21.15.47:0/3970052817 >> v1:172.21.15.47:6789/0 conn(0x7fe72406cb70 0x7fe7240720c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34542/0 (socket says 172.21.15.47:34542) 2024-04-26T23:46:13.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe721e00640 1 -- 172.21.15.47:0/3970052817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7240d04b0 msgr2=0x7fe72406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:13.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe721e00640 1 --2- 172.21.15.47:0/3970052817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7240d04b0 0x7fe72406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe721e00640 1 -- 172.21.15.47:0/3970052817 >> v1:172.21.15.47:6789/0 conn(0x7fe72406cb70 legacy=0x7fe7240720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.713+0000 7fe721e00640 1 -- 172.21.15.47:0/3970052817 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7240d0ae0 con 0x7fe72415cf50 2024-04-26T23:46:13.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe721e00640 1 --2- 172.21.15.47:0/3970052817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe7240cff70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe714009870 tx=0x7fe71401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796db43b3cf25080 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe721400640 1 -- 172.21.15.47:0/3970052817 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140b0070 con 0x7fe72415cf50 2024-04-26T23:46:13.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe721400640 1 -- 172.21.15.47:0/3970052817 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7140ab600 con 0x7fe72415cf50 2024-04-26T23:46:13.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe721400640 1 -- 172.21.15.47:0/3970052817 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140ab9d0 con 0x7fe72415cf50 2024-04-26T23:46:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 -- 172.21.15.47:0/3970052817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 msgr2=0x7fe7240cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 --2- 172.21.15.47:0/3970052817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe7240cff70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe714009870 tx=0x7fe71401c560 comp rx=0 tx=0).stop 2024-04-26T23:46:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 -- 172.21.15.47:0/3970052817 shutdown_connections 2024-04-26T23:46:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 --2- 172.21.15.47:0/3970052817 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7240d04b0 0x7fe72406c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 --2- 172.21.15.47:0/3970052817 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe7240cff70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 -- 172.21.15.47:0/3970052817 >> 172.21.15.47:0/3970052817 conn(0x7fe7240b2b70 msgr2=0x7fe7240b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:13.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 -- 172.21.15.47:0/3970052817 shutdown_connections 2024-04-26T23:46:13.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 -- 172.21.15.47:0/3970052817 wait complete. 2024-04-26T23:46:13.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 Processor -- start 2024-04-26T23:46:13.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.717+0000 7fe728a00640 1 -- start start 2024-04-26T23:46:13.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe72406cb70 0x7fe724161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7240d04b0 0x7fe7241621e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe72413ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe72415d330 con 0x7fe72415cf50 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7240af9d0 con 0x7fe7240d04b0 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7240b3c40 con 0x7fe72406cb70 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe72413ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe72413ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59188/0 (socket says 172.21.15.47:59188) 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 -- 172.21.15.47:0/3931825961 learned_addr learned my addr 172.21.15.47:0/3931825961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 -- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe72406cb70 msgr2=0x7fe724161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe719400640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7240d04b0 0x7fe7241621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe721e00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe72406cb70 0x7fe724161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe72406cb70 0x7fe724161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 -- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7240d04b0 msgr2=0x7fe7241621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7240d04b0 0x7fe7241621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 -- 172.21.15.47:0/3931825961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72409dc50 con 0x7fe72415cf50 2024-04-26T23:46:13.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe719400640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7240d04b0 0x7fe7241621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe721e00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe72406cb70 0x7fe724161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe722800640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe72413ddd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c7a0 tx=0x7fe71c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe71aa00640 1 -- 172.21.15.47:0/3931825961 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c017070 con 0x7fe72415cf50 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe71aa00640 1 -- 172.21.15.47:0/3931825961 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c00a640 con 0x7fe72415cf50 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe71aa00640 1 -- 172.21.15.47:0/3931825961 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00a9f0 con 0x7fe72415cf50 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72415dea0 con 0x7fe72415cf50 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72413e310 con 0x7fe72415cf50 2024-04-26T23:46:13.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe724069700 con 0x7fe72415cf50 2024-04-26T23:46:13.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.721+0000 7fe71aa00640 1 -- 172.21.15.47:0/3931825961 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe71c01a070 con 0x7fe72415cf50 2024-04-26T23:46:13.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.725+0000 7fe71aa00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe700068380 0x7fe70006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:13.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.725+0000 7fe71aa00640 1 -- 172.21.15.47:0/3931825961 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5854+0+0 (secure 0 0 0) 0x7fe71c0860b0 con 0x7fe72415cf50 2024-04-26T23:46:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.725+0000 7fe721e00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe700068380 0x7fe70006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:13.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.725+0000 7fe721e00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe700068380 0x7fe70006a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7140ad000 tx=0x7fe714008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:13.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.729+0000 7fe71aa00640 1 -- 172.21.15.47:0/3931825961 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe71c055f00 con 0x7fe72415cf50 2024-04-26T23:46:13.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe72415be00 con 0x7fe72415cf50 2024-04-26T23:46:13.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe71aa00640 1 -- 172.21.15.47:0/3931825961 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fe71c05a200 con 0x7fe72415cf50 2024-04-26T23:46:13.904 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:13.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe700068380 msgr2=0x7fe70006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe700068380 0x7fe70006a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7140ad000 tx=0x7fe714008040 comp rx=0 tx=0).stop 2024-04-26T23:46:13.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 msgr2=0x7fe72413ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:13.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe72413ddd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00c7a0 tx=0x7fe71c00cc60 comp rx=0 tx=0).stop 2024-04-26T23:46:13.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 shutdown_connections 2024-04-26T23:46:13.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe700068380 0x7fe70006a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe72415cf50 0x7fe72413ddd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7240d04b0 0x7fe7241621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 --2- 172.21.15.47:0/3931825961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe72406cb70 0x7fe724161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:13.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 >> 172.21.15.47:0/3931825961 conn(0x7fe7240b2b70 msgr2=0x7fe7240b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:13.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 shutdown_connections 2024-04-26T23:46:13.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:13.897+0000 7fe728a00640 1 -- 172.21.15.47:0/3931825961 wait complete. 2024-04-26T23:46:13.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:14.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb9a00640 1 Processor -- start 2024-04-26T23:46:14.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb9a00640 1 -- start start 2024-04-26T23:46:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb9a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fccb4162970 0x7fccb40700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb9a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb406f000 con 0x7fccb40730b0 2024-04-26T23:46:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb9a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb406f2e0 con 0x7fccb406ea90 2024-04-26T23:46:14.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb9a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fccb406f5c0 con 0x7fccb4162970 2024-04-26T23:46:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb2a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fccb4162970 0x7fccb40700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb3400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fccb40730b0 0x7fccb40cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34546/0 (socket says 172.21.15.47:34546) 2024-04-26T23:46:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb3400640 1 -- 172.21.15.47:0/1088014959 learned_addr learned my addr 172.21.15.47:0/1088014959 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb2a00640 1 -- 172.21.15.47:0/1088014959 >> v1:172.21.15.203:6789/0 conn(0x7fccb406ea90 legacy=0x7fccb40729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb2a00640 1 -- 172.21.15.47:0/1088014959 >> v1:172.21.15.47:6789/0 conn(0x7fccb40730b0 legacy=0x7fccb40cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb2a00640 1 -- 172.21.15.47:0/1088014959 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb406f8a0 con 0x7fccb4162970 2024-04-26T23:46:14.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.061+0000 7fccb2000640 1 -- 172.21.15.47:0/1088014959 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969757751 0 0) 0x7fccb406f000 con 0x7fccb40730b0 2024-04-26T23:46:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb2a00640 1 --2- 172.21.15.47:0/1088014959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb40700a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcca40097c0 tx=0x7fcca401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb38cde42fc9fd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb2000640 1 -- 172.21.15.47:0/1088014959 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40aa5f0 con 0x7fccb4162970 2024-04-26T23:46:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb2000640 1 -- 172.21.15.47:0/1088014959 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca40af070 con 0x7fccb4162970 2024-04-26T23:46:14.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb2000640 1 -- 172.21.15.47:0/1088014959 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca40aa9b0 con 0x7fccb4162970 2024-04-26T23:46:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb9a00640 1 -- 172.21.15.47:0/1088014959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 msgr2=0x7fccb40700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb9a00640 1 --2- 172.21.15.47:0/1088014959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb40700a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcca40097c0 tx=0x7fcca401c470 comp rx=0 tx=0).stop 2024-04-26T23:46:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb9a00640 1 -- 172.21.15.47:0/1088014959 shutdown_connections 2024-04-26T23:46:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb9a00640 1 --2- 172.21.15.47:0/1088014959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb40700a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb9a00640 1 -- 172.21.15.47:0/1088014959 >> 172.21.15.47:0/1088014959 conn(0x7fccb4070c00 msgr2=0x7fccb406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:14.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb9a00640 1 -- 172.21.15.47:0/1088014959 shutdown_connections 2024-04-26T23:46:14.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.065+0000 7fccb9a00640 1 -- 172.21.15.47:0/1088014959 wait complete. 2024-04-26T23:46:14.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 Processor -- start 2024-04-26T23:46:14.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 -- start start 2024-04-26T23:46:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb406ea90 0x7fccb4155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb40730b0 0x7fccb41656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb4162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fccb40cc080 con 0x7fccb4162970 2024-04-26T23:46:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fccb40b4840 con 0x7fccb40730b0 2024-04-26T23:46:14.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fccb4163530 con 0x7fccb406ea90 2024-04-26T23:46:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb4162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb4162ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59198/0 (socket says 172.21.15.47:59198) 2024-04-26T23:46:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 -- 172.21.15.47:0/3968040770 learned_addr learned my addr 172.21.15.47:0/3968040770 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb2a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb406ea90 0x7fccb4155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccaa000640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb40730b0 0x7fccb41656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 -- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb406ea90 msgr2=0x7fccb4155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb406ea90 0x7fccb4155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 -- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb40730b0 msgr2=0x7fccb41656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb40730b0 0x7fccb41656a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 -- 172.21.15.47:0/3968040770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb41565d0 con 0x7fccb4162970 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccaa000640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb40730b0 0x7fccb41656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb3400640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb4162ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fccac00c780 tx=0x7fccac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccab400640 1 -- 172.21.15.47:0/3968040770 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac018070 con 0x7fccb4162970 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccab400640 1 -- 172.21.15.47:0/3968040770 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccac00a640 con 0x7fccb4162970 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccab400640 1 -- 172.21.15.47:0/3968040770 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac00aab0 con 0x7fccb4162970 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb415cdd0 con 0x7fccb4162970 2024-04-26T23:46:14.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb415d390 con 0x7fccb4162970 2024-04-26T23:46:14.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.069+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb406d370 con 0x7fccb4162970 2024-04-26T23:46:14.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.073+0000 7fccab400640 1 -- 172.21.15.47:0/3968040770 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fccac01b070 con 0x7fccb4162970 2024-04-26T23:46:14.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.073+0000 7fccab400640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc90068380 0x7fcc9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.073+0000 7fccab400640 1 -- 172.21.15.47:0/3968040770 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fccac086070 con 0x7fccb4162970 2024-04-26T23:46:14.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.073+0000 7fccb2a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc90068380 0x7fcc9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.073+0000 7fccb2a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc90068380 0x7fcc9006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ae000 tx=0x7fcca40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.077+0000 7fccab400640 1 -- 172.21.15.47:0/3968040770 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fccac055eb0 con 0x7fccb4162970 2024-04-26T23:46:14.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.241+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fccb4069700 con 0x7fccb4162970 2024-04-26T23:46:14.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.241+0000 7fccab400640 1 -- 172.21.15.47:0/3968040770 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fccac05a1b0 con 0x7fccb4162970 2024-04-26T23:46:14.250 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:14.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc90068380 msgr2=0x7fcc9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc90068380 0x7fcc9006a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcca40ae000 tx=0x7fcca40a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:14.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 msgr2=0x7fccb4162ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb4162ff0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fccac00c780 tx=0x7fccac00cc40 comp rx=0 tx=0).stop 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 shutdown_connections 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcc90068380 0x7fcc9006a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fccb4162970 0x7fccb4162ff0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fccb40730b0 0x7fccb41656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 --2- 172.21.15.47:0/3968040770 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fccb406ea90 0x7fccb4155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 >> 172.21.15.47:0/3968040770 conn(0x7fccb4070c00 msgr2=0x7fccb415a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 shutdown_connections 2024-04-26T23:46:14.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.245+0000 7fccb9a00640 1 -- 172.21.15.47:0/3968040770 wait complete. 2024-04-26T23:46:14.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:14.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74ca000640 1 Processor -- start 2024-04-26T23:46:14.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74ca000640 1 -- start start 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74ca000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f74c415d080 0x7f74c40b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74ca000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f74c40ade00 0x7f74c40ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74ca000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c40b5a50 con 0x7f74c406c630 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74ca000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f74c415d460 con 0x7f74c40ade00 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74ca000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f74c40b5d30 con 0x7f74c415d080 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74bbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f74c40ade00 0x7f74c40ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74c3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f74c406c630 0x7f74c40b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34562/0 (socket says 172.21.15.47:34562) 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74c3e00640 1 -- 172.21.15.47:0/766582366 learned_addr learned my addr 172.21.15.47:0/766582366 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:14.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74c3400640 1 --2- 172.21.15.47:0/766582366 >> v2:172.21.15.203:3300/0 conn(0x7f74c415d080 0x7f74c40b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74bbe00640 1 -- 172.21.15.47:0/766582366 >> v2:172.21.15.203:3300/0 conn(0x7f74c415d080 msgr2=0x7f74c40b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74bbe00640 1 --2- 172.21.15.47:0/766582366 >> v2:172.21.15.203:3300/0 conn(0x7f74c415d080 0x7f74c40b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74bbe00640 1 -- 172.21.15.47:0/766582366 >> v1:172.21.15.47:6789/0 conn(0x7f74c406c630 legacy=0x7f74c40b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74bbe00640 1 -- 172.21.15.47:0/766582366 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c40b6010 con 0x7f74c40ade00 2024-04-26T23:46:14.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.405+0000 7f74c2a00640 1 -- 172.21.15.47:0/766582366 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208395461 0 0) 0x7f74c40b5a50 con 0x7f74c406c630 2024-04-26T23:46:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74bbe00640 1 --2- 172.21.15.47:0/766582366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c40ade00 0x7f74c40ccdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f74c40739e0 tx=0x7f74ac01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a946d4b32d53cf91 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74c2a00640 1 -- 172.21.15.47:0/766582366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0ab650 con 0x7f74c40ade00 2024-04-26T23:46:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74c2a00640 1 -- 172.21.15.47:0/766582366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ac0b0070 con 0x7f74c40ade00 2024-04-26T23:46:14.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74c2a00640 1 -- 172.21.15.47:0/766582366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0aba10 con 0x7f74c40ade00 2024-04-26T23:46:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 -- 172.21.15.47:0/766582366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c40ade00 msgr2=0x7f74c40ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 --2- 172.21.15.47:0/766582366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c40ade00 0x7f74c40ccdb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f74c40739e0 tx=0x7f74ac01c450 comp rx=0 tx=0).stop 2024-04-26T23:46:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 -- 172.21.15.47:0/766582366 shutdown_connections 2024-04-26T23:46:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 --2- 172.21.15.47:0/766582366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c40ade00 0x7f74c40ccdb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 --2- 172.21.15.47:0/766582366 >> v2:172.21.15.203:3300/0 conn(0x7f74c415d080 0x7f74c40b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 -- 172.21.15.47:0/766582366 >> 172.21.15.47:0/766582366 conn(0x7f74c40b2d40 msgr2=0x7f74c40b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 -- 172.21.15.47:0/766582366 shutdown_connections 2024-04-26T23:46:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.409+0000 7f74ca000640 1 -- 172.21.15.47:0/766582366 wait complete. 2024-04-26T23:46:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 Processor -- start 2024-04-26T23:46:14.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 -- start start 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c406c630 0x7f74c41507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74c40ade00 0x7f74c41571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f74c415d080 0x7f74c40c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f74c406ce70 con 0x7f74c406c630 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40af7a0 con 0x7f74c40ade00 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f74c40cd2f0 con 0x7f74c415d080 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c406c630 0x7f74c41507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c406c630 0x7f74c41507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59210/0 (socket says 172.21.15.47:59210) 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 -- 172.21.15.47:0/2446521272 learned_addr learned my addr 172.21.15.47:0/2446521272 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74bbe00640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74c40ade00 0x7f74c41571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3e00640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f74c415d080 0x7f74c40c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 -- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f74c415d080 msgr2=0x7f74c40c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f74c415d080 0x7f74c40c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 -- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74c40ade00 msgr2=0x7f74c41571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74c40ade00 0x7f74c41571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 -- 172.21.15.47:0/2446521272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c41560d0 con 0x7f74c406c630 2024-04-26T23:46:14.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74bbe00640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74c40ade00 0x7f74c41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:14.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74c3400640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c406c630 0x7f74c41507c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e870 tx=0x7f74b400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74bb400640 1 -- 172.21.15.47:0/2446521272 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4017070 con 0x7f74c406c630 2024-04-26T23:46:14.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74bb400640 1 -- 172.21.15.47:0/2446521272 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b400c940 con 0x7f74c406c630 2024-04-26T23:46:14.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c40cd660 con 0x7f74c406c630 2024-04-26T23:46:14.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74bb400640 1 -- 172.21.15.47:0/2446521272 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b400ccf0 con 0x7f74c406c630 2024-04-26T23:46:14.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.413+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c4156630 con 0x7f74c406c630 2024-04-26T23:46:14.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.417+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c40695f0 con 0x7f74c406c630 2024-04-26T23:46:14.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.417+0000 7f74bb400640 1 -- 172.21.15.47:0/2446521272 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f74b401a070 con 0x7f74c406c630 2024-04-26T23:46:14.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.417+0000 7f74bb400640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f74a00683b0 0x7f74a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.417+0000 7f74bb400640 1 -- 172.21.15.47:0/2446521272 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f74b40868e0 con 0x7f74c406c630 2024-04-26T23:46:14.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.417+0000 7f74bbe00640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f74a00683b0 0x7f74a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.417+0000 7f74bbe00640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f74a00683b0 0x7f74a006a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0af000 tx=0x7f74ac0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.421+0000 7f74bb400640 1 -- 172.21.15.47:0/2446521272 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f74c41560d0 con 0x7f74c406c630 2024-04-26T23:46:14.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.601+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f74c4076810 con 0x7f74c406c630 2024-04-26T23:46:14.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.601+0000 7f74bb400640 1 -- 172.21.15.47:0/2446521272 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f74b4056e00 con 0x7f74c406c630 2024-04-26T23:46:14.609 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:14.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f74a00683b0 msgr2=0x7f74a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f74a00683b0 0x7f74a006a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0af000 tx=0x7f74ac0a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c406c630 msgr2=0x7f74c41507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c406c630 0x7f74c41507c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f74b400e870 tx=0x7f74b400ec70 comp rx=0 tx=0).stop 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 shutdown_connections 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f74a00683b0 0x7f74a006a870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f74c415d080 0x7f74c40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74c40ade00 0x7f74c41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 --2- 172.21.15.47:0/2446521272 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f74c406c630 0x7f74c41507c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 >> 172.21.15.47:0/2446521272 conn(0x7f74c40b2d40 msgr2=0x7f74c4072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 shutdown_connections 2024-04-26T23:46:14.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.605+0000 7f74ca000640 1 -- 172.21.15.47:0/2446521272 wait complete. 2024-04-26T23:46:14.630 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:14.630 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:14.639 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:14.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25aa600640 1 Processor -- start 2024-04-26T23:46:14.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25aa600640 1 -- start start 2024-04-26T23:46:14.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25aa600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25a413ff90 0x7f25a40cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25aa600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f25a4070cc0 0x7f25a40d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25aa600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a4140370 con 0x7f25a40cff80 2024-04-26T23:46:14.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25aa600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f25a40d0490 con 0x7f25a413ff90 2024-04-26T23:46:14.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25aa600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f25a40d0770 con 0x7f25a4070cc0 2024-04-26T23:46:14.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a9200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25a413ff90 0x7f25a40cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a9c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f25a40cff80 0x7f25a4072850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34568/0 (socket says 172.21.15.47:34568) 2024-04-26T23:46:14.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a9c00640 1 -- 172.21.15.47:0/1430735968 learned_addr learned my addr 172.21.15.47:0/1430735968 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:14.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a3e00640 1 --2- 172.21.15.47:0/1430735968 >> v2:172.21.15.203:3300/0 conn(0x7f25a4070cc0 0x7f25a40d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a9200640 1 -- 172.21.15.47:0/1430735968 >> v2:172.21.15.203:3300/0 conn(0x7f25a4070cc0 msgr2=0x7f25a40d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:14.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a9200640 1 --2- 172.21.15.47:0/1430735968 >> v2:172.21.15.203:3300/0 conn(0x7f25a4070cc0 0x7f25a40d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a9200640 1 -- 172.21.15.47:0/1430735968 >> v1:172.21.15.47:6789/0 conn(0x7f25a40cff80 legacy=0x7f25a4072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a3400640 1 -- 172.21.15.47:0/1430735968 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914275064 0 0) 0x7f259c0014a0 con 0x7f25a40cff80 2024-04-26T23:46:14.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.817+0000 7f25a9200640 1 -- 172.21.15.47:0/1430735968 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a40d0a50 con 0x7f25a413ff90 2024-04-26T23:46:14.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25a9200640 1 --2- 172.21.15.47:0/1430735968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a413ff90 0x7f25a40cfa40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25a4146c30 tx=0x7f259801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9dde2dfa59c49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25a3400640 1 -- 172.21.15.47:0/1430735968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25980b1070 con 0x7f25a413ff90 2024-04-26T23:46:14.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25a3400640 1 -- 172.21.15.47:0/1430735968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25980ac620 con 0x7f25a413ff90 2024-04-26T23:46:14.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25a3400640 1 -- 172.21.15.47:0/1430735968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25980ac9f0 con 0x7f25a413ff90 2024-04-26T23:46:14.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 -- 172.21.15.47:0/1430735968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a413ff90 msgr2=0x7f25a40cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 --2- 172.21.15.47:0/1430735968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a413ff90 0x7f25a40cfa40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f25a4146c30 tx=0x7f259801c3c0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 -- 172.21.15.47:0/1430735968 shutdown_connections 2024-04-26T23:46:14.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 --2- 172.21.15.47:0/1430735968 >> v2:172.21.15.203:3300/0 conn(0x7f25a4070cc0 0x7f25a40d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 --2- 172.21.15.47:0/1430735968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a413ff90 0x7f25a40cfa40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 -- 172.21.15.47:0/1430735968 >> 172.21.15.47:0/1430735968 conn(0x7f25a406c5d0 msgr2=0x7f25a406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:14.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 -- 172.21.15.47:0/1430735968 shutdown_connections 2024-04-26T23:46:14.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 -- 172.21.15.47:0/1430735968 wait complete. 2024-04-26T23:46:14.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 Processor -- start 2024-04-26T23:46:14.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.821+0000 7f25aa600640 1 -- start start 2024-04-26T23:46:14.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a4070cc0 0x7f25a4136e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a40cff80 0x7f25a41478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a413ff90 0x7f25a4147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f25a4169be0 con 0x7f25a40cff80 2024-04-26T23:46:14.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f25a40d1fa0 con 0x7f25a413ff90 2024-04-26T23:46:14.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f25a4169d60 con 0x7f25a4070cc0 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a40cff80 0x7f25a41478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a40cff80 0x7f25a41478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59224/0 (socket says 172.21.15.47:59224) 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 -- 172.21.15.47:0/3313633459 learned_addr learned my addr 172.21.15.47:0/3313633459 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a9c00640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a413ff90 0x7f25a4147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a9200640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a4070cc0 0x7f25a4136e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 -- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a4070cc0 msgr2=0x7f25a4136e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a4070cc0 0x7f25a4136e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 -- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a413ff90 msgr2=0x7f25a4147e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a413ff90 0x7f25a4147e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 -- 172.21.15.47:0/3313633459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a40b47e0 con 0x7f25a40cff80 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a3e00640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a40cff80 0x7f25a41478f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f259000d830 tx=0x7f259000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a0c00640 1 -- 172.21.15.47:0/3313633459 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590004020 con 0x7f25a40cff80 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a0c00640 1 -- 172.21.15.47:0/3313633459 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25900041c0 con 0x7f25a40cff80 2024-04-26T23:46:14.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25a0c00640 1 -- 172.21.15.47:0/3313633459 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25900043b0 con 0x7f25a40cff80 2024-04-26T23:46:14.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a40b4ac0 con 0x7f25a40cff80 2024-04-26T23:46:14.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a40b5080 con 0x7f25a40cff80 2024-04-26T23:46:14.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.825+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a4069b80 con 0x7f25a40cff80 2024-04-26T23:46:14.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.829+0000 7f25a0c00640 1 -- 172.21.15.47:0/3313633459 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f259001b020 con 0x7f25a40cff80 2024-04-26T23:46:14.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.829+0000 7f25a0c00640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2584068380 0x7f258406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:14.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.829+0000 7f25a0c00640 1 -- 172.21.15.47:0/3313633459 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f2590086a50 con 0x7f25a40cff80 2024-04-26T23:46:14.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.829+0000 7f25a9200640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2584068380 0x7f258406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:14.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.829+0000 7f25a9200640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2584068380 0x7f258406a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f25980ae000 tx=0x7f2598008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:14.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.833+0000 7f25a0c00640 1 -- 172.21.15.47:0/3313633459 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2590056f70 con 0x7f25a40cff80 2024-04-26T23:46:15.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.997+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25a4072d20 con 0x7f25a40cff80 2024-04-26T23:46:15.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:14.997+0000 7f25a0c00640 1 -- 172.21.15.47:0/3313633459 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16828 (secure 0 0 0) 0x7f2590056870 con 0x7f25a40cff80 2024-04-26T23:46:15.006 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:15.006 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:13.826625+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2584068380 msgr2=0x7f258406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2584068380 0x7f258406a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f25980ae000 tx=0x7f2598008040 comp rx=0 tx=0).stop 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a40cff80 msgr2=0x7f25a41478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a40cff80 0x7f25a41478f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f259000d830 tx=0x7f259000dcf0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 shutdown_connections 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2584068380 0x7f258406a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25a413ff90 0x7f25a4147e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a40cff80 0x7f25a41478f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 --2- 172.21.15.47:0/3313633459 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f25a4070cc0 0x7f25a4136e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 >> 172.21.15.47:0/3313633459 conn(0x7f25a406c5d0 msgr2=0x7f25a413e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 shutdown_connections 2024-04-26T23:46:15.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.001+0000 7f25aa600640 1 -- 172.21.15.47:0/3313633459 wait complete. 2024-04-26T23:46:15.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:15.027 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:15.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f8730600640 1 Processor -- start 2024-04-26T23:46:15.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f8730600640 1 -- start start 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f8730600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f87280d0390 0x7f87280af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f8730600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87281603e0 0x7f872806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f8730600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87280ae6a0 con 0x7f872806c630 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f8730600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f87280ae920 con 0x7f87281603e0 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f8730600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f87280aec00 con 0x7f87280d0390 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f872e600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87281603e0 0x7f872806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f872e600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f87281603e0 0x7f872806cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59236/0 (socket says 172.21.15.47:59236) 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f872e600640 1 -- 172.21.15.47:0/4240179378 learned_addr learned my addr 172.21.15.47:0/4240179378 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:15.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f872d200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f872806c630 0x7f872815fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34570/0 (socket says 172.21.15.47:34570) 2024-04-26T23:46:15.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.165+0000 7f872dc00640 1 --2- 172.21.15.47:0/4240179378 >> v2:172.21.15.203:3300/0 conn(0x7f87280d0390 0x7f87280af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f872e600640 1 -- 172.21.15.47:0/4240179378 >> v2:172.21.15.203:3300/0 conn(0x7f87280d0390 msgr2=0x7f87280af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:15.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f872e600640 1 --2- 172.21.15.47:0/4240179378 >> v2:172.21.15.203:3300/0 conn(0x7f87280d0390 0x7f87280af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f872e600640 1 -- 172.21.15.47:0/4240179378 >> v1:172.21.15.47:6789/0 conn(0x7f872806c630 legacy=0x7f872815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f872e600640 1 -- 172.21.15.47:0/4240179378 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87280aeee0 con 0x7f87281603e0 2024-04-26T23:46:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f872e600640 1 --2- 172.21.15.47:0/4240179378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87281603e0 0x7f872806cab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f87280742c0 tx=0x7f872001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffd790c7437cc2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8727e00640 1 -- 172.21.15.47:0/4240179378 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87200a5620 con 0x7f87281603e0 2024-04-26T23:46:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8727e00640 1 -- 172.21.15.47:0/4240179378 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87200a57c0 con 0x7f87281603e0 2024-04-26T23:46:15.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8727e00640 1 -- 172.21.15.47:0/4240179378 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87200a5b90 con 0x7f87281603e0 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 -- 172.21.15.47:0/4240179378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87281603e0 msgr2=0x7f872806cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 --2- 172.21.15.47:0/4240179378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87281603e0 0x7f872806cab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f87280742c0 tx=0x7f872001c960 comp rx=0 tx=0).stop 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 -- 172.21.15.47:0/4240179378 shutdown_connections 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 --2- 172.21.15.47:0/4240179378 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f87281603e0 0x7f872806cab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 --2- 172.21.15.47:0/4240179378 >> v2:172.21.15.203:3300/0 conn(0x7f87280d0390 0x7f87280af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 -- 172.21.15.47:0/4240179378 >> 172.21.15.47:0/4240179378 conn(0x7f87280b2b70 msgr2=0x7f87280b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 -- 172.21.15.47:0/4240179378 shutdown_connections 2024-04-26T23:46:15.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.169+0000 7f8730600640 1 -- 172.21.15.47:0/4240179378 wait complete. 2024-04-26T23:46:15.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 Processor -- start 2024-04-26T23:46:15.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 -- start start 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872806c630 0x7f87280b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87280d0390 0x7f8728149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87281603e0 0x7f8728155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f872806faf0 con 0x7f872806c630 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f872806f970 con 0x7f87281603e0 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f872806fc70 con 0x7f87280d0390 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872806c630 0x7f87280b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872806c630 0x7f87280b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59250/0 (socket says 172.21.15.47:59250) 2024-04-26T23:46:15.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 -- 172.21.15.47:0/2171453263 learned_addr learned my addr 172.21.15.47:0/2171453263 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 -- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87280d0390 msgr2=0x7f8728149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87280d0390 0x7f8728149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 -- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87281603e0 msgr2=0x7f8728155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87281603e0 0x7f8728155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 -- 172.21.15.47:0/2171453263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8728149970 con 0x7f872806c630 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f872dc00640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872806c630 0x7f87280b2000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d620 tx=0x7f871c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8725600640 1 -- 172.21.15.47:0/2171453263 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00b620 con 0x7f872806c630 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8725600640 1 -- 172.21.15.47:0/2171453263 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c019070 con 0x7f872806c630 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87280b1000 con 0x7f872806c630 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8725600640 1 -- 172.21.15.47:0/2171453263 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c00b9e0 con 0x7f872806c630 2024-04-26T23:46:15.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.173+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87280b15c0 con 0x7f872806c630 2024-04-26T23:46:15.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.177+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8728069700 con 0x7f872806c630 2024-04-26T23:46:15.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.177+0000 7f8725600640 1 -- 172.21.15.47:0/2171453263 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f871c00bb80 con 0x7f872806c630 2024-04-26T23:46:15.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.177+0000 7f8725600640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8708068380 0x7f870806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.177+0000 7f8725600640 1 -- 172.21.15.47:0/2171453263 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f871c086f90 con 0x7f872806c630 2024-04-26T23:46:15.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.177+0000 7f872d200640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8708068380 0x7f870806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.177+0000 7f872d200640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8708068380 0x7f870806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8714000f70 tx=0x7f8714007a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.181+0000 7f8725600640 1 -- 172.21.15.47:0/2171453263 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f871c057420 con 0x7f872806c630 2024-04-26T23:46:15.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f87280b0d40 con 0x7f872806c630 2024-04-26T23:46:15.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8725600640 1 -- 172.21.15.47:0/2171453263 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f871c056d20 con 0x7f872806c630 2024-04-26T23:46:15.359 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8708068380 msgr2=0x7f870806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8708068380 0x7f870806a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8714000f70 tx=0x7f8714007a10 comp rx=0 tx=0).stop 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872806c630 msgr2=0x7f87280b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872806c630 0x7f87280b2000 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f871c00d620 tx=0x7f871c00dae0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 shutdown_connections 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8708068380 0x7f870806a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f87281603e0 0x7f8728155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f87280d0390 0x7f8728149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 --2- 172.21.15.47:0/2171453263 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f872806c630 0x7f87280b2000 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 >> 172.21.15.47:0/2171453263 conn(0x7f87280b2b70 msgr2=0x7f87280af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 shutdown_connections 2024-04-26T23:46:15.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.353+0000 7f8730600640 1 -- 172.21.15.47:0/2171453263 wait complete. 2024-04-26T23:46:15.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe07000640 1 Processor -- start 2024-04-26T23:46:15.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe07000640 1 -- start start 2024-04-26T23:46:15.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe07000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efe00162ab0 0x7efe0009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe07000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe000b56f0 0x7efe0009bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe07000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe00071620 con 0x7efe000704d0 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe07000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efe00162e90 con 0x7efe000b56f0 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe07000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7efe000d2d40 con 0x7efe00162ab0 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdf7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe000b56f0 0x7efe0009bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdf7400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe000b56f0 0x7efe0009bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59258/0 (socket says 172.21.15.47:59258) 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdf7400640 1 -- 172.21.15.47:0/228353699 learned_addr learned my addr 172.21.15.47:0/228353699 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efe05000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efe000704d0 0x7efe000708e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34586/0 (socket says 172.21.15.47:34586) 2024-04-26T23:46:15.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdffe00640 1 --2- 172.21.15.47:0/228353699 >> v2:172.21.15.203:3300/0 conn(0x7efe00162ab0 0x7efe0009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdf7400640 1 -- 172.21.15.47:0/228353699 >> v2:172.21.15.203:3300/0 conn(0x7efe00162ab0 msgr2=0x7efe0009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdf7400640 1 --2- 172.21.15.47:0/228353699 >> v2:172.21.15.203:3300/0 conn(0x7efe00162ab0 0x7efe0009ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdf7400640 1 -- 172.21.15.47:0/228353699 >> v1:172.21.15.47:6789/0 conn(0x7efe000704d0 legacy=0x7efe000708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.517+0000 7efdf7400640 1 -- 172.21.15.47:0/228353699 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0006dfc0 con 0x7efe000b56f0 2024-04-26T23:46:15.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efdf7400640 1 --2- 172.21.15.47:0/228353699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000b56f0 0x7efe0009bfa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efe00074ac0 tx=0x7efde801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44ed693d69b3d75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efdff400640 1 -- 172.21.15.47:0/228353699 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde80a56d0 con 0x7efe000b56f0 2024-04-26T23:46:15.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efdff400640 1 -- 172.21.15.47:0/228353699 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde80a5870 con 0x7efe000b56f0 2024-04-26T23:46:15.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efdff400640 1 -- 172.21.15.47:0/228353699 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde80a5c40 con 0x7efe000b56f0 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 -- 172.21.15.47:0/228353699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000b56f0 msgr2=0x7efe0009bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 --2- 172.21.15.47:0/228353699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000b56f0 0x7efe0009bfa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efe00074ac0 tx=0x7efde801c960 comp rx=0 tx=0).stop 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 -- 172.21.15.47:0/228353699 shutdown_connections 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 --2- 172.21.15.47:0/228353699 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000b56f0 0x7efe0009bfa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 --2- 172.21.15.47:0/228353699 >> v2:172.21.15.203:3300/0 conn(0x7efe00162ab0 0x7efe0009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 -- 172.21.15.47:0/228353699 >> 172.21.15.47:0/228353699 conn(0x7efe000b4c00 msgr2=0x7efe000b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 -- 172.21.15.47:0/228353699 shutdown_connections 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.521+0000 7efe07000640 1 -- 172.21.15.47:0/228353699 wait complete. 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 Processor -- start 2024-04-26T23:46:15.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 -- start start 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000704d0 0x7efe00156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe000b56f0 0x7efe00150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe00162ab0 0x7efe00158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe000d24a0 con 0x7efe000704d0 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe000d2320 con 0x7efe00162ab0 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe000721b0 con 0x7efe000b56f0 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000704d0 0x7efe00156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000704d0 0x7efe00156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59264/0 (socket says 172.21.15.47:59264) 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 -- 172.21.15.47:0/1661488145 learned_addr learned my addr 172.21.15.47:0/1661488145 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdf7400640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe000b56f0 0x7efe00150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe05000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe00162ab0 0x7efe00158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 -- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe000b56f0 msgr2=0x7efe00150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe000b56f0 0x7efe00150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 -- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe00162ab0 msgr2=0x7efe00158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe00162ab0 0x7efe00158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 -- 172.21.15.47:0/1661488145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe00159460 con 0x7efe000704d0 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe05000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe00162ab0 0x7efe00158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdffe00640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000704d0 0x7efe00156220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efdf000d5f0 tx=0x7efdf000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdfcc00640 1 -- 172.21.15.47:0/1661488145 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00125f0 con 0x7efe000704d0 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdfcc00640 1 -- 172.21.15.47:0/1661488145 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf0019070 con 0x7efe000704d0 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efdfcc00640 1 -- 172.21.15.47:0/1661488145 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00129b0 con 0x7efe000704d0 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe00159740 con 0x7efe000704d0 2024-04-26T23:46:15.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe00159d00 con 0x7efe000704d0 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.525+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe00157c60 con 0x7efe000704d0 2024-04-26T23:46:15.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.529+0000 7efdfcc00640 1 -- 172.21.15.47:0/1661488145 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efdf0012b50 con 0x7efe000704d0 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.529+0000 7efdfcc00640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efddc068380 0x7efddc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.529+0000 7efdfcc00640 1 -- 172.21.15.47:0/1661488145 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7efdf0086e40 con 0x7efe000704d0 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.529+0000 7efdf7400640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efddc068380 0x7efddc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.529+0000 7efdf7400640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efddc068380 0x7efddc06a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efde80ae000 tx=0x7efde80a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.533+0000 7efdfcc00640 1 -- 172.21.15.47:0/1661488145 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efdf00572d0 con 0x7efe000704d0 2024-04-26T23:46:15.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efe00069700 con 0x7efe000704d0 2024-04-26T23:46:15.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efdfcc00640 1 -- 172.21.15.47:0/1661488145 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7efdf0056bd0 con 0x7efe000704d0 2024-04-26T23:46:15.703 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efddc068380 msgr2=0x7efddc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efddc068380 0x7efddc06a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efde80ae000 tx=0x7efde80a7070 comp rx=0 tx=0).stop 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000704d0 msgr2=0x7efe00156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000704d0 0x7efe00156220 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7efdf000d5f0 tx=0x7efdf000dab0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 shutdown_connections 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efddc068380 0x7efddc06a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe00162ab0 0x7efe00158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe000b56f0 0x7efe00150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 --2- 172.21.15.47:0/1661488145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe000704d0 0x7efe00156220 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 >> 172.21.15.47:0/1661488145 conn(0x7efe000b4c00 msgr2=0x7efe000708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 shutdown_connections 2024-04-26T23:46:15.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.697+0000 7efe07000640 1 -- 172.21.15.47:0/1661488145 wait complete. 2024-04-26T23:46:15.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:15.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.861+0000 7fcb4e200640 1 Processor -- start 2024-04-26T23:46:15.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.861+0000 7fcb4e200640 1 -- start start 2024-04-26T23:46:15.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb4e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb4815cee0 0x7fcb480b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb4e200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb480af250 con 0x7fcb4806cb10 2024-04-26T23:46:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb4e200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb480af510 con 0x7fcb480aeda0 2024-04-26T23:46:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb4e200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480af7f0 con 0x7fcb4815cee0 2024-04-26T23:46:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb4815cee0 0x7fcb480b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcb4806cb10 0x7fcb480b50f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34596/0 (socket says 172.21.15.47:34596) 2024-04-26T23:46:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb4815cee0 0x7fcb480b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59268/0 (socket says 172.21.15.47:59268) 2024-04-26T23:46:15.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47e00640 1 -- 172.21.15.47:0/1679737759 learned_addr learned my addr 172.21.15.47:0/1679737759 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47400640 1 -- 172.21.15.47:0/1679737759 >> v1:172.21.15.203:6789/0 conn(0x7fcb480aeda0 legacy=0x7fcb4806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47400640 1 -- 172.21.15.47:0/1679737759 >> v1:172.21.15.47:6789/0 conn(0x7fcb4806cb10 legacy=0x7fcb480b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47400640 1 -- 172.21.15.47:0/1679737759 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4815f9d0 con 0x7fcb4815cee0 2024-04-26T23:46:15.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb46a00640 1 -- 172.21.15.47:0/1679737759 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682194012 0 0) 0x7fcb480af250 con 0x7fcb4806cb10 2024-04-26T23:46:15.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb47400640 1 --2- 172.21.15.47:0/1679737759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4815cee0 0x7fcb480b1260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097c0 tx=0x7fcb3801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2522753b5e27073 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb46a00640 1 -- 172.21.15.47:0/1679737759 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380b2070 con 0x7fcb4815cee0 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb46a00640 1 -- 172.21.15.47:0/1679737759 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380a9070 con 0x7fcb4815cee0 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.865+0000 7fcb46a00640 1 -- 172.21.15.47:0/1679737759 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380ad880 con 0x7fcb4815cee0 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- 172.21.15.47:0/1679737759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4815cee0 msgr2=0x7fcb480b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 --2- 172.21.15.47:0/1679737759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4815cee0 0x7fcb480b1260 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097c0 tx=0x7fcb3801c3a0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- 172.21.15.47:0/1679737759 shutdown_connections 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 --2- 172.21.15.47:0/1679737759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4815cee0 0x7fcb480b1260 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- 172.21.15.47:0/1679737759 >> 172.21.15.47:0/1679737759 conn(0x7fcb480b4400 msgr2=0x7fcb480d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- 172.21.15.47:0/1679737759 shutdown_connections 2024-04-26T23:46:15.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- 172.21.15.47:0/1679737759 wait complete. 2024-04-26T23:46:15.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 Processor -- start 2024-04-26T23:46:15.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- start start 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4806cb10 0x7fcb48153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480aeda0 0x7fcb4814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4815cee0 0x7fcb481540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4816d570 con 0x7fcb4806cb10 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcb481605e0 con 0x7fcb480aeda0 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb4e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4816d6f0 con 0x7fcb4815cee0 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb47400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4806cb10 0x7fcb48153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb47400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4806cb10 0x7fcb48153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59276/0 (socket says 172.21.15.47:59276) 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb47400640 1 -- 172.21.15.47:0/2702131949 learned_addr learned my addr 172.21.15.47:0/2702131949 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:15.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb3ea00640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480aeda0 0x7fcb4814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.869+0000 7fcb47e00640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4815cee0 0x7fcb481540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb47400640 1 -- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4815cee0 msgr2=0x7fcb481540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb47400640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4815cee0 0x7fcb481540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb47400640 1 -- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480aeda0 msgr2=0x7fcb4814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb47400640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480aeda0 0x7fcb4814c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb47400640 1 -- 172.21.15.47:0/2702131949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb481565c0 con 0x7fcb4806cb10 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3ea00640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480aeda0 0x7fcb4814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb47e00640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4815cee0 0x7fcb481540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb47400640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4806cb10 0x7fcb48153ad0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcb38018fb0 tx=0x7fcb3801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3fe00640 1 -- 172.21.15.47:0/2702131949 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380b2050 con 0x7fcb4806cb10 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3fe00640 1 -- 172.21.15.47:0/2702131949 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380be070 con 0x7fcb4806cb10 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3fe00640 1 -- 172.21.15.47:0/2702131949 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380ade60 con 0x7fcb4806cb10 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb481507e0 con 0x7fcb4806cb10 2024-04-26T23:46:15.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb48150da0 con 0x7fcb4806cb10 2024-04-26T23:46:15.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb48069700 con 0x7fcb4806cb10 2024-04-26T23:46:15.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3fe00640 1 -- 172.21.15.47:0/2702131949 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb380ab070 con 0x7fcb4806cb10 2024-04-26T23:46:15.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3fe00640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb24068380 0x7fcb2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:15.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3fe00640 1 -- 172.21.15.47:0/2702131949 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fcb38121100 con 0x7fcb4806cb10 2024-04-26T23:46:15.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.873+0000 7fcb3ea00640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb24068380 0x7fcb2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:15.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.877+0000 7fcb3ea00640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb24068380 0x7fcb2406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb481fb9d0 tx=0x7fcb30009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:15.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:15.877+0000 7fcb3fe00640 1 -- 172.21.15.47:0/2702131949 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcb38016050 con 0x7fcb4806cb10 2024-04-26T23:46:16.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.041+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcb480d12e0 con 0x7fcb4806cb10 2024-04-26T23:46:16.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.041+0000 7fcb3fe00640 1 -- 172.21.15.47:0/2702131949 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fcb380f1740 con 0x7fcb4806cb10 2024-04-26T23:46:16.050 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb24068380 msgr2=0x7fcb2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb24068380 0x7fcb2406a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb481fb9d0 tx=0x7fcb30009040 comp rx=0 tx=0).stop 2024-04-26T23:46:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4806cb10 msgr2=0x7fcb48153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4806cb10 0x7fcb48153ad0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcb38018fb0 tx=0x7fcb3801abe0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 shutdown_connections 2024-04-26T23:46:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcb24068380 0x7fcb2406a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcb4815cee0 0x7fcb481540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcb480aeda0 0x7fcb4814c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 --2- 172.21.15.47:0/2702131949 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb4806cb10 0x7fcb48153ad0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 >> 172.21.15.47:0/2702131949 conn(0x7fcb480b4400 msgr2=0x7fcb4806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 shutdown_connections 2024-04-26T23:46:16.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.045+0000 7fcb4e200640 1 -- 172.21.15.47:0/2702131949 wait complete. 2024-04-26T23:46:16.071 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:16.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.205+0000 7fb8f3000640 1 Processor -- start 2024-04-26T23:46:16.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f3000640 1 -- start start 2024-04-26T23:46:16.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f3000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb8ec0b3420 0x7fb8ec06df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f3000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec0d15b0 con 0x7fb8ec0b3040 2024-04-26T23:46:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f3000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8ec0cd360 con 0x7fb8ec06e460 2024-04-26T23:46:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f3000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb8ec0cd600 con 0x7fb8ec0b3420 2024-04-26T23:46:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f1200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb8ec0b3420 0x7fb8ec06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f1c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb8ec0b3040 0x7fb8ec0d0ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34602/0 (socket says 172.21.15.47:34602) 2024-04-26T23:46:16.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f1c00640 1 -- 172.21.15.47:0/4169533896 learned_addr learned my addr 172.21.15.47:0/4169533896 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f1200640 1 -- 172.21.15.47:0/4169533896 >> v1:172.21.15.203:6789/0 conn(0x7fb8ec06e460 legacy=0x7fb8ec15ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f1200640 1 -- 172.21.15.47:0/4169533896 >> v1:172.21.15.47:6789/0 conn(0x7fb8ec0b3040 legacy=0x7fb8ec0d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8f1200640 1 -- 172.21.15.47:0/4169533896 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec0cd8e0 con 0x7fb8ec0b3420 2024-04-26T23:46:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.209+0000 7fb8ebe00640 1 -- 172.21.15.47:0/4169533896 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3597555573 0 0) 0x7fb8e0001120 con 0x7fb8ec0b3040 2024-04-26T23:46:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f1200640 1 --2- 172.21.15.47:0/4169533896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec06df20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80097c0 tx=0x7fb8d801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6237a00adb96b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8ebe00640 1 -- 172.21.15.47:0/4169533896 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80b5070 con 0x7fb8ec0b3420 2024-04-26T23:46:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8ebe00640 1 -- 172.21.15.47:0/4169533896 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d80a8950 con 0x7fb8ec0b3420 2024-04-26T23:46:16.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8ebe00640 1 -- 172.21.15.47:0/4169533896 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80a8d20 con 0x7fb8ec0b3420 2024-04-26T23:46:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 -- 172.21.15.47:0/4169533896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 msgr2=0x7fb8ec06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 --2- 172.21.15.47:0/4169533896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec06df20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80097c0 tx=0x7fb8d801ec50 comp rx=0 tx=0).stop 2024-04-26T23:46:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 -- 172.21.15.47:0/4169533896 shutdown_connections 2024-04-26T23:46:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 --2- 172.21.15.47:0/4169533896 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec06df20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 -- 172.21.15.47:0/4169533896 >> 172.21.15.47:0/4169533896 conn(0x7fb8ec09ba60 msgr2=0x7fb8ec09be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 -- 172.21.15.47:0/4169533896 shutdown_connections 2024-04-26T23:46:16.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 -- 172.21.15.47:0/4169533896 wait complete. 2024-04-26T23:46:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 Processor -- start 2024-04-26T23:46:16.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.213+0000 7fb8f3000640 1 -- start start 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8ec06e460 0x7fb8ec0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8ec0b3040 0x7fb8ec0cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0ce180 con 0x7fb8ec0b3420 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0cdea0 con 0x7fb8ec0b3040 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ec15f2c0 con 0x7fb8ec06e460 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec0c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59284/0 (socket says 172.21.15.47:59284) 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 -- 172.21.15.47:0/3962858062 learned_addr learned my addr 172.21.15.47:0/3962858062 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f1200640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8ec0b3040 0x7fb8ec0cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f1c00640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8ec06e460 0x7fb8ec0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 -- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8ec06e460 msgr2=0x7fb8ec0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8ec06e460 0x7fb8ec0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 -- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8ec0b3040 msgr2=0x7fb8ec0cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8ec0b3040 0x7fb8ec0cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 -- 172.21.15.47:0/3962858062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ec15fb00 con 0x7fb8ec0b3420 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f2600640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec0c6770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c780 tx=0x7fb8e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8e9600640 1 -- 172.21.15.47:0/3962858062 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4004b70 con 0x7fb8ec0b3420 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8e9600640 1 -- 172.21.15.47:0/3962858062 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e4004d10 con 0x7fb8ec0b3420 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8e9600640 1 -- 172.21.15.47:0/3962858062 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400aa90 con 0x7fb8ec0b3420 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ec0c71f0 con 0x7fb8ec0b3420 2024-04-26T23:46:16.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ec15fdc0 con 0x7fb8ec0b3420 2024-04-26T23:46:16.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ec069470 con 0x7fb8ec0b3420 2024-04-26T23:46:16.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.217+0000 7fb8e9600640 1 -- 172.21.15.47:0/3962858062 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8e400ac30 con 0x7fb8ec0b3420 2024-04-26T23:46:16.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.221+0000 7fb8e9600640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb8cc068380 0x7fb8cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.221+0000 7fb8e9600640 1 -- 172.21.15.47:0/3962858062 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fb8e4086ce0 con 0x7fb8ec0b3420 2024-04-26T23:46:16.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.221+0000 7fb8f1c00640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb8cc068380 0x7fb8cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.221+0000 7fb8f1c00640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb8cc068380 0x7fb8cc06a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0007fd0 tx=0x7fb8e0007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:16.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.225+0000 7fb8e9600640 1 -- 172.21.15.47:0/3962858062 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb8e4020070 con 0x7fb8ec0b3420 2024-04-26T23:46:16.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.401+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb8ec06e910 con 0x7fb8ec0b3420 2024-04-26T23:46:16.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.401+0000 7fb8e9600640 1 -- 172.21.15.47:0/3962858062 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fb8e4057200 con 0x7fb8ec0b3420 2024-04-26T23:46:16.408 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb8cc068380 msgr2=0x7fb8cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb8cc068380 0x7fb8cc06a840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0007fd0 tx=0x7fb8e0007980 comp rx=0 tx=0).stop 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 msgr2=0x7fb8ec0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec0c6770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400c780 tx=0x7fb8e400cc40 comp rx=0 tx=0).stop 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 shutdown_connections 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb8cc068380 0x7fb8cc06a840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8ec0b3420 0x7fb8ec0c6770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb8ec0b3040 0x7fb8ec0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 --2- 172.21.15.47:0/3962858062 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8ec06e460 0x7fb8ec0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 >> 172.21.15.47:0/3962858062 conn(0x7fb8ec09ba60 msgr2=0x7fb8ec0d1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 shutdown_connections 2024-04-26T23:46:16.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.405+0000 7fb8f3000640 1 -- 172.21.15.47:0/3962858062 wait complete. 2024-04-26T23:46:16.430 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-04-26T23:46:16.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:16.430 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-26T23:46:16.451 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:16.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:46:16.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:16.451 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-26T23:46:16.503 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:46:16.503 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:16.512 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:46:16.513 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:16.565 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:16.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.697+0000 7f7a93e00640 1 Processor -- start 2024-04-26T23:46:16.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.697+0000 7f7a93e00640 1 -- start start 2024-04-26T23:46:16.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.697+0000 7f7a93e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7a8c06f0a0 0x7f7a8c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.697+0000 7f7a93e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c09ba60 0x7f7a8c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.697+0000 7f7a93e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8c0d2340 con 0x7f7a8c0ce340 2024-04-26T23:46:16.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.697+0000 7f7a93e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8c0cd580 con 0x7f7a8c06f0a0 2024-04-26T23:46:16.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.697+0000 7f7a93e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c0cd860 con 0x7f7a8c09ba60 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c09ba60 0x7f7a8c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c09ba60 0x7f7a8c09bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:41048/0 (socket says 172.21.15.47:41048) 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 -- 172.21.15.47:0/2466958081 learned_addr learned my addr 172.21.15.47:0/2466958081 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a91e00640 1 --1- 172.21.15.47:0/2466958081 >> v1:172.21.15.203:6789/0 conn(0x7f7a8c0ce340 0x7f7a8c0ce7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:53576/0 (socket says 172.21.15.47:53576) 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a91400640 1 --2- 172.21.15.47:0/2466958081 >> v2:172.21.15.203:3300/0 conn(0x7f7a8c06f0a0 0x7f7a8c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a8be00640 1 -- 172.21.15.47:0/2466958081 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473804689 0 0) 0x7f7a8c0d2340 con 0x7f7a8c0ce340 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 -- 172.21.15.47:0/2466958081 >> v2:172.21.15.203:3300/0 conn(0x7f7a8c06f0a0 msgr2=0x7f7a8c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 --2- 172.21.15.47:0/2466958081 >> v2:172.21.15.203:3300/0 conn(0x7f7a8c06f0a0 0x7f7a8c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 -- 172.21.15.47:0/2466958081 >> v1:172.21.15.203:6789/0 conn(0x7f7a8c0ce340 legacy=0x7f7a8c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 -- 172.21.15.47:0/2466958081 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0cdb40 con 0x7f7a8c09ba60 2024-04-26T23:46:16.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a90a00640 1 --2- 172.21.15.47:0/2466958081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c09ba60 0x7f7a8c09bee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a780098a0 tx=0x7f7a7801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80cbd52609005ea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.701+0000 7f7a8be00640 1 -- 172.21.15.47:0/2466958081 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780b0070 con 0x7f7a8c09ba60 2024-04-26T23:46:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a8be00640 1 -- 172.21.15.47:0/2466958081 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a780ab600 con 0x7f7a8c09ba60 2024-04-26T23:46:16.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a8be00640 1 -- 172.21.15.47:0/2466958081 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780ab9d0 con 0x7f7a8c09ba60 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- 172.21.15.47:0/2466958081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c09ba60 msgr2=0x7f7a8c09bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2466958081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c09ba60 0x7f7a8c09bee0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a780098a0 tx=0x7f7a7801c540 comp rx=0 tx=0).stop 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- 172.21.15.47:0/2466958081 shutdown_connections 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2466958081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c09ba60 0x7f7a8c09bee0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2466958081 >> v2:172.21.15.203:3300/0 conn(0x7f7a8c06f0a0 0x7f7a8c0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- 172.21.15.47:0/2466958081 >> 172.21.15.47:0/2466958081 conn(0x7f7a8c0d2e90 msgr2=0x7f7a8c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- 172.21.15.47:0/2466958081 shutdown_connections 2024-04-26T23:46:16.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- 172.21.15.47:0/2466958081 wait complete. 2024-04-26T23:46:16.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 Processor -- start 2024-04-26T23:46:16.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- start start 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a8c06f0a0 0x7f7a8c15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c09ba60 0x7f7a8c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c0ce340 0x7f7a8c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0d2120 con 0x7f7a8c09ba60 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0d1fa0 con 0x7f7a8c06f0a0 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a93e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c06d510 con 0x7f7a8c0ce340 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c09ba60 0x7f7a8c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a90a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c09ba60 0x7f7a8c0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59294/0 (socket says 172.21.15.47:59294) 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a90a00640 1 -- 172.21.15.47:0/2318407581 learned_addr learned my addr 172.21.15.47:0/2318407581 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:16.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a91400640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a8c06f0a0 0x7f7a8c15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.705+0000 7f7a91e00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c0ce340 0x7f7a8c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a90a00640 1 -- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c0ce340 msgr2=0x7f7a8c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a90a00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c0ce340 0x7f7a8c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a90a00640 1 -- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a8c06f0a0 msgr2=0x7f7a8c15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a90a00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a8c06f0a0 0x7f7a8c15fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a90a00640 1 -- 172.21.15.47:0/2318407581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c0b5cf0 con 0x7f7a8c09ba60 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a90a00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c09ba60 0x7f7a8c0b3d20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7a7801abf0 tx=0x7f7a7801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a89600640 1 -- 172.21.15.47:0/2318407581 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780b0040 con 0x7f7a8c09ba60 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a89600640 1 -- 172.21.15.47:0/2318407581 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78004020 con 0x7f7a8c09ba60 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a89600640 1 -- 172.21.15.47:0/2318407581 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780043d0 con 0x7f7a8c09ba60 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c0b5fd0 con 0x7f7a8c09ba60 2024-04-26T23:46:16.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c0b6590 con 0x7f7a8c09ba60 2024-04-26T23:46:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8c069700 con 0x7f7a8c09ba60 2024-04-26T23:46:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a89600640 1 -- 172.21.15.47:0/2318407581 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a78003620 con 0x7f7a8c09ba60 2024-04-26T23:46:16.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a89600640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7a6c0683b0 0x7f7a6c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:16.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a89600640 1 -- 172.21.15.47:0/2318407581 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f7a78120120 con 0x7f7a8c09ba60 2024-04-26T23:46:16.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.709+0000 7f7a91400640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7a6c0683b0 0x7f7a6c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:16.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.713+0000 7f7a91400640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7a6c0683b0 0x7f7a6c06a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cd550 tx=0x7f7a80009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:16.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.713+0000 7f7a89600640 1 -- 172.21.15.47:0/2318407581 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7a780b8030 con 0x7f7a8c09ba60 2024-04-26T23:46:16.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.881+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a8c0ce9a0 con 0x7f7a8c09ba60 2024-04-26T23:46:16.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.881+0000 7f7a89600640 1 -- 172.21.15.47:0/2318407581 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16828 (secure 0 0 0) 0x7f7a78016130 con 0x7f7a8c09ba60 2024-04-26T23:46:16.888 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:16.888 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:13.826625+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:16.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.881+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7a6c0683b0 msgr2=0x7f7a6c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.881+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7a6c0683b0 0x7f7a6c06a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c0cd550 tx=0x7f7a80009190 comp rx=0 tx=0).stop 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.881+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c09ba60 msgr2=0x7f7a8c0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.881+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c09ba60 0x7f7a8c0b3d20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7a7801abf0 tx=0x7f7a7801ad80 comp rx=0 tx=0).stop 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.881+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 shutdown_connections 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.885+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7a6c0683b0 0x7f7a6c06a870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.885+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7a8c0ce340 0x7f7a8c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.885+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7a8c09ba60 0x7f7a8c0b3d20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.885+0000 7f7a93e00640 1 --2- 172.21.15.47:0/2318407581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a8c06f0a0 0x7f7a8c15fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.885+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 >> 172.21.15.47:0/2318407581 conn(0x7f7a8c0d2e90 msgr2=0x7f7a8c0aff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.885+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 shutdown_connections 2024-04-26T23:46:16.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:16.885+0000 7f7a93e00640 1 -- 172.21.15.47:0/2318407581 wait complete. 2024-04-26T23:46:16.911 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:16.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:17.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb899c00640 1 Processor -- start 2024-04-26T23:46:17.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb899c00640 1 -- start start 2024-04-26T23:46:17.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb899c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb894162ab0 0x7fb89409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb899c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb89409bfa0 0x7fb894070be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb899c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89409c3b0 con 0x7fb8940b56f0 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb899c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb894071620 con 0x7fb894162ab0 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb899c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb894162e90 con 0x7fb89409bfa0 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb894162ab0 0x7fb89409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb894162ab0 0x7fb89409ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59310/0 (socket says 172.21.15.47:59310) 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892a00640 1 -- 172.21.15.47:0/3636928508 learned_addr learned my addr 172.21.15.47:0/3636928508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb88a000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb8940b56f0 0x7fb8940704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34604/0 (socket says 172.21.15.47:34604) 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb893400640 1 --2- 172.21.15.47:0/3636928508 >> v2:172.21.15.203:3300/0 conn(0x7fb89409bfa0 0x7fb894070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892a00640 1 -- 172.21.15.47:0/3636928508 >> v2:172.21.15.203:3300/0 conn(0x7fb89409bfa0 msgr2=0x7fb894070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892a00640 1 --2- 172.21.15.47:0/3636928508 >> v2:172.21.15.203:3300/0 conn(0x7fb89409bfa0 0x7fb894070be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892a00640 1 -- 172.21.15.47:0/3636928508 >> v1:172.21.15.47:6789/0 conn(0x7fb8940b56f0 legacy=0x7fb8940704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892a00640 1 -- 172.21.15.47:0/3636928508 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8940d2d40 con 0x7fb894162ab0 2024-04-26T23:46:17.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.049+0000 7fb892000640 1 -- 172.21.15.47:0/3636928508 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520598956 0 0) 0x7fb87c0014a0 con 0x7fb8940b56f0 2024-04-26T23:46:17.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb892a00640 1 --2- 172.21.15.47:0/3636928508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb89409ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb8940d0ff0 tx=0x7fb88401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f033f96207cd3a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb892000640 1 -- 172.21.15.47:0/3636928508 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8840b2070 con 0x7fb894162ab0 2024-04-26T23:46:17.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb892000640 1 -- 172.21.15.47:0/3636928508 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8840ad680 con 0x7fb894162ab0 2024-04-26T23:46:17.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb892000640 1 -- 172.21.15.47:0/3636928508 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8840ada50 con 0x7fb894162ab0 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 -- 172.21.15.47:0/3636928508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 msgr2=0x7fb89409ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 --2- 172.21.15.47:0/3636928508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb89409ba60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb8940d0ff0 tx=0x7fb88401c490 comp rx=0 tx=0).stop 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 -- 172.21.15.47:0/3636928508 shutdown_connections 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 --2- 172.21.15.47:0/3636928508 >> v2:172.21.15.203:3300/0 conn(0x7fb89409bfa0 0x7fb894070be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 --2- 172.21.15.47:0/3636928508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb89409ba60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 -- 172.21.15.47:0/3636928508 >> 172.21.15.47:0/3636928508 conn(0x7fb8940b4c00 msgr2=0x7fb8940b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 -- 172.21.15.47:0/3636928508 shutdown_connections 2024-04-26T23:46:17.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 -- 172.21.15.47:0/3636928508 wait complete. 2024-04-26T23:46:17.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 Processor -- start 2024-04-26T23:46:17.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.053+0000 7fb899c00640 1 -- start start 2024-04-26T23:46:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb89409bfa0 0x7fb894155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8940b56f0 0x7fb8940c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb8940c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb8940d2320 con 0x7fb894162ab0 2024-04-26T23:46:17.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8940718e0 con 0x7fb89409bfa0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb8940d24a0 con 0x7fb8940b56f0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb8940c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb8940c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59322/0 (socket says 172.21.15.47:59322) 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 -- 172.21.15.47:0/2287542948 learned_addr learned my addr 172.21.15.47:0/2287542948 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb892a00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb89409bfa0 0x7fb894155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb88a000640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8940b56f0 0x7fb8940c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 -- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8940b56f0 msgr2=0x7fb8940c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8940b56f0 0x7fb8940c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 -- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb89409bfa0 msgr2=0x7fb894155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb89409bfa0 0x7fb894155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 -- 172.21.15.47:0/2287542948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8941f91b0 con 0x7fb894162ab0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb893400640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb8940c8720 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00d560 tx=0x7fb88c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb88b400640 1 -- 172.21.15.47:0/2287542948 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0125f0 con 0x7fb894162ab0 2024-04-26T23:46:17.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb88b400640 1 -- 172.21.15.47:0/2287542948 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88c019070 con 0x7fb894162ab0 2024-04-26T23:46:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb88b400640 1 -- 172.21.15.47:0/2287542948 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0129f0 con 0x7fb894162ab0 2024-04-26T23:46:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8940b5de0 con 0x7fb894162ab0 2024-04-26T23:46:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8940c9030 con 0x7fb894162ab0 2024-04-26T23:46:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.057+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8940c99d0 con 0x7fb894162ab0 2024-04-26T23:46:17.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.061+0000 7fb88b400640 1 -- 172.21.15.47:0/2287542948 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb88c012b90 con 0x7fb894162ab0 2024-04-26T23:46:17.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.061+0000 7fb88b400640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb870068380 0x7fb87006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.061+0000 7fb88b400640 1 -- 172.21.15.47:0/2287542948 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fb88c086e20 con 0x7fb894162ab0 2024-04-26T23:46:17.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.061+0000 7fb892a00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb870068380 0x7fb87006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.061+0000 7fb892a00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb870068380 0x7fb87006a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8840af000 tx=0x7fb8840a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.065+0000 7fb88b400640 1 -- 172.21.15.47:0/2287542948 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb8940c99d0 con 0x7fb894162ab0 2024-04-26T23:46:17.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.229+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb894069700 con 0x7fb894162ab0 2024-04-26T23:46:17.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.229+0000 7fb88b400640 1 -- 172.21.15.47:0/2287542948 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fb88c0572b0 con 0x7fb894162ab0 2024-04-26T23:46:17.236 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:17.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.229+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb870068380 msgr2=0x7fb87006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb870068380 0x7fb87006a840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8840af000 tx=0x7fb8840a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 msgr2=0x7fb8940c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb8940c8720 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00d560 tx=0x7fb88c00da20 comp rx=0 tx=0).stop 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 shutdown_connections 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb870068380 0x7fb87006a840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb894162ab0 0x7fb8940c8720 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb8940b56f0 0x7fb8940c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 --2- 172.21.15.47:0/2287542948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb89409bfa0 0x7fb894155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 >> 172.21.15.47:0/2287542948 conn(0x7fb8940b4c00 msgr2=0x7fb8940b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 shutdown_connections 2024-04-26T23:46:17.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.233+0000 7fb899c00640 1 -- 172.21.15.47:0/2287542948 wait complete. 2024-04-26T23:46:17.258 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:17.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.393+0000 7fa67fc00640 1 Processor -- start 2024-04-26T23:46:17.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.393+0000 7fa67fc00640 1 -- start start 2024-04-26T23:46:17.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67fc00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa67806c630 0x7fa67806cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67fc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6780ae030 con 0x7fa678160b50 2024-04-26T23:46:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67fc00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6780d0ae0 con 0x7fa67815cf50 2024-04-26T23:46:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67fc00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa6780af7a0 con 0x7fa67806c630 2024-04-26T23:46:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa678160b50 0x7fa678160fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34612/0 (socket says 172.21.15.47:34612) 2024-04-26T23:46:17.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 -- 172.21.15.47:0/616330558 learned_addr learned my addr 172.21.15.47:0/616330558 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677e00640 1 --2- 172.21.15.47:0/616330558 >> v2:172.21.15.203:3300/0 conn(0x7fa67806c630 0x7fa67806cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647846863 0 0) 0x7fa6780ae030 con 0x7fa678160b50 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa660003530 con 0x7fa678160b50 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1406445058 0 0) 0x7fa660003530 con 0x7fa678160b50 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 >> v2:172.21.15.203:3300/0 conn(0x7fa67806c630 msgr2=0x7fa67806cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 --2- 172.21.15.47:0/616330558 >> v2:172.21.15.203:3300/0 conn(0x7fa67806c630 0x7fa67806cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 >> v1:172.21.15.203:6789/0 conn(0x7fa67815cf50 legacy=0x7fa6780cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6780af9d0 con 0x7fa678160b50 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fa670001a00 con 0x7fa678160b50 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 >> v1:172.21.15.47:6789/0 conn(0x7fa678160b50 legacy=0x7fa678160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600039c0 0x7fa660003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa660004810 0x7fa660004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6600051d0 0x7fa66000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa66000c040 con 0x7fa6600051d0 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa66000c1f0 con 0x7fa6600039c0 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa66000c3f0 con 0x7fa660004810 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6600051d0 0x7fa66000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67d200640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600039c0 0x7fa660003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa677e00640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa660004810 0x7fa660004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 -- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa660004810 msgr2=0x7fa660004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa660004810 0x7fa660004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 -- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600039c0 msgr2=0x7fa660003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600039c0 0x7fa660003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.397+0000 7fa67dc00640 1 -- 172.21.15.47:0/616330558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa660003530 con 0x7fa6600051d0 2024-04-26T23:46:17.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67dc00640 1 -- 172.21.15.47:0/616330558 reap_dead start 2024-04-26T23:46:17.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67dc00640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6600051d0 0x7fa66000b9d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa67000a850 tx=0x7fa67001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76e0133f06d5216 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67000a4a0 con 0x7fa6600051d0 2024-04-26T23:46:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6700ad650 con 0x7fa6600051d0 2024-04-26T23:46:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa677400640 1 -- 172.21.15.47:0/616330558 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6700ada40 con 0x7fa6600051d0 2024-04-26T23:46:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 -- 172.21.15.47:0/616330558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6600051d0 msgr2=0x7fa66000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6600051d0 0x7fa66000b9d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa67000a850 tx=0x7fa67001d3a0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 -- 172.21.15.47:0/616330558 shutdown_connections 2024-04-26T23:46:17.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 --2- 172.21.15.47:0/616330558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6600051d0 0x7fa66000b9d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 -- 172.21.15.47:0/616330558 >> 172.21.15.47:0/616330558 conn(0x7fa6780b2b70 msgr2=0x7fa6780b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:17.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 -- 172.21.15.47:0/616330558 shutdown_connections 2024-04-26T23:46:17.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 -- 172.21.15.47:0/616330558 wait complete. 2024-04-26T23:46:17.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 Processor -- start 2024-04-26T23:46:17.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.401+0000 7fa67fc00640 1 -- start start 2024-04-26T23:46:17.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600051d0 0x7fa6781593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6781598f0 0x7fa67815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa67815b850 0x7fa678157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa6780b0230 con 0x7fa67815b850 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6780aff50 con 0x7fa6600051d0 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa67815d330 con 0x7fa6781598f0 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa67815b850 0x7fa678157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa67815b850 0x7fa678157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59338/0 (socket says 172.21.15.47:59338) 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 -- 172.21.15.47:0/3268802503 learned_addr learned my addr 172.21.15.47:0/3268802503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa677e00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6781598f0 0x7fa67815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67d200640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600051d0 0x7fa6781593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 -- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6781598f0 msgr2=0x7fa67815b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6781598f0 0x7fa67815b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 -- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600051d0 msgr2=0x7fa6781593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600051d0 0x7fa6781593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 -- 172.21.15.47:0/3268802503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67815bea0 con 0x7fa67815b850 2024-04-26T23:46:17.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67dc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa67815b850 0x7fa678157e60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa67001dc40 tx=0x7fa660005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa674c00640 1 -- 172.21.15.47:0/3268802503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6700019c0 con 0x7fa67815b850 2024-04-26T23:46:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa674c00640 1 -- 172.21.15.47:0/3268802503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6700b4070 con 0x7fa67815b850 2024-04-26T23:46:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa67815c180 con 0x7fa67815b850 2024-04-26T23:46:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa674c00640 1 -- 172.21.15.47:0/3268802503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6700ada00 con 0x7fa67815b850 2024-04-26T23:46:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6781583a0 con 0x7fa67815b850 2024-04-26T23:46:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.405+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa678069700 con 0x7fa67815b850 2024-04-26T23:46:17.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.409+0000 7fa674c00640 1 -- 172.21.15.47:0/3268802503 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6700b6070 con 0x7fa67815b850 2024-04-26T23:46:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.409+0000 7fa674c00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa658068380 0x7fa65806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.409+0000 7fa674c00640 1 -- 172.21.15.47:0/3268802503 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fa6701207f0 con 0x7fa67815b850 2024-04-26T23:46:17.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.409+0000 7fa67d200640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa658068380 0x7fa65806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.409+0000 7fa67d200640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa658068380 0x7fa65806a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa66c000c10 tx=0x7fa66c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.413+0000 7fa674c00640 1 -- 172.21.15.47:0/3268802503 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa6700170b0 con 0x7fa67815b850 2024-04-26T23:46:17.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa678073d50 con 0x7fa67815b850 2024-04-26T23:46:17.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa674c00640 1 -- 172.21.15.47:0/3268802503 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fa6700f0780 con 0x7fa67815b850 2024-04-26T23:46:17.584 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa658068380 msgr2=0x7fa65806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa658068380 0x7fa65806a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa66c000c10 tx=0x7fa66c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa67815b850 msgr2=0x7fa678157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa67815b850 0x7fa678157e60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa67001dc40 tx=0x7fa660005840 comp rx=0 tx=0).stop 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 shutdown_connections 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa658068380 0x7fa65806a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa67815b850 0x7fa678157e60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa6781598f0 0x7fa67815b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 --2- 172.21.15.47:0/3268802503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6600051d0 0x7fa6781593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 >> 172.21.15.47:0/3268802503 conn(0x7fa6780b2b70 msgr2=0x7fa6780b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:17.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 shutdown_connections 2024-04-26T23:46:17.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.577+0000 7fa67fc00640 1 -- 172.21.15.47:0/3268802503 wait complete. 2024-04-26T23:46:17.604 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9b2600640 1 Processor -- start 2024-04-26T23:46:17.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9b2600640 1 -- start start 2024-04-26T23:46:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9b2600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9b2600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ac0ae6a0 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9b2600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ac0ae920 con 0x7fe9ac0d0390 2024-04-26T23:46:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9b2600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac0aec00 con 0x7fe9ac06cd40 2024-04-26T23:46:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9abe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe9ac15fcd0 0x7fe9ac160180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34620/0 (socket says 172.21.15.47:34620) 2024-04-26T23:46:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9abe00640 1 -- 172.21.15.47:0/3246132745 learned_addr learned my addr 172.21.15.47:0/3246132745 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9a2a00640 1 --2- 172.21.15.47:0/3246132745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9aaa00640 1 -- 172.21.15.47:0/3246132745 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653551375 0 0) 0x7fe9a40014a0 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9aaa00640 1 -- 172.21.15.47:0/3246132745 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe990003530 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9aaa00640 1 -- 172.21.15.47:0/3246132745 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3531967772 0 0) 0x7fe9ac0ae920 con 0x7fe9ac0d0390 2024-04-26T23:46:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9aaa00640 1 -- 172.21.15.47:0/3246132745 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9a40014a0 con 0x7fe9ac0d0390 2024-04-26T23:46:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9a2a00640 1 -- 172.21.15.47:0/3246132745 >> v1:172.21.15.203:6789/0 conn(0x7fe9ac0d0390 legacy=0x7fe9ac06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9a2a00640 1 -- 172.21.15.47:0/3246132745 >> v1:172.21.15.47:6789/0 conn(0x7fe9ac15fcd0 legacy=0x7fe9ac160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.741+0000 7fe9a2a00640 1 -- 172.21.15.47:0/3246132745 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac0aeee0 con 0x7fe9ac06cd40 2024-04-26T23:46:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9a2a00640 1 --2- 172.21.15.47:0/3246132745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac0af6e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9940097f0 tx=0x7fe99401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbfe06d074ee0b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9aaa00640 1 -- 172.21.15.47:0/3246132745 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9940b1070 con 0x7fe9ac06cd40 2024-04-26T23:46:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9aaa00640 1 -- 172.21.15.47:0/3246132745 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9940ac410 con 0x7fe9ac06cd40 2024-04-26T23:46:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9aaa00640 1 -- 172.21.15.47:0/3246132745 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9940ac7e0 con 0x7fe9ac06cd40 2024-04-26T23:46:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9b2600640 1 -- 172.21.15.47:0/3246132745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 msgr2=0x7fe9ac0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9b2600640 1 --2- 172.21.15.47:0/3246132745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac0af6e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe9940097f0 tx=0x7fe99401c420 comp rx=0 tx=0).stop 2024-04-26T23:46:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9b2600640 1 -- 172.21.15.47:0/3246132745 shutdown_connections 2024-04-26T23:46:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9b2600640 1 --2- 172.21.15.47:0/3246132745 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac0af6e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9b2600640 1 -- 172.21.15.47:0/3246132745 >> 172.21.15.47:0/3246132745 conn(0x7fe9ac0b2b70 msgr2=0x7fe9ac0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.745+0000 7fe9b2600640 1 -- 172.21.15.47:0/3246132745 shutdown_connections 2024-04-26T23:46:17.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 -- 172.21.15.47:0/3246132745 wait complete. 2024-04-26T23:46:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 Processor -- start 2024-04-26T23:46:17.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 -- start start 2024-04-26T23:46:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9ac0d0390 0x7fe9ac147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac15fcd0 0x7fe9ac1481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac06fa70 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac06f8f0 con 0x7fe9ac0d0390 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ac06fbf0 con 0x7fe9ac06cd40 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac15fcd0 0x7fe9ac1481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac15fcd0 0x7fe9ac1481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59340/0 (socket says 172.21.15.47:59340) 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 -- 172.21.15.47:0/61563018 learned_addr learned my addr 172.21.15.47:0/61563018 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9a2a00640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9ac0d0390 0x7fe9ac147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9ab400640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 -- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 msgr2=0x7fe9ac158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 -- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9ac0d0390 msgr2=0x7fe9ac147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9ac0d0390 0x7fe9ac147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 -- 172.21.15.47:0/61563018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac15e840 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9a2a00640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9ac0d0390 0x7fe9ac147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9abe00640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac15fcd0 0x7fe9ac1481d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4001fd0 tx=0x7fe9a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9a3e00640 1 -- 172.21.15.47:0/61563018 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4017070 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9a3e00640 1 -- 172.21.15.47:0/61563018 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a4012400 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9a3e00640 1 -- 172.21.15.47:0/61563018 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a40127b0 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac15eb20 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.749+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac1498b0 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.753+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac069700 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.753+0000 7fe9a3e00640 1 -- 172.21.15.47:0/61563018 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9a401a070 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.753+0000 7fe9a3e00640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe988068380 0x7fe98806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.753+0000 7fe9a3e00640 1 -- 172.21.15.47:0/61563018 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fe9a40869f0 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.753+0000 7fe9ab400640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe988068380 0x7fe98806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:17.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.753+0000 7fe9ab400640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe988068380 0x7fe98806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac09efe0 tx=0x7fe99c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:17.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.757+0000 7fe9a3e00640 1 -- 172.21.15.47:0/61563018 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe9ac0ae6a0 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe9ac0b3340 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9a3e00640 1 -- 172.21.15.47:0/61563018 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fe9a4056830 con 0x7fe9ac15fcd0 2024-04-26T23:46:17.932 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe988068380 msgr2=0x7fe98806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe988068380 0x7fe98806a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac09efe0 tx=0x7fe99c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac15fcd0 msgr2=0x7fe9ac1481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac15fcd0 0x7fe9ac1481d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4001fd0 tx=0x7fe9a400a430 comp rx=0 tx=0).stop 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 shutdown_connections 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe988068380 0x7fe98806a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9ac15fcd0 0x7fe9ac1481d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe9ac0d0390 0x7fe9ac147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 --2- 172.21.15.47:0/61563018 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9ac06cd40 0x7fe9ac158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:17.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 >> 172.21.15.47:0/61563018 conn(0x7fe9ac0b2b70 msgr2=0x7fe9ac0b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:17.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 shutdown_connections 2024-04-26T23:46:17.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:17.925+0000 7fe9b2600640 1 -- 172.21.15.47:0/61563018 wait complete. 2024-04-26T23:46:17.953 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:18.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.085+0000 7f8495a00640 1 Processor -- start 2024-04-26T23:46:18.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.085+0000 7f8495a00640 1 -- start start 2024-04-26T23:46:18.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f8495a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8490160780 0x7f849009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f8495a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84900cf530 0x7f849009bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f8495a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8490160b60 con 0x7f84900d1b30 2024-04-26T23:46:18.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f8495a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8490071bc0 con 0x7f84900cf530 2024-04-26T23:46:18.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f8495a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8490072540 con 0x7f8490160780 2024-04-26T23:46:18.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848f400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84900cf530 0x7f849009bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f8486000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f84900d1b30 0x7f84900704d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34628/0 (socket says 172.21.15.47:34628) 2024-04-26T23:46:18.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f8486000640 1 -- 172.21.15.47:0/997209259 learned_addr learned my addr 172.21.15.47:0/997209259 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:18.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848ea00640 1 --2- 172.21.15.47:0/997209259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8490160780 0x7f849009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848f400640 1 -- 172.21.15.47:0/997209259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8490160780 msgr2=0x7f849009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:18.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848f400640 1 --2- 172.21.15.47:0/997209259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8490160780 0x7f849009ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848f400640 1 -- 172.21.15.47:0/997209259 >> v1:172.21.15.47:6789/0 conn(0x7f84900d1b30 legacy=0x7f84900704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848f400640 1 -- 172.21.15.47:0/997209259 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8490072260 con 0x7f84900cf530 2024-04-26T23:46:18.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848ea00640 1 --2- 172.21.15.47:0/997209259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8490160780 0x7f849009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:18.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.089+0000 7f848e000640 1 -- 172.21.15.47:0/997209259 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877389993 0 0) 0x7f8490160b60 con 0x7f84900d1b30 2024-04-26T23:46:18.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f848f400640 1 --2- 172.21.15.47:0/997209259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84900cf530 0x7f849009bfa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f84880097c0 tx=0x7f848801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8acc9492d280ac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f848e000640 1 -- 172.21.15.47:0/997209259 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84880b5070 con 0x7f84900cf530 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f848e000640 1 -- 172.21.15.47:0/997209259 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84880a8990 con 0x7f84900cf530 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f848e000640 1 -- 172.21.15.47:0/997209259 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84880a8d60 con 0x7f84900cf530 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 -- 172.21.15.47:0/997209259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84900cf530 msgr2=0x7f849009bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 --2- 172.21.15.47:0/997209259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84900cf530 0x7f849009bfa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f84880097c0 tx=0x7f848801ec90 comp rx=0 tx=0).stop 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 -- 172.21.15.47:0/997209259 shutdown_connections 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 --2- 172.21.15.47:0/997209259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84900cf530 0x7f849009bfa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 --2- 172.21.15.47:0/997209259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8490160780 0x7f849009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 -- 172.21.15.47:0/997209259 >> 172.21.15.47:0/997209259 conn(0x7f84900b4b80 msgr2=0x7f84900b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 -- 172.21.15.47:0/997209259 shutdown_connections 2024-04-26T23:46:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 -- 172.21.15.47:0/997209259 wait complete. 2024-04-26T23:46:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 Processor -- start 2024-04-26T23:46:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.093+0000 7f8495a00640 1 -- start start 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84900cf530 0x7f84900b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84900d1b30 0x7f8490155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8490160780 0x7f84900b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f84900cdd20 con 0x7f8490160780 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84900ce090 con 0x7f84900cf530 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8490071e80 con 0x7f84900d1b30 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8490160780 0x7f84900b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8490160780 0x7f84900b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59360/0 (socket says 172.21.15.47:59360) 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 -- 172.21.15.47:0/2000068981 learned_addr learned my addr 172.21.15.47:0/2000068981 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8486000640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84900d1b30 0x7f8490155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 -- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84900d1b30 msgr2=0x7f8490155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848ea00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84900cf530 0x7f84900b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84900d1b30 0x7f8490155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 -- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84900cf530 msgr2=0x7f84900b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84900cf530 0x7f84900b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 -- 172.21.15.47:0/2000068981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84900b6710 con 0x7f8490160780 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8486000640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84900d1b30 0x7f8490155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848ea00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84900cf530 0x7f84900b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f848f400640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8490160780 0x7f84900b5ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f84880b3040 tx=0x7f848801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8487400640 1 -- 172.21.15.47:0/2000068981 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84880c0070 con 0x7f8490160780 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8487400640 1 -- 172.21.15.47:0/2000068981 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8488004230 con 0x7f8490160780 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84900b69f0 con 0x7f8490160780 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8487400640 1 -- 172.21.15.47:0/2000068981 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84880b5040 con 0x7f8490160780 2024-04-26T23:46:18.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84900b6fb0 con 0x7f8490160780 2024-04-26T23:46:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84900695f0 con 0x7f8490160780 2024-04-26T23:46:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.097+0000 7f8487400640 1 -- 172.21.15.47:0/2000068981 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f84880c3070 con 0x7f8490160780 2024-04-26T23:46:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.101+0000 7f8487400640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f846c068380 0x7f846c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.101+0000 7f8487400640 1 -- 172.21.15.47:0/2000068981 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f84881232e0 con 0x7f8490160780 2024-04-26T23:46:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.101+0000 7f848ea00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f846c068380 0x7f846c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.101+0000 7f848ea00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f846c068380 0x7f846c06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f849015cd00 tx=0x7f8480007550 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.105+0000 7f8487400640 1 -- 172.21.15.47:0/2000068981 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f84880187f0 con 0x7f8490160780 2024-04-26T23:46:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.281+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f849015fe30 con 0x7f8490160780 2024-04-26T23:46:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.281+0000 7f8487400640 1 -- 172.21.15.47:0/2000068981 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f84880f3800 con 0x7f8490160780 2024-04-26T23:46:18.289 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:18.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f846c068380 msgr2=0x7f846c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f846c068380 0x7f846c06a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f849015cd00 tx=0x7f8480007550 comp rx=0 tx=0).stop 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8490160780 msgr2=0x7f84900b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8490160780 0x7f84900b5ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f84880b3040 tx=0x7f848801ba30 comp rx=0 tx=0).stop 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 shutdown_connections 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f846c068380 0x7f846c06a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8490160780 0x7f84900b5ee0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f84900d1b30 0x7f8490155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 --2- 172.21.15.47:0/2000068981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f84900cf530 0x7f84900b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 >> 172.21.15.47:0/2000068981 conn(0x7f84900b4b80 msgr2=0x7f84900cfb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 shutdown_connections 2024-04-26T23:46:18.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.285+0000 7f8495a00640 1 -- 172.21.15.47:0/2000068981 wait complete. 2024-04-26T23:46:18.311 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:46:18.311 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:18.321 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:18.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.453+0000 7fae72c00640 1 Processor -- start 2024-04-26T23:46:18.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.453+0000 7fae72c00640 1 -- start start 2024-04-26T23:46:18.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae72c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fae6c0d0fb0 0x7fae6c070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae72c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c0d2340 con 0x7fae6c06f0a0 2024-04-26T23:46:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae72c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c0cd580 con 0x7fae6c09c170 2024-04-26T23:46:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae72c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fae6c0cf350 con 0x7fae6c0d0fb0 2024-04-26T23:46:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fae6c06f0a0 0x7fae6c09ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34632/0 (socket says 172.21.15.47:34632) 2024-04-26T23:46:18.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6be00640 1 -- 172.21.15.47:0/1529900054 learned_addr learned my addr 172.21.15.47:0/1529900054 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae70c00640 1 --2- 172.21.15.47:0/1529900054 >> v2:172.21.15.203:3300/0 conn(0x7fae6c0d0fb0 0x7fae6c070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879507722 0 0) 0x7fae6c0d2340 con 0x7fae6c06f0a0 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae50003530 con 0x7fae6c06f0a0 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3883740499 0 0) 0x7fae6c0cd580 con 0x7fae6c09c170 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae6c0d2340 con 0x7fae6c09c170 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 303324215 0 0) 0x7fae50003530 con 0x7fae6c06f0a0 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 >> v2:172.21.15.203:3300/0 conn(0x7fae6c0d0fb0 msgr2=0x7fae6c070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 --2- 172.21.15.47:0/1529900054 >> v2:172.21.15.203:3300/0 conn(0x7fae6c0d0fb0 0x7fae6c070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 >> v1:172.21.15.203:6789/0 conn(0x7fae6c09c170 legacy=0x7fae6c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c0cd860 con 0x7fae6c06f0a0 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fae5c001680 con 0x7fae6c06f0a0 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 >> v1:172.21.15.47:6789/0 conn(0x7fae6c06f0a0 legacy=0x7fae6c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae50003b50 0x7fae50003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae50004810 0x7fae50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae500051d0 0x7fae5000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0cf350 con 0x7fae50004810 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae5000c050 con 0x7fae500051d0 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fae5000c250 con 0x7fae50003b50 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae63400640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae50004810 0x7fae50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae6be00640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae50003b50 0x7fae50003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae70c00640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae500051d0 0x7fae5000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae63400640 1 -- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae50003b50 msgr2=0x7fae50003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae63400640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae50003b50 0x7fae50003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae63400640 1 -- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae500051d0 msgr2=0x7fae5000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:18.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae63400640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae500051d0 0x7fae5000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae63400640 1 -- 172.21.15.47:0/1529900054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae50003530 con 0x7fae50004810 2024-04-26T23:46:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.457+0000 7fae70c00640 1 -- 172.21.15.47:0/1529900054 reap_dead start 2024-04-26T23:46:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae63400640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae50004810 0x7fae50004c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae540018d0 tx=0x7fae5401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33aaacf3461080d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54001520 con 0x7fae50004810 2024-04-26T23:46:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae540052f0 con 0x7fae50004810 2024-04-26T23:46:18.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae6b400640 1 -- 172.21.15.47:0/1529900054 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae540a88f0 con 0x7fae50004810 2024-04-26T23:46:18.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 -- 172.21.15.47:0/1529900054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae50004810 msgr2=0x7fae50004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae50004810 0x7fae50004c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fae540018d0 tx=0x7fae5401ec90 comp rx=0 tx=0).stop 2024-04-26T23:46:18.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 -- 172.21.15.47:0/1529900054 shutdown_connections 2024-04-26T23:46:18.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 --2- 172.21.15.47:0/1529900054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae50004810 0x7fae50004c90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 -- 172.21.15.47:0/1529900054 >> 172.21.15.47:0/1529900054 conn(0x7fae6c0d2e90 msgr2=0x7fae6c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 -- 172.21.15.47:0/1529900054 shutdown_connections 2024-04-26T23:46:18.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 -- 172.21.15.47:0/1529900054 wait complete. 2024-04-26T23:46:18.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 Processor -- start 2024-04-26T23:46:18.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.461+0000 7fae72c00640 1 -- start start 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae50004810 0x7fae6c1e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae6c0c7e90 0x7fae6c155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae6c156000 0x7fae6c153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c06f480 con 0x7fae6c0c7e90 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c0cde20 con 0x7fae50004810 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c0d1fa0 con 0x7fae6c156000 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae6c0c7e90 0x7fae6c155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae6c0c7e90 0x7fae6c155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59388/0 (socket says 172.21.15.47:59388) 2024-04-26T23:46:18.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 -- 172.21.15.47:0/2058655441 learned_addr learned my addr 172.21.15.47:0/2058655441 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae6be00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae50004810 0x7fae6c1e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae70c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae6c156000 0x7fae6c153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 -- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae6c156000 msgr2=0x7fae6c153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae6c156000 0x7fae6c153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 -- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae50004810 msgr2=0x7fae6c1e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae50004810 0x7fae6c1e5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 -- 172.21.15.47:0/2058655441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c1e4b90 con 0x7fae6c0c7e90 2024-04-26T23:46:18.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae63400640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae6c0c7e90 0x7fae6c155ac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fae5401eac0 tx=0x7fae50005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae68c00640 1 -- 172.21.15.47:0/2058655441 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae540054a0 con 0x7fae6c0c7e90 2024-04-26T23:46:18.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae68c00640 1 -- 172.21.15.47:0/2058655441 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae540050d0 con 0x7fae6c0c7e90 2024-04-26T23:46:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae68c00640 1 -- 172.21.15.47:0/2058655441 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae540a8c30 con 0x7fae6c0c7e90 2024-04-26T23:46:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c1e4e70 con 0x7fae6c0c7e90 2024-04-26T23:46:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c1e5430 con 0x7fae6c0c7e90 2024-04-26T23:46:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.465+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c069700 con 0x7fae6c0c7e90 2024-04-26T23:46:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.469+0000 7fae68c00640 1 -- 172.21.15.47:0/2058655441 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae540bf020 con 0x7fae6c0c7e90 2024-04-26T23:46:18.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.469+0000 7fae68c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae48068380 0x7fae4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.469+0000 7fae68c00640 1 -- 172.21.15.47:0/2058655441 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fae54123240 con 0x7fae6c0c7e90 2024-04-26T23:46:18.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.469+0000 7fae6be00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae48068380 0x7fae4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.469+0000 7fae6be00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae48068380 0x7fae4806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fae5c000c10 tx=0x7fae5c001e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.473+0000 7fae68c00640 1 -- 172.21.15.47:0/2058655441 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fae540c6020 con 0x7fae6c0c7e90 2024-04-26T23:46:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.637+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae6c0689b0 con 0x7fae6c0c7e90 2024-04-26T23:46:18.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.637+0000 7fae68c00640 1 -- 172.21.15.47:0/2058655441 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16828 (secure 0 0 0) 0x7fae540189a0 con 0x7fae6c0c7e90 2024-04-26T23:46:18.645 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:18.645 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:13.826625+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae48068380 msgr2=0x7fae4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae48068380 0x7fae4806a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fae5c000c10 tx=0x7fae5c001e50 comp rx=0 tx=0).stop 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae6c0c7e90 msgr2=0x7fae6c155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae6c0c7e90 0x7fae6c155ac0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fae5401eac0 tx=0x7fae50005840 comp rx=0 tx=0).stop 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 shutdown_connections 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae48068380 0x7fae4806a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae6c156000 0x7fae6c153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae6c0c7e90 0x7fae6c155ac0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 --2- 172.21.15.47:0/2058655441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae50004810 0x7fae6c1e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 >> 172.21.15.47:0/2058655441 conn(0x7fae6c0d2e90 msgr2=0x7fae6c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 shutdown_connections 2024-04-26T23:46:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.641+0000 7fae72c00640 1 -- 172.21.15.47:0/2058655441 wait complete. 2024-04-26T23:46:18.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:18.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:18.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f99600640 1 Processor -- start 2024-04-26T23:46:18.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f99600640 1 -- start start 2024-04-26T23:46:18.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f99600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 0x7f6f940cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f99600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f94071f90 con 0x7f6f94160670 2024-04-26T23:46:18.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f99600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f94072230 con 0x7f6f94160a50 2024-04-26T23:46:18.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f99600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f94070ee0 con 0x7f6f9409c170 2024-04-26T23:46:18.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6f94160670 0x7f6f9409ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:34642/0 (socket says 172.21.15.47:34642) 2024-04-26T23:46:18.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92a00640 1 -- 172.21.15.47:0/956132906 learned_addr learned my addr 172.21.15.47:0/956132906 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f8be00640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 0x7f6f940cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198529394 0 0) 0x7f6f94071f90 con 0x7f6f94160670 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f78003530 con 0x7f6f94160670 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2819764047 0 0) 0x7f6f78003530 con 0x7f6f94160670 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 msgr2=0x7f6f940cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 0x7f6f940cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 >> v1:172.21.15.203:6789/0 conn(0x7f6f94160a50 legacy=0x7f6f940ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f94071130 con 0x7f6f94160670 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f6f840016a0 con 0x7f6f94160670 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 >> v1:172.21.15.47:6789/0 conn(0x7f6f94160670 legacy=0x7f6f9409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780039f0 0x7f6f78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f780043a0 0x7f6f78004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 0x7f6f78005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f94070ee0 con 0x7f6f780043a0 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7800ba80 con 0x7f6f780039f0 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7800bc80 con 0x7f6f9409c170 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f8be00640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f780043a0 0x7f6f78004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f92a00640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780039f0 0x7f6f78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f93400640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 0x7f6f78005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f8be00640 1 -- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 msgr2=0x7f6f78005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f8be00640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f9409c170 0x7f6f78005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f8be00640 1 -- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780039f0 msgr2=0x7f6f78003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f8be00640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780039f0 0x7f6f78003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.805+0000 7f6f8be00640 1 -- 172.21.15.47:0/956132906 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f78003530 con 0x7f6f780043a0 2024-04-26T23:46:18.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f8be00640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f780043a0 0x7f6f78004870 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009ae0 tx=0x7f6f7c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87fac13c9f60281 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0b2070 con 0x7f6f780043a0 2024-04-26T23:46:18.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7c0a5660 con 0x7f6f780043a0 2024-04-26T23:46:18.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f92000640 1 -- 172.21.15.47:0/956132906 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0096b0 con 0x7f6f780043a0 2024-04-26T23:46:18.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f99600640 1 -- 172.21.15.47:0/956132906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f780043a0 msgr2=0x7f6f78004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f99600640 1 --2- 172.21.15.47:0/956132906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f780043a0 0x7f6f78004870 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009ae0 tx=0x7f6f7c01ca70 comp rx=0 tx=0).stop 2024-04-26T23:46:18.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f93400640 1 -- 172.21.15.47:0/956132906 reap_dead start 2024-04-26T23:46:18.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f99600640 1 -- 172.21.15.47:0/956132906 shutdown_connections 2024-04-26T23:46:18.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f99600640 1 -- 172.21.15.47:0/956132906 >> 172.21.15.47:0/956132906 conn(0x7f6f940b4c00 msgr2=0x7f6f940b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:18.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f99600640 1 -- 172.21.15.47:0/956132906 shutdown_connections 2024-04-26T23:46:18.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.809+0000 7f6f99600640 1 -- 172.21.15.47:0/956132906 wait complete. 2024-04-26T23:46:18.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 Processor -- start 2024-04-26T23:46:18.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 -- start start 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780043a0 0x7f6f94154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f940b5d30 0x7f6f9415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f940b8110 0x7f6f940b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f940717d0 con 0x7f6f940b5d30 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6f94071650 con 0x7f6f780043a0 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f940b56f0 con 0x7f6f940b8110 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f940b5d30 0x7f6f9415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f940b5d30 0x7f6f9415b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:59398/0 (socket says 172.21.15.47:59398) 2024-04-26T23:46:18.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 -- 172.21.15.47:0/1008776048 learned_addr learned my addr 172.21.15.47:0/1008776048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f92a00640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780043a0 0x7f6f94154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f93400640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f940b8110 0x7f6f940b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 -- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f940b8110 msgr2=0x7f6f940b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f940b8110 0x7f6f940b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 -- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780043a0 msgr2=0x7f6f94154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780043a0 0x7f6f94154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 -- 172.21.15.47:0/1008776048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f940b6230 con 0x7f6f940b5d30 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8be00640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f940b5d30 0x7f6f9415b700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009ae0 tx=0x7f6f78005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8aa00640 1 -- 172.21.15.47:0/1008776048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0bc030 con 0x7f6f940b5d30 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8aa00640 1 -- 172.21.15.47:0/1008776048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7c00f000 con 0x7f6f940b5d30 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f940b6510 con 0x7f6f940b5d30 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f8aa00640 1 -- 172.21.15.47:0/1008776048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0b2040 con 0x7f6f940b5d30 2024-04-26T23:46:18.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f940b6ad0 con 0x7f6f940b5d30 2024-04-26T23:46:18.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.813+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f94069700 con 0x7f6f940b5d30 2024-04-26T23:46:18.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.817+0000 7f6f8aa00640 1 -- 172.21.15.47:0/1008776048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f7c0bf070 con 0x7f6f940b5d30 2024-04-26T23:46:18.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.817+0000 7f6f8aa00640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f700683b0 0x7f6f7006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.817+0000 7f6f8aa00640 1 -- 172.21.15.47:0/1008776048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f6f7c120e40 con 0x7f6f940b5d30 2024-04-26T23:46:18.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.817+0000 7f6f92a00640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f700683b0 0x7f6f7006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:18.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.817+0000 7f6f92a00640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f700683b0 0x7f6f7006a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f84001d20 tx=0x7f6f84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:18.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.821+0000 7f6f8aa00640 1 -- 172.21.15.47:0/1008776048 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6f7c016780 con 0x7f6f940b5d30 2024-04-26T23:46:18.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.985+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6f940b8f90 con 0x7f6f940b5d30 2024-04-26T23:46:18.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.985+0000 7f6f8aa00640 1 -- 172.21.15.47:0/1008776048 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f6f7c0f12d0 con 0x7f6f940b5d30 2024-04-26T23:46:18.993 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:18.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f700683b0 msgr2=0x7f6f7006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f700683b0 0x7f6f7006a870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f84001d20 tx=0x7f6f84009040 comp rx=0 tx=0).stop 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f940b5d30 msgr2=0x7f6f9415b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f940b5d30 0x7f6f9415b700 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009ae0 tx=0x7f6f78005840 comp rx=0 tx=0).stop 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 shutdown_connections 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f700683b0 0x7f6f7006a870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f940b8110 0x7f6f940b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f940b5d30 0x7f6f9415b700 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 --2- 172.21.15.47:0/1008776048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f780043a0 0x7f6f94154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 >> 172.21.15.47:0/1008776048 conn(0x7f6f940b4c00 msgr2=0x7f6f940d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 shutdown_connections 2024-04-26T23:46:18.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:18.989+0000 7f6f99600640 1 -- 172.21.15.47:0/1008776048 wait complete. 2024-04-26T23:46:19.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:19.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.149+0000 7f712fe00640 1 Processor -- start 2024-04-26T23:46:19.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.149+0000 7f712fe00640 1 -- start start 2024-04-26T23:46:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f71280d0390 0x7f71280af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712fe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71280ae6a0 con 0x7f712806c630 2024-04-26T23:46:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712fe00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71280ae920 con 0x7f71281603e0 2024-04-26T23:46:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f71280aec00 con 0x7f71280d0390 2024-04-26T23:46:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712ca00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f712806c630 0x7f712815fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50084/0 (socket says 172.21.15.47:50084) 2024-04-26T23:46:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712ca00640 1 -- 172.21.15.47:0/904631694 learned_addr learned my addr 172.21.15.47:0/904631694 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:19.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957655510 0 0) 0x7f7114001120 con 0x7f712806c630 2024-04-26T23:46:19.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7110005740 con 0x7f712806c630 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712d400640 1 --2- 172.21.15.47:0/904631694 >> v2:172.21.15.203:3300/0 conn(0x7f71280d0390 0x7f71280af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3276742883 0 0) 0x7f7110005740 con 0x7f712806c630 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 >> v2:172.21.15.203:3300/0 conn(0x7f71280d0390 msgr2=0x7f71280af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 --2- 172.21.15.47:0/904631694 >> v2:172.21.15.203:3300/0 conn(0x7f71280d0390 0x7f71280af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 >> v1:172.21.15.203:6789/0 conn(0x7f71281603e0 legacy=0x7f712806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71280aeee0 con 0x7f712806c630 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f7114001850 con 0x7f712806c630 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 >> v1:172.21.15.47:6789/0 conn(0x7f712806c630 legacy=0x7f712815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7110005bd0 0x7f7110005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110006a20 0x7f7110006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7110007500 0x7f711000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f71280aec00 con 0x7f7110005bd0 2024-04-26T23:46:19.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f711000e3d0 con 0x7f7110006a20 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f711000e5d0 con 0x7f7110007500 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712d400640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7110005bd0 0x7f7110005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712ca00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110006a20 0x7f7110006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712de00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7110007500 0x7f711000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712d400640 1 -- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7110007500 msgr2=0x7f711000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712d400640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7110007500 0x7f711000dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712d400640 1 -- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110006a20 msgr2=0x7f7110006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712d400640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110006a20 0x7f7110006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712d400640 1 -- 172.21.15.47:0/904631694 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7110005740 con 0x7f7110005bd0 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712de00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7110007500 0x7f711000dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:19.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.153+0000 7f712de00640 1 -- 172.21.15.47:0/904631694 reap_dead start 2024-04-26T23:46:19.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712d400640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7110005bd0 0x7f7110005ff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f711c00ba00 tx=0x7f711c01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5853920ecbe74689 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0b2070 con 0x7f7110005bd0 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711c0ad410 con 0x7f7110005bd0 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f7127e00640 1 -- 172.21.15.47:0/904631694 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c00b600 con 0x7f7110005bd0 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712fe00640 1 -- 172.21.15.47:0/904631694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7110005bd0 msgr2=0x7f7110005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712fe00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7110005bd0 0x7f7110005ff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f711c00ba00 tx=0x7f711c01c640 comp rx=0 tx=0).stop 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712fe00640 1 -- 172.21.15.47:0/904631694 shutdown_connections 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712fe00640 1 --2- 172.21.15.47:0/904631694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7110005bd0 0x7f7110005ff0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712fe00640 1 -- 172.21.15.47:0/904631694 >> 172.21.15.47:0/904631694 conn(0x7f71280b2b70 msgr2=0x7f71280b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712fe00640 1 -- 172.21.15.47:0/904631694 shutdown_connections 2024-04-26T23:46:19.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.157+0000 7f712fe00640 1 -- 172.21.15.47:0/904631694 wait complete. 2024-04-26T23:46:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 Processor -- start 2024-04-26T23:46:19.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 -- start start 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110005bd0 0x7f712806f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71280cf110 0x7f71280cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f712814b880 0x7f712814bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f712806cbb0 con 0x7f712814b880 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f712806ca30 con 0x7f7110005bd0 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f712806cd30 con 0x7f71280cf110 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f712814b880 0x7f712814bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f712814b880 0x7f712814bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51266/0 (socket says 172.21.15.47:51266) 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 -- 172.21.15.47:0/73517385 learned_addr learned my addr 172.21.15.47:0/73517385 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 -- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71280cf110 msgr2=0x7f71280cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71280cf110 0x7f71280cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 -- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110005bd0 msgr2=0x7f712806f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110005bd0 0x7f712806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 -- 172.21.15.47:0/73517385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71280cfad0 con 0x7f712814b880 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712de00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f712814b880 0x7f712814bce0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f712806e7d0 tx=0x7f712000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f7125600640 1 -- 172.21.15.47:0/73517385 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120003980 con 0x7f712814b880 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f7125600640 1 -- 172.21.15.47:0/73517385 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7120018070 con 0x7f712814b880 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f7125600640 1 -- 172.21.15.47:0/73517385 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120003d60 con 0x7f712814b880 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712809bcb0 con 0x7f712814b880 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f712809c270 con 0x7f712814b880 2024-04-26T23:46:19.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.161+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7128069700 con 0x7f712814b880 2024-04-26T23:46:19.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.165+0000 7f7125600640 1 -- 172.21.15.47:0/73517385 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f71200050d0 con 0x7f712814b880 2024-04-26T23:46:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.165+0000 7f7125600640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f71080683b0 0x7f710806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.165+0000 7f7125600640 1 -- 172.21.15.47:0/73517385 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f7120085ff0 con 0x7f712814b880 2024-04-26T23:46:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.165+0000 7f712d400640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f71080683b0 0x7f710806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.165+0000 7f712d400640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f71080683b0 0x7f710806a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f711c0af000 tx=0x7f711c004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.169+0000 7f7125600640 1 -- 172.21.15.47:0/73517385 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7120021020 con 0x7f712814b880 2024-04-26T23:46:19.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.333+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f712806ecb0 con 0x7f712814b880 2024-04-26T23:46:19.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.333+0000 7f7125600640 1 -- 172.21.15.47:0/73517385 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f7120056530 con 0x7f712814b880 2024-04-26T23:46:19.342 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f71080683b0 msgr2=0x7f710806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f71080683b0 0x7f710806a870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f711c0af000 tx=0x7f711c004740 comp rx=0 tx=0).stop 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f712814b880 msgr2=0x7f712814bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f712814b880 0x7f712814bce0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f712806e7d0 tx=0x7f712000eb90 comp rx=0 tx=0).stop 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 shutdown_connections 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f71080683b0 0x7f710806a870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f712814b880 0x7f712814bce0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f71280cf110 0x7f71280cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 --2- 172.21.15.47:0/73517385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7110005bd0 0x7f712806f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 >> 172.21.15.47:0/73517385 conn(0x7f71280b2b70 msgr2=0x7f7128154940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:19.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 shutdown_connections 2024-04-26T23:46:19.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.337+0000 7f712fe00640 1 -- 172.21.15.47:0/73517385 wait complete. 2024-04-26T23:46:19.363 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:19.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.497+0000 7f4223800640 1 Processor -- start 2024-04-26T23:46:19.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f4223800640 1 -- start start 2024-04-26T23:46:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f4223800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f421c06c630 0x7f421c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f4223800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f421c0ae030 con 0x7f421c15cf50 2024-04-26T23:46:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f4223800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f421c0d0ae0 con 0x7f421c160b50 2024-04-26T23:46:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f4223800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f421c0af7a0 con 0x7f421c06c630 2024-04-26T23:46:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f4220e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f421c15cf50 0x7f421c0cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50100/0 (socket says 172.21.15.47:50100) 2024-04-26T23:46:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f4220e00640 1 -- 172.21.15.47:0/646793778 learned_addr learned my addr 172.21.15.47:0/646793778 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:19.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f421be00640 1 --2- 172.21.15.47:0/646793778 >> v2:172.21.15.203:3300/0 conn(0x7f421c06c630 0x7f421c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f421b400640 1 -- 172.21.15.47:0/646793778 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342563552 0 0) 0x7f421c0ae030 con 0x7f421c15cf50 2024-04-26T23:46:19.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f421b400640 1 -- 172.21.15.47:0/646793778 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4204003530 con 0x7f421c15cf50 2024-04-26T23:46:19.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f421be00640 1 -- 172.21.15.47:0/646793778 >> v1:172.21.15.203:6789/0 conn(0x7f421c160b50 legacy=0x7f421c160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f421be00640 1 -- 172.21.15.47:0/646793778 >> v1:172.21.15.47:6789/0 conn(0x7f421c15cf50 legacy=0x7f421c0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.501+0000 7f421be00640 1 -- 172.21.15.47:0/646793778 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c0af9d0 con 0x7f421c06c630 2024-04-26T23:46:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f421be00640 1 --2- 172.21.15.47:0/646793778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c06c630 0x7f421c06cac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f42080097c0 tx=0x7f420801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24bf56ad08aa3e00 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f421b400640 1 -- 172.21.15.47:0/646793778 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080b0070 con 0x7f421c06c630 2024-04-26T23:46:19.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f421b400640 1 -- 172.21.15.47:0/646793778 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080ab600 con 0x7f421c06c630 2024-04-26T23:46:19.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f421b400640 1 -- 172.21.15.47:0/646793778 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42080ab9d0 con 0x7f421c06c630 2024-04-26T23:46:19.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 -- 172.21.15.47:0/646793778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c06c630 msgr2=0x7f421c06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 --2- 172.21.15.47:0/646793778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c06c630 0x7f421c06cac0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f42080097c0 tx=0x7f420801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 -- 172.21.15.47:0/646793778 shutdown_connections 2024-04-26T23:46:19.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 --2- 172.21.15.47:0/646793778 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c06c630 0x7f421c06cac0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 -- 172.21.15.47:0/646793778 >> 172.21.15.47:0/646793778 conn(0x7f421c0b2b70 msgr2=0x7f421c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:19.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 -- 172.21.15.47:0/646793778 shutdown_connections 2024-04-26T23:46:19.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 -- 172.21.15.47:0/646793778 wait complete. 2024-04-26T23:46:19.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 Processor -- start 2024-04-26T23:46:19.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.505+0000 7f4223800640 1 -- start start 2024-04-26T23:46:19.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421c06c630 0x7f421c166a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f421c15cf50 0x7f421c1fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c160b50 0x7f421c1fc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f421c0b3c40 con 0x7f421c06c630 2024-04-26T23:46:19.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f421c15d330 con 0x7f421c160b50 2024-04-26T23:46:19.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f421c0b3dc0 con 0x7f421c15cf50 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421c06c630 0x7f421c166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421c06c630 0x7f421c166a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51276/0 (socket says 172.21.15.47:51276) 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 -- 172.21.15.47:0/3667417285 learned_addr learned my addr 172.21.15.47:0/3667417285 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f421be00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f421c15cf50 0x7f421c1fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 -- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f421c15cf50 msgr2=0x7f421c1fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4221800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c160b50 0x7f421c1fc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f421c15cf50 0x7f421c1fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 -- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c160b50 msgr2=0x7f421c1fc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c160b50 0x7f421c1fc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 -- 172.21.15.47:0/3667417285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421c06efd0 con 0x7f421c06c630 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f421be00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f421c15cf50 0x7f421c1fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4221800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c160b50 0x7f421c1fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4220e00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421c06c630 0x7f421c166a50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f421000c4d0 tx=0x7f421000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4218c00640 1 -- 172.21.15.47:0/3667417285 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210017070 con 0x7f421c06c630 2024-04-26T23:46:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4218c00640 1 -- 172.21.15.47:0/3667417285 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4210005cf0 con 0x7f421c06c630 2024-04-26T23:46:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4218c00640 1 -- 172.21.15.47:0/3667417285 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210007270 con 0x7f421c06c630 2024-04-26T23:46:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421c06f2b0 con 0x7f421c06c630 2024-04-26T23:46:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421c06f870 con 0x7f421c06c630 2024-04-26T23:46:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.509+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421c06fab0 con 0x7f421c06c630 2024-04-26T23:46:19.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.513+0000 7f4218c00640 1 -- 172.21.15.47:0/3667417285 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f421001a070 con 0x7f421c06c630 2024-04-26T23:46:19.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.513+0000 7f4218c00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f41fc0683b0 0x7f41fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.513+0000 7f4218c00640 1 -- 172.21.15.47:0/3667417285 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f4210085d40 con 0x7f421c06c630 2024-04-26T23:46:19.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.513+0000 7f421be00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f41fc0683b0 0x7f41fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.513+0000 7f421be00640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f41fc0683b0 0x7f41fc06a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42080ad000 tx=0x7f4208008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.517+0000 7f4218c00640 1 -- 172.21.15.47:0/3667417285 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f421c06fab0 con 0x7f421c06c630 2024-04-26T23:46:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.681+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f421c160600 con 0x7f421c06c630 2024-04-26T23:46:19.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.681+0000 7f4218c00640 1 -- 172.21.15.47:0/3667417285 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f4210055c10 con 0x7f421c06c630 2024-04-26T23:46:19.689 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f41fc0683b0 msgr2=0x7f41fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f41fc0683b0 0x7f41fc06a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42080ad000 tx=0x7f4208008040 comp rx=0 tx=0).stop 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421c06c630 msgr2=0x7f421c166a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421c06c630 0x7f421c166a50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f421000c4d0 tx=0x7f421000c990 comp rx=0 tx=0).stop 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 shutdown_connections 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f41fc0683b0 0x7f41fc06a870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f421c160b50 0x7f421c1fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f421c15cf50 0x7f421c1fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 --2- 172.21.15.47:0/3667417285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f421c06c630 0x7f421c166a50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 >> 172.21.15.47:0/3667417285 conn(0x7f421c0b2b70 msgr2=0x7f421c160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 shutdown_connections 2024-04-26T23:46:19.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.685+0000 7f4223800640 1 -- 172.21.15.47:0/3667417285 wait complete. 2024-04-26T23:46:19.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:46:19.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.845+0000 7f45f5e00640 1 Processor -- start 2024-04-26T23:46:19.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.845+0000 7f45f5e00640 1 -- start start 2024-04-26T23:46:19.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.845+0000 7f45f5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45f015f440 0x7f45f00b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.845+0000 7f45f5e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f45f006dc20 0x7f45f00d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.845+0000 7f45f5e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f006e220 con 0x7f45f00b4ec0 2024-04-26T23:46:19.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.845+0000 7f45f5e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f45f006e500 con 0x7f45f015f440 2024-04-26T23:46:19.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.845+0000 7f45f5e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f45f006e7e0 con 0x7f45f006dc20 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45eea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45f015f440 0x7f45f00b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45e6000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f45f00b4ec0 0x7f45f006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50112/0 (socket says 172.21.15.47:50112) 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45eea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f45f015f440 0x7f45f00b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51278/0 (socket says 172.21.15.47:51278) 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45e6000640 1 -- 172.21.15.47:0/3217054762 learned_addr learned my addr 172.21.15.47:0/3217054762 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45ef400640 1 --2- 172.21.15.47:0/3217054762 >> v2:172.21.15.203:3300/0 conn(0x7f45f006dc20 0x7f45f00d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45eea00640 1 -- 172.21.15.47:0/3217054762 >> v2:172.21.15.203:3300/0 conn(0x7f45f006dc20 msgr2=0x7f45f00d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45eea00640 1 --2- 172.21.15.47:0/3217054762 >> v2:172.21.15.203:3300/0 conn(0x7f45f006dc20 0x7f45f00d1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45eea00640 1 -- 172.21.15.47:0/3217054762 >> v1:172.21.15.47:6789/0 conn(0x7f45f00b4ec0 legacy=0x7f45f006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45eea00640 1 -- 172.21.15.47:0/3217054762 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f00d16b0 con 0x7f45f015f440 2024-04-26T23:46:19.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45eea00640 1 --2- 172.21.15.47:0/3217054762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f015f440 0x7f45f00b4980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f45f00b57e0 tx=0x7f45e001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6140830a1fe9b99 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45ee000640 1 -- 172.21.15.47:0/3217054762 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00b2070 con 0x7f45f015f440 2024-04-26T23:46:19.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45ee000640 1 -- 172.21.15.47:0/3217054762 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00a57f0 con 0x7f45f015f440 2024-04-26T23:46:19.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.849+0000 7f45ee000640 1 -- 172.21.15.47:0/3217054762 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00a5bc0 con 0x7f45f015f440 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- 172.21.15.47:0/3217054762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f015f440 msgr2=0x7f45f00b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 --2- 172.21.15.47:0/3217054762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f015f440 0x7f45f00b4980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f45f00b57e0 tx=0x7f45e001c930 comp rx=0 tx=0).stop 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- 172.21.15.47:0/3217054762 shutdown_connections 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 --2- 172.21.15.47:0/3217054762 >> v2:172.21.15.203:3300/0 conn(0x7f45f006dc20 0x7f45f00d1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 --2- 172.21.15.47:0/3217054762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f015f440 0x7f45f00b4980 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- 172.21.15.47:0/3217054762 >> 172.21.15.47:0/3217054762 conn(0x7f45f009ba60 msgr2=0x7f45f009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- 172.21.15.47:0/3217054762 shutdown_connections 2024-04-26T23:46:19.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- 172.21.15.47:0/3217054762 wait complete. 2024-04-26T23:46:19.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 Processor -- start 2024-04-26T23:46:19.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- start start 2024-04-26T23:46:19.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f006dc20 0x7f45f00b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45f00b4ec0 0x7f45f01610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45f015f440 0x7f45f0161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f45f00b52f0 con 0x7f45f006dc20 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45f00d2b70 con 0x7f45f015f440 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45f5e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f45f016beb0 con 0x7f45f00b4ec0 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f006dc20 0x7f45f00b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f006dc20 0x7f45f00b11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51290/0 (socket says 172.21.15.47:51290) 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 -- 172.21.15.47:0/4109437095 learned_addr learned my addr 172.21.15.47:0/4109437095 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45e6000640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45f00b4ec0 0x7f45f01610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45ef400640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45f015f440 0x7f45f0161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 -- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45f00b4ec0 msgr2=0x7f45f01610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45f00b4ec0 0x7f45f01610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 -- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45f015f440 msgr2=0x7f45f0161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45f015f440 0x7f45f0161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.853+0000 7f45eea00640 1 -- 172.21.15.47:0/4109437095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f0155710 con 0x7f45f006dc20 2024-04-26T23:46:19.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.857+0000 7f45eea00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f006dc20 0x7f45f00b11f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f45e0019540 tx=0x7f45e00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.857+0000 7f45e7e00640 1 -- 172.21.15.47:0/4109437095 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00b2050 con 0x7f45f006dc20 2024-04-26T23:46:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.857+0000 7f45e7e00640 1 -- 172.21.15.47:0/4109437095 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00be070 con 0x7f45f006dc20 2024-04-26T23:46:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.857+0000 7f45e7e00640 1 -- 172.21.15.47:0/4109437095 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e00ada70 con 0x7f45f006dc20 2024-04-26T23:46:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.857+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f0161c40 con 0x7f45f006dc20 2024-04-26T23:46:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.857+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f015cdc0 con 0x7f45f006dc20 2024-04-26T23:46:19.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.857+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f00695f0 con 0x7f45f006dc20 2024-04-26T23:46:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.861+0000 7f45e7e00640 1 -- 172.21.15.47:0/4109437095 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45e00adc10 con 0x7f45f006dc20 2024-04-26T23:46:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.861+0000 7f45e7e00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f45cc068380 0x7f45cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.861+0000 7f45e7e00640 1 -- 172.21.15.47:0/4109437095 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f45e0121c90 con 0x7f45f006dc20 2024-04-26T23:46:19.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.861+0000 7f45e6000640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f45cc068380 0x7f45cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:19.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.861+0000 7f45e6000640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f45cc068380 0x7f45cc06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45f00c9ef0 tx=0x7f45d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:19.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:19.865+0000 7f45e7e00640 1 -- 172.21.15.47:0/4109437095 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f45e0016520 con 0x7f45f006dc20 2024-04-26T23:46:20.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f45f00c9c40 con 0x7f45f006dc20 2024-04-26T23:46:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45e7e00640 1 -- 172.21.15.47:0/4109437095 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f45e00ab340 con 0x7f45f006dc20 2024-04-26T23:46:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:46:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f45cc068380 msgr2=0x7f45cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f45cc068380 0x7f45cc06a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f45f00c9ef0 tx=0x7f45d8009040 comp rx=0 tx=0).stop 2024-04-26T23:46:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f006dc20 msgr2=0x7f45f00b11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f006dc20 0x7f45f00b11f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f45e0019540 tx=0x7f45e00196d0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 shutdown_connections 2024-04-26T23:46:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f45cc068380 0x7f45cc06a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45f015f440 0x7f45f0161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f45f00b4ec0 0x7f45f01610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 --2- 172.21.15.47:0/4109437095 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f45f006dc20 0x7f45f00b11f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 >> 172.21.15.47:0/4109437095 conn(0x7f45f009ba60 msgr2=0x7f45f00cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 shutdown_connections 2024-04-26T23:46:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.045+0000 7f45f5e00640 1 -- 172.21.15.47:0/4109437095 wait complete. 2024-04-26T23:46:20.072 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi203.front.sepia.ceph.com... 2024-04-26T23:46:20.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:20.073 DEBUG:teuthology.orchestra.run.smithi203:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-26T23:46:20.095 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:20.096 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:46:20.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:20.096 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-26T23:46:20.149 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:46:20.149 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:46:20.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.280+0000 7f4f75600640 1 Processor -- start 2024-04-26T23:46:20.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.280+0000 7f4f75600640 1 -- start start 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.280+0000 7f4f75600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4f7015c100 0x7f4f7015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.280+0000 7f4f75600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f700cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.280+0000 7f4f75600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7015fc50 con 0x7f4f700ce140 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f75600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4f70160860 con 0x7f4f7015c100 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f75600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7015d4a0 con 0x7f4f7006fcd0 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4f7015c100 0x7f4f7015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6f400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4f700ce140 0x7f4f7006ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50118/0 (socket says 172.21.15.47:50118) 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4f7015c100 0x7f4f7015cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51306/0 (socket says 172.21.15.47:51306) 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6f400640 1 -- 172.21.15.47:0/1628999340 learned_addr learned my addr 172.21.15.47:0/1628999340 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f66000640 1 --2- 172.21.15.47:0/1628999340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f700cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6ea00640 1 -- 172.21.15.47:0/1628999340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 msgr2=0x7f4f700cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:20.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6ea00640 1 --2- 172.21.15.47:0/1628999340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f700cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6ea00640 1 -- 172.21.15.47:0/1628999340 >> v1:172.21.15.47:6789/0 conn(0x7f4f700ce140 legacy=0x7f4f7006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6e000640 1 -- 172.21.15.47:0/1628999340 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681613048 0 0) 0x7f4f7015fc50 con 0x7f4f700ce140 2024-04-26T23:46:20.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6ea00640 1 -- 172.21.15.47:0/1628999340 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7015ff30 con 0x7f4f7015c100 2024-04-26T23:46:20.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6ea00640 1 --2- 172.21.15.47:0/1628999340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7015c100 0x7f4f7015cf60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f600097c0 tx=0x7f4f6001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5432a15242c809 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:20.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6e000640 1 -- 172.21.15.47:0/1628999340 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600b1070 con 0x7f4f7015c100 2024-04-26T23:46:20.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6e000640 1 -- 172.21.15.47:0/1628999340 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600ac410 con 0x7f4f7015c100 2024-04-26T23:46:20.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.284+0000 7f4f6e000640 1 -- 172.21.15.47:0/1628999340 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600ac7e0 con 0x7f4f7015c100 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- 172.21.15.47:0/1628999340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7015c100 msgr2=0x7f4f7015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 --2- 172.21.15.47:0/1628999340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7015c100 0x7f4f7015cf60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f600097c0 tx=0x7f4f6001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- 172.21.15.47:0/1628999340 shutdown_connections 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 --2- 172.21.15.47:0/1628999340 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f700cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 --2- 172.21.15.47:0/1628999340 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f7015c100 0x7f4f7015cf60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- 172.21.15.47:0/1628999340 >> 172.21.15.47:0/1628999340 conn(0x7f4f7006c800 msgr2=0x7f4f7006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- 172.21.15.47:0/1628999340 shutdown_connections 2024-04-26T23:46:20.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- 172.21.15.47:0/1628999340 wait complete. 2024-04-26T23:46:20.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 Processor -- start 2024-04-26T23:46:20.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- start start 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f7015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f700ce140 0x7f4f7015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f7015c100 0x7f4f701442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4f701691e0 con 0x7f4f700ce140 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f70169060 con 0x7f4f7015c100 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f75600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4f70169360 con 0x7f4f7006fcd0 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f700ce140 0x7f4f7015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f700ce140 0x7f4f7015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51320/0 (socket says 172.21.15.47:51320) 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 -- 172.21.15.47:0/4009264409 learned_addr learned my addr 172.21.15.47:0/4009264409 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f6ea00640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f7015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f6f400640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f7015c100 0x7f4f701442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 -- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 msgr2=0x7f4f7015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f7015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 -- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f7015c100 msgr2=0x7f4f701442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f7015c100 0x7f4f701442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.288+0000 7f4f66000640 1 -- 172.21.15.47:0/4009264409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7009e930 con 0x7f4f700ce140 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f66000640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f700ce140 0x7f4f7015b300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800d830 tx=0x7f4f5800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f67400640 1 -- 172.21.15.47:0/4009264409 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f580059a0 con 0x7f4f700ce140 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f67400640 1 -- 172.21.15.47:0/4009264409 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f58005b40 con 0x7f4f700ce140 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7009e0f0 con 0x7f4f700ce140 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f67400640 1 -- 172.21.15.47:0/4009264409 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f58005d30 con 0x7f4f700ce140 2024-04-26T23:46:20.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7009e370 con 0x7f4f700ce140 2024-04-26T23:46:20.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f70069700 con 0x7f4f700ce140 2024-04-26T23:46:20.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f67400640 1 -- 172.21.15.47:0/4009264409 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4f5801b020 con 0x7f4f700ce140 2024-04-26T23:46:20.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f67400640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4f4c0683b0 0x7f4f4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.292+0000 7f4f67400640 1 -- 172.21.15.47:0/4009264409 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f4f580869d0 con 0x7f4f700ce140 2024-04-26T23:46:20.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.296+0000 7f4f6ea00640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4f4c0683b0 0x7f4f4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.296+0000 7f4f6ea00640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4f4c0683b0 0x7f4f4c06a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4f600ae000 tx=0x7f4f60008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:20.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.296+0000 7f4f67400640 1 -- 172.21.15.47:0/4009264409 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4f7009e0f0 con 0x7f4f700ce140 2024-04-26T23:46:20.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f700d08b0 con 0x7f4f700ce140 2024-04-26T23:46:20.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f67400640 1 -- 172.21.15.47:0/4009264409 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f4f58056ef0 con 0x7f4f700ce140 2024-04-26T23:46:20.508 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:20.508 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:46:20.508 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4f4c0683b0 msgr2=0x7f4f4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4f4c0683b0 0x7f4f4c06a870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4f600ae000 tx=0x7f4f60008040 comp rx=0 tx=0).stop 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f700ce140 msgr2=0x7f4f7015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f700ce140 0x7f4f7015b300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800d830 tx=0x7f4f5800dcf0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 shutdown_connections 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4f4c0683b0 0x7f4f4c06a870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f7015c100 0x7f4f701442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4f700ce140 0x7f4f7015b300 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 --2- 172.21.15.47:0/4009264409 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4f7006fcd0 0x7f4f7015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 >> 172.21.15.47:0/4009264409 conn(0x7f4f7006c800 msgr2=0x7f4f70159110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 shutdown_connections 2024-04-26T23:46:20.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.500+0000 7f4f75600640 1 -- 172.21.15.47:0/4009264409 wait complete. 2024-04-26T23:46:20.532 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:20.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.664+0000 7f3557400640 1 Processor -- start 2024-04-26T23:46:20.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.664+0000 7f3557400640 1 -- start start 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3557400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3557400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f355015d5b0 0x7f355015da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3557400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35500cdc00 0x7f35500ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3557400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f35500ce580 con 0x7f35500cdc00 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3557400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f355015e050 con 0x7f355015d5b0 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3557400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f355015e330 con 0x7f35500b4360 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35500cdc00 0x7f35500ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f35500cdc00 0x7f35500ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51334/0 (socket says 172.21.15.47:51334) 2024-04-26T23:46:20.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 -- 172.21.15.47:0/3593707589 learned_addr learned my addr 172.21.15.47:0/3593707589 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3547e00640 1 --2- 172.21.15.47:0/3593707589 >> v2:172.21.15.203:3300/0 conn(0x7f355015d5b0 0x7f355015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3554a00640 1 --2- 172.21.15.47:0/3593707589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 -- 172.21.15.47:0/3593707589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 msgr2=0x7f35500cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 --2- 172.21.15.47:0/3593707589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 -- 172.21.15.47:0/3593707589 >> v2:172.21.15.203:3300/0 conn(0x7f355015d5b0 msgr2=0x7f355015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 --2- 172.21.15.47:0/3593707589 >> v2:172.21.15.203:3300/0 conn(0x7f355015d5b0 0x7f355015da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3555400640 1 -- 172.21.15.47:0/3593707589 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35500ceda0 con 0x7f35500cdc00 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3554a00640 1 --2- 172.21.15.47:0/3593707589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:20.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.668+0000 7f3547e00640 1 --2- 172.21.15.47:0/3593707589 >> v2:172.21.15.203:3300/0 conn(0x7f355015d5b0 0x7f355015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:20.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3555400640 1 --2- 172.21.15.47:0/3593707589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f35500ce040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f35500ce7b0 tx=0x7f354801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f7c921d990085 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f354fe00640 1 -- 172.21.15.47:0/3593707589 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35480a56f0 con 0x7f35500cdc00 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f354fe00640 1 -- 172.21.15.47:0/3593707589 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35480a5890 con 0x7f35500cdc00 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f354fe00640 1 -- 172.21.15.47:0/3593707589 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35480a5c60 con 0x7f35500cdc00 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- 172.21.15.47:0/3593707589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 msgr2=0x7f35500ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 --2- 172.21.15.47:0/3593707589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f35500ce040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f35500ce7b0 tx=0x7f354801c9f0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- 172.21.15.47:0/3593707589 shutdown_connections 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 --2- 172.21.15.47:0/3593707589 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f35500ce040 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 --2- 172.21.15.47:0/3593707589 >> v2:172.21.15.203:3300/0 conn(0x7f355015d5b0 0x7f355015da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 --2- 172.21.15.47:0/3593707589 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- 172.21.15.47:0/3593707589 >> 172.21.15.47:0/3593707589 conn(0x7f355006c800 msgr2=0x7f355006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- 172.21.15.47:0/3593707589 shutdown_connections 2024-04-26T23:46:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- 172.21.15.47:0/3593707589 wait complete. 2024-04-26T23:46:20.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 Processor -- start 2024-04-26T23:46:20.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- start start 2024-04-26T23:46:20.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f355009e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f355015d5b0 0x7f3550140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35500b60f0 con 0x7f35500cdc00 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f35500b5f70 con 0x7f355015d5b0 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3557400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f355015ef80 con 0x7f35500b4360 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.672+0000 7f3547e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f355009e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f355009e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51350/0 (socket says 172.21.15.47:51350) 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 -- 172.21.15.47:0/2373029190 learned_addr learned my addr 172.21.15.47:0/2373029190 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3554a00640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3555400640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f355015d5b0 0x7f3550140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 -- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 msgr2=0x7f35500c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 -- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f355015d5b0 msgr2=0x7f3550140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f355015d5b0 0x7f3550140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 -- 172.21.15.47:0/2373029190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3550072820 con 0x7f35500cdc00 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3547e00640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f355009e200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f353800c7f0 tx=0x7f353800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f354d600640 1 -- 172.21.15.47:0/2373029190 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538005ba0 con 0x7f35500cdc00 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f354d600640 1 -- 172.21.15.47:0/2373029190 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3538005d40 con 0x7f35500cdc00 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f354d600640 1 -- 172.21.15.47:0/2373029190 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538006250 con 0x7f35500cdc00 2024-04-26T23:46:20.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3550072b00 con 0x7f35500cdc00 2024-04-26T23:46:20.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35500733a0 con 0x7f35500cdc00 2024-04-26T23:46:20.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3550069700 con 0x7f35500cdc00 2024-04-26T23:46:20.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.676+0000 7f354d600640 1 -- 172.21.15.47:0/2373029190 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3538006600 con 0x7f35500cdc00 2024-04-26T23:46:20.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.680+0000 7f354d600640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f352c068380 0x7f352c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:20.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.680+0000 7f354d600640 1 -- 172.21.15.47:0/2373029190 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f3538086c30 con 0x7f35500cdc00 2024-04-26T23:46:20.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.680+0000 7f3554a00640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f352c068380 0x7f352c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:20.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.680+0000 7f3554a00640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f352c068380 0x7f352c06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3550156b10 tx=0x7f3540008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:20.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.684+0000 7f354d600640 1 -- 172.21.15.47:0/2373029190 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3538015020 con 0x7f35500cdc00 2024-04-26T23:46:20.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.848+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3550141910 con 0x7f35500cdc00 2024-04-26T23:46:20.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f354d600640 1 -- 172.21.15.47:0/2373029190 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16828 (secure 0 0 0) 0x7f3550141910 con 0x7f35500cdc00 2024-04-26T23:46:20.859 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:20.859 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:13.826625+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f352c068380 msgr2=0x7f352c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f352c068380 0x7f352c06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3550156b10 tx=0x7f3540008040 comp rx=0 tx=0).stop 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 msgr2=0x7f355009e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f355009e200 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f353800c7f0 tx=0x7f353800ccb0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 shutdown_connections 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f352c068380 0x7f352c06a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f355015d5b0 0x7f3550140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35500cdc00 0x7f355009e200 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 --2- 172.21.15.47:0/2373029190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35500b4360 0x7f35500c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 >> 172.21.15.47:0/2373029190 conn(0x7f355006c800 msgr2=0x7f35500b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:20.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 shutdown_connections 2024-04-26T23:46:20.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:20.852+0000 7f3557400640 1 -- 172.21.15.47:0/2373029190 wait complete. 2024-04-26T23:46:20.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:45:30.133691+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:45:31.028800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:20.881 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:21.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4b02c00640 1 Processor -- start 2024-04-26T23:46:21.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4b02c00640 1 -- start start 2024-04-26T23:46:21.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4b02c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4afc06c630 0x7f4afc0b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4b02c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4afc06e370 con 0x7f4afc06ca10 2024-04-26T23:46:21.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4b02c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4afc06e650 con 0x7f4afc06f410 2024-04-26T23:46:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4b02c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4afc06e930 con 0x7f4afc06c630 2024-04-26T23:46:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4afbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4afc06c630 0x7f4afc0b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4af3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4afc06ca10 0x7f4afc073dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50120/0 (socket says 172.21.15.47:50120) 2024-04-26T23:46:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4af3e00640 1 -- 172.21.15.47:0/2999798363 learned_addr learned my addr 172.21.15.47:0/2999798363 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4afbe00640 1 -- 172.21.15.47:0/2999798363 >> v1:172.21.15.203:6789/0 conn(0x7f4afc06f410 legacy=0x7f4afc06f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4afb400640 1 -- 172.21.15.47:0/2999798363 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044930038 0 0) 0x7f4afc06e370 con 0x7f4afc06ca10 2024-04-26T23:46:21.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4afbe00640 1 -- 172.21.15.47:0/2999798363 >> v1:172.21.15.47:6789/0 conn(0x7f4afc06ca10 legacy=0x7f4afc073dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.020+0000 7f4afbe00640 1 -- 172.21.15.47:0/2999798363 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc06ec10 con 0x7f4afc06c630 2024-04-26T23:46:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4afbe00640 1 --2- 172.21.15.47:0/2999798363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc0b5c30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0097c0 tx=0x7f4aec01cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b039848861c173 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4afb400640 1 -- 172.21.15.47:0/2999798363 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0b1070 con 0x7f4afc06c630 2024-04-26T23:46:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4afb400640 1 -- 172.21.15.47:0/2999798363 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aec0ac410 con 0x7f4afc06c630 2024-04-26T23:46:21.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4afb400640 1 -- 172.21.15.47:0/2999798363 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0ac7e0 con 0x7f4afc06c630 2024-04-26T23:46:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4b02c00640 1 -- 172.21.15.47:0/2999798363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 msgr2=0x7f4afc0b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2999798363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc0b5c30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0097c0 tx=0x7f4aec01cf00 comp rx=0 tx=0).stop 2024-04-26T23:46:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4b02c00640 1 -- 172.21.15.47:0/2999798363 shutdown_connections 2024-04-26T23:46:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2999798363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc0b5c30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4b02c00640 1 -- 172.21.15.47:0/2999798363 >> 172.21.15.47:0/2999798363 conn(0x7f4afc0b2b70 msgr2=0x7f4afc0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4b02c00640 1 -- 172.21.15.47:0/2999798363 shutdown_connections 2024-04-26T23:46:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.024+0000 7f4b02c00640 1 -- 172.21.15.47:0/2999798363 wait complete. 2024-04-26T23:46:21.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 Processor -- start 2024-04-26T23:46:21.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 -- start start 2024-04-26T23:46:21.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4afc06ca10 0x7f4afc13e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4afc06f410 0x7f4afc13e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc06cfb0 con 0x7f4afc06c630 2024-04-26T23:46:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4afc06ce30 con 0x7f4afc06ca10 2024-04-26T23:46:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4afc148040 con 0x7f4afc06f410 2024-04-26T23:46:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc15ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51380/0 (socket says 172.21.15.47:51380) 2024-04-26T23:46:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 -- 172.21.15.47:0/2256481058 learned_addr learned my addr 172.21.15.47:0/2256481058 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:21.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4af3e00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4afc06ca10 0x7f4afc13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b00c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4afc06f410 0x7f4afc13e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 -- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4afc06f410 msgr2=0x7f4afc13e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4afc06f410 0x7f4afc13e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 -- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4afc06ca10 msgr2=0x7f4afc13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4afc06ca10 0x7f4afc13e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 -- 172.21.15.47:0/2256481058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4afc15ef60 con 0x7f4afc06c630 2024-04-26T23:46:21.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4afbe00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc15ea20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0af040 tx=0x7f4aec019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4af8c00640 1 -- 172.21.15.47:0/2256481058 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0b9070 con 0x7f4afc06c630 2024-04-26T23:46:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4af8c00640 1 -- 172.21.15.47:0/2256481058 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aec0ace40 con 0x7f4afc06c630 2024-04-26T23:46:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4afc0cdd40 con 0x7f4afc06c630 2024-04-26T23:46:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4af8c00640 1 -- 172.21.15.47:0/2256481058 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec0b1040 con 0x7f4afc06c630 2024-04-26T23:46:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4afc0ce300 con 0x7f4afc06c630 2024-04-26T23:46:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.028+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4afc069700 con 0x7f4afc06c630 2024-04-26T23:46:21.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.032+0000 7f4af8c00640 1 -- 172.21.15.47:0/2256481058 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4aec0bc070 con 0x7f4afc06c630 2024-04-26T23:46:21.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.032+0000 7f4af8c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4ad8068380 0x7f4ad806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.032+0000 7f4af8c00640 1 -- 172.21.15.47:0/2256481058 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f4aec1204e0 con 0x7f4afc06c630 2024-04-26T23:46:21.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.032+0000 7f4af3e00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4ad8068380 0x7f4ad806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.032+0000 7f4af3e00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4ad8068380 0x7f4ad806a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4afc13ffb0 tx=0x7f4ae4007d10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.036+0000 7f4af8c00640 1 -- 172.21.15.47:0/2256481058 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4aec016090 con 0x7f4afc06c630 2024-04-26T23:46:21.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.200+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4afc0b2690 con 0x7f4afc06c630 2024-04-26T23:46:21.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.200+0000 7f4af8c00640 1 -- 172.21.15.47:0/2256481058 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f4aec0f0bc0 con 0x7f4afc06c630 2024-04-26T23:46:21.209 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:21.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4ad8068380 msgr2=0x7f4ad806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4ad8068380 0x7f4ad806a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4afc13ffb0 tx=0x7f4ae4007d10 comp rx=0 tx=0).stop 2024-04-26T23:46:21.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 msgr2=0x7f4afc15ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc15ea20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4aec0af040 tx=0x7f4aec019240 comp rx=0 tx=0).stop 2024-04-26T23:46:21.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 shutdown_connections 2024-04-26T23:46:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4ad8068380 0x7f4ad806a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4afc06f410 0x7f4afc13e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4afc06ca10 0x7f4afc13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 --2- 172.21.15.47:0/2256481058 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4afc06c630 0x7f4afc15ea20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 >> 172.21.15.47:0/2256481058 conn(0x7f4afc0b2b70 msgr2=0x7f4afc145830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 shutdown_connections 2024-04-26T23:46:21.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.204+0000 7f4b02c00640 1 -- 172.21.15.47:0/2256481058 wait complete. 2024-04-26T23:46:21.230 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:46:21.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.364+0000 7f140a200640 1 Processor -- start 2024-04-26T23:46:21.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.364+0000 7f140a200640 1 -- start start 2024-04-26T23:46:21.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.364+0000 7f140a200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f140406cac0 0x7f1404161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.364+0000 7f140a200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14040ae030 con 0x7f140406c630 2024-04-26T23:46:21.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.364+0000 7f140a200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14040d0ae0 con 0x7f140415cf50 2024-04-26T23:46:21.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.364+0000 7f140a200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f14040af7a0 con 0x7f140406cac0 2024-04-26T23:46:21.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.364+0000 7f1403e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f140406cac0 0x7f1404161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1403e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f140406cac0 0x7f1404161260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51388/0 (socket says 172.21.15.47:51388) 2024-04-26T23:46:21.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1403e00640 1 -- 172.21.15.47:0/3229191661 learned_addr learned my addr 172.21.15.47:0/3229191661 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:21.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f13fbe00640 1 --1- 172.21.15.47:0/3229191661 >> v1:172.21.15.47:6789/0 conn(0x7f140406c630 0x7f1404160b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50128/0 (socket says 172.21.15.47:50128) 2024-04-26T23:46:21.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1403e00640 1 -- 172.21.15.47:0/3229191661 >> v1:172.21.15.203:6789/0 conn(0x7f140415cf50 legacy=0x7f14040cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1403e00640 1 -- 172.21.15.47:0/3229191661 >> v1:172.21.15.47:6789/0 conn(0x7f140406c630 legacy=0x7f1404160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1403e00640 1 -- 172.21.15.47:0/3229191661 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14040af9d0 con 0x7f140406cac0 2024-04-26T23:46:21.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1403e00640 1 --2- 172.21.15.47:0/3229191661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404161260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009e50 tx=0x7f13fc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727f7cc1d5b313c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1402a00640 1 -- 172.21.15.47:0/3229191661 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0a58d0 con 0x7f140406cac0 2024-04-26T23:46:21.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1402a00640 1 -- 172.21.15.47:0/3229191661 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc0a5a70 con 0x7f140406cac0 2024-04-26T23:46:21.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.368+0000 7f1402a00640 1 -- 172.21.15.47:0/3229191661 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0a5e40 con 0x7f140406cac0 2024-04-26T23:46:21.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- 172.21.15.47:0/3229191661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 msgr2=0x7f1404161260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 --2- 172.21.15.47:0/3229191661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404161260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009e50 tx=0x7f13fc01ca00 comp rx=0 tx=0).stop 2024-04-26T23:46:21.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- 172.21.15.47:0/3229191661 shutdown_connections 2024-04-26T23:46:21.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 --2- 172.21.15.47:0/3229191661 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404161260 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- 172.21.15.47:0/3229191661 >> 172.21.15.47:0/3229191661 conn(0x7f14040b2b70 msgr2=0x7f14040b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:21.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- 172.21.15.47:0/3229191661 shutdown_connections 2024-04-26T23:46:21.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- 172.21.15.47:0/3229191661 wait complete. 2024-04-26T23:46:21.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 Processor -- start 2024-04-26T23:46:21.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- start start 2024-04-26T23:46:21.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f140406c630 0x7f140414f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f140415cf50 0x7f14041589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f140415d330 con 0x7f140406cac0 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f140406cf30 con 0x7f140406c630 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f140a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f14040b3c40 con 0x7f140415cf50 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51404/0 (socket says 172.21.15.47:51404) 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 -- 172.21.15.47:0/3042980517 learned_addr learned my addr 172.21.15.47:0/3042980517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f1403e00640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f140415cf50 0x7f14041589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f1403400640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f140406c630 0x7f140414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 -- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f140415cf50 msgr2=0x7f14041589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f140415cf50 0x7f14041589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 -- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f140406c630 msgr2=0x7f140414f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f140406c630 0x7f140414f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 -- 172.21.15.47:0/3042980517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1404158250 con 0x7f140406cac0 2024-04-26T23:46:21.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f1403e00640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f140415cf50 0x7f14041589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:21.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fbe00640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404168720 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c4c0 tx=0x7f13ec00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.372+0000 7f13fb400640 1 -- 172.21.15.47:0/3042980517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec018070 con 0x7f140406cac0 2024-04-26T23:46:21.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f13fb400640 1 -- 172.21.15.47:0/3042980517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13ec007480 con 0x7f140406cac0 2024-04-26T23:46:21.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140414fda0 con 0x7f140406cac0 2024-04-26T23:46:21.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f13fb400640 1 -- 172.21.15.47:0/3042980517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0047f0 con 0x7f140406cac0 2024-04-26T23:46:21.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14041478c0 con 0x7f140406cac0 2024-04-26T23:46:21.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1404069700 con 0x7f140406cac0 2024-04-26T23:46:21.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f13fb400640 1 -- 172.21.15.47:0/3042980517 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13ec01b070 con 0x7f140406cac0 2024-04-26T23:46:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f13fb400640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f13e00683b0 0x7f13e006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f13fb400640 1 -- 172.21.15.47:0/3042980517 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f13ec085cf0 con 0x7f140406cac0 2024-04-26T23:46:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.376+0000 7f1403400640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f13e00683b0 0x7f13e006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.380+0000 7f1403400640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f13e00683b0 0x7f13e006a870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000f70 tx=0x7f13f4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.380+0000 7f13fb400640 1 -- 172.21.15.47:0/3042980517 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1404158250 con 0x7f140406cac0 2024-04-26T23:46:21.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.544+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f14040b1670 con 0x7f140406cac0 2024-04-26T23:46:21.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.544+0000 7f13fb400640 1 -- 172.21.15.47:0/3042980517 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f13ec056180 con 0x7f140406cac0 2024-04-26T23:46:21.554 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:46:21.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f13e00683b0 msgr2=0x7f13e006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f13e00683b0 0x7f13e006a870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000f70 tx=0x7f13f4009040 comp rx=0 tx=0).stop 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 msgr2=0x7f1404168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404168720 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c4c0 tx=0x7f13ec00c980 comp rx=0 tx=0).stop 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 shutdown_connections 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f13e00683b0 0x7f13e006a870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f140415cf50 0x7f14041589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f140406cac0 0x7f1404168720 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 --2- 172.21.15.47:0/3042980517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f140406c630 0x7f140414f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 >> 172.21.15.47:0/3042980517 conn(0x7f14040b2b70 msgr2=0x7f1404159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 shutdown_connections 2024-04-26T23:46:21.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.548+0000 7f140a200640 1 -- 172.21.15.47:0/3042980517 wait complete. 2024-04-26T23:46:21.575 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:46:21.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc2a6200640 1 Processor -- start 2024-04-26T23:46:21.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc2a6200640 1 -- start start 2024-04-26T23:46:21.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc2a6200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc2a006c630 0x7fc2a006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc2a6200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2a0160b50 0x7fc2a0160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc2a6200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2a00ae030 con 0x7fc2a015cf50 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc2a6200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a00af7a0 con 0x7fc2a0160b50 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc2a6200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc2a006d000 con 0x7fc2a006c630 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2a0160b50 0x7fc2a0160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc2a0160b50 0x7fc2a0160fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51412/0 (socket says 172.21.15.47:51412) 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29fe00640 1 -- 172.21.15.47:0/426699241 learned_addr learned my addr 172.21.15.47:0/426699241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29ea00640 1 --2- 172.21.15.47:0/426699241 >> v2:172.21.15.203:3300/0 conn(0x7fc2a006c630 0x7fc2a006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29fe00640 1 -- 172.21.15.47:0/426699241 >> v2:172.21.15.203:3300/0 conn(0x7fc2a006c630 msgr2=0x7fc2a006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29fe00640 1 --2- 172.21.15.47:0/426699241 >> v2:172.21.15.203:3300/0 conn(0x7fc2a006c630 0x7fc2a006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29fe00640 1 -- 172.21.15.47:0/426699241 >> v1:172.21.15.203:6789/0 conn(0x7fc2a015cf50 legacy=0x7fc2a00cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.712+0000 7fc29fe00640 1 -- 172.21.15.47:0/426699241 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a00d0ae0 con 0x7fc2a0160b50 2024-04-26T23:46:21.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc29fe00640 1 --2- 172.21.15.47:0/426699241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a0160fc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0070500 tx=0x7fc29801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ad0bdb99197b2f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc29e000640 1 -- 172.21.15.47:0/426699241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2980a5760 con 0x7fc2a0160b50 2024-04-26T23:46:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc29e000640 1 -- 172.21.15.47:0/426699241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2980a5900 con 0x7fc2a0160b50 2024-04-26T23:46:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc29e000640 1 -- 172.21.15.47:0/426699241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2980a5cd0 con 0x7fc2a0160b50 2024-04-26T23:46:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 -- 172.21.15.47:0/426699241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 msgr2=0x7fc2a0160fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 --2- 172.21.15.47:0/426699241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a0160fc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0070500 tx=0x7fc29801c9b0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 -- 172.21.15.47:0/426699241 shutdown_connections 2024-04-26T23:46:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 --2- 172.21.15.47:0/426699241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a0160fc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 --2- 172.21.15.47:0/426699241 >> v2:172.21.15.203:3300/0 conn(0x7fc2a006c630 0x7fc2a006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 -- 172.21.15.47:0/426699241 >> 172.21.15.47:0/426699241 conn(0x7fc2a00b2b70 msgr2=0x7fc2a00b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 -- 172.21.15.47:0/426699241 shutdown_connections 2024-04-26T23:46:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 -- 172.21.15.47:0/426699241 wait complete. 2024-04-26T23:46:21.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 Processor -- start 2024-04-26T23:46:21.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.716+0000 7fc2a6200640 1 -- start start 2024-04-26T23:46:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a006c630 0x7fc2a015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2a015cf50 0x7fc2a015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0161910 con 0x7fc2a0160b50 2024-04-26T23:46:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a015d330 con 0x7fc2a006c630 2024-04-26T23:46:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2a0161a90 con 0x7fc2a015cf50 2024-04-26T23:46:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51424/0 (socket says 172.21.15.47:51424) 2024-04-26T23:46:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 -- 172.21.15.47:0/4075293948 learned_addr learned my addr 172.21.15.47:0/4075293948 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29ea00640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2a015cf50 0x7fc2a015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29f400640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a006c630 0x7fc2a015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 -- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2a015cf50 msgr2=0x7fc2a015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2a015cf50 0x7fc2a015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 -- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a006c630 msgr2=0x7fc2a015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a006c630 0x7fc2a015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 -- 172.21.15.47:0/4075293948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a0166f20 con 0x7fc2a0160b50 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc29fe00640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a015f6d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc29801a5e0 tx=0x7fc298019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc297400640 1 -- 172.21.15.47:0/4075293948 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2980b8670 con 0x7fc2a0160b50 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc297400640 1 -- 172.21.15.47:0/4075293948 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2980be070 con 0x7fc2a0160b50 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a01591e0 con 0x7fc2a0160b50 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc297400640 1 -- 172.21.15.47:0/4075293948 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2980b8a70 con 0x7fc2a0160b50 2024-04-26T23:46:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a009bb90 con 0x7fc2a0160b50 2024-04-26T23:46:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.720+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a0069700 con 0x7fc2a0160b50 2024-04-26T23:46:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.724+0000 7fc297400640 1 -- 172.21.15.47:0/4075293948 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc2980b8c10 con 0x7fc2a0160b50 2024-04-26T23:46:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.724+0000 7fc297400640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc280068380 0x7fc28006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.724+0000 7fc297400640 1 -- 172.21.15.47:0/4075293948 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fc298121aa0 con 0x7fc2a0160b50 2024-04-26T23:46:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.724+0000 7fc29f400640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc280068380 0x7fc28006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.724+0000 7fc29f400640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc280068380 0x7fc28006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc290007fd0 tx=0x7fc290007e40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.728+0000 7fc297400640 1 -- 172.21.15.47:0/4075293948 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc2980165a0 con 0x7fc2a0160b50 2024-04-26T23:46:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.892+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc2a0073d50 con 0x7fc2a0160b50 2024-04-26T23:46:21.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.892+0000 7fc297400640 1 -- 172.21.15.47:0/4075293948 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fc2980f1a00 con 0x7fc2a0160b50 2024-04-26T23:46:21.901 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:46:21.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc280068380 msgr2=0x7fc28006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc280068380 0x7fc28006a840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc290007fd0 tx=0x7fc290007e40 comp rx=0 tx=0).stop 2024-04-26T23:46:21.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 msgr2=0x7fc2a015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:21.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a015f6d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc29801a5e0 tx=0x7fc298019750 comp rx=0 tx=0).stop 2024-04-26T23:46:21.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 shutdown_connections 2024-04-26T23:46:21.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc280068380 0x7fc28006a840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2a0160b50 0x7fc2a015f6d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2a015cf50 0x7fc2a015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 --2- 172.21.15.47:0/4075293948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a006c630 0x7fc2a015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 >> 172.21.15.47:0/4075293948 conn(0x7fc2a00b2b70 msgr2=0x7fc2a0166810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 shutdown_connections 2024-04-26T23:46:21.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:21.896+0000 7fc2a6200640 1 -- 172.21.15.47:0/4075293948 wait complete. 2024-04-26T23:46:21.922 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:46:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 Processor -- start 2024-04-26T23:46:22.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 -- start start 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6d8c06c660 0x7f6d8c0b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6d8c06ca40 0x7f6d8c0d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6d8c0b15b0 con 0x7f6d8c06c660 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6d8c0b5200 con 0x7f6d8c06ca40 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d91400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c0b6fc0 con 0x7f6d8c0b6720 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6d8c06c660 0x7f6d8c0b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6d8c06c660 0x7f6d8c0b4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51432/0 (socket says 172.21.15.47:51432) 2024-04-26T23:46:22.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 -- 172.21.15.47:0/4255696677 learned_addr learned my addr 172.21.15.47:0/4255696677 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:22.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d83e00640 1 --2- 172.21.15.47:0/4255696677 >> v2:172.21.15.203:3300/0 conn(0x7f6d8c06ca40 0x7f6d8c0d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d90a00640 1 --2- 172.21.15.47:0/4255696677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 -- 172.21.15.47:0/4255696677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 msgr2=0x7f6d8c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:22.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 --2- 172.21.15.47:0/4255696677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 -- 172.21.15.47:0/4255696677 >> v2:172.21.15.203:3300/0 conn(0x7f6d8c06ca40 msgr2=0x7f6d8c0d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 --2- 172.21.15.47:0/4255696677 >> v2:172.21.15.203:3300/0 conn(0x7f6d8c06ca40 0x7f6d8c0d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d8be00640 1 -- 172.21.15.47:0/4255696677 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c0d2b40 con 0x7f6d8c06c660 2024-04-26T23:46:22.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.056+0000 7f6d90a00640 1 --2- 172.21.15.47:0/4255696677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:22.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d8be00640 1 --2- 172.21.15.47:0/4255696677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06c660 0x7f6d8c0b4cc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009870 tx=0x7f6d7c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7404d855841c0877 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d8b400640 1 -- 172.21.15.47:0/4255696677 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0b0070 con 0x7f6d8c06c660 2024-04-26T23:46:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d8b400640 1 -- 172.21.15.47:0/4255696677 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0ab600 con 0x7f6d8c06c660 2024-04-26T23:46:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d8b400640 1 -- 172.21.15.47:0/4255696677 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0ab9d0 con 0x7f6d8c06c660 2024-04-26T23:46:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 -- 172.21.15.47:0/4255696677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06c660 msgr2=0x7f6d8c0b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 --2- 172.21.15.47:0/4255696677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06c660 0x7f6d8c0b4cc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009870 tx=0x7f6d7c01c400 comp rx=0 tx=0).stop 2024-04-26T23:46:22.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 -- 172.21.15.47:0/4255696677 shutdown_connections 2024-04-26T23:46:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 --2- 172.21.15.47:0/4255696677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 --2- 172.21.15.47:0/4255696677 >> v2:172.21.15.203:3300/0 conn(0x7f6d8c06ca40 0x7f6d8c0d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 --2- 172.21.15.47:0/4255696677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06c660 0x7f6d8c0b4cc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 -- 172.21.15.47:0/4255696677 >> 172.21.15.47:0/4255696677 conn(0x7f6d8c06d510 msgr2=0x7f6d8c06d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 -- 172.21.15.47:0/4255696677 shutdown_connections 2024-04-26T23:46:22.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 -- 172.21.15.47:0/4255696677 wait complete. 2024-04-26T23:46:22.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 Processor -- start 2024-04-26T23:46:22.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.060+0000 7f6d91400640 1 -- start start 2024-04-26T23:46:22.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c06c660 0x7f6d8c1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06ca40 0x7f6d8c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c0af5b0 con 0x7f6d8c06ca40 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c15f4b0 con 0x7f6d8c06c660 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d8c0af730 con 0x7f6d8c0b6720 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06ca40 0x7f6d8c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06ca40 0x7f6d8c14f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51448/0 (socket says 172.21.15.47:51448) 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 -- 172.21.15.47:0/3649073145 learned_addr learned my addr 172.21.15.47:0/3649073145 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d8be00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c06c660 0x7f6d8c1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d90a00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 -- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 msgr2=0x7f6d8c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 -- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c06c660 msgr2=0x7f6d8c1500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c06c660 0x7f6d8c1500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 -- 172.21.15.47:0/3649073145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c150900 con 0x7f6d8c06ca40 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d90a00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d83e00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06ca40 0x7f6d8c14f880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400e870 tx=0x7f6d7400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d88c00640 1 -- 172.21.15.47:0/3649073145 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74017070 con 0x7f6d8c06ca40 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d88c00640 1 -- 172.21.15.47:0/3649073145 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7400ee60 con 0x7f6d8c06ca40 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d88c00640 1 -- 172.21.15.47:0/3649073145 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7400cb80 con 0x7f6d8c06ca40 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8c14eda0 con 0x7f6d8c06ca40 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8c1505f0 con 0x7f6d8c06ca40 2024-04-26T23:46:22.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.064+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8c069b80 con 0x7f6d8c06ca40 2024-04-26T23:46:22.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.068+0000 7f6d88c00640 1 -- 172.21.15.47:0/3649073145 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d7401a070 con 0x7f6d8c06ca40 2024-04-26T23:46:22.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.068+0000 7f6d88c00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d68068380 0x7f6d6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.068+0000 7f6d88c00640 1 -- 172.21.15.47:0/3649073145 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f6d74086d10 con 0x7f6d8c06ca40 2024-04-26T23:46:22.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.068+0000 7f6d8be00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d68068380 0x7f6d6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.068+0000 7f6d8be00640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d68068380 0x7f6d6806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0ad000 tx=0x7f6d7c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.072+0000 7f6d88c00640 1 -- 172.21.15.47:0/3649073145 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6d7408c020 con 0x7f6d8c06ca40 2024-04-26T23:46:22.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d8c157680 con 0x7f6d8c06ca40 2024-04-26T23:46:22.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d88c00640 1 -- 172.21.15.47:0/3649073145 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f6d74056ac0 con 0x7f6d8c06ca40 2024-04-26T23:46:22.279 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:22.279 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:46:22.280 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:46:22.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d68068380 msgr2=0x7f6d6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d68068380 0x7f6d6806a840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c0ad000 tx=0x7f6d7c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:46:22.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06ca40 msgr2=0x7f6d8c14f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06ca40 0x7f6d8c14f880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400e870 tx=0x7f6d7400ed30 comp rx=0 tx=0).stop 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 shutdown_connections 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d68068380 0x7f6d6806a840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d8c0b6720 0x7f6d8c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d8c06ca40 0x7f6d8c14f880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 --2- 172.21.15.47:0/3649073145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c06c660 0x7f6d8c1500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 >> 172.21.15.47:0/3649073145 conn(0x7f6d8c06d510 msgr2=0x7f6d8c162bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 shutdown_connections 2024-04-26T23:46:22.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.272+0000 7f6d91400640 1 -- 172.21.15.47:0/3649073145 wait complete. 2024-04-26T23:46:22.300 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:22.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ea00640 1 Processor -- start 2024-04-26T23:46:22.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ea00640 1 -- start start 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ea00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5e280ce310 0x7f5e2815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5e2806fcd0 0x7f5e280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ea00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2815fc50 con 0x7f5e2815c100 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ea00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5e28160860 con 0x7f5e2806fcd0 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ea00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2815d4a0 con 0x7f5e280ce310 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e27e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5e2815c100 0x7f5e280cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50140/0 (socket says 172.21.15.47:50140) 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e27e00640 1 -- 172.21.15.47:0/3365075459 learned_addr learned my addr 172.21.15.47:0/3365075459 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ca00640 1 --2- 172.21.15.47:0/3365075459 >> v2:172.21.15.47:3300/0 conn(0x7f5e2806fcd0 0x7f5e280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e27400640 1 --2- 172.21.15.47:0/3365075459 >> v2:172.21.15.203:3300/0 conn(0x7f5e280ce310 0x7f5e2815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e26a00640 1 -- 172.21.15.47:0/3365075459 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402071680 0 0) 0x7f5e2815fc50 con 0x7f5e2815c100 2024-04-26T23:46:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e26a00640 1 -- 172.21.15.47:0/3365075459 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e0c003530 con 0x7f5e2815c100 2024-04-26T23:46:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ca00640 1 -- 172.21.15.47:0/3365075459 >> v2:172.21.15.203:3300/0 conn(0x7f5e280ce310 msgr2=0x7f5e2815cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ca00640 1 --2- 172.21.15.47:0/3365075459 >> v2:172.21.15.203:3300/0 conn(0x7f5e280ce310 0x7f5e2815cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ca00640 1 -- 172.21.15.47:0/3365075459 >> v1:172.21.15.47:6789/0 conn(0x7f5e2815c100 legacy=0x7f5e280cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.436+0000 7f5e2ca00640 1 -- 172.21.15.47:0/3365075459 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2815ff30 con 0x7f5e2806fcd0 2024-04-26T23:46:22.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ca00640 1 --2- 172.21.15.47:0/3365075459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e2806fcd0 0x7f5e280b4e10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e281609e0 tx=0x7f5e2001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf3170fef14a794 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e26a00640 1 -- 172.21.15.47:0/3365075459 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e200b2070 con 0x7f5e2806fcd0 2024-04-26T23:46:22.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e26a00640 1 -- 172.21.15.47:0/3365075459 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e200a59f0 con 0x7f5e2806fcd0 2024-04-26T23:46:22.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e26a00640 1 -- 172.21.15.47:0/3365075459 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e200a5dc0 con 0x7f5e2806fcd0 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3365075459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e2806fcd0 msgr2=0x7f5e280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3365075459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e2806fcd0 0x7f5e280b4e10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e281609e0 tx=0x7f5e2001c930 comp rx=0 tx=0).stop 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3365075459 shutdown_connections 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3365075459 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e2806fcd0 0x7f5e280b4e10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3365075459 >> v2:172.21.15.203:3300/0 conn(0x7f5e280ce310 0x7f5e2815cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3365075459 >> 172.21.15.47:0/3365075459 conn(0x7f5e2806c800 msgr2=0x7f5e2806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3365075459 shutdown_connections 2024-04-26T23:46:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3365075459 wait complete. 2024-04-26T23:46:22.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 Processor -- start 2024-04-26T23:46:22.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.440+0000 7f5e2ea00640 1 -- start start 2024-04-26T23:46:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e2806fcd0 0x7f5e2814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e280ce310 0x7f5e2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e2815c100 0x7f5e2806e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5e280b5ef0 con 0x7f5e280ce310 2024-04-26T23:46:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e280b5d70 con 0x7f5e2815c100 2024-04-26T23:46:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5e280b6070 con 0x7f5e2806fcd0 2024-04-26T23:46:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e280ce310 0x7f5e2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e280ce310 0x7f5e2806e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51474/0 (socket says 172.21.15.47:51474) 2024-04-26T23:46:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 -- 172.21.15.47:0/3977657482 learned_addr learned my addr 172.21.15.47:0/3977657482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27e00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e2806fcd0 0x7f5e2814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ca00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e2815c100 0x7f5e2806e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 -- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e2806fcd0 msgr2=0x7f5e2814cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e2806fcd0 0x7f5e2814cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 -- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e2815c100 msgr2=0x7f5e2806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e2815c100 0x7f5e2806e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 -- 172.21.15.47:0/3977657482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e280aeac0 con 0x7f5e280ce310 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ca00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e2815c100 0x7f5e2806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e27400640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e280ce310 0x7f5e2806e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d830 tx=0x7f5e1400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e1fe00640 1 -- 172.21.15.47:0/3977657482 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e140059a0 con 0x7f5e280ce310 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e1fe00640 1 -- 172.21.15.47:0/3977657482 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e14005b40 con 0x7f5e280ce310 2024-04-26T23:46:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e1fe00640 1 -- 172.21.15.47:0/3977657482 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14005d30 con 0x7f5e280ce310 2024-04-26T23:46:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e280aeda0 con 0x7f5e280ce310 2024-04-26T23:46:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e280af360 con 0x7f5e280ce310 2024-04-26T23:46:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.444+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e28069700 con 0x7f5e280ce310 2024-04-26T23:46:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.448+0000 7f5e1fe00640 1 -- 172.21.15.47:0/3977657482 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5e1401b020 con 0x7f5e280ce310 2024-04-26T23:46:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.448+0000 7f5e1fe00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e08068380 0x7f5e0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.448+0000 7f5e1fe00640 1 -- 172.21.15.47:0/3977657482 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f5e140869f0 con 0x7f5e280ce310 2024-04-26T23:46:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.448+0000 7f5e27e00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e08068380 0x7f5e0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.448+0000 7f5e27e00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e08068380 0x7f5e0806a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e18007fd0 tx=0x7f5e18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.452+0000 7f5e1fe00640 1 -- 172.21.15.47:0/3977657482 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5e14056fb0 con 0x7f5e280ce310 2024-04-26T23:46:22.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.616+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e280d08b0 con 0x7f5e280ce310 2024-04-26T23:46:22.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.616+0000 7f5e1fe00640 1 -- 172.21.15.47:0/3977657482 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16828 (secure 0 0 0) 0x7f5e140568b0 con 0x7f5e280ce310 2024-04-26T23:46:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:22.625 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:13.826625+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e08068380 msgr2=0x7f5e0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e08068380 0x7f5e0806a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e18007fd0 tx=0x7f5e18009040 comp rx=0 tx=0).stop 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e280ce310 msgr2=0x7f5e2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e280ce310 0x7f5e2806e2f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d830 tx=0x7f5e1400dcf0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 shutdown_connections 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5e08068380 0x7f5e0806a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e2815c100 0x7f5e2806e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5e280ce310 0x7f5e2806e2f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 --2- 172.21.15.47:0/3977657482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5e2806fcd0 0x7f5e2814cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 >> 172.21.15.47:0/3977657482 conn(0x7f5e2806c800 msgr2=0x7f5e28165360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 shutdown_connections 2024-04-26T23:46:22.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.620+0000 7f5e2ea00640 1 -- 172.21.15.47:0/3977657482 wait complete. 2024-04-26T23:46:22.646 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:46:22.646 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:46:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.776+0000 7f0703e00640 1 Processor -- start 2024-04-26T23:46:22.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.776+0000 7f0703e00640 1 -- start start 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0703e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07041454e0 0x7f07040cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0703e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07040cc3c0 0x7f070406f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0703e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f070406fe70 0x7f070415f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0703e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f07040702c0 con 0x7f07041454e0 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0703e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0704073430 con 0x7f070406fe70 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0703e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0704073710 con 0x7f07040cc3c0 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07041454e0 0x7f07040cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f07041454e0 0x7f07040cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51482/0 (socket says 172.21.15.47:51482) 2024-04-26T23:46:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 -- 172.21.15.47:0/767790149 learned_addr learned my addr 172.21.15.47:0/767790149 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0703400640 1 --2- 172.21.15.47:0/767790149 >> v2:172.21.15.203:3300/0 conn(0x7f070406fe70 0x7f070415f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f06fa000640 1 --2- 172.21.15.47:0/767790149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07040cc3c0 0x7f070406f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 -- 172.21.15.47:0/767790149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07040cc3c0 msgr2=0x7f070406f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 --2- 172.21.15.47:0/767790149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07040cc3c0 0x7f070406f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 -- 172.21.15.47:0/767790149 >> v2:172.21.15.203:3300/0 conn(0x7f070406fe70 msgr2=0x7f070415f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 --2- 172.21.15.47:0/767790149 >> v2:172.21.15.203:3300/0 conn(0x7f070406fe70 0x7f070415f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f0702a00640 1 -- 172.21.15.47:0/767790149 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07040739f0 con 0x7f07041454e0 2024-04-26T23:46:22.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.780+0000 7f06fa000640 1 --2- 172.21.15.47:0/767790149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07040cc3c0 0x7f070406f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0702a00640 1 --2- 172.21.15.47:0/767790149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07041454e0 0x7f07040cbe80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f070415c380 tx=0x7f06f401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984c8636aecf58aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0702000640 1 -- 172.21.15.47:0/767790149 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f40b0070 con 0x7f07041454e0 2024-04-26T23:46:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0702000640 1 -- 172.21.15.47:0/767790149 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f40ab600 con 0x7f07041454e0 2024-04-26T23:46:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0702000640 1 -- 172.21.15.47:0/767790149 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f40ab9d0 con 0x7f07041454e0 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 -- 172.21.15.47:0/767790149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07041454e0 msgr2=0x7f07040cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 --2- 172.21.15.47:0/767790149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07041454e0 0x7f07040cbe80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f070415c380 tx=0x7f06f401c260 comp rx=0 tx=0).stop 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 -- 172.21.15.47:0/767790149 shutdown_connections 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 --2- 172.21.15.47:0/767790149 >> v2:172.21.15.203:3300/0 conn(0x7f070406fe70 0x7f070415f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 --2- 172.21.15.47:0/767790149 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07040cc3c0 0x7f070406f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 --2- 172.21.15.47:0/767790149 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07041454e0 0x7f07040cbe80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 -- 172.21.15.47:0/767790149 >> 172.21.15.47:0/767790149 conn(0x7f07040d0af0 msgr2=0x7f07040d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:22.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 -- 172.21.15.47:0/767790149 shutdown_connections 2024-04-26T23:46:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 -- 172.21.15.47:0/767790149 wait complete. 2024-04-26T23:46:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 Processor -- start 2024-04-26T23:46:22.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.784+0000 7f0703e00640 1 -- start start 2024-04-26T23:46:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070406fe70 0x7f070414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07040cc3c0 0x7f07040b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07041454e0 0x7f07040b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0704145a40 con 0x7f07040cc3c0 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f07041458c0 con 0x7f070406fe70 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f07040ce7c0 con 0x7f07041454e0 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07040cc3c0 0x7f07040b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07040cc3c0 0x7f07040b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51494/0 (socket says 172.21.15.47:51494) 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 -- 172.21.15.47:0/2866553645 learned_addr learned my addr 172.21.15.47:0/2866553645 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0702a00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070406fe70 0x7f070414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703400640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07041454e0 0x7f07040b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 -- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07041454e0 msgr2=0x7f07040b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07041454e0 0x7f07040b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 -- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070406fe70 msgr2=0x7f070414f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070406fe70 0x7f070414f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 -- 172.21.15.47:0/2866553645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070415b710 con 0x7f07040cc3c0 2024-04-26T23:46:22.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fa000640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07040cc3c0 0x7f07040b3920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c7c0 tx=0x7f06ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fbe00640 1 -- 172.21.15.47:0/2866553645 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec007a30 con 0x7f07040cc3c0 2024-04-26T23:46:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fbe00640 1 -- 172.21.15.47:0/2866553645 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec007bd0 con 0x7f07040cc3c0 2024-04-26T23:46:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fbe00640 1 -- 172.21.15.47:0/2866553645 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0113f0 con 0x7f07040cc3c0 2024-04-26T23:46:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0704143720 con 0x7f07040cc3c0 2024-04-26T23:46:22.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070415ccf0 con 0x7f07040cc3c0 2024-04-26T23:46:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070413de00 con 0x7f07040cc3c0 2024-04-26T23:46:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.788+0000 7f06fbe00640 1 -- 172.21.15.47:0/2866553645 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06ec011590 con 0x7f07040cc3c0 2024-04-26T23:46:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.792+0000 7f06fbe00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06e0068380 0x7f06e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:22.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.792+0000 7f06fbe00640 1 -- 172.21.15.47:0/2866553645 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f06ec086c10 con 0x7f07040cc3c0 2024-04-26T23:46:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.792+0000 7f0702a00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06e0068380 0x7f06e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:22.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.792+0000 7f0702a00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06e0068380 0x7f06e006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06f40ad000 tx=0x7f06f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:22.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.796+0000 7f06fbe00640 1 -- 172.21.15.47:0/2866553645 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f070413de00 con 0x7f07040cc3c0 2024-04-26T23:46:23.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0704069470 con 0x7f07040cc3c0 2024-04-26T23:46:23.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f06fbe00640 1 -- 172.21.15.47:0/2866553645 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7f070415b710 con 0x7f07040cc3c0 2024-04-26T23:46:23.004 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:23.004 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:46:23.004 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:46:23.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06e0068380 msgr2=0x7f06e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06e0068380 0x7f06e006a840 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06f40ad000 tx=0x7f06f4008040 comp rx=0 tx=0).stop 2024-04-26T23:46:23.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07040cc3c0 msgr2=0x7f07040b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07040cc3c0 0x7f07040b3920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c7c0 tx=0x7f06ec00cc80 comp rx=0 tx=0).stop 2024-04-26T23:46:23.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 shutdown_connections 2024-04-26T23:46:23.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06e0068380 0x7f06e006a840 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f07041454e0 0x7f07040b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f07040cc3c0 0x7f07040b3920 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 --2- 172.21.15.47:0/2866553645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f070406fe70 0x7f070414f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 >> 172.21.15.47:0/2866553645 conn(0x7f07040d0af0 msgr2=0x7f07040ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:23.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 shutdown_connections 2024-04-26T23:46:23.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:22.996+0000 7f0703e00640 1 -- 172.21.15.47:0/2866553645 wait complete. 2024-04-26T23:46:23.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:46:23.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.156+0000 7fb291800640 1 Processor -- start 2024-04-26T23:46:23.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.156+0000 7fb291800640 1 -- start start 2024-04-26T23:46:23.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb291800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb28c160810 0x7fb28c071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb291800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb28c0d1860 0x7fb28c0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb291800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28c0cd830 con 0x7fb28c072150 2024-04-26T23:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb291800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c071080 con 0x7fb28c160810 2024-04-26T23:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb291800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c071360 con 0x7fb28c0d1860 2024-04-26T23:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb28c160810 0x7fb28c071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb28c160810 0x7fb28c071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51504/0 (socket says 172.21.15.47:51504) 2024-04-26T23:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb283e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb28c072150 0x7fb28c0d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50154/0 (socket says 172.21.15.47:50154) 2024-04-26T23:46:23.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28aa00640 1 -- 172.21.15.47:0/175725431 learned_addr learned my addr 172.21.15.47:0/175725431 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28aa00640 1 -- 172.21.15.47:0/175725431 >> v2:172.21.15.203:3300/0 conn(0x7fb28c0d1860 msgr2=0x7fb28c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28b400640 1 --2- 172.21.15.47:0/175725431 >> v2:172.21.15.203:3300/0 conn(0x7fb28c0d1860 0x7fb28c0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28aa00640 1 --2- 172.21.15.47:0/175725431 >> v2:172.21.15.203:3300/0 conn(0x7fb28c0d1860 0x7fb28c0cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28aa00640 1 -- 172.21.15.47:0/175725431 >> v1:172.21.15.47:6789/0 conn(0x7fb28c072150 legacy=0x7fb28c0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28a000640 1 -- 172.21.15.47:0/175725431 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382505846 0 0) 0x7fb28c0cd830 con 0x7fb28c072150 2024-04-26T23:46:23.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28aa00640 1 -- 172.21.15.47:0/175725431 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c0cdad0 con 0x7fb28c160810 2024-04-26T23:46:23.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.160+0000 7fb28b400640 1 --2- 172.21.15.47:0/175725431 >> v2:172.21.15.203:3300/0 conn(0x7fb28c0d1860 0x7fb28c0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:23.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb28aa00640 1 --2- 172.21.15.47:0/175725431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c160810 0x7fb28c071760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb28c073fa0 tx=0x7fb27c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b65f844f99c74b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb28a000640 1 -- 172.21.15.47:0/175725431 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0b5070 con 0x7fb28c160810 2024-04-26T23:46:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb28a000640 1 -- 172.21.15.47:0/175725431 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c0a8a10 con 0x7fb28c160810 2024-04-26T23:46:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb28a000640 1 -- 172.21.15.47:0/175725431 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0a8de0 con 0x7fb28c160810 2024-04-26T23:46:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 -- 172.21.15.47:0/175725431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c160810 msgr2=0x7fb28c071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 --2- 172.21.15.47:0/175725431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c160810 0x7fb28c071760 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb28c073fa0 tx=0x7fb27c01ed10 comp rx=0 tx=0).stop 2024-04-26T23:46:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 -- 172.21.15.47:0/175725431 shutdown_connections 2024-04-26T23:46:23.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 --2- 172.21.15.47:0/175725431 >> v2:172.21.15.203:3300/0 conn(0x7fb28c0d1860 0x7fb28c0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 --2- 172.21.15.47:0/175725431 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c160810 0x7fb28c071760 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 -- 172.21.15.47:0/175725431 >> 172.21.15.47:0/175725431 conn(0x7fb28c0d2e90 msgr2=0x7fb28c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:23.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 -- 172.21.15.47:0/175725431 shutdown_connections 2024-04-26T23:46:23.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 -- 172.21.15.47:0/175725431 wait complete. 2024-04-26T23:46:23.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 Processor -- start 2024-04-26T23:46:23.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.164+0000 7fb291800640 1 -- start start 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c072150 0x7fb28c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c0d1860 0x7fb28c158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb28c160810 0x7fb28c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c160bf0 con 0x7fb28c072150 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c071ca0 con 0x7fb28c0d1860 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb28c160d70 con 0x7fb28c160810 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c072150 0x7fb28c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c072150 0x7fb28c1593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51510/0 (socket says 172.21.15.47:51510) 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 -- 172.21.15.47:0/2339168874 learned_addr learned my addr 172.21.15.47:0/2339168874 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:23.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb283e00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c0d1860 0x7fb28c158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28b400640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb28c160810 0x7fb28c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 -- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb28c160810 msgr2=0x7fb28c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb28c160810 0x7fb28c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 -- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c0d1860 msgr2=0x7fb28c158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c0d1860 0x7fb28c158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 -- 172.21.15.47:0/2339168874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c0d08a0 con 0x7fb28c072150 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28b400640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb28c160810 0x7fb28c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb283e00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c0d1860 0x7fb28c158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb28aa00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c072150 0x7fb28c1593a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0b3040 tx=0x7fb27c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb282a00640 1 -- 172.21.15.47:0/2339168874 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0b5070 con 0x7fb28c072150 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb282a00640 1 -- 172.21.15.47:0/2339168874 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c0b0c50 con 0x7fb28c072150 2024-04-26T23:46:23.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c0d0b80 con 0x7fb28c072150 2024-04-26T23:46:23.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb282a00640 1 -- 172.21.15.47:0/2339168874 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0bb410 con 0x7fb28c072150 2024-04-26T23:46:23.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c0d0570 con 0x7fb28c072150 2024-04-26T23:46:23.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28c1f4c20 con 0x7fb28c072150 2024-04-26T23:46:23.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.168+0000 7fb282a00640 1 -- 172.21.15.47:0/2339168874 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb27c0c2060 con 0x7fb28c072150 2024-04-26T23:46:23.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.172+0000 7fb282a00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb268068380 0x7fb26806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.172+0000 7fb282a00640 1 -- 172.21.15.47:0/2339168874 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fb27c123db0 con 0x7fb28c072150 2024-04-26T23:46:23.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.172+0000 7fb283e00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb268068380 0x7fb26806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.172+0000 7fb283e00640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb268068380 0x7fb26806a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06e8b0 tx=0x7fb274007cb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.176+0000 7fb282a00640 1 -- 172.21.15.47:0/2339168874 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb27c128070 con 0x7fb28c072150 2024-04-26T23:46:23.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.372+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb28c069700 con 0x7fb28c072150 2024-04-26T23:46:23.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.372+0000 7fb282a00640 1 -- 172.21.15.47:0/2339168874 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5175 (secure 0 0 0) 0x7fb27c018870 con 0x7fb28c072150 2024-04-26T23:46:23.382 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:23.382 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/2245663608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":2245663608},{"type":"v1","addr":"172.21.15.47:6834","nonce":2245663608}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3474335836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3474335836},{"type":"v1","addr":"172.21.15.47:6835","nonce":3474335836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/439272157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":439272157},{"type":"v1","addr":"172.21.15.203:6837","nonce":439272157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:45:32.065076+0000","modified":"2024-04-26T23:45:35.081165+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.203:6836/428433298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":428433298},{"type":"v1","addr":"172.21.15.203:6836","nonce":428433298}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-04-26T23:46:23.382 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 8 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb268068380 msgr2=0x7fb26806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb268068380 0x7fb26806a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb28c06e8b0 tx=0x7fb274007cb0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c072150 msgr2=0x7fb28c1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c072150 0x7fb28c1593a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb27c0b3040 tx=0x7fb27c01bab0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 shutdown_connections 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb268068380 0x7fb26806a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb28c160810 0x7fb28c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb28c0d1860 0x7fb28c158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 --2- 172.21.15.47:0/2339168874 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb28c072150 0x7fb28c1593a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 >> 172.21.15.47:0/2339168874 conn(0x7fb28c0d2e90 msgr2=0x7fb28c15f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 shutdown_connections 2024-04-26T23:46:23.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.376+0000 7fb291800640 1 -- 172.21.15.47:0/2339168874 wait complete. 2024-04-26T23:46:23.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:23.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf0aa00640 1 Processor -- start 2024-04-26T23:46:23.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf0aa00640 1 -- start start 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf0aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf04160810 0x7fbf04071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf0aa00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbf040d1860 0x7fbf040cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf0aa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf040cd830 con 0x7fbf04072150 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf0aa00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbf04071080 con 0x7fbf040d1860 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf0aa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbf04071360 con 0x7fbf04160810 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbefb400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbf04072150 0x7fbf040d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50162/0 (socket says 172.21.15.47:50162) 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbefb400640 1 -- 172.21.15.47:0/4128005783 learned_addr learned my addr 172.21.15.47:0/4128005783 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf03e00640 1 --2- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf04160810 0x7fbf04071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf08a00640 1 --2- 172.21.15.47:0/4128005783 >> v2:172.21.15.203:3300/0 conn(0x7fbf040d1860 0x7fbf040cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf03400640 1 -- 172.21.15.47:0/4128005783 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3958159544 0 0) 0x7fbf040cd830 con 0x7fbf04072150 2024-04-26T23:46:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf03400640 1 -- 172.21.15.47:0/4128005783 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbee8003530 con 0x7fbf04072150 2024-04-26T23:46:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf08a00640 1 -- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf04160810 msgr2=0x7fbf04071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf08a00640 1 --2- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf04160810 0x7fbf04071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf08a00640 1 -- 172.21.15.47:0/4128005783 >> v1:172.21.15.47:6789/0 conn(0x7fbf04072150 legacy=0x7fbf040d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf08a00640 1 -- 172.21.15.47:0/4128005783 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf040cdad0 con 0x7fbf040d1860 2024-04-26T23:46:23.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.536+0000 7fbf03e00640 1 --2- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf04160810 0x7fbf04071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf08a00640 1 --2- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf040d1860 0x7fbf040cdff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009d90 tx=0x7fbefc01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8161d9daf8c618ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf03400640 1 -- 172.21.15.47:0/4128005783 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0b4070 con 0x7fbf040d1860 2024-04-26T23:46:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf03400640 1 -- 172.21.15.47:0/4128005783 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc0af600 con 0x7fbf040d1860 2024-04-26T23:46:23.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf03400640 1 -- 172.21.15.47:0/4128005783 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0af9d0 con 0x7fbf040d1860 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 -- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf040d1860 msgr2=0x7fbf040cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf040d1860 0x7fbf040cdff0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbefc009d90 tx=0x7fbefc01f150 comp rx=0 tx=0).stop 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 -- 172.21.15.47:0/4128005783 shutdown_connections 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf040d1860 0x7fbf040cdff0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/4128005783 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf04160810 0x7fbf04071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 -- 172.21.15.47:0/4128005783 >> 172.21.15.47:0/4128005783 conn(0x7fbf040d2e90 msgr2=0x7fbf040d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 -- 172.21.15.47:0/4128005783 shutdown_connections 2024-04-26T23:46:23.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.540+0000 7fbf0aa00640 1 -- 172.21.15.47:0/4128005783 wait complete. 2024-04-26T23:46:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 Processor -- start 2024-04-26T23:46:23.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 -- start start 2024-04-26T23:46:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf04072150 0x7fbf040b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf040d1860 0x7fbf04155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf04160810 0x7fbf040c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04160bf0 con 0x7fbf04160810 2024-04-26T23:46:23.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04071ca0 con 0x7fbf04072150 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbf04160d70 con 0x7fbf040d1860 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf04160810 0x7fbf040c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf04160810 0x7fbf040c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51526/0 (socket says 172.21.15.47:51526) 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 -- 172.21.15.47:0/3573958536 learned_addr learned my addr 172.21.15.47:0/3573958536 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 -- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf040d1860 msgr2=0x7fbf04155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf040d1860 0x7fbf04155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 -- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf04072150 msgr2=0x7fbf040b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf04072150 0x7fbf040b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 -- 172.21.15.47:0/3573958536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf040b6e80 con 0x7fbf04160810 2024-04-26T23:46:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf08a00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf04160810 0x7fbf040c9f60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0b2040 tx=0x7fbefc01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf00c00640 1 -- 172.21.15.47:0/3573958536 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0b4040 con 0x7fbf04160810 2024-04-26T23:46:23.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf00c00640 1 -- 172.21.15.47:0/3573958536 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc0c1070 con 0x7fbf04160810 2024-04-26T23:46:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf00c00640 1 -- 172.21.15.47:0/3573958536 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc009450 con 0x7fbf04160810 2024-04-26T23:46:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf040c7ce0 con 0x7fbf04160810 2024-04-26T23:46:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.544+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf040c82a0 con 0x7fbf04160810 2024-04-26T23:46:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.548+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf04069700 con 0x7fbf04160810 2024-04-26T23:46:23.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.548+0000 7fbf00c00640 1 -- 172.21.15.47:0/3573958536 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbefc0ba6b0 con 0x7fbf04160810 2024-04-26T23:46:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.548+0000 7fbf00c00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbee0068380 0x7fbee006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.548+0000 7fbf00c00640 1 -- 172.21.15.47:0/3573958536 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fbefc1252a0 con 0x7fbf04160810 2024-04-26T23:46:23.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.548+0000 7fbf03e00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbee0068380 0x7fbee006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.548+0000 7fbf03e00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbee0068380 0x7fbee006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006e90 tx=0x7fbef4006de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.552+0000 7fbf00c00640 1 -- 172.21.15.47:0/3573958536 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbefc018cb0 con 0x7fbf04160810 2024-04-26T23:46:23.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.716+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf0415fdf0 con 0x7fbf04160810 2024-04-26T23:46:23.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf00c00640 1 -- 172.21.15.47:0/3573958536 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16828 (secure 0 0 0) 0x7fbefc0f57c0 con 0x7fbf04160810 2024-04-26T23:46:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:23.727 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":25,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:13.826625+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:45:30.133691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T23:45:31.028800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:23.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbee0068380 msgr2=0x7fbee006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbee0068380 0x7fbee006a840 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006e90 tx=0x7fbef4006de0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf04160810 msgr2=0x7fbf040c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf04160810 0x7fbf040c9f60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0b2040 tx=0x7fbefc01bef0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 shutdown_connections 2024-04-26T23:46:23.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbee0068380 0x7fbee006a840 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbf04160810 0x7fbf040c9f60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbf040d1860 0x7fbf04155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 --2- 172.21.15.47:0/3573958536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf04072150 0x7fbf040b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 >> 172.21.15.47:0/3573958536 conn(0x7fbf040d2e90 msgr2=0x7fbf0406ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:23.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 shutdown_connections 2024-04-26T23:46:23.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.720+0000 7fbf0aa00640 1 -- 172.21.15.47:0/3573958536 wait complete. 2024-04-26T23:46:23.749 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:46:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.880+0000 7f9ac3200640 1 Processor -- start 2024-04-26T23:46:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.880+0000 7f9ac3200640 1 -- start start 2024-04-26T23:46:23.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9ac3200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9abc159b70 0x7f9abc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9ac3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc1603b0 0x7f9abc06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9ac3200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc0aea30 con 0x7f9abc0af7f0 2024-04-26T23:46:23.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9ac3200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9abc0af360 con 0x7f9abc159b70 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9ac3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc0aed10 con 0x7f9abc1603b0 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9abc159b70 0x7f9abc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9abc159b70 0x7f9abc06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51528/0 (socket says 172.21.15.47:51528) 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 -- 172.21.15.47:0/388876570 learned_addr learned my addr 172.21.15.47:0/388876570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9ac1200640 1 --2- 172.21.15.47:0/388876570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc1603b0 0x7f9abc06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 -- 172.21.15.47:0/388876570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc1603b0 msgr2=0x7f9abc06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 --2- 172.21.15.47:0/388876570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc1603b0 0x7f9abc06cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 -- 172.21.15.47:0/388876570 >> v1:172.21.15.203:6789/0 conn(0x7f9abc0af7f0 legacy=0x7f9abc15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 -- 172.21.15.47:0/388876570 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc0aeff0 con 0x7f9abc159b70 2024-04-26T23:46:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.884+0000 7f9abbe00640 1 --2- 172.21.15.47:0/388876570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc159b70 0x7f9abc06c630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0af4e0 tx=0x7f9aac01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f77e360d204bbbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9abb400640 1 -- 172.21.15.47:0/388876570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0ab650 con 0x7f9abc159b70 2024-04-26T23:46:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9abb400640 1 -- 172.21.15.47:0/388876570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac0b0070 con 0x7f9abc159b70 2024-04-26T23:46:23.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9abb400640 1 -- 172.21.15.47:0/388876570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0aba10 con 0x7f9abc159b70 2024-04-26T23:46:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- 172.21.15.47:0/388876570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc159b70 msgr2=0x7f9abc06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 --2- 172.21.15.47:0/388876570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc159b70 0x7f9abc06c630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0af4e0 tx=0x7f9aac01c540 comp rx=0 tx=0).stop 2024-04-26T23:46:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- 172.21.15.47:0/388876570 shutdown_connections 2024-04-26T23:46:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 --2- 172.21.15.47:0/388876570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc1603b0 0x7f9abc06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 --2- 172.21.15.47:0/388876570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc159b70 0x7f9abc06c630 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- 172.21.15.47:0/388876570 >> 172.21.15.47:0/388876570 conn(0x7f9abc0b2d40 msgr2=0x7f9abc0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:23.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- 172.21.15.47:0/388876570 shutdown_connections 2024-04-26T23:46:23.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- 172.21.15.47:0/388876570 wait complete. 2024-04-26T23:46:23.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 Processor -- start 2024-04-26T23:46:23.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- start start 2024-04-26T23:46:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc0af7f0 0x7f9abc0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc159b70 0x7f9abc158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc1603b0 0x7f9abc144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc06fa60 con 0x7f9abc1603b0 2024-04-26T23:46:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc06f8e0 con 0x7f9abc0af7f0 2024-04-26T23:46:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac3200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc06fbe0 con 0x7f9abc159b70 2024-04-26T23:46:23.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc1603b0 0x7f9abc144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc1603b0 0x7f9abc144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51534/0 (socket says 172.21.15.47:51534) 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ac1200640 1 -- 172.21.15.47:0/982986482 learned_addr learned my addr 172.21.15.47:0/982986482 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9abbe00640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc0af7f0 0x7f9abc0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.888+0000 7f9ab3e00640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc159b70 0x7f9abc158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac1200640 1 -- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc159b70 msgr2=0x7f9abc158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac1200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc159b70 0x7f9abc158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac1200640 1 -- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc0af7f0 msgr2=0x7f9abc0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac1200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc0af7f0 0x7f9abc0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:23.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac1200640 1 -- 172.21.15.47:0/982986482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc144d60 con 0x7f9abc1603b0 2024-04-26T23:46:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac1200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc1603b0 0x7f9abc144820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007e60 tx=0x7f9ab400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ab8c00640 1 -- 172.21.15.47:0/982986482 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4014420 con 0x7f9abc1603b0 2024-04-26T23:46:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ab8c00640 1 -- 172.21.15.47:0/982986482 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab4019070 con 0x7f9abc1603b0 2024-04-26T23:46:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ab8c00640 1 -- 172.21.15.47:0/982986482 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4014820 con 0x7f9abc1603b0 2024-04-26T23:46:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc0b57f0 con 0x7f9abc1603b0 2024-04-26T23:46:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc0cd7e0 con 0x7f9abc1603b0 2024-04-26T23:46:23.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc0695f0 con 0x7f9abc1603b0 2024-04-26T23:46:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ab8c00640 1 -- 172.21.15.47:0/982986482 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9ab40149c0 con 0x7f9abc1603b0 2024-04-26T23:46:23.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ab8c00640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068380 0x7f9a9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9ab8c00640 1 -- 172.21.15.47:0/982986482 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f9ab4087260 con 0x7f9abc1603b0 2024-04-26T23:46:23.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.892+0000 7f9abbe00640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068380 0x7f9a9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:23.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.896+0000 7f9abbe00640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068380 0x7f9a9806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0af000 tx=0x7f9aac0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:23.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:23.896+0000 7f9ab8c00640 1 -- 172.21.15.47:0/982986482 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9ab4057010 con 0x7f9abc1603b0 2024-04-26T23:46:24.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.096+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9abc06eca0 con 0x7f9abc1603b0 2024-04-26T23:46:24.104 INFO:tasks.ceph.mon.a.smithi047.stderr:2024-04-26T23:46:24.096+0000 7efc1ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:46:24.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ab8c00640 1 -- 172.21.15.47:0/982986482 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f9ab405b310 con 0x7f9abc1603b0 2024-04-26T23:46:24.107 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:46:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068380 msgr2=0x7f9a9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068380 0x7f9a9806a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0af000 tx=0x7f9aac0a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc1603b0 msgr2=0x7f9abc144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc1603b0 0x7f9abc144820 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4007e60 tx=0x7f9ab400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 shutdown_connections 2024-04-26T23:46:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068380 0x7f9a9806a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc1603b0 0x7f9abc144820 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc159b70 0x7f9abc158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 --2- 172.21.15.47:0/982986482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc0af7f0 0x7f9abc0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 >> 172.21.15.47:0/982986482 conn(0x7f9abc0b2d40 msgr2=0x7f9abc0b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 shutdown_connections 2024-04-26T23:46:24.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.100+0000 7f9ac3200640 1 -- 172.21.15.47:0/982986482 wait complete. 2024-04-26T23:46:24.118 INFO:tasks.ceph.mds.d.smithi203.stderr: -3254> 2024-04-26T23:45:36.379+0000 7fce88a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:46:24.130 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:46:24.169 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-26T23:46:24.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.264+0000 7fcafe600640 1 Processor -- start 2024-04-26T23:46:24.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.264+0000 7fcafe600640 1 -- start start 2024-04-26T23:46:24.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcafe600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf80d0390 0x7fcaf80af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:24.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcafe600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcaf81603e0 0x7fcaf806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:24.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcafe600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf80ae6a0 con 0x7fcaf806c630 2024-04-26T23:46:24.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcafe600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf80ae920 con 0x7fcaf81603e0 2024-04-26T23:46:24.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcafe600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf80aec00 con 0x7fcaf80d0390 2024-04-26T23:46:24.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaf7e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcaf81603e0 0x7fcaf806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:24.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaeea00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fcaf806c630 0x7fcaf815fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:44856/0 (socket says 172.21.15.47:44856) 2024-04-26T23:46:24.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaf7400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf80d0390 0x7fcaf80af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:24.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaeea00640 1 -- 172.21.15.47:0/1418587032 learned_addr learned my addr 172.21.15.47:0/1418587032 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:24.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaf7400640 1 -- 172.21.15.47:0/1418587032 >> v2:172.21.15.203:3300/0 conn(0x7fcaf81603e0 msgr2=0x7fcaf806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:24.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaf7400640 1 --2- 172.21.15.47:0/1418587032 >> v2:172.21.15.203:3300/0 conn(0x7fcaf81603e0 0x7fcaf806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaf7400640 1 -- 172.21.15.47:0/1418587032 >> v1:172.21.15.203:6789/0 conn(0x7fcaf806c630 legacy=0x7fcaf815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:24.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaf7400640 1 -- 172.21.15.47:0/1418587032 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf80aeee0 con 0x7fcaf80d0390 2024-04-26T23:46:24.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.268+0000 7fcaf6a00640 1 -- 172.21.15.47:0/1418587032 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489229030 0 0) 0x7fcae0001120 con 0x7fcaf806c630 2024-04-26T23:46:24.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcaf7400640 1 --2- 172.21.15.47:0/1418587032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf80d0390 0x7fcaf80af6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcae80097c0 tx=0x7fcae801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302b02a7eecb7145 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:24.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcaf6a00640 1 -- 172.21.15.47:0/1418587032 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae80b0070 con 0x7fcaf80d0390 2024-04-26T23:46:24.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcaf6a00640 1 -- 172.21.15.47:0/1418587032 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae80ab600 con 0x7fcaf80d0390 2024-04-26T23:46:24.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcaf6a00640 1 -- 172.21.15.47:0/1418587032 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae80ab9d0 con 0x7fcaf80d0390 2024-04-26T23:46:24.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 -- 172.21.15.47:0/1418587032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf80d0390 msgr2=0x7fcaf80af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:24.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 --2- 172.21.15.47:0/1418587032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf80d0390 0x7fcaf80af6e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcae80097c0 tx=0x7fcae801c410 comp rx=0 tx=0).stop 2024-04-26T23:46:24.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 -- 172.21.15.47:0/1418587032 shutdown_connections 2024-04-26T23:46:24.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 --2- 172.21.15.47:0/1418587032 >> v2:172.21.15.203:3300/0 conn(0x7fcaf81603e0 0x7fcaf806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 --2- 172.21.15.47:0/1418587032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf80d0390 0x7fcaf80af6e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 -- 172.21.15.47:0/1418587032 >> 172.21.15.47:0/1418587032 conn(0x7fcaf80b2b70 msgr2=0x7fcaf80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:24.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 -- 172.21.15.47:0/1418587032 shutdown_connections 2024-04-26T23:46:24.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 -- 172.21.15.47:0/1418587032 wait complete. 2024-04-26T23:46:24.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 Processor -- start 2024-04-26T23:46:24.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.272+0000 7fcafe600640 1 -- start start 2024-04-26T23:46:24.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf806c630 0x7fcaf81f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:24.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaf80d0390 0x7fcaf81563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:24.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf81603e0 0x7fcaf8072830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf806fa70 con 0x7fcaf80d0390 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf806f8f0 con 0x7fcaf806c630 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf806fbf0 con 0x7fcaf81603e0 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaf80d0390 0x7fcaf81563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaf80d0390 0x7fcaf81563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51538/0 (socket says 172.21.15.47:51538) 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 -- 172.21.15.47:0/138292301 learned_addr learned my addr 172.21.15.47:0/138292301 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaf7400640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf806c630 0x7fcaf81f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaf7e00640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf81603e0 0x7fcaf8072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 -- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf81603e0 msgr2=0x7fcaf8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf81603e0 0x7fcaf8072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 -- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf806c630 msgr2=0x7fcaf81f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf806c630 0x7fcaf81f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 -- 172.21.15.47:0/138292301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf8156d20 con 0x7fcaf80d0390 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaeea00640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaf80d0390 0x7fcaf81563b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c480 tx=0x7fcae000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaefe00640 1 -- 172.21.15.47:0/138292301 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0018070 con 0x7fcaf80d0390 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaefe00640 1 -- 172.21.15.47:0/138292301 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae0007500 con 0x7fcaf80d0390 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcaefe00640 1 -- 172.21.15.47:0/138292301 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0004a30 con 0x7fcaf80d0390 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf8157000 con 0x7fcaf80d0390 2024-04-26T23:46:24.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf809bcb0 con 0x7fcaf80d0390 2024-04-26T23:46:24.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.276+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf809beb0 con 0x7fcaf80d0390 2024-04-26T23:46:24.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.280+0000 7fcaefe00640 1 -- 172.21.15.47:0/138292301 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcae001b070 con 0x7fcaf80d0390 2024-04-26T23:46:24.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.280+0000 7fcaefe00640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcad4068380 0x7fcad406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:24.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.280+0000 7fcaefe00640 1 -- 172.21.15.47:0/138292301 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5940+0+0 (secure 0 0 0) 0x7fcae0085d10 con 0x7fcaf80d0390 2024-04-26T23:46:24.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.280+0000 7fcaf7400640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcad4068380 0x7fcad406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:24.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.280+0000 7fcaf7400640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcad4068380 0x7fcad406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcae80ad000 tx=0x7fcae80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:24.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.284+0000 7fcaefe00640 1 -- 172.21.15.47:0/138292301 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcaf809beb0 con 0x7fcaf80d0390 2024-04-26T23:46:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:24.484+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcaf806ecb0 con 0x7fcaf80d0390 2024-04-26T23:46:25.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.104+0000 7fcaefe00640 1 -- 172.21.15.47:0/138292301 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7fcae008b020 con 0x7fcaf80d0390 2024-04-26T23:46:25.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcad4068380 msgr2=0x7fcad406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcad4068380 0x7fcad406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcae80ad000 tx=0x7fcae80a6000 comp rx=0 tx=0).stop 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaf80d0390 msgr2=0x7fcaf81563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaf80d0390 0x7fcaf81563b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c480 tx=0x7fcae000c940 comp rx=0 tx=0).stop 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 shutdown_connections 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcad4068380 0x7fcad406a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcaf81603e0 0x7fcaf8072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcaf80d0390 0x7fcaf81563b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 --2- 172.21.15.47:0/138292301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcaf806c630 0x7fcaf81f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 >> 172.21.15.47:0/138292301 conn(0x7fcaf80b2b70 msgr2=0x7fcaf815cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:25.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 shutdown_connections 2024-04-26T23:46:25.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.108+0000 7fcafe600640 1 -- 172.21.15.47:0/138292301 wait complete. 2024-04-26T23:46:25.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:46:25.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.280+0000 7f5d26a00640 1 Processor -- start 2024-04-26T23:46:25.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.280+0000 7f5d26a00640 1 -- start start 2024-04-26T23:46:25.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d26a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5d2006d720 0x7f5d2006db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:25.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d26a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d200b5cf0 con 0x7f5d2015f410 2024-04-26T23:46:25.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d26a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2015f7f0 con 0x7f5d2006e070 2024-04-26T23:46:25.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d26a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5d200cd510 con 0x7f5d2006d720 2024-04-26T23:46:25.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d1fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5d2015f410 0x7f5d200d1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50168/0 (socket says 172.21.15.47:50168) 2024-04-26T23:46:25.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d1fe00640 1 -- 172.21.15.47:0/918881467 learned_addr learned my addr 172.21.15.47:0/918881467 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d17400640 1 --2- 172.21.15.47:0/918881467 >> v2:172.21.15.203:3300/0 conn(0x7f5d2006d720 0x7f5d2006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820355129 0 0) 0x7f5d10001120 con 0x7f5d2015f410 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d04003530 con 0x7f5d2015f410 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104728101 0 0) 0x7f5d2015f7f0 con 0x7f5d2006e070 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d10001120 con 0x7f5d2006e070 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d17400640 1 -- 172.21.15.47:0/918881467 >> v1:172.21.15.203:6789/0 conn(0x7f5d2006e070 legacy=0x7f5d200ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d17400640 1 -- 172.21.15.47:0/918881467 >> v1:172.21.15.47:6789/0 conn(0x7f5d2015f410 legacy=0x7f5d200d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4193562140 0 0) 0x7f5d04003530 con 0x7f5d2015f410 2024-04-26T23:46:25.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.284+0000 7f5d17400640 1 -- 172.21.15.47:0/918881467 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d200d2390 con 0x7f5d2006d720 2024-04-26T23:46:25.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d17400640 1 --2- 172.21.15.47:0/918881467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006d720 0x7f5d2006db30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d080097c0 tx=0x7f5d0801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0e91548a947a73c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:25.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d080b1070 con 0x7f5d2006d720 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d080a4c10 con 0x7f5d2006d720 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d1f400640 1 -- 172.21.15.47:0/918881467 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10001850 con 0x7f5d2006d720 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 -- 172.21.15.47:0/918881467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006d720 msgr2=0x7f5d2006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 --2- 172.21.15.47:0/918881467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006d720 0x7f5d2006db30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d080097c0 tx=0x7f5d0801c3c0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 -- 172.21.15.47:0/918881467 shutdown_connections 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 --2- 172.21.15.47:0/918881467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006d720 0x7f5d2006db30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 -- 172.21.15.47:0/918881467 >> 172.21.15.47:0/918881467 conn(0x7f5d200d2ec0 msgr2=0x7f5d200d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 -- 172.21.15.47:0/918881467 shutdown_connections 2024-04-26T23:46:25.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 -- 172.21.15.47:0/918881467 wait complete. 2024-04-26T23:46:25.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 Processor -- start 2024-04-26T23:46:25.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 -- start start 2024-04-26T23:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d2006d720 0x7f5d2015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.288+0000 7f5d26a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006e070 0x7f5d200c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d26a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d2015f410 0x7f5d20153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d26a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2016cf70 con 0x7f5d2006d720 2024-04-26T23:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d26a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2006e480 con 0x7f5d2006e070 2024-04-26T23:46:25.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d26a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2016d0f0 con 0x7f5d2015f410 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d2006d720 0x7f5d2015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d2006d720 0x7f5d2015b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51552/0 (socket says 172.21.15.47:51552) 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 -- 172.21.15.47:0/3478754397 learned_addr learned my addr 172.21.15.47:0/3478754397 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d17400640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006e070 0x7f5d200c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d24a00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d2015f410 0x7f5d20153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 -- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d2015f410 msgr2=0x7f5d20153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d2015f410 0x7f5d20153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 -- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006e070 msgr2=0x7f5d200c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006e070 0x7f5d200c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:25.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 -- 172.21.15.47:0/3478754397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d200c8ed0 con 0x7f5d2006d720 2024-04-26T23:46:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1fe00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d2006d720 0x7f5d2015b6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000c780 tx=0x7f5d1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1cc00640 1 -- 172.21.15.47:0/3478754397 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10017070 con 0x7f5d2006d720 2024-04-26T23:46:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1cc00640 1 -- 172.21.15.47:0/3478754397 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10005d10 con 0x7f5d2006d720 2024-04-26T23:46:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d200c91b0 con 0x7f5d2006d720 2024-04-26T23:46:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1cc00640 1 -- 172.21.15.47:0/3478754397 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d100072b0 con 0x7f5d2006d720 2024-04-26T23:46:25.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d200cb210 con 0x7f5d2006d720 2024-04-26T23:46:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d200695f0 con 0x7f5d2006d720 2024-04-26T23:46:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.292+0000 7f5d1cc00640 1 -- 172.21.15.47:0/3478754397 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d1001a070 con 0x7f5d2006d720 2024-04-26T23:46:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.296+0000 7f5d1cc00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5cfc068380 0x7f5cfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:25.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.296+0000 7f5d1cc00640 1 -- 172.21.15.47:0/3478754397 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5940+0+0 (secure 0 0 0) 0x7f5d100860c0 con 0x7f5d2006d720 2024-04-26T23:46:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.296+0000 7f5d17400640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5cfc068380 0x7f5cfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:25.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.296+0000 7f5d17400640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5cfc068380 0x7f5cfc06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d080ae000 tx=0x7f5d08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:25.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.300+0000 7f5d1cc00640 1 -- 172.21.15.47:0/3478754397 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d200b5cf0 con 0x7f5d2006d720 2024-04-26T23:46:25.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:25.464+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5d20156b30 con 0x7f5d2006d720 2024-04-26T23:46:26.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.104+0000 7f5d1cc00640 1 -- 172.21.15.47:0/3478754397 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f5d10055f30 con 0x7f5d2006d720 2024-04-26T23:46:26.113 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:46:26.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5cfc068380 msgr2=0x7f5cfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5cfc068380 0x7f5cfc06a840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d080ae000 tx=0x7f5d08008040 comp rx=0 tx=0).stop 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d2006d720 msgr2=0x7f5d2015b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d2006d720 0x7f5d2015b6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000c780 tx=0x7f5d1000cc40 comp rx=0 tx=0).stop 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 shutdown_connections 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5cfc068380 0x7f5cfc06a840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5d2015f410 0x7f5d20153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d2006e070 0x7f5d200c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 --2- 172.21.15.47:0/3478754397 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5d2006d720 0x7f5d2015b6f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 >> 172.21.15.47:0/3478754397 conn(0x7f5d200d2ec0 msgr2=0x7f5d200cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:26.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 shutdown_connections 2024-04-26T23:46:26.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.108+0000 7f5d26a00640 1 -- 172.21.15.47:0/3478754397 wait complete. 2024-04-26T23:46:26.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:46:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa79e00640 1 Processor -- start 2024-04-26T23:46:26.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa79e00640 1 -- start start 2024-04-26T23:46:26.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa79e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7faa7415c1d0 0x7faa740d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa79e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faa740d03b0 0x7faa74072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa79e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa74072140 con 0x7faa7406fca0 2024-04-26T23:46:26.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa79e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7faa74072420 con 0x7faa740d03b0 2024-04-26T23:46:26.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa79e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7faa74072700 con 0x7faa7415c1d0 2024-04-26T23:46:26.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa73400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faa740d03b0 0x7faa74072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa73400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7faa740d03b0 0x7faa74072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51568/0 (socket says 172.21.15.47:51568) 2024-04-26T23:46:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa73400640 1 -- 172.21.15.47:0/2463269648 learned_addr learned my addr 172.21.15.47:0/2463269648 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa72a00640 1 --2- 172.21.15.47:0/2463269648 >> v2:172.21.15.203:3300/0 conn(0x7faa7415c1d0 0x7faa740d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa73400640 1 -- 172.21.15.47:0/2463269648 >> v2:172.21.15.203:3300/0 conn(0x7faa7415c1d0 msgr2=0x7faa740d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa73400640 1 --2- 172.21.15.47:0/2463269648 >> v2:172.21.15.203:3300/0 conn(0x7faa7415c1d0 0x7faa740d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa73400640 1 -- 172.21.15.47:0/2463269648 >> v1:172.21.15.203:6789/0 conn(0x7faa7406fca0 legacy=0x7faa740cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.280+0000 7faa73400640 1 -- 172.21.15.47:0/2463269648 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa740729e0 con 0x7faa740d03b0 2024-04-26T23:46:26.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa73400640 1 --2- 172.21.15.47:0/2463269648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa740d03b0 0x7faa74072f00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa7406d530 tx=0x7faa6c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761b866db9c0e731 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa72000640 1 -- 172.21.15.47:0/2463269648 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0a5840 con 0x7faa740d03b0 2024-04-26T23:46:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa72000640 1 -- 172.21.15.47:0/2463269648 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6c0a59e0 con 0x7faa740d03b0 2024-04-26T23:46:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa72000640 1 -- 172.21.15.47:0/2463269648 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6c0a5db0 con 0x7faa740d03b0 2024-04-26T23:46:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 -- 172.21.15.47:0/2463269648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa740d03b0 msgr2=0x7faa74072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 --2- 172.21.15.47:0/2463269648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa740d03b0 0x7faa74072f00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faa7406d530 tx=0x7faa6c01c960 comp rx=0 tx=0).stop 2024-04-26T23:46:26.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 -- 172.21.15.47:0/2463269648 shutdown_connections 2024-04-26T23:46:26.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 --2- 172.21.15.47:0/2463269648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa740d03b0 0x7faa74072f00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 --2- 172.21.15.47:0/2463269648 >> v2:172.21.15.203:3300/0 conn(0x7faa7415c1d0 0x7faa740d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 -- 172.21.15.47:0/2463269648 >> 172.21.15.47:0/2463269648 conn(0x7faa740d0c90 msgr2=0x7faa740d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:26.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 -- 172.21.15.47:0/2463269648 shutdown_connections 2024-04-26T23:46:26.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.284+0000 7faa79e00640 1 -- 172.21.15.47:0/2463269648 wait complete. 2024-04-26T23:46:26.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 Processor -- start 2024-04-26T23:46:26.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 -- start start 2024-04-26T23:46:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa7406fca0 0x7faa7414f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa740d03b0 0x7faa7415c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa7415c1d0 0x7faa7415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7faa74073dd0 con 0x7faa7406fca0 2024-04-26T23:46:26.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faa74073c50 con 0x7faa7415c1d0 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7faa74168c10 con 0x7faa740d03b0 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa7406fca0 0x7faa7414f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa7406fca0 0x7faa7414f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51570/0 (socket says 172.21.15.47:51570) 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 -- 172.21.15.47:0/1948766652 learned_addr learned my addr 172.21.15.47:0/1948766652 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa73400640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa7415c1d0 0x7faa7415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 -- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa740d03b0 msgr2=0x7faa7415c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa6be00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa740d03b0 0x7faa7415c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa740d03b0 0x7faa7415c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 -- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa7415c1d0 msgr2=0x7faa7415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa7415c1d0 0x7faa7415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 -- 172.21.15.47:0/1948766652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa74155870 con 0x7faa7406fca0 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa73400640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa7415c1d0 0x7faa7415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa6be00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa740d03b0 0x7faa7415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:26.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa72a00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa7406fca0 0x7faa7414f3a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa6400e960 tx=0x7faa6400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:26.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa6b400640 1 -- 172.21.15.47:0/1948766652 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64017070 con 0x7faa7406fca0 2024-04-26T23:46:26.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa6b400640 1 -- 172.21.15.47:0/1948766652 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6400ca00 con 0x7faa7406fca0 2024-04-26T23:46:26.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa6b400640 1 -- 172.21.15.47:0/1948766652 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6400cdb0 con 0x7faa7406fca0 2024-04-26T23:46:26.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa74155b50 con 0x7faa7406fca0 2024-04-26T23:46:26.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.288+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa74156110 con 0x7faa7406fca0 2024-04-26T23:46:26.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.292+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa740695f0 con 0x7faa7406fca0 2024-04-26T23:46:26.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.292+0000 7faa6b400640 1 -- 172.21.15.47:0/1948766652 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa6401a070 con 0x7faa7406fca0 2024-04-26T23:46:26.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.292+0000 7faa6b400640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faa50068380 0x7faa5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:26.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.292+0000 7faa6b400640 1 -- 172.21.15.47:0/1948766652 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5502+0+0 (secure 0 0 0) 0x7faa64086d90 con 0x7faa7406fca0 2024-04-26T23:46:26.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.292+0000 7faa6be00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faa50068380 0x7faa5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:26.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.292+0000 7faa6be00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faa50068380 0x7faa5006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa74154d10 tx=0x7faa5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:26.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.296+0000 7faa6b400640 1 -- 172.21.15.47:0/1948766652 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7faa64057380 con 0x7faa7406fca0 2024-04-26T23:46:26.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:26.464+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faa7406eee0 con 0x7faa7406fca0 2024-04-26T23:46:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.112+0000 7faa6b400640 1 -- 172.21.15.47:0/1948766652 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7faa64056c80 con 0x7faa7406fca0 2024-04-26T23:46:27.119 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-04-26T23:46:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.112+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faa50068380 msgr2=0x7faa5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.112+0000 7faa79e00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faa50068380 0x7faa5006a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa74154d10 tx=0x7faa5c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.112+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa7406fca0 msgr2=0x7faa7414f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.112+0000 7faa79e00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa7406fca0 0x7faa7414f3a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa6400e960 tx=0x7faa6400ee20 comp rx=0 tx=0).stop 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 shutdown_connections 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faa50068380 0x7faa5006a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa7415c1d0 0x7faa7415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7faa740d03b0 0x7faa7415c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 --2- 172.21.15.47:0/1948766652 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa7406fca0 0x7faa7414f3a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 >> 172.21.15.47:0/1948766652 conn(0x7faa740d0c90 msgr2=0x7faa7415b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 shutdown_connections 2024-04-26T23:46:27.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.116+0000 7faa79e00640 1 -- 172.21.15.47:0/1948766652 wait complete. 2024-04-26T23:46:27.150 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:46:27.150 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:46:27.150 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:46:27.150 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:27.150 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:46:27.151 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:46:27.151 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:46:27.151 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:27.151 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:46:27.151 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:46:27.151 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:46:27.151 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:27.151 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:46:27.152 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:46:27.152 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:46:27.152 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:46:27.163 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:46:27.164 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:46:27.165 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:46:27.165 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:46:27.166 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:46:27.166 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:46:27.167 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:46:27.167 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:46:27.211 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:46:27.211 DEBUG:teuthology.parallel:result is None 2024-04-26T23:46:27.212 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:46:27.212 DEBUG:teuthology.parallel:result is None 2024-04-26T23:46:27.213 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:46:27.213 DEBUG:teuthology.parallel:result is None 2024-04-26T23:46:27.214 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:46:27.214 DEBUG:teuthology.parallel:result is None 2024-04-26T23:46:27.215 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:46:27.300 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-26T23:46:27.301 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-26T23:46:27.303 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-26T23:46:27.304 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-04-26T23:46:27.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3dfb200640 1 Processor -- start 2024-04-26T23:46:27.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3dfb200640 1 -- start start 2024-04-26T23:46:27.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3dfb200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3dfc0b5660 0x7f3dfc0ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3dfb200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dfc06e8b0 con 0x7f3dfc15f4a0 2024-04-26T23:46:27.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3dfb200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dfc074600 con 0x7f3dfc09c170 2024-04-26T23:46:27.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3dfb200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3dfc06eb50 con 0x7f3dfc0b5660 2024-04-26T23:46:27.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3dfc15f4a0 0x7f3dfc09ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50186/0 (socket says 172.21.15.47:50186) 2024-04-26T23:46:27.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9e00640 1 -- 172.21.15.47:0/2351262677 learned_addr learned my addr 172.21.15.47:0/2351262677 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168415676 0 0) 0x7f3dfc06e8b0 con 0x7f3dfc15f4a0 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de0003530 con 0x7f3dfc15f4a0 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3518731722 0 0) 0x7f3de0003530 con 0x7f3dfc15f4a0 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 >> v2:172.21.15.203:3300/0 conn(0x7f3dfc0b5660 msgr2=0x7f3dfc0ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 --2- 172.21.15.47:0/2351262677 >> v2:172.21.15.203:3300/0 conn(0x7f3dfc0b5660 0x7f3dfc0ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 >> v1:172.21.15.203:6789/0 conn(0x7f3dfc09c170 legacy=0x7f3dfc0cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc06ee30 con 0x7f3dfc15f4a0 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f3dec001680 con 0x7f3dfc15f4a0 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 >> v1:172.21.15.47:6789/0 conn(0x7f3dfc15f4a0 legacy=0x7f3dfc09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3de0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de0004810 0x7f3de0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de0005220 0x7f3de000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc06eb50 con 0x7f3de0004810 2024-04-26T23:46:27.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3de000c170 con 0x7f3de0005220 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.356+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3de000c370 con 0x7f3de00039c0 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df1400640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de0004810 0x7f3de0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9e00640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3de0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3dfa800640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de0005220 0x7f3de000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9e00640 1 -- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de0005220 msgr2=0x7f3de000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9e00640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3de0005220 0x7f3de000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9e00640 1 -- 172.21.15.47:0/2351262677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de0004810 msgr2=0x7f3de0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9e00640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de0004810 0x7f3de0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9e00640 1 -- 172.21.15.47:0/2351262677 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de0003530 con 0x7f3de00039c0 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df1400640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3de0004810 0x7f3de0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:27.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3dfa800640 1 -- 172.21.15.47:0/2351262677 reap_dead start 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9e00640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3de0003da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3dec004ae0 tx=0x7f3dec01fa90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=398b7dab83a1d466 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec004cf0 con 0x7f3de00039c0 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec005ae0 con 0x7f3de00039c0 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.360+0000 7f3df9400640 1 -- 172.21.15.47:0/2351262677 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec008110 con 0x7f3de00039c0 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 msgr2=0x7f3de0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3de0003da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3dec004ae0 tx=0x7f3dec01fa90 comp rx=0 tx=0).stop 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- 172.21.15.47:0/2351262677 shutdown_connections 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2351262677 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3de0003da0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- 172.21.15.47:0/2351262677 >> 172.21.15.47:0/2351262677 conn(0x7f3dfc0b4b40 msgr2=0x7f3dfc0b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- 172.21.15.47:0/2351262677 shutdown_connections 2024-04-26T23:46:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- 172.21.15.47:0/2351262677 wait complete. 2024-04-26T23:46:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 Processor -- start 2024-04-26T23:46:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- start start 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3dfc0cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc152db0 0x7f3dfc1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dfc0c8f40 0x7f3dfc0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc0cd5c0 con 0x7f3dfc152db0 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc06f3f0 con 0x7f3dfc0c8f40 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfb200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc0d1a90 con 0x7f3de00039c0 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc152db0 0x7f3dfc1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc152db0 0x7f3dfc1526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51618/0 (socket says 172.21.15.47:51618) 2024-04-26T23:46:27.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 -- 172.21.15.47:0/2332402209 learned_addr learned my addr 172.21.15.47:0/2332402209 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df9e00640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3dfc0cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3dfa800640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dfc0c8f40 0x7f3dfc0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 -- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 msgr2=0x7f3dfc0cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3dfc0cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 -- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dfc0c8f40 msgr2=0x7f3dfc0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dfc0c8f40 0x7f3dfc0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.364+0000 7f3df1400640 1 -- 172.21.15.47:0/2332402209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc0cae00 con 0x7f3dfc152db0 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df1400640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc152db0 0x7f3dfc1526a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3de400f7d0 tx=0x7f3de400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df2a00640 1 -- 172.21.15.47:0/2332402209 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de4018070 con 0x7f3dfc152db0 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df2a00640 1 -- 172.21.15.47:0/2332402209 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de400fe80 con 0x7f3dfc152db0 2024-04-26T23:46:27.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df2a00640 1 -- 172.21.15.47:0/2332402209 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de40039b0 con 0x7f3dfc152db0 2024-04-26T23:46:27.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc0cc590 con 0x7f3dfc152db0 2024-04-26T23:46:27.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc0c6aa0 con 0x7f3dfc152db0 2024-04-26T23:46:27.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dfc069b80 con 0x7f3dfc152db0 2024-04-26T23:46:27.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df2a00640 1 -- 172.21.15.47:0/2332402209 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3de4005270 con 0x7f3dfc152db0 2024-04-26T23:46:27.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df2a00640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd8068380 0x7f3dd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:27.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df2a00640 1 -- 172.21.15.47:0/2332402209 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4943+0+0 (secure 0 0 0) 0x7f3de4086760 con 0x7f3dfc152db0 2024-04-26T23:46:27.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.368+0000 7f3df9e00640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd8068380 0x7f3dd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:27.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.372+0000 7f3df9e00640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd8068380 0x7f3dd806a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0ae000 tx=0x7f3dec007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:27.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.372+0000 7f3df2a00640 1 -- 172.21.15.47:0/2332402209 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3de4056f80 con 0x7f3dfc152db0 2024-04-26T23:46:27.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:27.556+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3dfc0cd3a0 con 0x7f3dfc152db0 2024-04-26T23:46:28.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.120+0000 7f3df2a00640 1 -- 172.21.15.47:0/2332402209 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) ==== 97+0+0 (secure 0 0 0) 0x7f3de401ce90 con 0x7f3dfc152db0 2024-04-26T23:46:28.130 INFO:teuthology.orchestra.run.smithi047.stderr: removed all blocklist entries 2024-04-26T23:46:28.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd8068380 msgr2=0x7f3dd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd8068380 0x7f3dd806a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3dec0ae000 tx=0x7f3dec007040 comp rx=0 tx=0).stop 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc152db0 msgr2=0x7f3dfc1526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc152db0 0x7f3dfc1526a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3de400f7d0 tx=0x7f3de400fc90 comp rx=0 tx=0).stop 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 shutdown_connections 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd8068380 0x7f3dd806a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3dfc0c8f40 0x7f3dfc0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3dfc152db0 0x7f3dfc1526a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 --2- 172.21.15.47:0/2332402209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3de00039c0 0x7f3dfc0cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 >> 172.21.15.47:0/2332402209 conn(0x7f3dfc0b4b40 msgr2=0x7f3dfc0b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 shutdown_connections 2024-04-26T23:46:28.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.124+0000 7f3dfb200640 1 -- 172.21.15.47:0/2332402209 wait complete. 2024-04-26T23:46:28.157 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:46:28.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa78f200640 1 Processor -- start 2024-04-26T23:46:28.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa78f200640 1 -- start start 2024-04-26T23:46:28.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa78f200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa7880ce310 0x7fa78815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa78f200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78815fc50 con 0x7fa78815c100 2024-04-26T23:46:28.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa78f200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78815ff30 con 0x7fa78806fcd0 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa78f200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa788160860 con 0x7fa7880ce310 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa77fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa7880ce310 0x7fa78815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa787e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa78815c100 0x7fa7880cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50202/0 (socket says 172.21.15.47:50202) 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.292+0000 7fa787e00640 1 -- 172.21.15.47:0/273799614 learned_addr learned my addr 172.21.15.47:0/273799614 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa77fe00640 1 -- 172.21.15.47:0/273799614 >> v1:172.21.15.203:6789/0 conn(0x7fa78806fcd0 legacy=0x7fa7880b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa77fe00640 1 -- 172.21.15.47:0/273799614 >> v1:172.21.15.47:6789/0 conn(0x7fa78815c100 legacy=0x7fa7880cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa77fe00640 1 -- 172.21.15.47:0/273799614 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa788160210 con 0x7fa7880ce310 2024-04-26T23:46:28.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa787400640 1 -- 172.21.15.47:0/273799614 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461659401 0 0) 0x7fa78815fc50 con 0x7fa78815c100 2024-04-26T23:46:28.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa77fe00640 1 --2- 172.21.15.47:0/273799614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7880ce310 0x7fa78815cf60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7700097a0 tx=0x7fa77001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f385901fbd9468 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa787400640 1 -- 172.21.15.47:0/273799614 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7700b1070 con 0x7fa7880ce310 2024-04-26T23:46:28.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa787400640 1 -- 172.21.15.47:0/273799614 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7700ac5f0 con 0x7fa7880ce310 2024-04-26T23:46:28.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa787400640 1 -- 172.21.15.47:0/273799614 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7700ac9c0 con 0x7fa7880ce310 2024-04-26T23:46:28.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa78f200640 1 -- 172.21.15.47:0/273799614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7880ce310 msgr2=0x7fa78815cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa78f200640 1 --2- 172.21.15.47:0/273799614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7880ce310 0x7fa78815cf60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa7700097a0 tx=0x7fa77001c480 comp rx=0 tx=0).stop 2024-04-26T23:46:28.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa78f200640 1 -- 172.21.15.47:0/273799614 shutdown_connections 2024-04-26T23:46:28.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa78f200640 1 --2- 172.21.15.47:0/273799614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa7880ce310 0x7fa78815cf60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa78f200640 1 -- 172.21.15.47:0/273799614 >> 172.21.15.47:0/273799614 conn(0x7fa78806c800 msgr2=0x7fa78806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:28.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.296+0000 7fa78f200640 1 -- 172.21.15.47:0/273799614 shutdown_connections 2024-04-26T23:46:28.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 -- 172.21.15.47:0/273799614 wait complete. 2024-04-26T23:46:28.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 Processor -- start 2024-04-26T23:46:28.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 -- start start 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78806fcd0 0x7fa78815ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7880ce310 0x7fa78814e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa78815c100 0x7fa788159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa788169e60 con 0x7fa78806fcd0 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7880b6000 con 0x7fa7880ce310 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa788169fe0 con 0x7fa78815c100 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78806fcd0 0x7fa78815ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78806fcd0 0x7fa78815ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51640/0 (socket says 172.21.15.47:51640) 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 -- 172.21.15.47:0/3716170082 learned_addr learned my addr 172.21.15.47:0/3716170082 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa77fe00640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7880ce310 0x7fa78814e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78d200640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa78815c100 0x7fa788159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 -- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa78815c100 msgr2=0x7fa788159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa78815c100 0x7fa788159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 -- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7880ce310 msgr2=0x7fa78814e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7880ce310 0x7fa78814e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 -- 172.21.15.47:0/3716170082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78815f2a0 con 0x7fa78806fcd0 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa787e00640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78806fcd0 0x7fa78815ae80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa77800c410 tx=0x7fa77800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa784c00640 1 -- 172.21.15.47:0/3716170082 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7780074e0 con 0x7fa78806fcd0 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa784c00640 1 -- 172.21.15.47:0/3716170082 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7780047f0 con 0x7fa78806fcd0 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa784c00640 1 -- 172.21.15.47:0/3716170082 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778007680 con 0x7fa78806fcd0 2024-04-26T23:46:28.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78815e8c0 con 0x7fa78806fcd0 2024-04-26T23:46:28.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.300+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78815a960 con 0x7fa78806fcd0 2024-04-26T23:46:28.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.304+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa788069700 con 0x7fa78806fcd0 2024-04-26T23:46:28.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.304+0000 7fa784c00640 1 -- 172.21.15.47:0/3716170082 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa778011070 con 0x7fa78806fcd0 2024-04-26T23:46:28.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.304+0000 7fa784c00640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa764068380 0x7fa76406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.304+0000 7fa784c00640 1 -- 172.21.15.47:0/3716170082 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7fa778086240 con 0x7fa78806fcd0 2024-04-26T23:46:28.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.304+0000 7fa77fe00640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa764068380 0x7fa76406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.304+0000 7fa77fe00640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa764068380 0x7fa76406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7700ae000 tx=0x7fa770008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.318 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.308+0000 7fa784c00640 1 -- 172.21.15.47:0/3716170082 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa778056ab0 con 0x7fa78806fcd0 2024-04-26T23:46:28.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.532+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa7880d08b0 con 0x7fa78806fcd0 2024-04-26T23:46:28.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.532+0000 7fa784c00640 1 -- 172.21.15.47:0/3716170082 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fa7780563b0 con 0x7fa78806fcd0 2024-04-26T23:46:28.541 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "auth_dump": [ 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.a", 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmPvgWGxAAiYQ2zUX0ozNfqhRyoqklbA==", 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:46:28.542 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.b", 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxm0ms+JxAA/yzvj5fwb8ubsCaa8RPulA==", 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.c", 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmJQ08IhAA+Pq7378EpZhTk027ykb25Q==", 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.d", 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmqVSULhAA4u/dlOjp5dvwF7dCSEzBjQ==", 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.0", 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBkPCxmlALuFBAALtrCma5B3PGPr4wwo9MHsQ==", 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.1", 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBnPCxms/UlHhAAqYSWMKwMrWVB4fAaks2ouw==", 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.2", 2024-04-26T23:46:28.547 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBqPCxmL2dpKBAAoLK+/xVyjawGaNzqnJKfsA==", 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.3", 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBtPCxmvmoNMRAAZIRxIBrJHZ4Zf8L6w3C7dg==", 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.548 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.4", 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBzPCxmuAseJRAAFY67ni0LWB3q0kgi5MdGMA==", 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.5", 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQB2PCxmLy55LxAAQ1LcwQkn4tgpBOBAAVGPmw==", 2024-04-26T23:46:28.549 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.6", 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQB5PCxmk2xtORAAUD/E0hWuBjAzQzLWViuGwQ==", 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.7", 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQB9PCxmHWQvBhAAqMiM2MHF9YUbdt0wrrJKZw==", 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.0", 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmSs+fMhAAi6eSRSyhcIwg3ckGbNdS9Q==", 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.551 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.1", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBjPCxmwgTIABAAoqIgP1MTeUjPZz0fFI/QZA==", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-26T23:46:28.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.2", 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmnAndOBAARbPEFhWyxpORFk++YkeIZw==", 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.3", 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBjPCxmnBTmBhAAzw4PpzWsqCroEIeyjApSPg==", 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.admin", 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBhPCxmosOzOhAAEZcOKcH6whmSmdPyES3Txg==", 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.556 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-mds", 2024-04-26T23:46:28.556 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCDPCxmnvtcBRAAr2lVYjNNugbpW69Wvnn1iQ==", 2024-04-26T23:46:28.556 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.556 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-mds" 2024-04-26T23:46:28.556 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-mgr", 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCDPCxm7QxdBRAAlHhyinEcsCkeUwdEWGgZbg==", 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-osd", 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCDPCxm1RxdBRAAWvWVuZikk1X6ZgnQ9LODHw==", 2024-04-26T23:46:28.557 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-osd" 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rbd", 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCDPCxmMytdBRAAVr922FSTBw79PHnsf810SA==", 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.558 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-26T23:46:28.559 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.559 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCDPCxm4jldBRAATxsdo/AeUz5QcRrbZGM59A==", 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.bootstrap-rgw", 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQCDPCxmgkhdBRAAR8J1b55Rs9+Hc7xKlRpqlg==", 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.x", 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmzWLtFhAAQralpGU4KTBxBggcgaIHZA==", 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.y", 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmOXIBExAAAvRWdTqgQoTBjJINIP8Axw==", 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-26T23:46:28.561 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-04-26T23:46:28.562 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:46:28.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:28.562 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-04-26T23:46:28.562 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:46:28.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa764068380 msgr2=0x7fa76406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa764068380 0x7fa76406a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa7700ae000 tx=0x7fa770008040 comp rx=0 tx=0).stop 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78806fcd0 msgr2=0x7fa78815ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78806fcd0 0x7fa78815ae80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa77800c410 tx=0x7fa77800c8d0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 shutdown_connections 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa764068380 0x7fa76406a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa78815c100 0x7fa788159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa7880ce310 0x7fa78814e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 --2- 172.21.15.47:0/3716170082 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa78806fcd0 0x7fa78815ae80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 >> 172.21.15.47:0/3716170082 conn(0x7fa78806c800 msgr2=0x7fa788072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 shutdown_connections 2024-04-26T23:46:28.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.536+0000 7fa78f200640 1 -- 172.21.15.47:0/3716170082 wait complete. 2024-04-26T23:46:28.565 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-26T23:46:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.696+0000 7f5c3c400640 1 Processor -- start 2024-04-26T23:46:28.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.696+0000 7f5c3c400640 1 -- start start 2024-04-26T23:46:28.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c3c400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 0x7f5c340d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c3c400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5c340cee50 0x7f5c340734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c3c400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c34159e80 con 0x7f5c34073060 2024-04-26T23:46:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c3c400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5c34073ae0 con 0x7f5c340cee50 2024-04-26T23:46:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c3c400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5c34073dc0 con 0x7f5c34159aa0 2024-04-26T23:46:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5c34073060 0x7f5c340ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:50210/0 (socket says 172.21.15.47:50210) 2024-04-26T23:46:28.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39000640 1 -- 172.21.15.47:0/640992283 learned_addr learned my addr 172.21.15.47:0/640992283 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c3a400640 1 --2- 172.21.15.47:0/640992283 >> v2:172.21.15.203:3300/0 conn(0x7f5c340cee50 0x7f5c340734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39a00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 0x7f5c340d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910642928 0 0) 0x7f5c34159e80 con 0x7f5c34073060 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c1c003530 con 0x7f5c34073060 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 74644522 0 0) 0x7f5c1c003530 con 0x7f5c34073060 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 msgr2=0x7f5c340d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 0x7f5c340d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 >> v2:172.21.15.203:3300/0 conn(0x7f5c340cee50 msgr2=0x7f5c340734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 --2- 172.21.15.47:0/640992283 >> v2:172.21.15.203:3300/0 conn(0x7f5c340cee50 0x7f5c340734c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c340b4ed0 con 0x7f5c34073060 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f5c20001680 con 0x7f5c34073060 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 >> v1:172.21.15.47:6789/0 conn(0x7f5c34073060 legacy=0x7f5c340ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c004810 0x7f5c1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 0x7f5c1c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5c34073ae0 con 0x7f5c1c0039c0 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5c34073dc0 con 0x7f5c1c004810 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c00b9d0 con 0x7f5c34159aa0 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39a00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39000640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c004810 0x7f5c1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c3a400640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 0x7f5c1c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39a00640 1 -- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 msgr2=0x7f5c1c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39a00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c34159aa0 0x7f5c1c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39a00640 1 -- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c004810 msgr2=0x7f5c1c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39a00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c004810 0x7f5c1c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.700+0000 7f5c39a00640 1 -- 172.21.15.47:0/640992283 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c003530 con 0x7f5c1c0039c0 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c39a00640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009ae0 tx=0x7f5c2801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6969c9fb9cbc4d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c280096b0 con 0x7f5c1c0039c0 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c280a8460 con 0x7f5c1c0039c0 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c33e00640 1 -- 172.21.15.47:0/640992283 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c280a8850 con 0x7f5c1c0039c0 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c3c400640 1 -- 172.21.15.47:0/640992283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c0039c0 msgr2=0x7f5c1c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c3c400640 1 --2- 172.21.15.47:0/640992283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c1c0039c0 0x7f5c1c003de0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009ae0 tx=0x7f5c2801ca70 comp rx=0 tx=0).stop 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c3a400640 1 -- 172.21.15.47:0/640992283 reap_dead start 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c3c400640 1 -- 172.21.15.47:0/640992283 shutdown_connections 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c3c400640 1 -- 172.21.15.47:0/640992283 >> 172.21.15.47:0/640992283 conn(0x7f5c340b39c0 msgr2=0x7f5c340b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:28.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c3c400640 1 -- 172.21.15.47:0/640992283 shutdown_connections 2024-04-26T23:46:28.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.704+0000 7f5c3c400640 1 -- 172.21.15.47:0/640992283 wait complete. 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 Processor -- start 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 -- start start 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c0039c0 0x7f5c34153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c341550f0 0x7f5c34155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c34070270 0x7f5c340706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5c340b5a60 con 0x7f5c34070270 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5c340b58e0 con 0x7f5c1c0039c0 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5c340b5be0 con 0x7f5c341550f0 2024-04-26T23:46:28.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c34070270 0x7f5c340706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c34070270 0x7f5c340706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:51656/0 (socket says 172.21.15.47:51656) 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 -- 172.21.15.47:0/1546826073 learned_addr learned my addr 172.21.15.47:0/1546826073 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c39a00640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c0039c0 0x7f5c34153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c39000640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c341550f0 0x7f5c34155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 -- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c341550f0 msgr2=0x7f5c34155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c341550f0 0x7f5c34155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 -- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c0039c0 msgr2=0x7f5c34153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c0039c0 0x7f5c34153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 -- 172.21.15.47:0/1546826073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3406ee80 con 0x7f5c34070270 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3a400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c34070270 0x7f5c340706d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5c3406eb70 tx=0x7f5c2c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c31600640 1 -- 172.21.15.47:0/1546826073 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c015430 con 0x7f5c34070270 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c31600640 1 -- 172.21.15.47:0/1546826073 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c01d070 con 0x7f5c34070270 2024-04-26T23:46:28.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3406f160 con 0x7f5c34070270 2024-04-26T23:46:28.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c31600640 1 -- 172.21.15.47:0/1546826073 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c015830 con 0x7f5c34070270 2024-04-26T23:46:28.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3406f720 con 0x7f5c34070270 2024-04-26T23:46:28.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.708+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c34155ab0 con 0x7f5c34070270 2024-04-26T23:46:28.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.712+0000 7f5c31600640 1 -- 172.21.15.47:0/1546826073 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c2c0159d0 con 0x7f5c34070270 2024-04-26T23:46:28.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.712+0000 7f5c31600640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5c14068320 0x7f5c1406a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:28.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.712+0000 7f5c31600640 1 -- 172.21.15.47:0/1546826073 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f5c2c086eb0 con 0x7f5c34070270 2024-04-26T23:46:28.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.712+0000 7f5c39a00640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5c14068320 0x7f5c1406a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:28.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.712+0000 7f5c39a00640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5c14068320 0x7f5c1406a7e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c280af000 tx=0x7f5c280b3040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:28.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.716+0000 7f5c31600640 1 -- 172.21.15.47:0/1546826073 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c2c010040 con 0x7f5c34070270 2024-04-26T23:46:28.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.936+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f5c340cfeb0 con 0x7f5c34070270 2024-04-26T23:46:28.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.940+0000 7f5c31600640 1 -- 172.21.15.47:0/1546826073 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f5c2c0577c0 con 0x7f5c34070270 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5c14068320 msgr2=0x7f5c1406a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5c14068320 0x7f5c1406a7e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5c280af000 tx=0x7f5c280b3040 comp rx=0 tx=0).stop 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c34070270 msgr2=0x7f5c340706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c34070270 0x7f5c340706d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5c3406eb70 tx=0x7f5c2c00f580 comp rx=0 tx=0).stop 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 shutdown_connections 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5c14068320 0x7f5c1406a7e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c34070270 0x7f5c340706d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c341550f0 0x7f5c34155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 --2- 172.21.15.47:0/1546826073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1c0039c0 0x7f5c34153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 >> 172.21.15.47:0/1546826073 conn(0x7f5c340b39c0 msgr2=0x7f5c340b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 shutdown_connections 2024-04-26T23:46:28.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:28.944+0000 7f5c3c400640 1 -- 172.21.15.47:0/1546826073 wait complete. 2024-04-26T23:46:28.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-26T23:46:29.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc8a00640 1 Processor -- start 2024-04-26T23:46:29.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc8a00640 1 -- start start 2024-04-26T23:46:29.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc8a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9cc40d2b40 0x7f9cc40d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc8a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9cc40c8ac0 0x7f9cc40c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc8a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc40cfa80 con 0x7f9cc415f270 2024-04-26T23:46:29.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc8a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc40d0330 con 0x7f9cc40c8ac0 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc8a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc40cfd20 con 0x7f9cc40d2b40 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc3400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9cc415f270 0x7f9cc40d22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49222/0 (socket says 172.21.15.47:49222) 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc3400640 1 -- 172.21.15.47:0/657877370 learned_addr learned my addr 172.21.15.47:0/657877370 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc3e00640 1 --2- 172.21.15.47:0/657877370 >> v2:172.21.15.47:3300/0 conn(0x7f9cc40c8ac0 0x7f9cc40c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cbaa00640 1 --2- 172.21.15.47:0/657877370 >> v2:172.21.15.203:3300/0 conn(0x7f9cc40d2b40 0x7f9cc40d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc2a00640 1 -- 172.21.15.47:0/657877370 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367293213 0 0) 0x7f9cc40cfa80 con 0x7f9cc415f270 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc2a00640 1 -- 172.21.15.47:0/657877370 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ca8003530 con 0x7f9cc415f270 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc3e00640 1 -- 172.21.15.47:0/657877370 >> v2:172.21.15.203:3300/0 conn(0x7f9cc40d2b40 msgr2=0x7f9cc40d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:29.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc3e00640 1 --2- 172.21.15.47:0/657877370 >> v2:172.21.15.203:3300/0 conn(0x7f9cc40d2b40 0x7f9cc40d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc3e00640 1 -- 172.21.15.47:0/657877370 >> v1:172.21.15.47:6789/0 conn(0x7f9cc415f270 legacy=0x7f9cc40d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cc3e00640 1 -- 172.21.15.47:0/657877370 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc40d30b0 con 0x7f9cc40c8ac0 2024-04-26T23:46:29.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.104+0000 7f9cbaa00640 1 --2- 172.21.15.47:0/657877370 >> v2:172.21.15.203:3300/0 conn(0x7f9cc40d2b40 0x7f9cc40d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:29.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc3e00640 1 --2- 172.21.15.47:0/657877370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40c8ac0 0x7f9cc40c8f50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40b7a70 tx=0x7f9cbc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1624c35836971973 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc2a00640 1 -- 172.21.15.47:0/657877370 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0b2070 con 0x7f9cc40c8ac0 2024-04-26T23:46:29.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc2a00640 1 -- 172.21.15.47:0/657877370 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc0a58a0 con 0x7f9cc40c8ac0 2024-04-26T23:46:29.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc2a00640 1 -- 172.21.15.47:0/657877370 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0a5c70 con 0x7f9cc40c8ac0 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 -- 172.21.15.47:0/657877370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40c8ac0 msgr2=0x7f9cc40c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/657877370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40c8ac0 0x7f9cc40c8f50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40b7a70 tx=0x7f9cbc01c930 comp rx=0 tx=0).stop 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 -- 172.21.15.47:0/657877370 shutdown_connections 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/657877370 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc40c8ac0 0x7f9cc40c8f50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/657877370 >> v2:172.21.15.203:3300/0 conn(0x7f9cc40d2b40 0x7f9cc40d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 -- 172.21.15.47:0/657877370 >> 172.21.15.47:0/657877370 conn(0x7f9cc409e2f0 msgr2=0x7f9cc40d4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 -- 172.21.15.47:0/657877370 shutdown_connections 2024-04-26T23:46:29.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.108+0000 7f9cc8a00640 1 -- 172.21.15.47:0/657877370 wait complete. 2024-04-26T23:46:29.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 Processor -- start 2024-04-26T23:46:29.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 -- start start 2024-04-26T23:46:29.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cc40c8ac0 0x7f9cc41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9cc40d2b40 0x7f9cc41570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc415d6d0 0x7f9cc415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc40d3d20 con 0x7f9cc415d6d0 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc40d3ba0 con 0x7f9cc40c8ac0 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc40d3ea0 con 0x7f9cc40d2b40 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc415d6d0 0x7f9cc415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc415d6d0 0x7f9cc415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55364/0 (socket says 172.21.15.47:55364) 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 -- 172.21.15.47:0/3414583096 learned_addr learned my addr 172.21.15.47:0/3414583096 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3400640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cc40c8ac0 0x7f9cc41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cbaa00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9cc40d2b40 0x7f9cc41570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 -- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9cc40d2b40 msgr2=0x7f9cc41570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9cc40d2b40 0x7f9cc41570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 -- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cc40c8ac0 msgr2=0x7f9cc41588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cc40c8ac0 0x7f9cc41588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 -- 172.21.15.47:0/3414583096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc4157810 con 0x7f9cc415d6d0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc3e00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc415d6d0 0x7f9cc415cda0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc01a560 tx=0x7f9cbc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cbbe00640 1 -- 172.21.15.47:0/3414583096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0bd020 con 0x7f9cc415d6d0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cbbe00640 1 -- 172.21.15.47:0/3414583096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cbc0b8470 con 0x7f9cc415d6d0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cbbe00640 1 -- 172.21.15.47:0/3414583096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0b2040 con 0x7f9cc415d6d0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc4157af0 con 0x7f9cc415d6d0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.112+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc41580b0 con 0x7f9cc415d6d0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.116+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc4069470 con 0x7f9cc415d6d0 2024-04-26T23:46:29.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.116+0000 7f9cbbe00640 1 -- 172.21.15.47:0/3414583096 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9cbc0c0020 con 0x7f9cc415d6d0 2024-04-26T23:46:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.116+0000 7f9cbbe00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ca0068380 0x7f9ca006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.116+0000 7f9cc3400640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ca0068380 0x7f9ca006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.116+0000 7f9cbbe00640 1 -- 172.21.15.47:0/3414583096 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f9cbc0f7e50 con 0x7f9cc415d6d0 2024-04-26T23:46:29.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.116+0000 7f9cc3400640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ca0068380 0x7f9ca006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4007fd0 tx=0x7f9cb4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.120+0000 7f9cbbe00640 1 -- 172.21.15.47:0/3414583096 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9cbc126080 con 0x7f9cc415d6d0 2024-04-26T23:46:29.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.348+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f9cc4163550 con 0x7f9cc415d6d0 2024-04-26T23:46:29.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.348+0000 7f9cbbe00640 1 -- 172.21.15.47:0/3414583096 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f9cbc0c7030 con 0x7f9cc415d6d0 2024-04-26T23:46:29.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ca0068380 msgr2=0x7f9ca006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ca0068380 0x7f9ca006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4007fd0 tx=0x7f9cb4009040 comp rx=0 tx=0).stop 2024-04-26T23:46:29.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc415d6d0 msgr2=0x7f9cc415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc415d6d0 0x7f9cc415cda0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc01a560 tx=0x7f9cbc0196d0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 shutdown_connections 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ca0068380 0x7f9ca006a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9cc415d6d0 0x7f9cc415cda0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9cc40d2b40 0x7f9cc41570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 --2- 172.21.15.47:0/3414583096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9cc40c8ac0 0x7f9cc41588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 >> 172.21.15.47:0/3414583096 conn(0x7f9cc409e2f0 msgr2=0x7f9cc4169350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 shutdown_connections 2024-04-26T23:46:29.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.352+0000 7f9cc8a00640 1 -- 172.21.15.47:0/3414583096 wait complete. 2024-04-26T23:46:29.381 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-26T23:46:29.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.512+0000 7f7b77400640 1 Processor -- start 2024-04-26T23:46:29.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.512+0000 7f7b77400640 1 -- start start 2024-04-26T23:46:29.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b77400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 0x7f7b7015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b77400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b7015e4e0 con 0x7f7b7015e6e0 2024-04-26T23:46:29.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b77400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b700b0f50 con 0x7f7b7015eb60 2024-04-26T23:46:29.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b77400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700b1230 con 0x7f7b7015acd0 2024-04-26T23:46:29.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b67e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7b7015e6e0 0x7f7b700b2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49230/0 (socket says 172.21.15.47:49230) 2024-04-26T23:46:29.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b67e00640 1 -- 172.21.15.47:0/1106591662 learned_addr learned my addr 172.21.15.47:0/1106591662 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b74a00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 0x7f7b7015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099079627 0 0) 0x7f7b58001120 con 0x7f7b7015e6e0 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b54003530 con 0x7f7b7015e6e0 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880370288 0 0) 0x7f7b700b0f50 con 0x7f7b7015eb60 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b58001120 con 0x7f7b7015eb60 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3026110009 0 0) 0x7f7b54003530 con 0x7f7b7015e6e0 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 msgr2=0x7f7b7015dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 0x7f7b7015dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 >> v1:172.21.15.203:6789/0 conn(0x7f7b7015eb60 legacy=0x7f7b700b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700b1510 con 0x7f7b7015e6e0 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f7b58001850 con 0x7f7b7015e6e0 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 >> v1:172.21.15.47:6789/0 conn(0x7f7b7015e6e0 legacy=0x7f7b700b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b54003b80 0x7f7b54003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 0x7f7b54004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54004d50 0x7f7b540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700b1230 con 0x7f7b54003b80 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5400bad0 con 0x7f7b54004d50 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5400bcd0 con 0x7f7b7015acd0 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b74a00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b54003b80 0x7f7b54003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b75400640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54004d50 0x7f7b540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b67e00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 0x7f7b54004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b74a00640 1 -- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 msgr2=0x7f7b54004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b74a00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b7015acd0 0x7f7b54004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b74a00640 1 -- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54004d50 msgr2=0x7f7b540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:29.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b74a00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54004d50 0x7f7b540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.516+0000 7f7b74a00640 1 -- 172.21.15.47:0/1106591662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b54003530 con 0x7f7b54003b80 2024-04-26T23:46:29.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b74a00640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b54003b80 0x7f7b54003f80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009ae0 tx=0x7f7b6001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5509bf0e1196c1df server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600b2070 con 0x7f7b54003b80 2024-04-26T23:46:29.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b600a5610 con 0x7f7b54003b80 2024-04-26T23:46:29.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b6fe00640 1 -- 172.21.15.47:0/1106591662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b600096b0 con 0x7f7b54003b80 2024-04-26T23:46:29.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b77400640 1 -- 172.21.15.47:0/1106591662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b54003b80 msgr2=0x7f7b54003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b77400640 1 --2- 172.21.15.47:0/1106591662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b54003b80 0x7f7b54003f80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009ae0 tx=0x7f7b6001ca40 comp rx=0 tx=0).stop 2024-04-26T23:46:29.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b75400640 1 -- 172.21.15.47:0/1106591662 reap_dead start 2024-04-26T23:46:29.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b77400640 1 -- 172.21.15.47:0/1106591662 shutdown_connections 2024-04-26T23:46:29.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b77400640 1 -- 172.21.15.47:0/1106591662 >> 172.21.15.47:0/1106591662 conn(0x7f7b700b6590 msgr2=0x7f7b700b69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:29.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b77400640 1 -- 172.21.15.47:0/1106591662 shutdown_connections 2024-04-26T23:46:29.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.520+0000 7f7b77400640 1 -- 172.21.15.47:0/1106591662 wait complete. 2024-04-26T23:46:29.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 Processor -- start 2024-04-26T23:46:29.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 -- start start 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54003b80 0x7f7b70154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7015ef70 0x7f7b701556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b701550d0 0x7f7b70155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700b3410 con 0x7f7b7015ef70 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700b0bc0 con 0x7f7b54003b80 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700b3590 con 0x7f7b701550d0 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7015ef70 0x7f7b701556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b75400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b701550d0 0x7f7b70155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7015ef70 0x7f7b701556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55388/0 (socket says 172.21.15.47:55388) 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b74a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54003b80 0x7f7b70154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 -- 172.21.15.47:0/3801508574 learned_addr learned my addr 172.21.15.47:0/3801508574 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 -- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b701550d0 msgr2=0x7f7b70155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b701550d0 0x7f7b70155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 -- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54003b80 msgr2=0x7f7b70154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54003b80 0x7f7b70154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 -- 172.21.15.47:0/3801508574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700700f0 con 0x7f7b7015ef70 2024-04-26T23:46:29.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b67e00640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7015ef70 0x7f7b701556b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b580010f0 tx=0x7f7b5800ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b6d600640 1 -- 172.21.15.47:0/3801508574 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b58019070 con 0x7f7b7015ef70 2024-04-26T23:46:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b6d600640 1 -- 172.21.15.47:0/3801508574 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b58004ac0 con 0x7f7b7015ef70 2024-04-26T23:46:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b6d600640 1 -- 172.21.15.47:0/3801508574 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5800c780 con 0x7f7b7015ef70 2024-04-26T23:46:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b7015cd50 con 0x7f7b7015ef70 2024-04-26T23:46:29.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.524+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b7015d030 con 0x7f7b7015ef70 2024-04-26T23:46:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.528+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b70156cf0 con 0x7f7b7015ef70 2024-04-26T23:46:29.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.528+0000 7f7b6d600640 1 -- 172.21.15.47:0/3801508574 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7b5801c070 con 0x7f7b7015ef70 2024-04-26T23:46:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.528+0000 7f7b6d600640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7b4c068380 0x7f7b4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.528+0000 7f7b6d600640 1 -- 172.21.15.47:0/3801508574 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f7b58085fb0 con 0x7f7b7015ef70 2024-04-26T23:46:29.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.528+0000 7f7b74a00640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7b4c068380 0x7f7b4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.528+0000 7f7b74a00640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7b4c068380 0x7f7b4c06a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7b600af000 tx=0x7f7b600046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.532+0000 7f7b6d600640 1 -- 172.21.15.47:0/3801508574 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7b70156cf0 con 0x7f7b7015ef70 2024-04-26T23:46:29.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.756+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f7b700695f0 con 0x7f7b7015ef70 2024-04-26T23:46:29.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b6d600640 1 -- 172.21.15.47:0/3801508574 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f7b7015e4e0 con 0x7f7b7015ef70 2024-04-26T23:46:29.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7b4c068380 msgr2=0x7f7b4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7b4c068380 0x7f7b4c06a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7b600af000 tx=0x7f7b600046d0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7015ef70 msgr2=0x7f7b701556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7015ef70 0x7f7b701556b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b580010f0 tx=0x7f7b5800ef80 comp rx=0 tx=0).stop 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 shutdown_connections 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7b4c068380 0x7f7b4c06a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7b701550d0 0x7f7b70155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b7015ef70 0x7f7b701556b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 --2- 172.21.15.47:0/3801508574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b54003b80 0x7f7b70154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 >> 172.21.15.47:0/3801508574 conn(0x7f7b700b6590 msgr2=0x7f7b7015fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:29.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.760+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 shutdown_connections 2024-04-26T23:46:29.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.764+0000 7f7b77400640 1 -- 172.21.15.47:0/3801508574 wait complete. 2024-04-26T23:46:29.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-26T23:46:29.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.920+0000 7f6f5e400640 1 Processor -- start 2024-04-26T23:46:29.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f5e400640 1 -- start start 2024-04-26T23:46:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f5e400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 0x7f6f5806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f5e400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f580aea30 con 0x7f6f580af7f0 2024-04-26T23:46:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f5e400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f580aed10 con 0x7f6f581603b0 2024-04-26T23:46:29.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f5e400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f580af360 con 0x7f6f58159b70 2024-04-26T23:46:29.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f4fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6f580af7f0 0x7f6f5815fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49244/0 (socket says 172.21.15.47:49244) 2024-04-26T23:46:29.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f4fe00640 1 -- 172.21.15.47:0/2380714335 learned_addr learned my addr 172.21.15.47:0/2380714335 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:29.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57400640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 0x7f6f5806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674142049 0 0) 0x7f6f580aea30 con 0x7f6f580af7f0 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f3c003530 con 0x7f6f580af7f0 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2777752368 0 0) 0x7f6f3c003530 con 0x7f6f580af7f0 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 msgr2=0x7f6f5806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 0x7f6f5806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 >> v1:172.21.15.203:6789/0 conn(0x7f6f581603b0 legacy=0x7f6f5806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f580aeff0 con 0x7f6f580af7f0 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f6f40001680 con 0x7f6f580af7f0 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 >> v1:172.21.15.47:6789/0 conn(0x7f6f580af7f0 legacy=0x7f6f5815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3c0039f0 0x7f6f3c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 0x7f6f3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c004d50 0x7f6f3c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580af360 con 0x7f6f3c0039f0 2024-04-26T23:46:29.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c00ba80 con 0x7f6f3c004d50 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3c00de90 con 0x7f6f58159b70 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57400640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3c0039f0 0x7f6f3c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f4fe00640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 0x7f6f3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57e00640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c004d50 0x7f6f3c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57400640 1 -- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 msgr2=0x7f6f3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57400640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f58159b70 0x7f6f3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57400640 1 -- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c004d50 msgr2=0x7f6f3c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57400640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c004d50 0x7f6f3c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.924+0000 7f6f57400640 1 -- 172.21.15.47:0/2380714335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c003530 con 0x7f6f3c0039f0 2024-04-26T23:46:29.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f57400640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3c0039f0 0x7f6f3c003e30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009ab0 tx=0x7f6f4801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7857281762b760fa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480b2070 con 0x7f6f3c0039f0 2024-04-26T23:46:29.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f480a5530 con 0x7f6f3c0039f0 2024-04-26T23:46:29.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f56a00640 1 -- 172.21.15.47:0/2380714335 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480096b0 con 0x7f6f3c0039f0 2024-04-26T23:46:29.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f5e400640 1 -- 172.21.15.47:0/2380714335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3c0039f0 msgr2=0x7f6f3c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f5e400640 1 --2- 172.21.15.47:0/2380714335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f3c0039f0 0x7f6f3c003e30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009ab0 tx=0x7f6f4801ca50 comp rx=0 tx=0).stop 2024-04-26T23:46:29.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f57e00640 1 -- 172.21.15.47:0/2380714335 reap_dead start 2024-04-26T23:46:29.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f5e400640 1 -- 172.21.15.47:0/2380714335 shutdown_connections 2024-04-26T23:46:29.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f5e400640 1 -- 172.21.15.47:0/2380714335 >> 172.21.15.47:0/2380714335 conn(0x7f6f580b2d40 msgr2=0x7f6f580b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:29.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f5e400640 1 -- 172.21.15.47:0/2380714335 shutdown_connections 2024-04-26T23:46:29.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.928+0000 7f6f5e400640 1 -- 172.21.15.47:0/2380714335 wait complete. 2024-04-26T23:46:29.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 Processor -- start 2024-04-26T23:46:29.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 -- start start 2024-04-26T23:46:29.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c0039f0 0x7f6f5814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f5815ddf0 0x7f6f5815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f5814fe70 0x7f6f5815e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f58072240 con 0x7f6f5815ddf0 2024-04-26T23:46:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580720c0 con 0x7f6f3c0039f0 2024-04-26T23:46:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f580723c0 con 0x7f6f5814fe70 2024-04-26T23:46:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f5815ddf0 0x7f6f5815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f5815ddf0 0x7f6f5815cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55406/0 (socket says 172.21.15.47:55406) 2024-04-26T23:46:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 -- 172.21.15.47:0/1376104584 learned_addr learned my addr 172.21.15.47:0/1376104584 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f57400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c0039f0 0x7f6f5814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f57e00640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f5814fe70 0x7f6f5815e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 -- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f5814fe70 msgr2=0x7f6f5815e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f5814fe70 0x7f6f5815e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 -- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c0039f0 msgr2=0x7f6f5814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c0039f0 0x7f6f5814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 -- 172.21.15.47:0/1376104584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5815d3e0 con 0x7f6f5815ddf0 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f57e00640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f5814fe70 0x7f6f5815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f57400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c0039f0 0x7f6f5814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4fe00640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f5815ddf0 0x7f6f5815cdd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6f40007340 tx=0x7f6f40007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4f400640 1 -- 172.21.15.47:0/1376104584 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000f960 con 0x7f6f5815ddf0 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4f400640 1 -- 172.21.15.47:0/1376104584 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f40018070 con 0x7f6f5815ddf0 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f4f400640 1 -- 172.21.15.47:0/1376104584 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000fd40 con 0x7f6f5815ddf0 2024-04-26T23:46:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5815d6c0 con 0x7f6f5815ddf0 2024-04-26T23:46:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f580cea30 con 0x7f6f5815ddf0 2024-04-26T23:46:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.932+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f580695f0 con 0x7f6f5815ddf0 2024-04-26T23:46:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.936+0000 7f6f4f400640 1 -- 172.21.15.47:0/1376104584 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f4001d460 con 0x7f6f5815ddf0 2024-04-26T23:46:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.936+0000 7f6f4f400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f340683b0 0x7f6f3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.936+0000 7f6f4f400640 1 -- 172.21.15.47:0/1376104584 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f6f40086620 con 0x7f6f5815ddf0 2024-04-26T23:46:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.936+0000 7f6f57400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f340683b0 0x7f6f3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.936+0000 7f6f57400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f340683b0 0x7f6f3406a870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6f480af000 tx=0x7f6f480046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:29.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:29.940+0000 7f6f4f400640 1 -- 172.21.15.47:0/1376104584 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6f40056f20 con 0x7f6f5815ddf0 2024-04-26T23:46:30.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.164+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f6f58150250 con 0x7f6f5815ddf0 2024-04-26T23:46:30.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.164+0000 7f6f4f400640 1 -- 172.21.15.47:0/1376104584 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f6f40056820 con 0x7f6f5815ddf0 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f340683b0 msgr2=0x7f6f3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f340683b0 0x7f6f3406a870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6f480af000 tx=0x7f6f480046d0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f5815ddf0 msgr2=0x7f6f5815cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f5815ddf0 0x7f6f5815cdd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6f40007340 tx=0x7f6f40007800 comp rx=0 tx=0).stop 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 shutdown_connections 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f340683b0 0x7f6f3406a870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f5814fe70 0x7f6f5815e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f5815ddf0 0x7f6f5815cdd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 --2- 172.21.15.47:0/1376104584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f3c0039f0 0x7f6f5814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 >> 172.21.15.47:0/1376104584 conn(0x7f6f580b2d40 msgr2=0x7f6f580b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 shutdown_connections 2024-04-26T23:46:30.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.168+0000 7f6f5e400640 1 -- 172.21.15.47:0/1376104584 wait complete. 2024-04-26T23:46:30.194 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-26T23:46:30.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 Processor -- start 2024-04-26T23:46:30.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 -- start start 2024-04-26T23:46:30.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b9c159b70 0x7f8b9c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8b9c0af7f0 0x7f8b9c06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c15fca0 0x7f8b9c160150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9c0af360 con 0x7f8b9c159b70 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9c0aea30 con 0x7f8b9c0af7f0 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8ba1600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c0aed10 con 0x7f8b9c15fca0 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b9c159b70 0x7f8b9c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b9c159b70 0x7f8b9c06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55410/0 (socket says 172.21.15.47:55410) 2024-04-26T23:46:30.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 -- 172.21.15.47:0/3106907640 learned_addr learned my addr 172.21.15.47:0/3106907640 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:30.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 -- 172.21.15.47:0/3106907640 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c15fca0 msgr2=0x7f8b9c160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:30.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b92000640 1 --2- 172.21.15.47:0/3106907640 >> v2:172.21.15.203:3300/0 conn(0x7f8b9c0af7f0 0x7f8b9c06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9b400640 1 --2- 172.21.15.47:0/3106907640 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c15fca0 0x7f8b9c160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 --2- 172.21.15.47:0/3106907640 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c15fca0 0x7f8b9c160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 -- 172.21.15.47:0/3106907640 >> v2:172.21.15.203:3300/0 conn(0x7f8b9c0af7f0 msgr2=0x7f8b9c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:30.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 --2- 172.21.15.47:0/3106907640 >> v2:172.21.15.203:3300/0 conn(0x7f8b9c0af7f0 0x7f8b9c06cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9aa00640 1 -- 172.21.15.47:0/3106907640 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c0aeff0 con 0x7f8b9c159b70 2024-04-26T23:46:30.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b92000640 1 --2- 172.21.15.47:0/3106907640 >> v2:172.21.15.203:3300/0 conn(0x7f8b9c0af7f0 0x7f8b9c06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:30.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.328+0000 7f8b9b400640 1 --2- 172.21.15.47:0/3106907640 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c15fca0 0x7f8b9c160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8b9aa00640 1 --2- 172.21.15.47:0/3106907640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c06c630 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0d1d50 tx=0x7f8b8c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da676c960e92b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8b9a000640 1 -- 172.21.15.47:0/3106907640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0aa660 con 0x7f8b9c159b70 2024-04-26T23:46:30.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8b9a000640 1 -- 172.21.15.47:0/3106907640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c0af070 con 0x7f8b9c159b70 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8b9a000640 1 -- 172.21.15.47:0/3106907640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0aaa20 con 0x7f8b9c159b70 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 -- 172.21.15.47:0/3106907640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 msgr2=0x7f8b9c06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 --2- 172.21.15.47:0/3106907640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c06c630 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0d1d50 tx=0x7f8b8c01c520 comp rx=0 tx=0).stop 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 -- 172.21.15.47:0/3106907640 shutdown_connections 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 --2- 172.21.15.47:0/3106907640 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c15fca0 0x7f8b9c160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 --2- 172.21.15.47:0/3106907640 >> v2:172.21.15.203:3300/0 conn(0x7f8b9c0af7f0 0x7f8b9c06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 --2- 172.21.15.47:0/3106907640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c06c630 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 -- 172.21.15.47:0/3106907640 >> 172.21.15.47:0/3106907640 conn(0x7f8b9c0b2d40 msgr2=0x7f8b9c0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 -- 172.21.15.47:0/3106907640 shutdown_connections 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.332+0000 7f8ba1600640 1 -- 172.21.15.47:0/3106907640 wait complete. 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 Processor -- start 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 -- start start 2024-04-26T23:46:30.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c0af7f0 0x7f8b9c0cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b9c15fca0 0x7f8b9c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c073d70 con 0x7f8b9c159b70 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c073bf0 con 0x7f8b9c15fca0 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c073ef0 con 0x7f8b9c0af7f0 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55416/0 (socket says 172.21.15.47:55416) 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 -- 172.21.15.47:0/2283146749 learned_addr learned my addr 172.21.15.47:0/2283146749 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b9aa00640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c0af7f0 0x7f8b9c0cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b9b400640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b9c15fca0 0x7f8b9c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 -- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c0af7f0 msgr2=0x7f8b9c0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c0af7f0 0x7f8b9c0cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 -- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b9c15fca0 msgr2=0x7f8b9c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b9c15fca0 0x7f8b9c0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 -- 172.21.15.47:0/2283146749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c0d0520 con 0x7f8b9c159b70 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b92000640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c0b5420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400cee0 tx=0x7f8b8400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b93400640 1 -- 172.21.15.47:0/2283146749 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8401a070 con 0x7f8b9c159b70 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b93400640 1 -- 172.21.15.47:0/2283146749 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8400d840 con 0x7f8b9c159b70 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8b93400640 1 -- 172.21.15.47:0/2283146749 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8400dc10 con 0x7f8b9c159b70 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c0cf110 con 0x7f8b9c159b70 2024-04-26T23:46:30.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c0cf6d0 con 0x7f8b9c159b70 2024-04-26T23:46:30.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.336+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c0695f0 con 0x7f8b9c159b70 2024-04-26T23:46:30.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.340+0000 7f8b93400640 1 -- 172.21.15.47:0/2283146749 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b8401d070 con 0x7f8b9c159b70 2024-04-26T23:46:30.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.340+0000 7f8b93400640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b78068380 0x7f8b7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.340+0000 7f8b93400640 1 -- 172.21.15.47:0/2283146749 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f8b84086dc0 con 0x7f8b9c159b70 2024-04-26T23:46:30.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.340+0000 7f8b9aa00640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b78068380 0x7f8b7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.340+0000 7f8b9aa00640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b78068380 0x7f8b7806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0ae000 tx=0x7f8b8c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:30.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.344+0000 7f8b93400640 1 -- 172.21.15.47:0/2283146749 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8b84057070 con 0x7f8b9c159b70 2024-04-26T23:46:30.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.564+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f8b9c0cd440 con 0x7f8b9c159b70 2024-04-26T23:46:30.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8b93400640 1 -- 172.21.15.47:0/2283146749 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f8b8405b370 con 0x7f8b9c159b70 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b78068380 msgr2=0x7f8b7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b78068380 0x7f8b7806a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0ae000 tx=0x7f8b8c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 msgr2=0x7f8b9c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c0b5420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b8400cee0 tx=0x7f8b8400a710 comp rx=0 tx=0).stop 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 shutdown_connections 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b78068380 0x7f8b7806a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b9c15fca0 0x7f8b9c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b9c159b70 0x7f8b9c0b5420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 --2- 172.21.15.47:0/2283146749 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b9c0af7f0 0x7f8b9c0cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 >> 172.21.15.47:0/2283146749 conn(0x7f8b9c0b2d40 msgr2=0x7f8b9c159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 shutdown_connections 2024-04-26T23:46:30.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.568+0000 7f8ba1600640 1 -- 172.21.15.47:0/2283146749 wait complete. 2024-04-26T23:46:30.598 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-26T23:46:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cfa600640 1 Processor -- start 2024-04-26T23:46:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cfa600640 1 -- start start 2024-04-26T23:46:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cfa600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf415ee10 0x7f3cf415ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cfa600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3cf40af530 0x7f3cf40b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cfa600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf41604e0 con 0x7f3cf40b07e0 2024-04-26T23:46:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cfa600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3cf40af0a0 con 0x7f3cf40af530 2024-04-26T23:46:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cfa600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf40b0c50 con 0x7f3cf415ee10 2024-04-26T23:46:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3cf40af530 0x7f3cf40b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf9c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3cf40b07e0 0x7f3cf40b2510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49248/0 (socket says 172.21.15.47:49248) 2024-04-26T23:46:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf9c00640 1 -- 172.21.15.47:0/4229965970 learned_addr learned my addr 172.21.15.47:0/4229965970 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf9200640 1 --2- 172.21.15.47:0/4229965970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf415ee10 0x7f3cf415ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf3400640 1 -- 172.21.15.47:0/4229965970 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445733951 0 0) 0x7f3cec0014a0 con 0x7f3cf40b07e0 2024-04-26T23:46:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf3400640 1 -- 172.21.15.47:0/4229965970 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cdc003530 con 0x7f3cf40b07e0 2024-04-26T23:46:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf3e00640 1 -- 172.21.15.47:0/4229965970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf415ee10 msgr2=0x7f3cf415ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf3e00640 1 --2- 172.21.15.47:0/4229965970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf415ee10 0x7f3cf415ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf3e00640 1 -- 172.21.15.47:0/4229965970 >> v1:172.21.15.47:6789/0 conn(0x7f3cf40b07e0 legacy=0x7f3cf40b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.732+0000 7f3cf3e00640 1 -- 172.21.15.47:0/4229965970 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf40b4220 con 0x7f3cf40af530 2024-04-26T23:46:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cf3e00640 1 --2- 172.21.15.47:0/4229965970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf40af530 0x7f3cf40b02a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00097c0 tx=0x7f3ce001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc07681344693043 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cf3400640 1 -- 172.21.15.47:0/4229965970 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00b2070 con 0x7f3cf40af530 2024-04-26T23:46:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cf3400640 1 -- 172.21.15.47:0/4229965970 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce00ad640 con 0x7f3cf40af530 2024-04-26T23:46:30.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cf3400640 1 -- 172.21.15.47:0/4229965970 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00ada10 con 0x7f3cf40af530 2024-04-26T23:46:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 -- 172.21.15.47:0/4229965970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf40af530 msgr2=0x7f3cf40b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 --2- 172.21.15.47:0/4229965970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf40af530 0x7f3cf40b02a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00097c0 tx=0x7f3ce001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 -- 172.21.15.47:0/4229965970 shutdown_connections 2024-04-26T23:46:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 --2- 172.21.15.47:0/4229965970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf40af530 0x7f3cf40b02a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 --2- 172.21.15.47:0/4229965970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf415ee10 0x7f3cf415ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 -- 172.21.15.47:0/4229965970 >> 172.21.15.47:0/4229965970 conn(0x7f3cf4075df0 msgr2=0x7f3cf406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:30.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 -- 172.21.15.47:0/4229965970 shutdown_connections 2024-04-26T23:46:30.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.736+0000 7f3cfa600640 1 -- 172.21.15.47:0/4229965970 wait complete. 2024-04-26T23:46:30.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 Processor -- start 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 -- start start 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf40af530 0x7f3cf4156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cf40b07e0 0x7f3cf40b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf415ee10 0x7f3cf415cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40af9b0 con 0x7f3cf415ee10 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40b6b30 con 0x7f3cf40b07e0 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf414e870 con 0x7f3cf40af530 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf415ee10 0x7f3cf415cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf415ee10 0x7f3cf415cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55424/0 (socket says 172.21.15.47:55424) 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 -- 172.21.15.47:0/3368569466 learned_addr learned my addr 172.21.15.47:0/3368569466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9200640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf40af530 0x7f3cf4156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf3e00640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cf40b07e0 0x7f3cf40b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 -- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf40af530 msgr2=0x7f3cf4156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf40af530 0x7f3cf4156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 -- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cf40b07e0 msgr2=0x7f3cf40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cf40b07e0 0x7f3cf40b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 -- 172.21.15.47:0/3368569466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf414eb50 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf9c00640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf415ee10 0x7f3cf415cd20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00cb50 tx=0x7f3cec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf0c00640 1 -- 172.21.15.47:0/3368569466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec017070 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf0c00640 1 -- 172.21.15.47:0/3368569466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cec00ad40 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf414ee30 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cf0c00640 1 -- 172.21.15.47:0/3368569466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec012620 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf4156dd0 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.740+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf4069b80 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.744+0000 7f3cf0c00640 1 -- 172.21.15.47:0/3368569466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3cec01a070 con 0x7f3cf415ee10 2024-04-26T23:46:30.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.744+0000 7f3cf0c00640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3cd40683b0 0x7f3cd406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:30.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.744+0000 7f3cf0c00640 1 -- 172.21.15.47:0/3368569466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f3cec0864b0 con 0x7f3cf415ee10 2024-04-26T23:46:30.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.744+0000 7f3cf9200640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3cd40683b0 0x7f3cd406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:30.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.744+0000 7f3cf9200640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3cd40683b0 0x7f3cd406a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009ac0 tx=0x7f3ce8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:30.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.748+0000 7f3cf0c00640 1 -- 172.21.15.47:0/3368569466 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3cf41604e0 con 0x7f3cf415ee10 2024-04-26T23:46:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.972+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f3cf40b4b40 con 0x7f3cf415ee10 2024-04-26T23:46:30.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.976+0000 7f3cf0c00640 1 -- 172.21.15.47:0/3368569466 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3cec0566d0 con 0x7f3cf415ee10 2024-04-26T23:46:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3cd40683b0 msgr2=0x7f3cd406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3cd40683b0 0x7f3cd406a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009ac0 tx=0x7f3ce8009190 comp rx=0 tx=0).stop 2024-04-26T23:46:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf415ee10 msgr2=0x7f3cf415cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf415ee10 0x7f3cf415cd20 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3cec00cb50 tx=0x7f3cec00a430 comp rx=0 tx=0).stop 2024-04-26T23:46:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 shutdown_connections 2024-04-26T23:46:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3cd40683b0 0x7f3cd406a870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cf415ee10 0x7f3cf415cd20 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3cf40b07e0 0x7f3cf40b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 --2- 172.21.15.47:0/3368569466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3cf40af530 0x7f3cf4156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 >> 172.21.15.47:0/3368569466 conn(0x7f3cf4075df0 msgr2=0x7f3cf415f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 shutdown_connections 2024-04-26T23:46:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:30.980+0000 7f3cfa600640 1 -- 172.21.15.47:0/3368569466 wait complete. 2024-04-26T23:46:31.006 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:31.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.140+0000 7fbe25600640 1 Processor -- start 2024-04-26T23:46:31.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.140+0000 7fbe25600640 1 -- start start 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe25600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbe20160810 0x7fbe20071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe25600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe200d1860 0x7fbe200cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe25600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe200cd830 con 0x7fbe20072150 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe25600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbe20071080 con 0x7fbe200d1860 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe25600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbe20071360 con 0x7fbe20160810 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe1f400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe200d1860 0x7fbe200cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe16000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbe20072150 0x7fbe200d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49254/0 (socket says 172.21.15.47:49254) 2024-04-26T23:46:31.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe16000640 1 -- 172.21.15.47:0/1070469519 learned_addr learned my addr 172.21.15.47:0/1070469519 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:31.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe1f400640 1 -- 172.21.15.47:0/1070469519 >> v2:172.21.15.203:3300/0 conn(0x7fbe20160810 msgr2=0x7fbe20071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:31.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe1f400640 1 --2- 172.21.15.47:0/1070469519 >> v2:172.21.15.203:3300/0 conn(0x7fbe20160810 0x7fbe20071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe1f400640 1 -- 172.21.15.47:0/1070469519 >> v1:172.21.15.47:6789/0 conn(0x7fbe20072150 legacy=0x7fbe200d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe1f400640 1 -- 172.21.15.47:0/1070469519 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200cdad0 con 0x7fbe200d1860 2024-04-26T23:46:31.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe1e000640 1 -- 172.21.15.47:0/1070469519 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224747018 0 0) 0x7fbe200cd830 con 0x7fbe20072150 2024-04-26T23:46:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.144+0000 7fbe1f400640 1 --2- 172.21.15.47:0/1070469519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe200d1860 0x7fbe200cdff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe200767e0 tx=0x7fbe1801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458f23655a7e3824 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe1e000640 1 -- 172.21.15.47:0/1070469519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180b4070 con 0x7fbe200d1860 2024-04-26T23:46:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe1e000640 1 -- 172.21.15.47:0/1070469519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe180af600 con 0x7fbe200d1860 2024-04-26T23:46:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe1e000640 1 -- 172.21.15.47:0/1070469519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180af9d0 con 0x7fbe200d1860 2024-04-26T23:46:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- 172.21.15.47:0/1070469519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe200d1860 msgr2=0x7fbe200cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 --2- 172.21.15.47:0/1070469519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe200d1860 0x7fbe200cdff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbe200767e0 tx=0x7fbe1801f110 comp rx=0 tx=0).stop 2024-04-26T23:46:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- 172.21.15.47:0/1070469519 shutdown_connections 2024-04-26T23:46:31.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 --2- 172.21.15.47:0/1070469519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe200d1860 0x7fbe200cdff0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 --2- 172.21.15.47:0/1070469519 >> v2:172.21.15.203:3300/0 conn(0x7fbe20160810 0x7fbe20071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- 172.21.15.47:0/1070469519 >> 172.21.15.47:0/1070469519 conn(0x7fbe200d2e90 msgr2=0x7fbe200d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- 172.21.15.47:0/1070469519 shutdown_connections 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- 172.21.15.47:0/1070469519 wait complete. 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 Processor -- start 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- start start 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe20072150 0x7fbe2014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe200d1860 0x7fbe200d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20160810 0x7fbe200b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20160bf0 con 0x7fbe20160810 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20071ca0 con 0x7fbe200d1860 2024-04-26T23:46:31.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe25600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe20160d70 con 0x7fbe20072150 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe1f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20160810 0x7fbe200b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe1f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20160810 0x7fbe200b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55442/0 (socket says 172.21.15.47:55442) 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe1f400640 1 -- 172.21.15.47:0/3204687055 learned_addr learned my addr 172.21.15.47:0/3204687055 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe1ea00640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe20072150 0x7fbe2014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.148+0000 7fbe16000640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe200d1860 0x7fbe200d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1f400640 1 -- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe20072150 msgr2=0x7fbe2014f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1f400640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe20072150 0x7fbe2014f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1f400640 1 -- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe200d1860 msgr2=0x7fbe200d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1f400640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe200d1860 0x7fbe200d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1f400640 1 -- 172.21.15.47:0/3204687055 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200d0c10 con 0x7fbe20160810 2024-04-26T23:46:31.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1ea00640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe20072150 0x7fbe2014f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe16000640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe200d1860 0x7fbe200d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1f400640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20160810 0x7fbe200b3b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b2040 tx=0x7fbe1801beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe17400640 1 -- 172.21.15.47:0/3204687055 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180b4040 con 0x7fbe20160810 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe17400640 1 -- 172.21.15.47:0/3204687055 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe180c1070 con 0x7fbe20160810 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe17400640 1 -- 172.21.15.47:0/3204687055 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe180ba6b0 con 0x7fbe20160810 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe20150140 con 0x7fbe20160810 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe20150700 con 0x7fbe20160810 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe20069700 con 0x7fbe20160810 2024-04-26T23:46:31.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe17400640 1 -- 172.21.15.47:0/3204687055 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe180ba850 con 0x7fbe20160810 2024-04-26T23:46:31.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe17400640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbdfc068380 0x7fbdfc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe17400640 1 -- 172.21.15.47:0/3204687055 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7fbe18125160 con 0x7fbe20160810 2024-04-26T23:46:31.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.152+0000 7fbe1ea00640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbdfc068380 0x7fbdfc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.156+0000 7fbe1ea00640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbdfc068380 0x7fbdfc06a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbe10006fd0 tx=0x7fbe10008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.156+0000 7fbe17400640 1 -- 172.21.15.47:0/3204687055 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbe18018c70 con 0x7fbe20160810 2024-04-26T23:46:31.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe201508d0 con 0x7fbe20160810 2024-04-26T23:46:31.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe17400640 1 -- 172.21.15.47:0/3204687055 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+12879 (secure 0 0 0) 0x7fbe180f5b30 con 0x7fbe20160810 2024-04-26T23:46:31.332 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:31.332 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":32,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:28.134597+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:31.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbdfc068380 msgr2=0x7fbdfc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbdfc068380 0x7fbdfc06a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbe10006fd0 tx=0x7fbe10008040 comp rx=0 tx=0).stop 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20160810 msgr2=0x7fbe200b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20160810 0x7fbe200b3b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b2040 tx=0x7fbe1801beb0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 shutdown_connections 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbdfc068380 0x7fbdfc06a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe20160810 0x7fbe200b3b80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe200d1860 0x7fbe200d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 --2- 172.21.15.47:0/3204687055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe20072150 0x7fbe2014f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 >> 172.21.15.47:0/3204687055 conn(0x7fbe200d2e90 msgr2=0x7fbe2015f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 shutdown_connections 2024-04-26T23:46:31.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.324+0000 7fbe25600640 1 -- 172.21.15.47:0/3204687055 wait complete. 2024-04-26T23:46:31.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:46:31.354 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:46:31.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0341800640 1 Processor -- start 2024-04-26T23:46:31.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0341800640 1 -- start start 2024-04-26T23:46:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0341800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c0b56f0 0x7f033c0d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0341800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c071620 con 0x7f033c09c170 2024-04-26T23:46:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0341800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c162e90 con 0x7f033c162ab0 2024-04-26T23:46:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0341800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f033c0d2d40 con 0x7f033c0b56f0 2024-04-26T23:46:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0332000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f033c09c170 0x7f033c0d1310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49264/0 (socket says 172.21.15.47:49264) 2024-04-26T23:46:31.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.488+0000 7f0332000640 1 -- 172.21.15.47:0/1510260355 learned_addr learned my addr 172.21.15.47:0/1510260355 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033b400640 1 --2- 172.21.15.47:0/1510260355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c0b56f0 0x7f033c0d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033a000640 1 -- 172.21.15.47:0/1510260355 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 628927531 0 0) 0x7f033c071620 con 0x7f033c09c170 2024-04-26T23:46:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033a000640 1 -- 172.21.15.47:0/1510260355 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0320003530 con 0x7f033c09c170 2024-04-26T23:46:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033b400640 1 -- 172.21.15.47:0/1510260355 >> v1:172.21.15.203:6789/0 conn(0x7f033c162ab0 legacy=0x7f033c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033b400640 1 -- 172.21.15.47:0/1510260355 >> v1:172.21.15.47:6789/0 conn(0x7f033c09c170 legacy=0x7f033c0d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033b400640 1 -- 172.21.15.47:0/1510260355 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c06dfc0 con 0x7f033c0b56f0 2024-04-26T23:46:31.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033b400640 1 --2- 172.21.15.47:0/1510260355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c0b56f0 0x7f033c0d1a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0334009dc0 tx=0x7f033401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db5d7ed6c0f220a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.492+0000 7f033a000640 1 -- 172.21.15.47:0/1510260355 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340b2070 con 0x7f033c0b56f0 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033a000640 1 -- 172.21.15.47:0/1510260355 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03340a5870 con 0x7f033c0b56f0 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033a000640 1 -- 172.21.15.47:0/1510260355 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340a5c40 con 0x7f033c0b56f0 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- 172.21.15.47:0/1510260355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c0b56f0 msgr2=0x7f033c0d1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 --2- 172.21.15.47:0/1510260355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c0b56f0 0x7f033c0d1a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0334009dc0 tx=0x7f033401c900 comp rx=0 tx=0).stop 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- 172.21.15.47:0/1510260355 shutdown_connections 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 --2- 172.21.15.47:0/1510260355 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c0b56f0 0x7f033c0d1a20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- 172.21.15.47:0/1510260355 >> 172.21.15.47:0/1510260355 conn(0x7f033c0b4c00 msgr2=0x7f033c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- 172.21.15.47:0/1510260355 shutdown_connections 2024-04-26T23:46:31.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- 172.21.15.47:0/1510260355 wait complete. 2024-04-26T23:46:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 Processor -- start 2024-04-26T23:46:31.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- start start 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c09c170 0x7f033c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f033c0b56f0 0x7f033c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f033c162ab0 0x7f033c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f033c0721b0 con 0x7f033c162ab0 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f033c0718e0 con 0x7f033c0b56f0 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0341800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f033c072330 con 0x7f033c09c170 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f033c162ab0 0x7f033c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f033c162ab0 0x7f033c15d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55446/0 (socket says 172.21.15.47:55446) 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 -- 172.21.15.47:0/1250065362 learned_addr learned my addr 172.21.15.47:0/1250065362 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0332000640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f033c0b56f0 0x7f033c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033aa00640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c09c170 0x7f033c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 -- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c09c170 msgr2=0x7f033c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c09c170 0x7f033c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 -- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f033c0b56f0 msgr2=0x7f033c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f033c0b56f0 0x7f033c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033b400640 1 -- 172.21.15.47:0/1250065362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c162240 con 0x7f033c162ab0 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f033aa00640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c09c170 0x7f033c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.496+0000 7f0332000640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f033c0b56f0 0x7f033c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f033b400640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f033c162ab0 0x7f033c15d2a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0334019510 tx=0x7f03340196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0333400640 1 -- 172.21.15.47:0/1250065362 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340b2050 con 0x7f033c162ab0 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0333400640 1 -- 172.21.15.47:0/1250065362 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03340be070 con 0x7f033c162ab0 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0333400640 1 -- 172.21.15.47:0/1250065362 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340ad870 con 0x7f033c162ab0 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c0b2620 con 0x7f033c162ab0 2024-04-26T23:46:31.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c1532d0 con 0x7f033c162ab0 2024-04-26T23:46:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033c069700 con 0x7f033c162ab0 2024-04-26T23:46:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0333400640 1 -- 172.21.15.47:0/1250065362 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f03340ada10 con 0x7f033c162ab0 2024-04-26T23:46:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0333400640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0318068380 0x7f031806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.500+0000 7f0333400640 1 -- 172.21.15.47:0/1250065362 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7f0334121780 con 0x7f033c162ab0 2024-04-26T23:46:31.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.504+0000 7f033aa00640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0318068380 0x7f031806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.504+0000 7f033aa00640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0318068380 0x7f031806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f033c0d08f0 tx=0x7f032c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.504+0000 7f0333400640 1 -- 172.21.15.47:0/1250065362 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0334016580 con 0x7f033c162ab0 2024-04-26T23:46:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f033c153c40 con 0x7f033c162ab0 2024-04-26T23:46:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0333400640 1 -- 172.21.15.47:0/1250065362 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7f03340add00 con 0x7f033c162ab0 2024-04-26T23:46:31.679 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:46:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0318068380 msgr2=0x7f031806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0318068380 0x7f031806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f033c0d08f0 tx=0x7f032c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f033c162ab0 msgr2=0x7f033c15d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f033c162ab0 0x7f033c15d2a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0334019510 tx=0x7f03340196a0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 shutdown_connections 2024-04-26T23:46:31.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0318068380 0x7f031806a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f033c162ab0 0x7f033c15d2a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f033c0b56f0 0x7f033c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 --2- 172.21.15.47:0/1250065362 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f033c09c170 0x7f033c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 >> 172.21.15.47:0/1250065362 conn(0x7f033c0b4c00 msgr2=0x7f033c09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:31.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 shutdown_connections 2024-04-26T23:46:31.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.672+0000 7f0341800640 1 -- 172.21.15.47:0/1250065362 wait complete. 2024-04-26T23:46:31.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:46:31.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 Processor -- start 2024-04-26T23:46:31.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 -- start start 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7feb6c15c100 0x7feb6c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb6c06fcd0 0x7feb6c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c0ce140 0x7feb6c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7feb6c160860 con 0x7feb6c06fcd0 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7feb6c15d4a0 con 0x7feb6c15c100 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb72c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c15fc50 con 0x7feb6c0ce140 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb63400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb6c06fcd0 0x7feb6c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb63400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb6c06fcd0 0x7feb6c0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55454/0 (socket says 172.21.15.47:55454) 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb63400640 1 -- 172.21.15.47:0/366371423 learned_addr learned my addr 172.21.15.47:0/366371423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb70c00640 1 --2- 172.21.15.47:0/366371423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c0ce140 0x7feb6c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb6be00640 1 --2- 172.21.15.47:0/366371423 >> v2:172.21.15.203:3300/0 conn(0x7feb6c15c100 0x7feb6c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb63400640 1 -- 172.21.15.47:0/366371423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c0ce140 msgr2=0x7feb6c06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:31.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.832+0000 7feb63400640 1 --2- 172.21.15.47:0/366371423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c0ce140 0x7feb6c06ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb63400640 1 -- 172.21.15.47:0/366371423 >> v2:172.21.15.203:3300/0 conn(0x7feb6c15c100 msgr2=0x7feb6c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:31.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb63400640 1 --2- 172.21.15.47:0/366371423 >> v2:172.21.15.203:3300/0 conn(0x7feb6c15c100 0x7feb6c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb63400640 1 -- 172.21.15.47:0/366371423 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c15ff30 con 0x7feb6c06fcd0 2024-04-26T23:46:31.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb70c00640 1 --2- 172.21.15.47:0/366371423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c0ce140 0x7feb6c06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:31.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb63400640 1 --2- 172.21.15.47:0/366371423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c0cdc00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0703a0 tx=0x7feb5401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762fb49f93399614 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb6b400640 1 -- 172.21.15.47:0/366371423 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540b0070 con 0x7feb6c06fcd0 2024-04-26T23:46:31.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb6b400640 1 -- 172.21.15.47:0/366371423 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb540ab600 con 0x7feb6c06fcd0 2024-04-26T23:46:31.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb6b400640 1 -- 172.21.15.47:0/366371423 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540ab9d0 con 0x7feb6c06fcd0 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 -- 172.21.15.47:0/366371423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 msgr2=0x7feb6c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 --2- 172.21.15.47:0/366371423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c0cdc00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7feb6c0703a0 tx=0x7feb5401c260 comp rx=0 tx=0).stop 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 -- 172.21.15.47:0/366371423 shutdown_connections 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 --2- 172.21.15.47:0/366371423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c0cdc00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 --2- 172.21.15.47:0/366371423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c0ce140 0x7feb6c06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 --2- 172.21.15.47:0/366371423 >> v2:172.21.15.203:3300/0 conn(0x7feb6c15c100 0x7feb6c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 -- 172.21.15.47:0/366371423 >> 172.21.15.47:0/366371423 conn(0x7feb6c06c800 msgr2=0x7feb6c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 -- 172.21.15.47:0/366371423 shutdown_connections 2024-04-26T23:46:31.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.836+0000 7feb72c00640 1 -- 172.21.15.47:0/366371423 wait complete. 2024-04-26T23:46:31.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 Processor -- start 2024-04-26T23:46:31.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 -- start start 2024-04-26T23:46:31.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.850 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6c0ce140 0x7feb6c13e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c15c100 0x7feb6c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c0cef90 con 0x7feb6c06fcd0 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb6c0cee10 con 0x7feb6c0ce140 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7feb6c0cf110 con 0x7feb6c15c100 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55470/0 (socket says 172.21.15.47:55470) 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 -- 172.21.15.47:0/1160700521 learned_addr learned my addr 172.21.15.47:0/1160700521 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 -- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c15c100 msgr2=0x7feb6c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c15c100 0x7feb6c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 -- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6c0ce140 msgr2=0x7feb6c13e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6c0ce140 0x7feb6c13e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 -- 172.21.15.47:0/1160700521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6c158e60 con 0x7feb6c06fcd0 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb6be00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c15a1a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00e870 tx=0x7feb5c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb68c00640 1 -- 172.21.15.47:0/1160700521 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c017070 con 0x7feb6c06fcd0 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb68c00640 1 -- 172.21.15.47:0/1160700521 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5c00c940 con 0x7feb6c06fcd0 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6c159100 con 0x7feb6c06fcd0 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb68c00640 1 -- 172.21.15.47:0/1160700521 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c00ccf0 con 0x7feb6c06fcd0 2024-04-26T23:46:31.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.840+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb6c1596c0 con 0x7feb6c06fcd0 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.844+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6c069700 con 0x7feb6c06fcd0 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.844+0000 7feb68c00640 1 -- 172.21.15.47:0/1160700521 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb5c01a070 con 0x7feb6c06fcd0 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.844+0000 7feb68c00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb48068380 0x7feb4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.844+0000 7feb68c00640 1 -- 172.21.15.47:0/1160700521 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7feb5c086550 con 0x7feb6c06fcd0 2024-04-26T23:46:31.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.844+0000 7feb63400640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb48068380 0x7feb4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:31.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.844+0000 7feb63400640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb48068380 0x7feb4806a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb540ad000 tx=0x7feb54004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:31.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:31.848+0000 7feb68c00640 1 -- 172.21.15.47:0/1160700521 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feb5c056e50 con 0x7feb6c06fcd0 2024-04-26T23:46:32.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7feb6c0d08b0 con 0x7feb6c06fcd0 2024-04-26T23:46:32.023 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb68c00640 1 -- 172.21.15.47:0/1160700521 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) ==== 84+0+65 (secure 0 0 0) 0x7feb5c056750 con 0x7feb6c06fcd0 2024-04-26T23:46:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:32.024 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-26T23:46:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-04-26T23:46:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-04-26T23:46:32.024 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:32.024 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb48068380 msgr2=0x7feb4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb48068380 0x7feb4806a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb540ad000 tx=0x7feb54004740 comp rx=0 tx=0).stop 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 msgr2=0x7feb6c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c15a1a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00e870 tx=0x7feb5c00ec70 comp rx=0 tx=0).stop 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 shutdown_connections 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feb48068380 0x7feb4806a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7feb6c15c100 0x7feb6c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6c0ce140 0x7feb6c13e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 --2- 172.21.15.47:0/1160700521 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb6c06fcd0 0x7feb6c15a1a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 >> 172.21.15.47:0/1160700521 conn(0x7feb6c06c800 msgr2=0x7feb6c0ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 shutdown_connections 2024-04-26T23:46:32.026 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.016+0000 7feb72c00640 1 -- 172.21.15.47:0/1160700521 wait complete. 2024-04-26T23:46:32.047 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:46:32.047 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:46:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.184+0000 7fedfd200640 1 Processor -- start 2024-04-26T23:46:32.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.184+0000 7fedfd200640 1 -- start start 2024-04-26T23:46:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedfd200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedf80b40c0 0x7fedf806de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:32.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedfd200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd10 0x7fedf80ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedfd200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf80d07e0 con 0x7fedf815f630 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedfd200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80cd5a0 con 0x7fedf80b40c0 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedfd200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80cd880 con 0x7fedf80cdd10 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedefe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedf80b40c0 0x7fedf806de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedefe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fedf80b40c0 0x7fedf806de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55486/0 (socket says 172.21.15.47:55486) 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedefe00640 1 -- 172.21.15.47:0/1996882916 learned_addr learned my addr 172.21.15.47:0/1996882916 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedf6800640 1 --2- 172.21.15.47:0/1996882916 >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd10 0x7fedf80ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedefe00640 1 -- 172.21.15.47:0/1996882916 >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd10 msgr2=0x7fedf80ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedefe00640 1 --2- 172.21.15.47:0/1996882916 >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd10 0x7fedf80ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedefe00640 1 -- 172.21.15.47:0/1996882916 >> v1:172.21.15.203:6789/0 conn(0x7fedf815f630 legacy=0x7fedf806d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedefe00640 1 -- 172.21.15.47:0/1996882916 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80d1db0 con 0x7fedf80b40c0 2024-04-26T23:46:32.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.188+0000 7fedf6800640 1 --2- 172.21.15.47:0/1996882916 >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd10 0x7fedf80ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:32.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedefe00640 1 --2- 172.21.15.47:0/1996882916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf806de30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fedf80737f0 tx=0x7fede001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb1dde5cff942c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedf5400640 1 -- 172.21.15.47:0/1996882916 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00b1070 con 0x7fedf80b40c0 2024-04-26T23:46:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedf5400640 1 -- 172.21.15.47:0/1996882916 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede00ac630 con 0x7fedf80b40c0 2024-04-26T23:46:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedf5400640 1 -- 172.21.15.47:0/1996882916 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede00a8050 con 0x7fedf80b40c0 2024-04-26T23:46:32.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- 172.21.15.47:0/1996882916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 msgr2=0x7fedf806de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 --2- 172.21.15.47:0/1996882916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf806de30 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fedf80737f0 tx=0x7fede001c3d0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- 172.21.15.47:0/1996882916 shutdown_connections 2024-04-26T23:46:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 --2- 172.21.15.47:0/1996882916 >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd10 0x7fedf80ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 --2- 172.21.15.47:0/1996882916 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf806de30 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- 172.21.15.47:0/1996882916 >> 172.21.15.47:0/1996882916 conn(0x7fedf80d2f50 msgr2=0x7fedf80d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- 172.21.15.47:0/1996882916 shutdown_connections 2024-04-26T23:46:32.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- 172.21.15.47:0/1996882916 wait complete. 2024-04-26T23:46:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 Processor -- start 2024-04-26T23:46:32.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- start start 2024-04-26T23:46:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf8157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd10 0x7fedf80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf815f630 0x7fedf80c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806e4f0 con 0x7fedf80b40c0 2024-04-26T23:46:32.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806e370 con 0x7fedf80cdd10 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedfd200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fedf816c200 con 0x7fedf815f630 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedf5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf8157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedf5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf8157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55502/0 (socket says 172.21.15.47:55502) 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.192+0000 7fedf5e00640 1 -- 172.21.15.47:0/3952873621 learned_addr learned my addr 172.21.15.47:0/3952873621 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedf6800640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf815f630 0x7fedf80c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedefe00640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd10 0x7fedf80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedf5e00640 1 -- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf815f630 msgr2=0x7fedf80c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedf5e00640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf815f630 0x7fedf80c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedf5e00640 1 -- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd10 msgr2=0x7fedf80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedf5e00640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd10 0x7fedf80c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:32.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedf5e00640 1 -- 172.21.15.47:0/3952873621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80cc020 con 0x7fedf80b40c0 2024-04-26T23:46:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedf5e00640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf8157470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fede800c3c0 tx=0x7fede800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedee000640 1 -- 172.21.15.47:0/3952873621 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8017070 con 0x7fedf80b40c0 2024-04-26T23:46:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedee000640 1 -- 172.21.15.47:0/3952873621 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede80052d0 con 0x7fedf80b40c0 2024-04-26T23:46:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedee000640 1 -- 172.21.15.47:0/3952873621 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8003840 con 0x7fedf80b40c0 2024-04-26T23:46:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf80cc300 con 0x7fedf80b40c0 2024-04-26T23:46:32.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf80cc8c0 con 0x7fedf80b40c0 2024-04-26T23:46:32.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf80695f0 con 0x7fedf80b40c0 2024-04-26T23:46:32.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedee000640 1 -- 172.21.15.47:0/3952873621 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fede801a070 con 0x7fedf80b40c0 2024-04-26T23:46:32.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.196+0000 7fedee000640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068380 0x7fedd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:32.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.200+0000 7fedee000640 1 -- 172.21.15.47:0/3952873621 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4857+0+0 (secure 0 0 0) 0x7fede8085a30 con 0x7fedf80b40c0 2024-04-26T23:46:32.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.200+0000 7fedefe00640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068380 0x7fedd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:32.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.200+0000 7fedefe00640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068380 0x7fedd406a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fede00ae000 tx=0x7fede0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:32.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.200+0000 7fedee000640 1 -- 172.21.15.47:0/3952873621 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fede8005480 con 0x7fedf80b40c0 2024-04-26T23:46:32.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:32.221 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:46:32.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:32.372+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fedf80cca90 con 0x7fedf80b40c0 2024-04-26T23:46:33.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.140+0000 7fedee000640 1 -- 172.21.15.47:0/3952873621 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) ==== 138+0+0 (secure 0 0 0) 0x7fede80562a0 con 0x7fedf80b40c0 2024-04-26T23:46:33.151 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-04-26T23:46:33.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068380 msgr2=0x7fedd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:33.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068380 0x7fedd406a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fede00ae000 tx=0x7fede0008040 comp rx=0 tx=0).stop 2024-04-26T23:46:33.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 msgr2=0x7fedf8157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:33.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf8157470 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fede800c3c0 tx=0x7fede800c880 comp rx=0 tx=0).stop 2024-04-26T23:46:33.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 shutdown_connections 2024-04-26T23:46:33.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068380 0x7fedd406a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf815f630 0x7fedf80c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd10 0x7fedf80c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 --2- 172.21.15.47:0/3952873621 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf80b40c0 0x7fedf8157470 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 >> 172.21.15.47:0/3952873621 conn(0x7fedf80d2f50 msgr2=0x7fedf806d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:33.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 shutdown_connections 2024-04-26T23:46:33.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.144+0000 7fedfd200640 1 -- 172.21.15.47:0/3952873621 wait complete. 2024-04-26T23:46:33.181 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:46:33.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.324+0000 7f328ae00640 1 Processor -- start 2024-04-26T23:46:33.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.324+0000 7f328ae00640 1 -- start start 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f328ae00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f32840af950 0x7f32840afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f328ae00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3284073840 0x7f3284160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f328ae00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32840b0270 con 0x7f3284073e90 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f328ae00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f32840add90 con 0x7f3284073840 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f328ae00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f32840adfe0 con 0x7f32840af950 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f327b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3284073840 0x7f3284160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f3288e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3284073e90 0x7f3284160ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49266/0 (socket says 172.21.15.47:49266) 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f3288e00640 1 -- 172.21.15.47:0/2584806046 learned_addr learned my addr 172.21.15.47:0/2584806046 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:33.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f3283e00640 1 --2- 172.21.15.47:0/2584806046 >> v2:172.21.15.203:3300/0 conn(0x7f32840af950 0x7f32840afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f327b400640 1 -- 172.21.15.47:0/2584806046 >> v2:172.21.15.203:3300/0 conn(0x7f32840af950 msgr2=0x7f32840afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f327b400640 1 --2- 172.21.15.47:0/2584806046 >> v2:172.21.15.203:3300/0 conn(0x7f32840af950 0x7f32840afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f327b400640 1 -- 172.21.15.47:0/2584806046 >> v1:172.21.15.47:6789/0 conn(0x7f3284073e90 legacy=0x7f3284160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f3283400640 1 -- 172.21.15.47:0/2584806046 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998585813 0 0) 0x7f32840b0270 con 0x7f3284073e90 2024-04-26T23:46:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f327b400640 1 -- 172.21.15.47:0/2584806046 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32840ae2c0 con 0x7f3284073840 2024-04-26T23:46:33.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f3283e00640 1 --2- 172.21.15.47:0/2584806046 >> v2:172.21.15.203:3300/0 conn(0x7f32840af950 0x7f32840afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.328+0000 7f327b400640 1 --2- 172.21.15.47:0/2584806046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3284073840 0x7f3284160ab0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f32840b61e0 tx=0x7f326c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179256b132aa3da4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f3283400640 1 -- 172.21.15.47:0/2584806046 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c0ab650 con 0x7f3284073840 2024-04-26T23:46:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f3283400640 1 -- 172.21.15.47:0/2584806046 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326c0b0070 con 0x7f3284073840 2024-04-26T23:46:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f3283400640 1 -- 172.21.15.47:0/2584806046 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c0aba10 con 0x7f3284073840 2024-04-26T23:46:33.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- 172.21.15.47:0/2584806046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3284073840 msgr2=0x7f3284160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 --2- 172.21.15.47:0/2584806046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3284073840 0x7f3284160ab0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f32840b61e0 tx=0x7f326c01c450 comp rx=0 tx=0).stop 2024-04-26T23:46:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- 172.21.15.47:0/2584806046 shutdown_connections 2024-04-26T23:46:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 --2- 172.21.15.47:0/2584806046 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3284073840 0x7f3284160ab0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 --2- 172.21.15.47:0/2584806046 >> v2:172.21.15.203:3300/0 conn(0x7f32840af950 0x7f32840afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- 172.21.15.47:0/2584806046 >> 172.21.15.47:0/2584806046 conn(0x7f32840b2a40 msgr2=0x7f32840b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- 172.21.15.47:0/2584806046 shutdown_connections 2024-04-26T23:46:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- 172.21.15.47:0/2584806046 wait complete. 2024-04-26T23:46:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 Processor -- start 2024-04-26T23:46:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- start start 2024-04-26T23:46:33.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3284073840 0x7f328415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3284073e90 0x7f32841551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32840af950 0x7f32841494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f328415d350 con 0x7f32840af950 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f328415d1d0 con 0x7f3284073e90 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f328ae00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3284161700 con 0x7f3284073840 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f3288e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32840af950 0x7f32841494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f3288e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32840af950 0x7f32841494b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55506/0 (socket says 172.21.15.47:55506) 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f3288e00640 1 -- 172.21.15.47:0/1381791180 learned_addr learned my addr 172.21.15.47:0/1381791180 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f327b400640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3284073e90 0x7f32841551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.332+0000 7f3283e00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3284073840 0x7f328415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3288e00640 1 -- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3284073840 msgr2=0x7f328415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3288e00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3284073840 0x7f328415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3288e00640 1 -- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3284073e90 msgr2=0x7f32841551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:33.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3288e00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3284073e90 0x7f32841551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3288e00640 1 -- 172.21.15.47:0/1381791180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328415bf80 con 0x7f32840af950 2024-04-26T23:46:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f327b400640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3284073e90 0x7f32841551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3288e00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32840af950 0x7f32841494b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f327c00c7a0 tx=0x7f327c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3280c00640 1 -- 172.21.15.47:0/1381791180 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c018070 con 0x7f32840af950 2024-04-26T23:46:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3280c00640 1 -- 172.21.15.47:0/1381791180 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c00a640 con 0x7f32840af950 2024-04-26T23:46:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3280c00640 1 -- 172.21.15.47:0/1381791180 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c00aab0 con 0x7f32840af950 2024-04-26T23:46:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328415c260 con 0x7f32840af950 2024-04-26T23:46:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3284157380 con 0x7f32840af950 2024-04-26T23:46:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3284069700 con 0x7f32840af950 2024-04-26T23:46:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3280c00640 1 -- 172.21.15.47:0/1381791180 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f327c01b070 con 0x7f32840af950 2024-04-26T23:46:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3280c00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3260068380 0x7f326006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.336+0000 7f3280c00640 1 -- 172.21.15.47:0/1381791180 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5227+0+0 (secure 0 0 0) 0x7f327c085da0 con 0x7f32840af950 2024-04-26T23:46:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.340+0000 7f3283e00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3260068380 0x7f326006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:33.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.340+0000 7f3283e00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3260068380 0x7f326006a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f327400ba10 tx=0x7f3274008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.344+0000 7f3280c00640 1 -- 172.21.15.47:0/1381791180 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f327c0565d0 con 0x7f32840af950 2024-04-26T23:46:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:33.512+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3284072110 con 0x7f32840af950 2024-04-26T23:46:34.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.144+0000 7f3280c00640 1 -- 172.21.15.47:0/1381791180 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) ==== 170+0+0 (secure 0 0 0) 0x7f327c055ed0 con 0x7f32840af950 2024-04-26T23:46:34.154 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-04-26T23:46:34.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3260068380 msgr2=0x7f326006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:34.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3260068380 0x7f326006a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f327400ba10 tx=0x7f3274008040 comp rx=0 tx=0).stop 2024-04-26T23:46:34.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32840af950 msgr2=0x7f32841494b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32840af950 0x7f32841494b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f327c00c7a0 tx=0x7f327c00cc60 comp rx=0 tx=0).stop 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 shutdown_connections 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3260068380 0x7f326006a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32840af950 0x7f32841494b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3284073e90 0x7f32841551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 --2- 172.21.15.47:0/1381791180 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3284073840 0x7f328415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 >> 172.21.15.47:0/1381791180 conn(0x7f32840b2a40 msgr2=0x7f3284159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 shutdown_connections 2024-04-26T23:46:34.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.148+0000 7f328ae00640 1 -- 172.21.15.47:0/1381791180 wait complete. 2024-04-26T23:46:34.199 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:46:34.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c9e00640 1 Processor -- start 2024-04-26T23:46:34.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c9e00640 1 -- start start 2024-04-26T23:46:34.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c9e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f21c406c630 0x7f21c406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:34.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c9e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c40ae030 con 0x7f21c4160b50 2024-04-26T23:46:34.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c9e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c40d0ae0 con 0x7f21c415cf50 2024-04-26T23:46:34.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c9e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f21c40af7a0 con 0x7f21c406c630 2024-04-26T23:46:34.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21ba000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f21c406c630 0x7f21c406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:34.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c3400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f21c4160b50 0x7f21c4160fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49280/0 (socket says 172.21.15.47:49280) 2024-04-26T23:46:34.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.336+0000 7f21c3400640 1 -- 172.21.15.47:0/4223870007 learned_addr learned my addr 172.21.15.47:0/4223870007 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:34.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21ba000640 1 -- 172.21.15.47:0/4223870007 >> v1:172.21.15.203:6789/0 conn(0x7f21c415cf50 legacy=0x7f21c40cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:34.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21ba000640 1 -- 172.21.15.47:0/4223870007 >> v1:172.21.15.47:6789/0 conn(0x7f21c4160b50 legacy=0x7f21c4160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:34.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21ba000640 1 -- 172.21.15.47:0/4223870007 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c40af9d0 con 0x7f21c406c630 2024-04-26T23:46:34.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21ba000640 1 --2- 172.21.15.47:0/4223870007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c406c630 0x7f21c406cac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0097c0 tx=0x7f21ac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6b849e3bf2d6b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:34.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c2000640 1 -- 172.21.15.47:0/4223870007 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0b0070 con 0x7f21c406c630 2024-04-26T23:46:34.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c2000640 1 -- 172.21.15.47:0/4223870007 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ac0ab600 con 0x7f21c406c630 2024-04-26T23:46:34.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c2000640 1 -- 172.21.15.47:0/4223870007 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ac0ab9d0 con 0x7f21c406c630 2024-04-26T23:46:34.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c9e00640 1 -- 172.21.15.47:0/4223870007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c406c630 msgr2=0x7f21c406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:34.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c9e00640 1 --2- 172.21.15.47:0/4223870007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c406c630 0x7f21c406cac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0097c0 tx=0x7f21ac01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c9e00640 1 -- 172.21.15.47:0/4223870007 shutdown_connections 2024-04-26T23:46:34.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c9e00640 1 --2- 172.21.15.47:0/4223870007 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c406c630 0x7f21c406cac0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c9e00640 1 -- 172.21.15.47:0/4223870007 >> 172.21.15.47:0/4223870007 conn(0x7f21c40b2b70 msgr2=0x7f21c40b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:34.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.340+0000 7f21c9e00640 1 -- 172.21.15.47:0/4223870007 shutdown_connections 2024-04-26T23:46:34.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 -- 172.21.15.47:0/4223870007 wait complete. 2024-04-26T23:46:34.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 Processor -- start 2024-04-26T23:46:34.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 -- start start 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21c406c630 0x7f21c41597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21c415cf50 0x7f21c414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c4160b50 0x7f21c4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f21c40b3c40 con 0x7f21c4160b50 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21c415d330 con 0x7f21c415cf50 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f21c40b3dc0 con 0x7f21c406c630 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c4160b50 0x7f21c4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:34.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c4160b50 0x7f21c4156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55522/0 (socket says 172.21.15.47:55522) 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 -- 172.21.15.47:0/911183796 learned_addr learned my addr 172.21.15.47:0/911183796 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c2a00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21c406c630 0x7f21c41597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21ba000640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21c415cf50 0x7f21c414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 -- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21c406c630 msgr2=0x7f21c41597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21c406c630 0x7f21c41597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 -- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21c415cf50 msgr2=0x7f21c414eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21c415cf50 0x7f21c414eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 -- 172.21.15.47:0/911183796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c4157510 con 0x7f21c4160b50 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21ba000640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21c415cf50 0x7f21c414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c3400640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c4160b50 0x7f21c4156fd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00ca80 tx=0x7f21bc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21bbe00640 1 -- 172.21.15.47:0/911183796 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc017070 con 0x7f21c4160b50 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21bbe00640 1 -- 172.21.15.47:0/911183796 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21bc00ac30 con 0x7f21c4160b50 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21bbe00640 1 -- 172.21.15.47:0/911183796 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc012400 con 0x7f21c4160b50 2024-04-26T23:46:34.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c41577e0 con 0x7f21c4160b50 2024-04-26T23:46:34.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.344+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c4157da0 con 0x7f21c4160b50 2024-04-26T23:46:34.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.348+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c40d1be0 con 0x7f21c4160b50 2024-04-26T23:46:34.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.348+0000 7f21bbe00640 1 -- 172.21.15.47:0/911183796 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f21bc01a070 con 0x7f21c4160b50 2024-04-26T23:46:34.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.348+0000 7f21bbe00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21a0068380 0x7f21a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:34.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.348+0000 7f21bbe00640 1 -- 172.21.15.47:0/911183796 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5609+0+0 (secure 0 0 0) 0x7f21bc086a50 con 0x7f21c4160b50 2024-04-26T23:46:34.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.352+0000 7f21c2a00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21a0068380 0x7f21a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:34.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.352+0000 7f21c2a00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21a0068380 0x7f21a006a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f21b4001650 tx=0x7f21b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:34.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.352+0000 7f21bbe00640 1 -- 172.21.15.47:0/911183796 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f21bc056a00 con 0x7f21c4160b50 2024-04-26T23:46:34.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:34.560+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f21c4069700 con 0x7f21c4160b50 2024-04-26T23:46:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.164+0000 7f21bbe00640 1 -- 172.21.15.47:0/911183796 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7f21bc05ad00 con 0x7f21c4160b50 2024-04-26T23:46:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 4 and data pool 5 2024-04-26T23:46:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.164+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21a0068380 msgr2=0x7f21a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.164+0000 7f21c9e00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21a0068380 0x7f21a006a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f21b4001650 tx=0x7f21b4009040 comp rx=0 tx=0).stop 2024-04-26T23:46:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.164+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c4160b50 msgr2=0x7f21c4156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.164+0000 7f21c9e00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c4160b50 0x7f21c4156fd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00ca80 tx=0x7f21bc00cf40 comp rx=0 tx=0).stop 2024-04-26T23:46:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 shutdown_connections 2024-04-26T23:46:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f21a0068380 0x7f21a006a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f21c4160b50 0x7f21c4156fd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f21c415cf50 0x7f21c414eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 --2- 172.21.15.47:0/911183796 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f21c406c630 0x7f21c41597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 >> 172.21.15.47:0/911183796 conn(0x7f21c40b2b70 msgr2=0x7f21c4160fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:35.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 shutdown_connections 2024-04-26T23:46:35.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.168+0000 7f21c9e00640 1 -- 172.21.15.47:0/911183796 wait complete. 2024-04-26T23:46:35.229 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:35.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6434800640 1 Processor -- start 2024-04-26T23:46:35.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6434800640 1 -- start start 2024-04-26T23:46:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6434800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f642c0d0fb0 0x7f642c070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6434800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c0d2340 con 0x7f642c06f0a0 2024-04-26T23:46:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6434800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c0cd580 con 0x7f642c09c170 2024-04-26T23:46:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6434800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f642c0cf350 con 0x7f642c0d0fb0 2024-04-26T23:46:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6431e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f642c06f0a0 0x7f642c09ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49286/0 (socket says 172.21.15.47:49286) 2024-04-26T23:46:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6431e00640 1 -- 172.21.15.47:0/1726670944 learned_addr learned my addr 172.21.15.47:0/1726670944 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:35.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6432800640 1 --2- 172.21.15.47:0/1726670944 >> v2:172.21.15.47:3300/0 conn(0x7f642c0d0fb0 0x7f642c070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6430a00640 1 -- 172.21.15.47:0/1726670944 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536440706 0 0) 0x7f642c0d2340 con 0x7f642c06f0a0 2024-04-26T23:46:35.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6430a00640 1 -- 172.21.15.47:0/1726670944 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6414003530 con 0x7f642c06f0a0 2024-04-26T23:46:35.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6432800640 1 -- 172.21.15.47:0/1726670944 >> v1:172.21.15.203:6789/0 conn(0x7f642c09c170 legacy=0x7f642c070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6432800640 1 -- 172.21.15.47:0/1726670944 >> v1:172.21.15.47:6789/0 conn(0x7f642c06f0a0 legacy=0x7f642c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.364+0000 7f6432800640 1 -- 172.21.15.47:0/1726670944 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c0cd860 con 0x7f642c0d0fb0 2024-04-26T23:46:35.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6432800640 1 --2- 172.21.15.47:0/1726670944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c0d0fb0 0x7f642c070aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f4669f292c1070 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6430a00640 1 -- 172.21.15.47:0/1726670944 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280b2070 con 0x7f642c0d0fb0 2024-04-26T23:46:35.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6430a00640 1 -- 172.21.15.47:0/1726670944 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280a5770 con 0x7f642c0d0fb0 2024-04-26T23:46:35.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6430a00640 1 -- 172.21.15.47:0/1726670944 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280a5b20 con 0x7f642c0d0fb0 2024-04-26T23:46:35.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6434800640 1 -- 172.21.15.47:0/1726670944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c0d0fb0 msgr2=0x7f642c070aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6434800640 1 --2- 172.21.15.47:0/1726670944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c0d0fb0 0x7f642c070aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642801c8b0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6434800640 1 -- 172.21.15.47:0/1726670944 shutdown_connections 2024-04-26T23:46:35.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6434800640 1 --2- 172.21.15.47:0/1726670944 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c0d0fb0 0x7f642c070aa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6434800640 1 -- 172.21.15.47:0/1726670944 >> 172.21.15.47:0/1726670944 conn(0x7f642c0d2e90 msgr2=0x7f642c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:35.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6434800640 1 -- 172.21.15.47:0/1726670944 shutdown_connections 2024-04-26T23:46:35.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.368+0000 7f6434800640 1 -- 172.21.15.47:0/1726670944 wait complete. 2024-04-26T23:46:35.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 Processor -- start 2024-04-26T23:46:35.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 -- start start 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f642c06f0a0 0x7f642c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c09c170 0x7f642c0c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f642c0d0fb0 0x7f642c0c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f642c0d2120 con 0x7f642c09c170 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f642c0d1fa0 con 0x7f642c0d0fb0 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f642c06d510 con 0x7f642c06f0a0 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c09c170 0x7f642c0c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f642c06f0a0 0x7f642c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6432800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f642c0d0fb0 0x7f642c0c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c09c170 0x7f642c0c7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55544/0 (socket says 172.21.15.47:55544) 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 -- 172.21.15.47:0/3123969226 learned_addr learned my addr 172.21.15.47:0/3123969226 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 -- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f642c06f0a0 msgr2=0x7f642c155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f642c06f0a0 0x7f642c155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 -- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f642c0d0fb0 msgr2=0x7f642c0c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f642c0d0fb0 0x7f642c0c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 -- 172.21.15.47:0/3123969226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c0b6ad0 con 0x7f642c09c170 2024-04-26T23:46:35.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6431400640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c09c170 0x7f642c0c7c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c450 tx=0x7f641c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6426000640 1 -- 172.21.15.47:0/3123969226 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c016020 con 0x7f642c09c170 2024-04-26T23:46:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6426000640 1 -- 172.21.15.47:0/3123969226 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641c0052d0 con 0x7f642c09c170 2024-04-26T23:46:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6426000640 1 -- 172.21.15.47:0/3123969226 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c007260 con 0x7f642c09c170 2024-04-26T23:46:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c0b6db0 con 0x7f642c09c170 2024-04-26T23:46:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.372+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c0b7370 con 0x7f642c09c170 2024-04-26T23:46:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.376+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642c069700 con 0x7f642c09c170 2024-04-26T23:46:35.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.376+0000 7f6426000640 1 -- 172.21.15.47:0/3123969226 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f641c007400 con 0x7f642c09c170 2024-04-26T23:46:35.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.376+0000 7f6426000640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6410068380 0x7f641006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.376+0000 7f6426000640 1 -- 172.21.15.47:0/3123969226 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f641c0862f0 con 0x7f642c09c170 2024-04-26T23:46:35.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.376+0000 7f6431e00640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6410068380 0x7f641006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.376+0000 7f6431e00640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6410068380 0x7f641006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64200011f0 tx=0x7f6420007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.380+0000 7f6426000640 1 -- 172.21.15.47:0/3123969226 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f641c020020 con 0x7f642c09c170 2024-04-26T23:46:35.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f642c0cce00 con 0x7f642c09c170 2024-04-26T23:46:35.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6426000640 1 -- 172.21.15.47:0/3123969226 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16670 (secure 0 0 0) 0x7f641c005480 con 0x7f642c09c170 2024-04-26T23:46:35.556 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:35.556 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":35,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:34.565101+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:35.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6410068380 msgr2=0x7f641006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6410068380 0x7f641006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64200011f0 tx=0x7f6420007d40 comp rx=0 tx=0).stop 2024-04-26T23:46:35.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c09c170 msgr2=0x7f642c0c7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c09c170 0x7f642c0c7c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c450 tx=0x7f641c00c910 comp rx=0 tx=0).stop 2024-04-26T23:46:35.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 shutdown_connections 2024-04-26T23:46:35.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6410068380 0x7f641006a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f642c0d0fb0 0x7f642c0c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f642c09c170 0x7f642c0c7c80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 --2- 172.21.15.47:0/3123969226 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f642c06f0a0 0x7f642c155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 >> 172.21.15.47:0/3123969226 conn(0x7f642c0d2e90 msgr2=0x7f642c070390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 shutdown_connections 2024-04-26T23:46:35.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.548+0000 7f6434800640 1 -- 172.21.15.47:0/3123969226 wait complete. 2024-04-26T23:46:35.577 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:35.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.708+0000 7f6441e00640 1 Processor -- start 2024-04-26T23:46:35.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.708+0000 7f6441e00640 1 -- start start 2024-04-26T23:46:35.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f6441e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f643c0b4360 0x7f643c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f6441e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643c15e050 con 0x7f643c15d5b0 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f6441e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643c15e330 con 0x7f643c0ce310 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f6441e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f643c0ceda0 con 0x7f643c0b4360 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f643aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f643c0b4360 0x7f643c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f6432000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f643c15d5b0 0x7f643c0cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49300/0 (socket says 172.21.15.47:49300) 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f6432000640 1 -- 172.21.15.47:0/3894533899 learned_addr learned my addr 172.21.15.47:0/3894533899 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f643aa00640 1 -- 172.21.15.47:0/3894533899 >> v1:172.21.15.203:6789/0 conn(0x7f643c0ce310 legacy=0x7f643c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f643aa00640 1 -- 172.21.15.47:0/3894533899 >> v1:172.21.15.47:6789/0 conn(0x7f643c15d5b0 legacy=0x7f643c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f643aa00640 1 -- 172.21.15.47:0/3894533899 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c0cf080 con 0x7f643c0b4360 2024-04-26T23:46:35.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f643aa00640 1 --2- 172.21.15.47:0/3894533899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c0b4360 0x7f643c0cf5a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f642c009d90 tx=0x7f642c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54276142fa28c349 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.712+0000 7f643a000640 1 -- 172.21.15.47:0/3894533899 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0b2070 con 0x7f643c0b4360 2024-04-26T23:46:35.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f643a000640 1 -- 172.21.15.47:0/3894533899 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642c0a5830 con 0x7f643c0b4360 2024-04-26T23:46:35.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f643a000640 1 -- 172.21.15.47:0/3894533899 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642c0a5c00 con 0x7f643c0b4360 2024-04-26T23:46:35.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- 172.21.15.47:0/3894533899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c0b4360 msgr2=0x7f643c0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 --2- 172.21.15.47:0/3894533899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c0b4360 0x7f643c0cf5a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f642c009d90 tx=0x7f642c01c970 comp rx=0 tx=0).stop 2024-04-26T23:46:35.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- 172.21.15.47:0/3894533899 shutdown_connections 2024-04-26T23:46:35.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 --2- 172.21.15.47:0/3894533899 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c0b4360 0x7f643c0cf5a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- 172.21.15.47:0/3894533899 >> 172.21.15.47:0/3894533899 conn(0x7f643c06c800 msgr2=0x7f643c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:35.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- 172.21.15.47:0/3894533899 shutdown_connections 2024-04-26T23:46:35.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- 172.21.15.47:0/3894533899 wait complete. 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 Processor -- start 2024-04-26T23:46:35.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- start start 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f643c0b4360 0x7f643c09e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f643c0ce310 0x7f643c09ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c15d5b0 0x7f643c0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f643c16b760 con 0x7f643c15d5b0 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f643c15ddd0 con 0x7f643c0b4360 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6441e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f643c16b8e0 con 0x7f643c0ce310 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f643b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c15d5b0 0x7f643c0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f643b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c15d5b0 0x7f643c0732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55562/0 (socket says 172.21.15.47:55562) 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f643b400640 1 -- 172.21.15.47:0/2756185653 learned_addr learned my addr 172.21.15.47:0/2756185653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f643aa00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f643c0b4360 0x7f643c09e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.716+0000 7f6432000640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f643c0ce310 0x7f643c09ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f643b400640 1 -- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f643c0ce310 msgr2=0x7f643c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f643b400640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f643c0ce310 0x7f643c09ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f643b400640 1 -- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f643c0b4360 msgr2=0x7f643c09e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f643b400640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f643c0b4360 0x7f643c09e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f643b400640 1 -- 172.21.15.47:0/2756185653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c09bfa0 con 0x7f643c15d5b0 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f643b400640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c15d5b0 0x7f643c0732d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f643400c460 tx=0x7f643400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f6433e00640 1 -- 172.21.15.47:0/2756185653 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434016020 con 0x7f643c15d5b0 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f6433e00640 1 -- 172.21.15.47:0/2756185653 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6434005220 con 0x7f643c15d5b0 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c1fc4a0 con 0x7f643c15d5b0 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f6433e00640 1 -- 172.21.15.47:0/2756185653 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434007030 con 0x7f643c15d5b0 2024-04-26T23:46:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c1fcce0 con 0x7f643c15d5b0 2024-04-26T23:46:35.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c069700 con 0x7f643c15d5b0 2024-04-26T23:46:35.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.720+0000 7f6433e00640 1 -- 172.21.15.47:0/2756185653 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f64340071d0 con 0x7f643c15d5b0 2024-04-26T23:46:35.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.724+0000 7f6433e00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6418068380 0x7f641806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:35.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.724+0000 7f6433e00640 1 -- 172.21.15.47:0/2756185653 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6434086310 con 0x7f643c15d5b0 2024-04-26T23:46:35.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.724+0000 7f643aa00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6418068380 0x7f641806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:35.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.724+0000 7f643aa00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6418068380 0x7f641806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f642c0af000 tx=0x7f642c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:35.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.728+0000 7f6433e00640 1 -- 172.21.15.47:0/2756185653 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6434020020 con 0x7f643c15d5b0 2024-04-26T23:46:35.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.892+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f643c0b4fb0 con 0x7f643c15d5b0 2024-04-26T23:46:35.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6433e00640 1 -- 172.21.15.47:0/2756185653 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16670 (secure 0 0 0) 0x7f643c1fc4a0 con 0x7f643c15d5b0 2024-04-26T23:46:35.903 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:35.903 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":35,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:34.565101+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:35.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6418068380 msgr2=0x7f641806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6418068380 0x7f641806a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f642c0af000 tx=0x7f642c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c15d5b0 msgr2=0x7f643c0732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c15d5b0 0x7f643c0732d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f643400c460 tx=0x7f643400c920 comp rx=0 tx=0).stop 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 shutdown_connections 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6418068380 0x7f641806a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f643c15d5b0 0x7f643c0732d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f643c0ce310 0x7f643c09ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 --2- 172.21.15.47:0/2756185653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f643c0b4360 0x7f643c09e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 >> 172.21.15.47:0/2756185653 conn(0x7f643c06c800 msgr2=0x7f643c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 shutdown_connections 2024-04-26T23:46:35.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:35.896+0000 7f6441e00640 1 -- 172.21.15.47:0/2756185653 wait complete. 2024-04-26T23:46:35.926 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:46:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d8a000640 1 Processor -- start 2024-04-26T23:46:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d8a000640 1 -- start start 2024-04-26T23:46:36.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d8a000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8d8415cf50 0x7f8d840cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d8a000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8406cd40 0x7f8d84160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d8a000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d840ae030 con 0x7f8d840d04b0 2024-04-26T23:46:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d8a000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8d840af7a0 con 0x7f8d8415cf50 2024-04-26T23:46:36.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d8a000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840d0ae0 con 0x7f8d8406cd40 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d83e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8406cd40 0x7f8d84160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d7aa00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f8d840d04b0 0x7f8d8406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:34872/0 (socket says 172.21.15.47:34872) 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d7aa00640 1 -- 172.21.15.47:0/2641112104 learned_addr learned my addr 172.21.15.47:0/2641112104 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d83400640 1 --2- 172.21.15.47:0/2641112104 >> v2:172.21.15.203:3300/0 conn(0x7f8d8415cf50 0x7f8d840cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d82a00640 1 -- 172.21.15.47:0/2641112104 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027782426 0 0) 0x7f8d840ae030 con 0x7f8d840d04b0 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d82a00640 1 -- 172.21.15.47:0/2641112104 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d68003530 con 0x7f8d840d04b0 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d83400640 1 -- 172.21.15.47:0/2641112104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8406cd40 msgr2=0x7f8d84160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d83400640 1 --2- 172.21.15.47:0/2641112104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8406cd40 0x7f8d84160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d83400640 1 -- 172.21.15.47:0/2641112104 >> v1:172.21.15.203:6789/0 conn(0x7f8d840d04b0 legacy=0x7f8d8406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:36.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.064+0000 7f8d83400640 1 -- 172.21.15.47:0/2641112104 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d840af9d0 con 0x7f8d8415cf50 2024-04-26T23:46:36.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d83400640 1 --2- 172.21.15.47:0/2641112104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d8415cf50 0x7f8d840cff70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097c0 tx=0x7f8d7401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810bfde77066e9af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:36.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d82a00640 1 -- 172.21.15.47:0/2641112104 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740b2070 con 0x7f8d8415cf50 2024-04-26T23:46:36.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d82a00640 1 -- 172.21.15.47:0/2641112104 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d740ad680 con 0x7f8d8415cf50 2024-04-26T23:46:36.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d82a00640 1 -- 172.21.15.47:0/2641112104 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740ada30 con 0x7f8d8415cf50 2024-04-26T23:46:36.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 -- 172.21.15.47:0/2641112104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d8415cf50 msgr2=0x7f8d840cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:36.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2641112104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d8415cf50 0x7f8d840cff70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097c0 tx=0x7f8d7401c470 comp rx=0 tx=0).stop 2024-04-26T23:46:36.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 -- 172.21.15.47:0/2641112104 shutdown_connections 2024-04-26T23:46:36.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2641112104 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8406cd40 0x7f8d84160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2641112104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d8415cf50 0x7f8d840cff70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 -- 172.21.15.47:0/2641112104 >> 172.21.15.47:0/2641112104 conn(0x7f8d840b2b70 msgr2=0x7f8d840b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 -- 172.21.15.47:0/2641112104 shutdown_connections 2024-04-26T23:46:36.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.068+0000 7f8d8a000640 1 -- 172.21.15.47:0/2641112104 wait complete. 2024-04-26T23:46:36.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 Processor -- start 2024-04-26T23:46:36.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 -- start start 2024-04-26T23:46:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d8406cd40 0x7f8d8409e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d840d04b0 0x7f8d8413b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8415cf50 0x7f8d840b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d840b3c40 con 0x7f8d8406cd40 2024-04-26T23:46:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d8415d330 con 0x7f8d840d04b0 2024-04-26T23:46:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840b3dc0 con 0x7f8d8415cf50 2024-04-26T23:46:36.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d8406cd40 0x7f8d8409e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d8406cd40 0x7f8d8409e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55564/0 (socket says 172.21.15.47:55564) 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 -- 172.21.15.47:0/2615688214 learned_addr learned my addr 172.21.15.47:0/2615688214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d7aa00640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d840d04b0 0x7f8d8413b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83e00640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8415cf50 0x7f8d840b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 -- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8415cf50 msgr2=0x7f8d840b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8415cf50 0x7f8d840b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 -- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d840d04b0 msgr2=0x7f8d8413b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d840d04b0 0x7f8d8413b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 -- 172.21.15.47:0/2615688214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8409d110 con 0x7f8d8406cd40 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d7aa00640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d840d04b0 0x7f8d8413b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83e00640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8415cf50 0x7f8d840b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:36.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d83400640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d8406cd40 0x7f8d8409e1b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8d740b0040 tx=0x7f8d7401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d7be00640 1 -- 172.21.15.47:0/2615688214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740be070 con 0x7f8d8406cd40 2024-04-26T23:46:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d7be00640 1 -- 172.21.15.47:0/2615688214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d740b3040 con 0x7f8d8406cd40 2024-04-26T23:46:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d7be00640 1 -- 172.21.15.47:0/2615688214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740b2050 con 0x7f8d8406cd40 2024-04-26T23:46:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8409d3f0 con 0x7f8d8406cd40 2024-04-26T23:46:36.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8409d9b0 con 0x7f8d8406cd40 2024-04-26T23:46:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.072+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d84069700 con 0x7f8d8406cd40 2024-04-26T23:46:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.076+0000 7f8d7be00640 1 -- 172.21.15.47:0/2615688214 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d74004030 con 0x7f8d8406cd40 2024-04-26T23:46:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.076+0000 7f8d7be00640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d600683b0 0x7f8d6006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.076+0000 7f8d7be00640 1 -- 172.21.15.47:0/2615688214 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8d74120320 con 0x7f8d8406cd40 2024-04-26T23:46:36.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.076+0000 7f8d7aa00640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d600683b0 0x7f8d6006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:36.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.076+0000 7f8d7aa00640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d600683b0 0x7f8d6006a870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d841fb370 tx=0x7f8d6c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:36.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.080+0000 7f8d7be00640 1 -- 172.21.15.47:0/2615688214 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8d74016090 con 0x7f8d8406cd40 2024-04-26T23:46:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:36.288+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8d841535f0 con 0x7f8d8406cd40 2024-04-26T23:46:37.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d7be00640 1 -- 172.21.15.47:0/2615688214 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f8d740f0290 con 0x7f8d8406cd40 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d600683b0 msgr2=0x7f8d6006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d600683b0 0x7f8d6006a870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d841fb370 tx=0x7f8d6c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d8406cd40 msgr2=0x7f8d8409e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d8406cd40 0x7f8d8409e1b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8d740b0040 tx=0x7f8d7401acb0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 shutdown_connections 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d600683b0 0x7f8d6006a870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d8415cf50 0x7f8d840b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d840d04b0 0x7f8d8413b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 --2- 172.21.15.47:0/2615688214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d8406cd40 0x7f8d8409e1b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.196+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 >> 172.21.15.47:0/2615688214 conn(0x7f8d840b2b70 msgr2=0x7f8d84158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:37.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.200+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 shutdown_connections 2024-04-26T23:46:37.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.200+0000 7f8d8a000640 1 -- 172.21.15.47:0/2615688214 wait complete. 2024-04-26T23:46:37.230 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:46:37.230 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:46:37.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc323e00640 1 Processor -- start 2024-04-26T23:46:37.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc323e00640 1 -- start start 2024-04-26T23:46:37.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc323e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc31c160a50 0x7fc31c0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc323e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31c071f90 con 0x7fc31c09c170 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc323e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31c072230 con 0x7fc31c160670 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc323e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc31c070ee0 con 0x7fc31c160a50 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc320a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc31c09c170 0x7fc31c0cdbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49316/0 (socket says 172.21.15.47:49316) 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc320a00640 1 -- 172.21.15.47:0/3955749329 learned_addr learned my addr 172.21.15.47:0/3955749329 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc321e00640 1 --2- 172.21.15.47:0/3955749329 >> v2:172.21.15.47:3300/0 conn(0x7fc31c160a50 0x7fc31c0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc31be00640 1 -- 172.21.15.47:0/3955749329 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767954334 0 0) 0x7fc31c071f90 con 0x7fc31c09c170 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc31be00640 1 -- 172.21.15.47:0/3955749329 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc304003530 con 0x7fc31c09c170 2024-04-26T23:46:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc321e00640 1 -- 172.21.15.47:0/3955749329 >> v1:172.21.15.203:6789/0 conn(0x7fc31c160670 legacy=0x7fc31c09ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc321e00640 1 -- 172.21.15.47:0/3955749329 >> v1:172.21.15.47:6789/0 conn(0x7fc31c09c170 legacy=0x7fc31c0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:37.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.372+0000 7fc321e00640 1 -- 172.21.15.47:0/3955749329 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c071130 con 0x7fc31c160a50 2024-04-26T23:46:37.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc321e00640 1 --2- 172.21.15.47:0/3955749329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160a50 0x7fc31c0ce2c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc314009d90 tx=0x7fc31401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cb4f89c27aff09 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc31be00640 1 -- 172.21.15.47:0/3955749329 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3140b2070 con 0x7fc31c160a50 2024-04-26T23:46:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc31be00640 1 -- 172.21.15.47:0/3955749329 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3140a59c0 con 0x7fc31c160a50 2024-04-26T23:46:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc31be00640 1 -- 172.21.15.47:0/3955749329 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3140a5d90 con 0x7fc31c160a50 2024-04-26T23:46:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 -- 172.21.15.47:0/3955749329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160a50 msgr2=0x7fc31c0ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:37.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 --2- 172.21.15.47:0/3955749329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160a50 0x7fc31c0ce2c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc314009d90 tx=0x7fc31401c8e0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 -- 172.21.15.47:0/3955749329 shutdown_connections 2024-04-26T23:46:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 --2- 172.21.15.47:0/3955749329 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160a50 0x7fc31c0ce2c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 -- 172.21.15.47:0/3955749329 >> 172.21.15.47:0/3955749329 conn(0x7fc31c0b4c00 msgr2=0x7fc31c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 -- 172.21.15.47:0/3955749329 shutdown_connections 2024-04-26T23:46:37.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 -- 172.21.15.47:0/3955749329 wait complete. 2024-04-26T23:46:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 Processor -- start 2024-04-26T23:46:37.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.376+0000 7fc323e00640 1 -- start start 2024-04-26T23:46:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc31c09c170 0x7fc31c152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160670 0x7fc31c06e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc31c160a50 0x7fc31c0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c0719a0 con 0x7fc31c160670 2024-04-26T23:46:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c0cec10 con 0x7fc31c09c170 2024-04-26T23:46:37.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc31c071b20 con 0x7fc31c160a50 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160670 0x7fc31c06e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160670 0x7fc31c06e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55586/0 (socket says 172.21.15.47:55586) 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 -- 172.21.15.47:0/369681460 learned_addr learned my addr 172.21.15.47:0/369681460 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc321400640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc31c09c170 0x7fc31c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc321e00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc31c160a50 0x7fc31c0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 -- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc31c160a50 msgr2=0x7fc31c0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc31c160a50 0x7fc31c0c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 -- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc31c09c170 msgr2=0x7fc31c152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc31c09c170 0x7fc31c152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 -- 172.21.15.47:0/369681460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c152c40 con 0x7fc31c160670 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc320a00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160670 0x7fc31c06e750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c420 tx=0x7fc30800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc319600640 1 -- 172.21.15.47:0/369681460 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc308017070 con 0x7fc31c160670 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc319600640 1 -- 172.21.15.47:0/369681460 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc308005cf0 con 0x7fc31c160670 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc319600640 1 -- 172.21.15.47:0/369681460 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3080072d0 con 0x7fc31c160670 2024-04-26T23:46:37.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31c06d6b0 con 0x7fc31c160670 2024-04-26T23:46:37.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31c06dc70 con 0x7fc31c160670 2024-04-26T23:46:37.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31c069700 con 0x7fc31c160670 2024-04-26T23:46:37.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.380+0000 7fc319600640 1 -- 172.21.15.47:0/369681460 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc30801a070 con 0x7fc31c160670 2024-04-26T23:46:37.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.384+0000 7fc319600640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc2fc068380 0x7fc2fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:37.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.384+0000 7fc319600640 1 -- 172.21.15.47:0/369681460 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fc308085db0 con 0x7fc31c160670 2024-04-26T23:46:37.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.384+0000 7fc321400640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc2fc068380 0x7fc2fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:37.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.384+0000 7fc321400640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc2fc068380 0x7fc2fc06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc310001770 tx=0x7fc310009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:37.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.388+0000 7fc319600640 1 -- 172.21.15.47:0/369681460 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc30808a070 con 0x7fc31c160670 2024-04-26T23:46:37.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:37.588+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc31c0ce460 con 0x7fc31c160670 2024-04-26T23:46:38.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.200+0000 7fc319600640 1 -- 172.21.15.47:0/369681460 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fc308055d40 con 0x7fc31c160670 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc2fc068380 msgr2=0x7fc2fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc2fc068380 0x7fc2fc06a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc310001770 tx=0x7fc310009040 comp rx=0 tx=0).stop 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160670 msgr2=0x7fc31c06e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160670 0x7fc31c06e750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc30800c420 tx=0x7fc30800c8e0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 shutdown_connections 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc2fc068380 0x7fc2fc06a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc31c160a50 0x7fc31c0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc31c160670 0x7fc31c06e750 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 --2- 172.21.15.47:0/369681460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc31c09c170 0x7fc31c152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 >> 172.21.15.47:0/369681460 conn(0x7fc31c0b4c00 msgr2=0x7fc31c0d1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 shutdown_connections 2024-04-26T23:46:38.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.204+0000 7fc323e00640 1 -- 172.21.15.47:0/369681460 wait complete. 2024-04-26T23:46:38.234 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:46:38.234 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:46:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.368+0000 7fadbf000640 1 Processor -- start 2024-04-26T23:46:38.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.368+0000 7fadbf000640 1 -- start start 2024-04-26T23:46:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadbf000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fadb80b4360 0x7fadb80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadbf000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb815da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadbf000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb815e050 con 0x7fadb815d5b0 2024-04-26T23:46:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadbf000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fadb815e330 con 0x7fadb80b4360 2024-04-26T23:46:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadbf000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fadb80ceda0 con 0x7fadb80ce310 2024-04-26T23:46:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadb7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fadb80b4360 0x7fadb80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadb7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fadb80b4360 0x7fadb80cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55598/0 (socket says 172.21.15.47:55598) 2024-04-26T23:46:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadb7e00640 1 -- 172.21.15.47:0/3370883342 learned_addr learned my addr 172.21.15.47:0/3370883342 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadb7e00640 1 -- 172.21.15.47:0/3370883342 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 msgr2=0x7fadb815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:38.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadbd000640 1 --2- 172.21.15.47:0/3370883342 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadb7e00640 1 --2- 172.21.15.47:0/3370883342 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadb7e00640 1 -- 172.21.15.47:0/3370883342 >> v1:172.21.15.203:6789/0 conn(0x7fadb815d5b0 legacy=0x7fadb80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadb7e00640 1 -- 172.21.15.47:0/3370883342 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb80cf080 con 0x7fadb80b4360 2024-04-26T23:46:38.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.372+0000 7fadbd000640 1 --2- 172.21.15.47:0/3370883342 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:38.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadb7e00640 1 --2- 172.21.15.47:0/3370883342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb80b4360 0x7fadb80cf5a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fada8009e50 tx=0x7fada801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82944de3a2f4272 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadb7400640 1 -- 172.21.15.47:0/3370883342 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada80a5780 con 0x7fadb80b4360 2024-04-26T23:46:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadb7400640 1 -- 172.21.15.47:0/3370883342 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada80a5920 con 0x7fadb80b4360 2024-04-26T23:46:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadb7400640 1 -- 172.21.15.47:0/3370883342 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada80a5cf0 con 0x7fadb80b4360 2024-04-26T23:46:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- 172.21.15.47:0/3370883342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb80b4360 msgr2=0x7fadb80cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 --2- 172.21.15.47:0/3370883342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb80b4360 0x7fadb80cf5a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fada8009e50 tx=0x7fada801c9f0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- 172.21.15.47:0/3370883342 shutdown_connections 2024-04-26T23:46:38.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 --2- 172.21.15.47:0/3370883342 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 --2- 172.21.15.47:0/3370883342 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb80b4360 0x7fadb80cf5a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- 172.21.15.47:0/3370883342 >> 172.21.15.47:0/3370883342 conn(0x7fadb806c800 msgr2=0x7fadb806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:38.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- 172.21.15.47:0/3370883342 shutdown_connections 2024-04-26T23:46:38.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- 172.21.15.47:0/3370883342 wait complete. 2024-04-26T23:46:38.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 Processor -- start 2024-04-26T23:46:38.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- start start 2024-04-26T23:46:38.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadb80b4360 0x7fadb81477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb81564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb815d5b0 0x7fadb8156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fadb815f100 con 0x7fadb815d5b0 2024-04-26T23:46:38.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fadb815ef80 con 0x7fadb80b4360 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbf000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fadb815f280 con 0x7fadb80ce310 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbd000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb815d5b0 0x7fadb8156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbd000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb815d5b0 0x7fadb8156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55608/0 (socket says 172.21.15.47:55608) 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.376+0000 7fadbd000640 1 -- 172.21.15.47:0/3107332423 learned_addr learned my addr 172.21.15.47:0/3107332423 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadb7e00640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadb80b4360 0x7fadb81477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadaf400640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb81564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbd000640 1 -- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 msgr2=0x7fadb81564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbd000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb81564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbd000640 1 -- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadb80b4360 msgr2=0x7fadb81477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbd000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadb80b4360 0x7fadb81477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbd000640 1 -- 172.21.15.47:0/3107332423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb809bb00 con 0x7fadb815d5b0 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbd000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb815d5b0 0x7fadb8156a10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c7f0 tx=0x7fadb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadb4c00640 1 -- 172.21.15.47:0/3107332423 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0015070 con 0x7fadb815d5b0 2024-04-26T23:46:38.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadb4c00640 1 -- 172.21.15.47:0/3107332423 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb0004240 con 0x7fadb815d5b0 2024-04-26T23:46:38.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadb4c00640 1 -- 172.21.15.47:0/3107332423 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0003620 con 0x7fadb815d5b0 2024-04-26T23:46:38.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb809bde0 con 0x7fadb815d5b0 2024-04-26T23:46:38.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb809c3a0 con 0x7fadb815d5b0 2024-04-26T23:46:38.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb8069700 con 0x7fadb815d5b0 2024-04-26T23:46:38.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadb4c00640 1 -- 172.21.15.47:0/3107332423 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fadb00039d0 con 0x7fadb815d5b0 2024-04-26T23:46:38.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadb4c00640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad94068380 0x7fad9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.380+0000 7fadb4c00640 1 -- 172.21.15.47:0/3107332423 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fadb0086970 con 0x7fadb815d5b0 2024-04-26T23:46:38.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.384+0000 7fadb7e00640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad94068380 0x7fad9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.384+0000 7fadb7e00640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad94068380 0x7fad9406a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fada80ae000 tx=0x7fada80a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:38.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.384+0000 7fadb4c00640 1 -- 172.21.15.47:0/3107332423 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fadb0056970 con 0x7fadb815d5b0 2024-04-26T23:46:38.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.588+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadb80d06a0 con 0x7fadb815d5b0 2024-04-26T23:46:38.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.588+0000 7fadb4c00640 1 -- 172.21.15.47:0/3107332423 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7fadb005ac70 con 0x7fadb815d5b0 2024-04-26T23:46:38.597 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:38.597 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3134789300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3134789300},{"type":"v1","addr":"172.21.15.203:6836","nonce":3134789300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/4099074472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4099074472},{"type":"v1","addr":"172.21.15.203:6837","nonce":4099074472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5298,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/789136995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":789136995},{"type":"v1","addr":"172.21.15.47:6834","nonce":789136995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:46:34.565067+0000","modified":"2024-04-26T23:46:37.594167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/2869278725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":2869278725},{"type":"v1","addr":"172.21.15.47:6835","nonce":2869278725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":2}]} 2024-04-26T23:46:38.597 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 17 2024-04-26T23:46:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad94068380 msgr2=0x7fad9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad94068380 0x7fad9406a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fada80ae000 tx=0x7fada80a7070 comp rx=0 tx=0).stop 2024-04-26T23:46:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb815d5b0 msgr2=0x7fadb8156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb815d5b0 0x7fadb8156a10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fadb000c7f0 tx=0x7fadb000ccb0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 shutdown_connections 2024-04-26T23:46:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad94068380 0x7fad9406a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fadb815d5b0 0x7fadb8156a10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fadb80ce310 0x7fadb81564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 --2- 172.21.15.47:0/3107332423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fadb80b4360 0x7fadb81477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 >> 172.21.15.47:0/3107332423 conn(0x7fadb806c800 msgr2=0x7fadb80cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 shutdown_connections 2024-04-26T23:46:38.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.592+0000 7fadbf000640 1 -- 172.21.15.47:0/3107332423 wait complete. 2024-04-26T23:46:38.619 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:46:38.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffec00640 1 Processor -- start 2024-04-26T23:46:38.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffec00640 1 -- start start 2024-04-26T23:46:38.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff8073c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdff815c630 0x7fdff815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffec00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff806f6e0 con 0x7fdff815fc50 2024-04-26T23:46:38.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdff815d5b0 con 0x7fdff815c630 2024-04-26T23:46:38.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdff80aefb0 con 0x7fdff815c250 2024-04-26T23:46:38.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffcc00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdff815fc50 0x7fdff8160080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49332/0 (socket says 172.21.15.47:49332) 2024-04-26T23:46:38.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdffcc00640 1 -- 172.21.15.47:0/3816199823 learned_addr learned my addr 172.21.15.47:0/3816199823 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:38.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdff7e00640 1 --2- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff8073c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdfef400640 1 --2- 172.21.15.47:0/3816199823 >> v2:172.21.15.203:3300/0 conn(0x7fdff815c630 0x7fdff815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdff7400640 1 -- 172.21.15.47:0/3816199823 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185585089 0 0) 0x7fdff806f6e0 con 0x7fdff815fc50 2024-04-26T23:46:38.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdff7400640 1 -- 172.21.15.47:0/3816199823 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfdc005740 con 0x7fdff815fc50 2024-04-26T23:46:38.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdff7400640 1 -- 172.21.15.47:0/3816199823 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3145102144 0 0) 0x7fdfdc005740 con 0x7fdff815fc50 2024-04-26T23:46:38.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdfef400640 1 -- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 msgr2=0x7fdff8073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:38.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdfef400640 1 --2- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff8073c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdfef400640 1 -- 172.21.15.47:0/3816199823 >> v1:172.21.15.47:6789/0 conn(0x7fdff815fc50 legacy=0x7fdff8160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.752+0000 7fdfef400640 1 -- 172.21.15.47:0/3816199823 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff80af290 con 0x7fdff815c630 2024-04-26T23:46:38.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdfef400640 1 --2- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff815ca90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00097c0 tx=0x7fdfe001c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fb897ea41195be3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdff7400640 1 -- 172.21.15.47:0/3816199823 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00b0070 con 0x7fdff815c630 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdff7400640 1 -- 172.21.15.47:0/3816199823 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe00ab400 con 0x7fdff815c630 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdff7400640 1 -- 172.21.15.47:0/3816199823 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff0001a00 con 0x7fdff815c630 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 -- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 msgr2=0x7fdff815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 --2- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff815ca90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00097c0 tx=0x7fdfe001c300 comp rx=0 tx=0).stop 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 -- 172.21.15.47:0/3816199823 shutdown_connections 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 --2- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff815ca90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 --2- 172.21.15.47:0/3816199823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff8073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 -- 172.21.15.47:0/3816199823 >> 172.21.15.47:0/3816199823 conn(0x7fdff80d1df0 msgr2=0x7fdff80d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 -- 172.21.15.47:0/3816199823 shutdown_connections 2024-04-26T23:46:38.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.756+0000 7fdffec00640 1 -- 172.21.15.47:0/3816199823 wait complete. 2024-04-26T23:46:38.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 Processor -- start 2024-04-26T23:46:38.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 -- start start 2024-04-26T23:46:38.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff80b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff81f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff815fc50 0x7fdff80b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80b0aa0 con 0x7fdff815fc50 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdff80741b0 con 0x7fdff815c630 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdff80b0c20 con 0x7fdff815c250 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff815fc50 0x7fdff80b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff815fc50 0x7fdff80b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55624/0 (socket says 172.21.15.47:55624) 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 -- 172.21.15.47:0/3857143674 learned_addr learned my addr 172.21.15.47:0/3857143674 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdff7e00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff80b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdfef400640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff81f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 -- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 msgr2=0x7fdff80b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff80b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 -- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 msgr2=0x7fdff81f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff81f8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 -- 172.21.15.47:0/3857143674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff81575c0 con 0x7fdff815fc50 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdfef400640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff81f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdff7e00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff80b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffcc00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff815fc50 0x7fdff80b5e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdff000cc90 tx=0x7fdff000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdff4c00640 1 -- 172.21.15.47:0/3857143674 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff000ce40 con 0x7fdff815fc50 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdff4c00640 1 -- 172.21.15.47:0/3857143674 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff0012400 con 0x7fdff815fc50 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdff4c00640 1 -- 172.21.15.47:0/3857143674 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff00127f0 con 0x7fdff815fc50 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81578a0 con 0x7fdff815fc50 2024-04-26T23:46:38.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.760+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff8157e60 con 0x7fdff815fc50 2024-04-26T23:46:38.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.764+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff8069700 con 0x7fdff815fc50 2024-04-26T23:46:38.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.764+0000 7fdff4c00640 1 -- 172.21.15.47:0/3857143674 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdff0012990 con 0x7fdff815fc50 2024-04-26T23:46:38.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.764+0000 7fdff4c00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdfd4068380 0x7fdfd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:38.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.764+0000 7fdff4c00640 1 -- 172.21.15.47:0/3857143674 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fdff0087230 con 0x7fdff815fc50 2024-04-26T23:46:38.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.764+0000 7fdff7e00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdfd4068380 0x7fdfd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:38.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.764+0000 7fdff7e00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdfd4068380 0x7fdfd406a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009bb0 tx=0x7fdfe8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:38.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.768+0000 7fdff4c00640 1 -- 172.21.15.47:0/3857143674 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdff0057750 con 0x7fdff815fc50 2024-04-26T23:46:38.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.932+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdff80d2a50 con 0x7fdff815fc50 2024-04-26T23:46:38.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdff4c00640 1 -- 172.21.15.47:0/3857143674 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16657 (secure 0 0 0) 0x7fdff0057050 con 0x7fdff815fc50 2024-04-26T23:46:38.943 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:38.943 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":36,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:46:36.182280+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:46:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdfd4068380 msgr2=0x7fdfd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdfd4068380 0x7fdfd406a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009bb0 tx=0x7fdfe8008040 comp rx=0 tx=0).stop 2024-04-26T23:46:38.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff815fc50 msgr2=0x7fdff80b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff815fc50 0x7fdff80b5e00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdff000cc90 tx=0x7fdff000a430 comp rx=0 tx=0).stop 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 shutdown_connections 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdfd4068380 0x7fdfd406a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdff815fc50 0x7fdff80b5e00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdff815c630 0x7fdff81f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 --2- 172.21.15.47:0/3857143674 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdff815c250 0x7fdff80b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 >> 172.21.15.47:0/3857143674 conn(0x7fdff80d1df0 msgr2=0x7fdff815b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 shutdown_connections 2024-04-26T23:46:38.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:38.936+0000 7fdffec00640 1 -- 172.21.15.47:0/3857143674 wait complete. 2024-04-26T23:46:38.965 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:46:38.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:46:39.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.096+0000 7f9f82e00640 1 Processor -- start 2024-04-26T23:46:39.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.096+0000 7f9f82e00640 1 -- start start 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c15ef00 0x7f9f7c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f7c0d3360 0x7f9f7c070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7c071050 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7c06df60 con 0x7f9f7c0d3360 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c071330 con 0x7f9f7c15ef00 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f81a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c15ef00 0x7f9f7c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f7c0d3360 0x7f9f7c070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f81000640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f9f7c06e3f0 0x7f9f7c0d2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:35992/0 (socket says 172.21.15.47:35992) 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f81000640 1 -- 172.21.15.47:0/637383356 learned_addr learned my addr 172.21.15.47:0/637383356 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:39.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9f7c0d3360 0x7f9f7c070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:47452/0 (socket says 172.21.15.47:47452) 2024-04-26T23:46:39.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82400640 1 -- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c15ef00 msgr2=0x7f9f7c15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:39.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82400640 1 --2- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c15ef00 0x7f9f7c15f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82400640 1 -- 172.21.15.47:0/637383356 >> v1:172.21.15.203:6789/0 conn(0x7f9f7c06e3f0 legacy=0x7f9f7c0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f82400640 1 -- 172.21.15.47:0/637383356 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c06d910 con 0x7f9f7c0d3360 2024-04-26T23:46:39.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.100+0000 7f9f81a00640 1 --2- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c15ef00 0x7f9f7c15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:39.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82400640 1 --2- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c0d3360 0x7f9f7c070320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009dc0 tx=0x7f9f7401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fa3b0b168bc49ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f7be00640 1 -- 172.21.15.47:0/637383356 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740b2070 con 0x7f9f7c0d3360 2024-04-26T23:46:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f7be00640 1 -- 172.21.15.47:0/637383356 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f740a58f0 con 0x7f9f7c0d3360 2024-04-26T23:46:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f7be00640 1 -- 172.21.15.47:0/637383356 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f740a5cc0 con 0x7f9f7c0d3360 2024-04-26T23:46:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c0d3360 msgr2=0x7f9f7c070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 --2- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c0d3360 0x7f9f7c070320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009dc0 tx=0x7f9f7401c920 comp rx=0 tx=0).stop 2024-04-26T23:46:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- 172.21.15.47:0/637383356 shutdown_connections 2024-04-26T23:46:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 --2- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c0d3360 0x7f9f7c070320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 --2- 172.21.15.47:0/637383356 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c15ef00 0x7f9f7c15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- 172.21.15.47:0/637383356 >> 172.21.15.47:0/637383356 conn(0x7f9f7c09ba60 msgr2=0x7f9f7c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- 172.21.15.47:0/637383356 shutdown_connections 2024-04-26T23:46:39.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- 172.21.15.47:0/637383356 wait complete. 2024-04-26T23:46:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 Processor -- start 2024-04-26T23:46:39.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- start start 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f7c06e3f0 0x7f9f7c0afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c0d3360 0x7f9f7c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c15ef00 0x7f9f7c0ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c16c130 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c0d1890 con 0x7f9f7c15ef00 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f82e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c16c2b0 con 0x7f9f7c0d3360 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f81a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f7c06e3f0 0x7f9f7c0afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f81a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f7c06e3f0 0x7f9f7c0afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38622/0 (socket says 172.21.15.47:38622) 2024-04-26T23:46:39.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.104+0000 7f9f81a00640 1 -- 172.21.15.47:0/2730919886 learned_addr learned my addr 172.21.15.47:0/2730919886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f81a00640 1 -- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c0d3360 msgr2=0x7f9f7c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f81a00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c0d3360 0x7f9f7c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f81a00640 1 -- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c15ef00 msgr2=0x7f9f7c0ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f81a00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c15ef00 0x7f9f7c0ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f81a00640 1 -- 172.21.15.47:0/2730919886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c0b15b0 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f81a00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f7c06e3f0 0x7f9f7c0afa50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000e9b0 tx=0x7f9f7000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f79600640 1 -- 172.21.15.47:0/2730919886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70017070 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f79600640 1 -- 172.21.15.47:0/2730919886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f7000c9a0 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f79600640 1 -- 172.21.15.47:0/2730919886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000cd70 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c0b0150 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c0b0710 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c069470 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f79600640 1 -- 172.21.15.47:0/2730919886 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f7001a070 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f79600640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f5c068380 0x7f9f5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f79600640 1 -- 172.21.15.47:0/2730919886 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f9f700868e0 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.108+0000 7f9f81000640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f5c068380 0x7f9f5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.112+0000 7f9f81000640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f5c068380 0x7f9f5c06a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f68000f70 tx=0x7f9f68007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.112+0000 7f9f79600640 1 -- 172.21.15.47:0/2730919886 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9f70056e00 con 0x7f9f7c06e3f0 2024-04-26T23:46:39.138 INFO:tasks.ceph.mds.a.smithi047.stderr:2024-04-26T23:46:39.132+0000 7fa473400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:46:39.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.276+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9f7c0703b0 con 0x7f9f5c068380 2024-04-26T23:46:39.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.284+0000 7f9f79600640 1 -- 172.21.15.47:0/2730919886 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245467 (secure 0 0 0) 0x7f9f7c0703b0 con 0x7f9f5c068380 2024-04-26T23:46:39.293 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:39.295 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f5c068380 msgr2=0x7f9f5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f5c068380 0x7f9f5c06a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9f68000f70 tx=0x7f9f68007a90 comp rx=0 tx=0).stop 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f7c06e3f0 msgr2=0x7f9f7c0afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f7c06e3f0 0x7f9f7c0afa50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000e9b0 tx=0x7f9f7000ee70 comp rx=0 tx=0).stop 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 shutdown_connections 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9f5c068380 0x7f9f5c06a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f7c15ef00 0x7f9f7c0ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9f7c0d3360 0x7f9f7c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 --2- 172.21.15.47:0/2730919886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9f7c06e3f0 0x7f9f7c0afa50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 >> 172.21.15.47:0/2730919886 conn(0x7f9f7c09ba60 msgr2=0x7f9f7c0d1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 shutdown_connections 2024-04-26T23:46:39.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.288+0000 7f9f82e00640 1 -- 172.21.15.47:0/2730919886 wait complete. 2024-04-26T23:46:39.314 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-26T23:46:38.169543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236840,"kb_used_data":4020,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737880,"statfs":{"total":773094113280,"available":772851589120,"internally_reserved":0,"allocated":4116480,"data_stored":2287109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.019498"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161614+0000","last_change":"2024-04-26T23:46:34.161614+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161614+0000","last_undegraded":"2024-04-26T23:46:34.161614+0000","last_fullsized":"2024-04-26T23:46:34.161614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.177583+0000","last_change":"2024-04-26T23:46:34.177583+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.177583+0000","last_undegraded":"2024-04-26T23:46:34.177583+0000","last_fullsized":"2024-04-26T23:46:34.177583+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156663+0000","last_change":"2024-04-26T23:46:34.156663+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156663+0000","last_undegraded":"2024-04-26T23:46:34.156663+0000","last_fullsized":"2024-04-26T23:46:34.156663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163721+0000","last_change":"2024-04-26T23:46:34.163721+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163721+0000","last_undegraded":"2024-04-26T23:46:34.163721+0000","last_fullsized":"2024-04-26T23:46:34.163721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165896+0000","last_change":"2024-04-26T23:46:34.165896+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165896+0000","last_undegraded":"2024-04-26T23:46:34.165896+0000","last_fullsized":"2024-04-26T23:46:34.165896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.175149+0000","last_change":"2024-04-26T23:46:34.175149+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.175149+0000","last_undegraded":"2024-04-26T23:46:34.175149+0000","last_fullsized":"2024-04-26T23:46:34.175149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165651+0000","last_change":"2024-04-26T23:46:34.165651+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165651+0000","last_undegraded":"2024-04-26T23:46:34.165651+0000","last_fullsized":"2024-04-26T23:46:34.165651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.168244+0000","last_change":"2024-04-26T23:46:34.168244+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.168244+0000","last_undegraded":"2024-04-26T23:46:34.168244+0000","last_fullsized":"2024-04-26T23:46:34.168244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161511+0000","last_change":"2024-04-26T23:46:34.161511+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161511+0000","last_undegraded":"2024-04-26T23:46:34.161511+0000","last_fullsized":"2024-04-26T23:46:34.161511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163713+0000","last_change":"2024-04-26T23:46:34.163713+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163713+0000","last_undegraded":"2024-04-26T23:46:34.163713+0000","last_fullsized":"2024-04-26T23:46:34.163713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.170071+0000","last_change":"2024-04-26T23:46:34.170071+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.170071+0000","last_undegraded":"2024-04-26T23:46:34.170071+0000","last_fullsized":"2024-04-26T23:46:34.170071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.158087+0000","last_change":"2024-04-26T23:46:34.158087+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.158087+0000","last_undegraded":"2024-04-26T23:46:34.158087+0000","last_fullsized":"2024-04-26T23:46:34.158087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165351+0000","last_change":"2024-04-26T23:46:34.165351+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165351+0000","last_undegraded":"2024-04-26T23:46:34.165351+0000","last_fullsized":"2024-04-26T23:46:34.165351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.174096+0000","last_change":"2024-04-26T23:46:34.174096+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.174096+0000","last_undegraded":"2024-04-26T23:46:34.174096+0000","last_fullsized":"2024-04-26T23:46:34.174096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156020+0000","last_change":"2024-04-26T23:46:34.156020+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156020+0000","last_undegraded":"2024-04-26T23:46:34.156020+0000","last_fullsized":"2024-04-26T23:46:34.156020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165834+0000","last_change":"2024-04-26T23:46:34.165834+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165834+0000","last_undegraded":"2024-04-26T23:46:34.165834+0000","last_fullsized":"2024-04-26T23:46:34.165834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167694+0000","last_change":"2024-04-26T23:46:34.167694+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167694+0000","last_undegraded":"2024-04-26T23:46:34.167694+0000","last_fullsized":"2024-04-26T23:46:34.167694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.173980+0000","last_change":"2024-04-26T23:46:34.173980+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.173980+0000","last_undegraded":"2024-04-26T23:46:34.173980+0000","last_fullsized":"2024-04-26T23:46:34.173980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.175531+0000","last_change":"2024-04-26T23:46:34.175531+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.175531+0000","last_undegraded":"2024-04-26T23:46:34.175531+0000","last_fullsized":"2024-04-26T23:46:34.175531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165096+0000","last_change":"2024-04-26T23:46:34.165096+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165096+0000","last_undegraded":"2024-04-26T23:46:34.165096+0000","last_fullsized":"2024-04-26T23:46:34.165096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161893+0000","last_change":"2024-04-26T23:46:34.161893+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161893+0000","last_undegraded":"2024-04-26T23:46:34.161893+0000","last_fullsized":"2024-04-26T23:46:34.161893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159667+0000","last_change":"2024-04-26T23:46:34.159667+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159667+0000","last_undegraded":"2024-04-26T23:46:34.159667+0000","last_fullsized":"2024-04-26T23:46:34.159667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156027+0000","last_change":"2024-04-26T23:46:34.156027+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156027+0000","last_undegraded":"2024-04-26T23:46:34.156027+0000","last_fullsized":"2024-04-26T23:46:34.156027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166901+0000","last_change":"2024-04-26T23:46:34.166901+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166901+0000","last_undegraded":"2024-04-26T23:46:34.166901+0000","last_fullsized":"2024-04-26T23:46:34.166901+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.172216+0000","last_change":"2024-04-26T23:46:34.172216+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.172216+0000","last_undegraded":"2024-04-26T23:46:34.172216+0000","last_fullsized":"2024-04-26T23:46:34.172216+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160044+0000","last_change":"2024-04-26T23:46:34.160044+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160044+0000","last_undegraded":"2024-04-26T23:46:34.160044+0000","last_fullsized":"2024-04-26T23:46:34.160044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157626+0000","last_change":"2024-04-26T23:46:34.157626+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157626+0000","last_undegraded":"2024-04-26T23:46:34.157626+0000","last_fullsized":"2024-04-26T23:46:34.157626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161360+0000","last_change":"2024-04-26T23:46:34.161360+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161360+0000","last_undegraded":"2024-04-26T23:46:34.161360+0000","last_fullsized":"2024-04-26T23:46:34.161360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166188+0000","last_change":"2024-04-26T23:46:34.166188+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166188+0000","last_undegraded":"2024-04-26T23:46:34.166188+0000","last_fullsized":"2024-04-26T23:46:34.166188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160799+0000","last_change":"2024-04-26T23:46:34.160799+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160799+0000","last_undegraded":"2024-04-26T23:46:34.160799+0000","last_fullsized":"2024-04-26T23:46:34.160799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167805+0000","last_change":"2024-04-26T23:46:34.167805+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167805+0000","last_undegraded":"2024-04-26T23:46:34.167805+0000","last_fullsized":"2024-04-26T23:46:34.167805+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.176749+0000","last_change":"2024-04-26T23:46:34.175419+0000","last_active":"2024-04-26T23:46:34.176749+0000","last_peered":"2024-04-26T23:46:34.176749+0000","last_clean":"2024-04-26T23:46:34.176749+0000","last_became_active":"2024-04-26T23:46:34.175127+0000","last_became_peered":"2024-04-26T23:46:34.175127+0000","last_unstale":"2024-04-26T23:46:34.176749+0000","last_undegraded":"2024-04-26T23:46:34.176749+0000","last_fullsized":"2024-04-26T23:46:34.176749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:41.721074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161088+0000","last_change":"2024-04-26T23:46:34.161088+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161088+0000","last_undegraded":"2024-04-26T23:46:34.161088+0000","last_fullsized":"2024-04-26T23:46:34.161088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162105+0000","last_change":"2024-04-26T23:46:34.162105+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162105+0000","last_undegraded":"2024-04-26T23:46:34.162105+0000","last_fullsized":"2024-04-26T23:46:34.162105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188518+0000","last_change":"2024-04-26T23:46:34.187217+0000","last_active":"2024-04-26T23:46:34.188518+0000","last_peered":"2024-04-26T23:46:34.188518+0000","last_clean":"2024-04-26T23:46:34.188518+0000","last_became_active":"2024-04-26T23:46:34.186901+0000","last_became_peered":"2024-04-26T23:46:34.186901+0000","last_unstale":"2024-04-26T23:46:34.188518+0000","last_undegraded":"2024-04-26T23:46:34.188518+0000","last_fullsized":"2024-04-26T23:46:34.188518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:11.450124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159503+0000","last_change":"2024-04-26T23:46:34.159503+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159503+0000","last_undegraded":"2024-04-26T23:46:34.159503+0000","last_fullsized":"2024-04-26T23:46:34.159503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.180930+0000","last_change":"2024-04-26T23:46:34.179542+0000","last_active":"2024-04-26T23:46:34.180930+0000","last_peered":"2024-04-26T23:46:34.180930+0000","last_clean":"2024-04-26T23:46:34.180930+0000","last_became_active":"2024-04-26T23:46:34.179230+0000","last_became_peered":"2024-04-26T23:46:34.179230+0000","last_unstale":"2024-04-26T23:46:34.180930+0000","last_undegraded":"2024-04-26T23:46:34.180930+0000","last_fullsized":"2024-04-26T23:46:34.180930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:13.695920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165465+0000","last_change":"2024-04-26T23:46:34.165465+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165465+0000","last_undegraded":"2024-04-26T23:46:34.165465+0000","last_fullsized":"2024-04-26T23:46:34.165465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.182027+0000","last_change":"2024-04-26T23:46:34.178810+0000","last_active":"2024-04-26T23:46:34.182027+0000","last_peered":"2024-04-26T23:46:34.182027+0000","last_clean":"2024-04-26T23:46:34.182027+0000","last_became_active":"2024-04-26T23:46:34.177743+0000","last_became_peered":"2024-04-26T23:46:34.177743+0000","last_unstale":"2024-04-26T23:46:34.182027+0000","last_undegraded":"2024-04-26T23:46:34.182027+0000","last_fullsized":"2024-04-26T23:46:34.182027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:01.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156199+0000","last_change":"2024-04-26T23:46:34.156199+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156199+0000","last_undegraded":"2024-04-26T23:46:34.156199+0000","last_fullsized":"2024-04-26T23:46:34.156199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.190298+0000","last_change":"2024-04-26T23:46:34.186701+0000","last_active":"2024-04-26T23:46:34.190298+0000","last_peered":"2024-04-26T23:46:34.190298+0000","last_clean":"2024-04-26T23:46:34.190298+0000","last_became_active":"2024-04-26T23:46:34.186448+0000","last_became_peered":"2024-04-26T23:46:34.186448+0000","last_unstale":"2024-04-26T23:46:34.190298+0000","last_undegraded":"2024-04-26T23:46:34.190298+0000","last_fullsized":"2024-04-26T23:46:34.190298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:18.240827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162949+0000","last_change":"2024-04-26T23:46:34.162949+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162949+0000","last_undegraded":"2024-04-26T23:46:34.162949+0000","last_fullsized":"2024-04-26T23:46:34.162949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184937+0000","last_change":"2024-04-26T23:46:34.181576+0000","last_active":"2024-04-26T23:46:34.184937+0000","last_peered":"2024-04-26T23:46:34.184937+0000","last_clean":"2024-04-26T23:46:34.184937+0000","last_became_active":"2024-04-26T23:46:34.181279+0000","last_became_peered":"2024-04-26T23:46:34.181279+0000","last_unstale":"2024-04-26T23:46:34.184937+0000","last_undegraded":"2024-04-26T23:46:34.184937+0000","last_fullsized":"2024-04-26T23:46:34.184937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:28.087390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159251+0000","last_change":"2024-04-26T23:46:34.159251+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159251+0000","last_undegraded":"2024-04-26T23:46:34.159251+0000","last_fullsized":"2024-04-26T23:46:34.159251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.172754+0000","last_change":"2024-04-26T23:46:34.169490+0000","last_active":"2024-04-26T23:46:34.172754+0000","last_peered":"2024-04-26T23:46:34.172754+0000","last_clean":"2024-04-26T23:46:34.172754+0000","last_became_active":"2024-04-26T23:46:34.169205+0000","last_became_peered":"2024-04-26T23:46:34.169205+0000","last_unstale":"2024-04-26T23:46:34.172754+0000","last_undegraded":"2024-04-26T23:46:34.172754+0000","last_fullsized":"2024-04-26T23:46:34.172754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:24.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157309+0000","last_change":"2024-04-26T23:46:34.157309+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157309+0000","last_undegraded":"2024-04-26T23:46:34.157309+0000","last_fullsized":"2024-04-26T23:46:34.157309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184816+0000","last_change":"2024-04-26T23:46:34.179582+0000","last_active":"2024-04-26T23:46:34.184816+0000","last_peered":"2024-04-26T23:46:34.184816+0000","last_clean":"2024-04-26T23:46:34.184816+0000","last_became_active":"2024-04-26T23:46:34.179049+0000","last_became_peered":"2024-04-26T23:46:34.179049+0000","last_unstale":"2024-04-26T23:46:34.184816+0000","last_undegraded":"2024-04-26T23:46:34.184816+0000","last_fullsized":"2024-04-26T23:46:34.184816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.842965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.170777+0000","last_change":"2024-04-26T23:46:34.170777+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.170777+0000","last_undegraded":"2024-04-26T23:46:34.170777+0000","last_fullsized":"2024-04-26T23:46:34.170777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.171721+0000","last_change":"2024-04-26T23:46:34.171721+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.171721+0000","last_undegraded":"2024-04-26T23:46:34.171721+0000","last_fullsized":"2024-04-26T23:46:34.171721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181722+0000","last_change":"2024-04-26T23:46:34.179540+0000","last_active":"2024-04-26T23:46:34.181722+0000","last_peered":"2024-04-26T23:46:34.181722+0000","last_clean":"2024-04-26T23:46:34.181722+0000","last_became_active":"2024-04-26T23:46:34.179281+0000","last_became_peered":"2024-04-26T23:46:34.179281+0000","last_unstale":"2024-04-26T23:46:34.181722+0000","last_undegraded":"2024-04-26T23:46:34.181722+0000","last_fullsized":"2024-04-26T23:46:34.181722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:13.248964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157318+0000","last_change":"2024-04-26T23:46:34.157318+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157318+0000","last_undegraded":"2024-04-26T23:46:34.157318+0000","last_fullsized":"2024-04-26T23:46:34.157318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188122+0000","last_change":"2024-04-26T23:46:34.186637+0000","last_active":"2024-04-26T23:46:34.188122+0000","last_peered":"2024-04-26T23:46:34.188122+0000","last_clean":"2024-04-26T23:46:34.188122+0000","last_became_active":"2024-04-26T23:46:34.186389+0000","last_became_peered":"2024-04-26T23:46:34.186389+0000","last_unstale":"2024-04-26T23:46:34.188122+0000","last_undegraded":"2024-04-26T23:46:34.188122+0000","last_fullsized":"2024-04-26T23:46:34.188122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:31:14.942666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160482+0000","last_change":"2024-04-26T23:46:34.160482+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160482+0000","last_undegraded":"2024-04-26T23:46:34.160482+0000","last_fullsized":"2024-04-26T23:46:34.160482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.171972+0000","last_change":"2024-04-26T23:46:34.166497+0000","last_active":"2024-04-26T23:46:34.171972+0000","last_peered":"2024-04-26T23:46:34.171972+0000","last_clean":"2024-04-26T23:46:34.171972+0000","last_became_active":"2024-04-26T23:46:34.165705+0000","last_became_peered":"2024-04-26T23:46:34.165705+0000","last_unstale":"2024-04-26T23:46:34.171972+0000","last_undegraded":"2024-04-26T23:46:34.171972+0000","last_fullsized":"2024-04-26T23:46:34.171972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:43.245922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167478+0000","last_change":"2024-04-26T23:46:34.167478+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167478+0000","last_undegraded":"2024-04-26T23:46:34.167478+0000","last_fullsized":"2024-04-26T23:46:34.167478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186054+0000","last_change":"2024-04-26T23:46:34.173170+0000","last_active":"2024-04-26T23:46:34.186054+0000","last_peered":"2024-04-26T23:46:34.186054+0000","last_clean":"2024-04-26T23:46:34.186054+0000","last_became_active":"2024-04-26T23:46:34.172917+0000","last_became_peered":"2024-04-26T23:46:34.172917+0000","last_unstale":"2024-04-26T23:46:34.186054+0000","last_undegraded":"2024-04-26T23:46:34.186054+0000","last_fullsized":"2024-04-26T23:46:34.186054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167368+0000","last_change":"2024-04-26T23:46:34.167368+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167368+0000","last_undegraded":"2024-04-26T23:46:34.167368+0000","last_fullsized":"2024-04-26T23:46:34.167368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184693+0000","last_change":"2024-04-26T23:46:34.179239+0000","last_active":"2024-04-26T23:46:34.184693+0000","last_peered":"2024-04-26T23:46:34.184693+0000","last_clean":"2024-04-26T23:46:34.184693+0000","last_became_active":"2024-04-26T23:46:34.178903+0000","last_became_peered":"2024-04-26T23:46:34.178903+0000","last_unstale":"2024-04-26T23:46:34.184693+0000","last_undegraded":"2024-04-26T23:46:34.184693+0000","last_fullsized":"2024-04-26T23:46:34.184693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:59.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160224+0000","last_change":"2024-04-26T23:46:34.160224+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160224+0000","last_undegraded":"2024-04-26T23:46:34.160224+0000","last_fullsized":"2024-04-26T23:46:34.160224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188048+0000","last_change":"2024-04-26T23:46:34.186295+0000","last_active":"2024-04-26T23:46:34.188048+0000","last_peered":"2024-04-26T23:46:34.188048+0000","last_clean":"2024-04-26T23:46:34.188048+0000","last_became_active":"2024-04-26T23:46:34.186014+0000","last_became_peered":"2024-04-26T23:46:34.186014+0000","last_unstale":"2024-04-26T23:46:34.188048+0000","last_undegraded":"2024-04-26T23:46:34.188048+0000","last_fullsized":"2024-04-26T23:46:34.188048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:30.093195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162935+0000","last_change":"2024-04-26T23:46:34.162935+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162935+0000","last_undegraded":"2024-04-26T23:46:34.162935+0000","last_fullsized":"2024-04-26T23:46:34.162935+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186304+0000","last_change":"2024-04-26T23:46:34.180474+0000","last_active":"2024-04-26T23:46:34.186304+0000","last_peered":"2024-04-26T23:46:34.186304+0000","last_clean":"2024-04-26T23:46:34.186304+0000","last_became_active":"2024-04-26T23:46:34.180195+0000","last_became_peered":"2024-04-26T23:46:34.180195+0000","last_unstale":"2024-04-26T23:46:34.186304+0000","last_undegraded":"2024-04-26T23:46:34.186304+0000","last_fullsized":"2024-04-26T23:46:34.186304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:31.072186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157176+0000","last_change":"2024-04-26T23:46:34.157176+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157176+0000","last_undegraded":"2024-04-26T23:46:34.157176+0000","last_fullsized":"2024-04-26T23:46:34.157176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175236+0000","last_change":"2024-04-26T23:46:34.171710+0000","last_active":"2024-04-26T23:46:34.175236+0000","last_peered":"2024-04-26T23:46:34.175236+0000","last_clean":"2024-04-26T23:46:34.175236+0000","last_became_active":"2024-04-26T23:46:34.171422+0000","last_became_peered":"2024-04-26T23:46:34.171422+0000","last_unstale":"2024-04-26T23:46:34.175236+0000","last_undegraded":"2024-04-26T23:46:34.175236+0000","last_fullsized":"2024-04-26T23:46:34.175236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:52:49.894347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159624+0000","last_change":"2024-04-26T23:46:34.159624+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159624+0000","last_undegraded":"2024-04-26T23:46:34.159624+0000","last_fullsized":"2024-04-26T23:46:34.159624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175284+0000","last_change":"2024-04-26T23:46:34.173257+0000","last_active":"2024-04-26T23:46:34.175284+0000","last_peered":"2024-04-26T23:46:34.175284+0000","last_clean":"2024-04-26T23:46:34.175284+0000","last_became_active":"2024-04-26T23:46:34.172921+0000","last_became_peered":"2024-04-26T23:46:34.172921+0000","last_unstale":"2024-04-26T23:46:34.175284+0000","last_undegraded":"2024-04-26T23:46:34.175284+0000","last_fullsized":"2024-04-26T23:46:34.175284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:27.275026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164196+0000","last_change":"2024-04-26T23:46:34.164196+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164196+0000","last_undegraded":"2024-04-26T23:46:34.164196+0000","last_fullsized":"2024-04-26T23:46:34.164196+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181672+0000","last_change":"2024-04-26T23:46:34.178125+0000","last_active":"2024-04-26T23:46:34.181672+0000","last_peered":"2024-04-26T23:46:34.181672+0000","last_clean":"2024-04-26T23:46:34.181672+0000","last_became_active":"2024-04-26T23:46:34.177837+0000","last_became_peered":"2024-04-26T23:46:34.177837+0000","last_unstale":"2024-04-26T23:46:34.181672+0000","last_undegraded":"2024-04-26T23:46:34.181672+0000","last_fullsized":"2024-04-26T23:46:34.181672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:25.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163748+0000","last_change":"2024-04-26T23:46:34.163748+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163748+0000","last_undegraded":"2024-04-26T23:46:34.163748+0000","last_fullsized":"2024-04-26T23:46:34.163748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164590+0000","last_change":"2024-04-26T23:46:34.164590+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164590+0000","last_undegraded":"2024-04-26T23:46:34.164590+0000","last_fullsized":"2024-04-26T23:46:34.164590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.179394+0000","last_change":"2024-04-26T23:46:34.178182+0000","last_active":"2024-04-26T23:46:34.179394+0000","last_peered":"2024-04-26T23:46:34.179394+0000","last_clean":"2024-04-26T23:46:34.179394+0000","last_became_active":"2024-04-26T23:46:34.177914+0000","last_became_peered":"2024-04-26T23:46:34.177914+0000","last_unstale":"2024-04-26T23:46:34.179394+0000","last_undegraded":"2024-04-26T23:46:34.179394+0000","last_fullsized":"2024-04-26T23:46:34.179394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164290+0000","last_change":"2024-04-26T23:46:34.164290+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164290+0000","last_undegraded":"2024-04-26T23:46:34.164290+0000","last_fullsized":"2024-04-26T23:46:34.164290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175327+0000","last_change":"2024-04-26T23:46:34.171217+0000","last_active":"2024-04-26T23:46:34.175327+0000","last_peered":"2024-04-26T23:46:34.175327+0000","last_clean":"2024-04-26T23:46:34.175327+0000","last_became_active":"2024-04-26T23:46:34.170668+0000","last_became_peered":"2024-04-26T23:46:34.170668+0000","last_unstale":"2024-04-26T23:46:34.175327+0000","last_undegraded":"2024-04-26T23:46:34.175327+0000","last_fullsized":"2024-04-26T23:46:34.175327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:13.695920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166401+0000","last_change":"2024-04-26T23:46:34.166401+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166401+0000","last_undegraded":"2024-04-26T23:46:34.166401+0000","last_fullsized":"2024-04-26T23:46:34.166401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181678+0000","last_change":"2024-04-26T23:46:34.179422+0000","last_active":"2024-04-26T23:46:34.181678+0000","last_peered":"2024-04-26T23:46:34.181678+0000","last_clean":"2024-04-26T23:46:34.181678+0000","last_became_active":"2024-04-26T23:46:34.179130+0000","last_became_peered":"2024-04-26T23:46:34.179130+0000","last_unstale":"2024-04-26T23:46:34.181678+0000","last_undegraded":"2024-04-26T23:46:34.181678+0000","last_fullsized":"2024-04-26T23:46:34.181678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:53.287265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164912+0000","last_change":"2024-04-26T23:46:34.164912+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164912+0000","last_undegraded":"2024-04-26T23:46:34.164912+0000","last_fullsized":"2024-04-26T23:46:34.164912+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186289+0000","last_change":"2024-04-26T23:46:34.176531+0000","last_active":"2024-04-26T23:46:34.186289+0000","last_peered":"2024-04-26T23:46:34.186289+0000","last_clean":"2024-04-26T23:46:34.186289+0000","last_became_active":"2024-04-26T23:46:34.176220+0000","last_became_peered":"2024-04-26T23:46:34.176220+0000","last_unstale":"2024-04-26T23:46:34.186289+0000","last_undegraded":"2024-04-26T23:46:34.186289+0000","last_fullsized":"2024-04-26T23:46:34.186289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:12.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156089+0000","last_change":"2024-04-26T23:46:34.156089+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156089+0000","last_undegraded":"2024-04-26T23:46:34.156089+0000","last_fullsized":"2024-04-26T23:46:34.156089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.185930+0000","last_change":"2024-04-26T23:46:34.170536+0000","last_active":"2024-04-26T23:46:34.185930+0000","last_peered":"2024-04-26T23:46:34.185930+0000","last_clean":"2024-04-26T23:46:34.185930+0000","last_became_active":"2024-04-26T23:46:34.169534+0000","last_became_peered":"2024-04-26T23:46:34.169534+0000","last_unstale":"2024-04-26T23:46:34.185930+0000","last_undegraded":"2024-04-26T23:46:34.185930+0000","last_fullsized":"2024-04-26T23:46:34.185930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160365+0000","last_change":"2024-04-26T23:46:34.160365+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160365+0000","last_undegraded":"2024-04-26T23:46:34.160365+0000","last_fullsized":"2024-04-26T23:46:34.160365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186083+0000","last_change":"2024-04-26T23:46:34.175739+0000","last_active":"2024-04-26T23:46:34.186083+0000","last_peered":"2024-04-26T23:46:34.186083+0000","last_clean":"2024-04-26T23:46:34.186083+0000","last_became_active":"2024-04-26T23:46:34.175510+0000","last_became_peered":"2024-04-26T23:46:34.175510+0000","last_unstale":"2024-04-26T23:46:34.186083+0000","last_undegraded":"2024-04-26T23:46:34.186083+0000","last_fullsized":"2024-04-26T23:46:34.186083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:32:54.994053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161524+0000","last_change":"2024-04-26T23:46:34.161524+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161524+0000","last_undegraded":"2024-04-26T23:46:34.161524+0000","last_fullsized":"2024-04-26T23:46:34.161524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175307+0000","last_change":"2024-04-26T23:46:34.170955+0000","last_active":"2024-04-26T23:46:34.175307+0000","last_peered":"2024-04-26T23:46:34.175307+0000","last_clean":"2024-04-26T23:46:34.175307+0000","last_became_active":"2024-04-26T23:46:34.170342+0000","last_became_peered":"2024-04-26T23:46:34.170342+0000","last_unstale":"2024-04-26T23:46:34.175307+0000","last_undegraded":"2024-04-26T23:46:34.175307+0000","last_fullsized":"2024-04-26T23:46:34.175307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:42.613416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162564+0000","last_change":"2024-04-26T23:46:34.162564+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162564+0000","last_undegraded":"2024-04-26T23:46:34.162564+0000","last_fullsized":"2024-04-26T23:46:34.162564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184737+0000","last_change":"2024-04-26T23:46:34.179277+0000","last_active":"2024-04-26T23:46:34.184737+0000","last_peered":"2024-04-26T23:46:34.184737+0000","last_clean":"2024-04-26T23:46:34.184737+0000","last_became_active":"2024-04-26T23:46:34.178980+0000","last_became_peered":"2024-04-26T23:46:34.178980+0000","last_unstale":"2024-04-26T23:46:34.184737+0000","last_undegraded":"2024-04-26T23:46:34.184737+0000","last_fullsized":"2024-04-26T23:46:34.184737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:44.753454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.168175+0000","last_change":"2024-04-26T23:46:34.168175+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.168175+0000","last_undegraded":"2024-04-26T23:46:34.168175+0000","last_fullsized":"2024-04-26T23:46:34.168175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.177607+0000","last_change":"2024-04-26T23:46:34.176449+0000","last_active":"2024-04-26T23:46:34.177607+0000","last_peered":"2024-04-26T23:46:34.177607+0000","last_clean":"2024-04-26T23:46:34.177607+0000","last_became_active":"2024-04-26T23:46:34.176138+0000","last_became_peered":"2024-04-26T23:46:34.176138+0000","last_unstale":"2024-04-26T23:46:34.177607+0000","last_undegraded":"2024-04-26T23:46:34.177607+0000","last_fullsized":"2024-04-26T23:46:34.177607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.172214+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:46:34.172214+0000","last_peered":"2024-04-26T23:46:34.172214+0000","last_clean":"2024-04-26T23:46:34.172214+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:46:34.172214+0000","last_undegraded":"2024-04-26T23:46:34.172214+0000","last_fullsized":"2024-04-26T23:46:34.172214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":727825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":946176,"data_stored":722008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:46:39.318 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:46:39.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.492+0000 7f1018800640 1 Processor -- start 2024-04-26T23:46:39.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.492+0000 7f1018800640 1 -- start start 2024-04-26T23:46:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1018800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f10100ce310 0x7f101015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1018800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10100b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1018800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f101015fc50 con 0x7f101015c100 2024-04-26T23:46:39.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1018800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1010160860 con 0x7f10100ce310 2024-04-26T23:46:39.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1018800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f101015d4a0 con 0x7f101006fcd0 2024-04-26T23:46:39.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1016800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10100b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1015400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f10100ce310 0x7f101015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1015400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f10100ce310 0x7f101015cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:47464/0 (socket says 172.21.15.47:47464) 2024-04-26T23:46:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1016800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10100b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:43854/0 (socket says 172.21.15.47:43854) 2024-04-26T23:46:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1015400640 1 -- 172.21.15.47:0/1931198594 learned_addr learned my addr 172.21.15.47:0/1931198594 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1015400640 1 -- 172.21.15.47:0/1931198594 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 msgr2=0x7f10100b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1015400640 1 --2- 172.21.15.47:0/1931198594 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10100b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1015400640 1 -- 172.21.15.47:0/1931198594 >> v1:172.21.15.203:6789/0 conn(0x7f101015c100 legacy=0x7f10100cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.496+0000 7f1015400640 1 -- 172.21.15.47:0/1931198594 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101015ff30 con 0x7f10100ce310 2024-04-26T23:46:39.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1015400640 1 --2- 172.21.15.47:0/1931198594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10100ce310 0x7f101015cf60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1000006fd0 tx=0x7f100001e750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c509364fab77bc14 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1014a00640 1 -- 172.21.15.47:0/1931198594 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000b4070 con 0x7f10100ce310 2024-04-26T23:46:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1014a00640 1 -- 172.21.15.47:0/1931198594 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10000a7710 con 0x7f10100ce310 2024-04-26T23:46:39.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1014a00640 1 -- 172.21.15.47:0/1931198594 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000a7ae0 con 0x7f10100ce310 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 -- 172.21.15.47:0/1931198594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10100ce310 msgr2=0x7f101015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 --2- 172.21.15.47:0/1931198594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10100ce310 0x7f101015cf60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1000006fd0 tx=0x7f100001e750 comp rx=0 tx=0).stop 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 -- 172.21.15.47:0/1931198594 shutdown_connections 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 --2- 172.21.15.47:0/1931198594 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10100b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 --2- 172.21.15.47:0/1931198594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10100ce310 0x7f101015cf60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 -- 172.21.15.47:0/1931198594 >> 172.21.15.47:0/1931198594 conn(0x7f101006c800 msgr2=0x7f101006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 -- 172.21.15.47:0/1931198594 shutdown_connections 2024-04-26T23:46:39.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 -- 172.21.15.47:0/1931198594 wait complete. 2024-04-26T23:46:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 Processor -- start 2024-04-26T23:46:39.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.500+0000 7f1018800640 1 -- start start 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10101552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10100ce310 0x7f10100b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f101015c100 0x7f10100cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f10100b5ef0 con 0x7f10100ce310 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f10100b5d70 con 0x7f101015c100 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f10100b6070 con 0x7f101006fcd0 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10100ce310 0x7f10100b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10100ce310 0x7f10100b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38638/0 (socket says 172.21.15.47:38638) 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 -- 172.21.15.47:0/1186974151 learned_addr learned my addr 172.21.15.47:0/1186974151 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1016800640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f101015c100 0x7f10100cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015e00640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10101552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 -- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 msgr2=0x7f10101552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10101552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 -- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f101015c100 msgr2=0x7f10100cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f101015c100 0x7f10100cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 -- 172.21.15.47:0/1186974151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10100b2260 con 0x7f10100ce310 2024-04-26T23:46:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015e00640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10101552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:39.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1015400640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10100ce310 0x7f10100b15a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f100001b360 tx=0x7f100001b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f100a000640 1 -- 172.21.15.47:0/1186974151 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000b4030 con 0x7f10100ce310 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f100a000640 1 -- 172.21.15.47:0/1186974151 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10000a7ad0 con 0x7f10100ce310 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f100a000640 1 -- 172.21.15.47:0/1186974151 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000006040 con 0x7f10100ce310 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10100aec20 con 0x7f10100ce310 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10100ae140 con 0x7f10100ce310 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.504+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1010069700 con 0x7f10100ce310 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.508+0000 7f100a000640 1 -- 172.21.15.47:0/1186974151 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10000b7030 con 0x7f10100ce310 2024-04-26T23:46:39.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.508+0000 7f100a000640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0ff40683b0 0x7f0ff406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.508+0000 7f100a000640 1 -- 172.21.15.47:0/1186974151 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f100011ffb0 con 0x7f10100ce310 2024-04-26T23:46:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.508+0000 7f1015e00640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0ff40683b0 0x7f0ff406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.508+0000 7f1015e00640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0ff40683b0 0x7f0ff406a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f101015b440 tx=0x7f1004009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.512+0000 7f100a000640 1 -- 172.21.15.47:0/1186974151 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f10000be030 con 0x7f10100ce310 2024-04-26T23:46:39.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.672+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10100d08b0 con 0x7f0ff40683b0 2024-04-26T23:46:39.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.680+0000 7f100a000640 1 -- 172.21.15.47:0/1186974151 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245467 (secure 0 0 0) 0x7f10100d08b0 con 0x7f0ff40683b0 2024-04-26T23:46:39.689 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:39.690 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:46:39.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0ff40683b0 msgr2=0x7f0ff406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0ff40683b0 0x7f0ff406a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f101015b440 tx=0x7f1004009040 comp rx=0 tx=0).stop 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10100ce310 msgr2=0x7f10100b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10100ce310 0x7f10100b15a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f100001b360 tx=0x7f100001b4f0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 shutdown_connections 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0ff40683b0 0x7f0ff406a870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f101015c100 0x7f10100cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f10100ce310 0x7f10100b15a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 --2- 172.21.15.47:0/1186974151 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f101006fcd0 0x7f10101552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 >> 172.21.15.47:0/1186974151 conn(0x7f101006c800 msgr2=0x7f101006e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 shutdown_connections 2024-04-26T23:46:39.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.684+0000 7f1018800640 1 -- 172.21.15.47:0/1186974151 wait complete. 2024-04-26T23:46:39.710 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-26T23:46:38.169543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236840,"kb_used_data":4020,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737880,"statfs":{"total":773094113280,"available":772851589120,"internally_reserved":0,"allocated":4116480,"data_stored":2287109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.019498"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161614+0000","last_change":"2024-04-26T23:46:34.161614+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161614+0000","last_undegraded":"2024-04-26T23:46:34.161614+0000","last_fullsized":"2024-04-26T23:46:34.161614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.177583+0000","last_change":"2024-04-26T23:46:34.177583+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.177583+0000","last_undegraded":"2024-04-26T23:46:34.177583+0000","last_fullsized":"2024-04-26T23:46:34.177583+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156663+0000","last_change":"2024-04-26T23:46:34.156663+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156663+0000","last_undegraded":"2024-04-26T23:46:34.156663+0000","last_fullsized":"2024-04-26T23:46:34.156663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163721+0000","last_change":"2024-04-26T23:46:34.163721+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163721+0000","last_undegraded":"2024-04-26T23:46:34.163721+0000","last_fullsized":"2024-04-26T23:46:34.163721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165896+0000","last_change":"2024-04-26T23:46:34.165896+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165896+0000","last_undegraded":"2024-04-26T23:46:34.165896+0000","last_fullsized":"2024-04-26T23:46:34.165896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.175149+0000","last_change":"2024-04-26T23:46:34.175149+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.175149+0000","last_undegraded":"2024-04-26T23:46:34.175149+0000","last_fullsized":"2024-04-26T23:46:34.175149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165651+0000","last_change":"2024-04-26T23:46:34.165651+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165651+0000","last_undegraded":"2024-04-26T23:46:34.165651+0000","last_fullsized":"2024-04-26T23:46:34.165651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.168244+0000","last_change":"2024-04-26T23:46:34.168244+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.168244+0000","last_undegraded":"2024-04-26T23:46:34.168244+0000","last_fullsized":"2024-04-26T23:46:34.168244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161511+0000","last_change":"2024-04-26T23:46:34.161511+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161511+0000","last_undegraded":"2024-04-26T23:46:34.161511+0000","last_fullsized":"2024-04-26T23:46:34.161511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163713+0000","last_change":"2024-04-26T23:46:34.163713+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163713+0000","last_undegraded":"2024-04-26T23:46:34.163713+0000","last_fullsized":"2024-04-26T23:46:34.163713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.170071+0000","last_change":"2024-04-26T23:46:34.170071+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.170071+0000","last_undegraded":"2024-04-26T23:46:34.170071+0000","last_fullsized":"2024-04-26T23:46:34.170071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.158087+0000","last_change":"2024-04-26T23:46:34.158087+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.158087+0000","last_undegraded":"2024-04-26T23:46:34.158087+0000","last_fullsized":"2024-04-26T23:46:34.158087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165351+0000","last_change":"2024-04-26T23:46:34.165351+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165351+0000","last_undegraded":"2024-04-26T23:46:34.165351+0000","last_fullsized":"2024-04-26T23:46:34.165351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.174096+0000","last_change":"2024-04-26T23:46:34.174096+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.174096+0000","last_undegraded":"2024-04-26T23:46:34.174096+0000","last_fullsized":"2024-04-26T23:46:34.174096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156020+0000","last_change":"2024-04-26T23:46:34.156020+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156020+0000","last_undegraded":"2024-04-26T23:46:34.156020+0000","last_fullsized":"2024-04-26T23:46:34.156020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165834+0000","last_change":"2024-04-26T23:46:34.165834+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165834+0000","last_undegraded":"2024-04-26T23:46:34.165834+0000","last_fullsized":"2024-04-26T23:46:34.165834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167694+0000","last_change":"2024-04-26T23:46:34.167694+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167694+0000","last_undegraded":"2024-04-26T23:46:34.167694+0000","last_fullsized":"2024-04-26T23:46:34.167694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.173980+0000","last_change":"2024-04-26T23:46:34.173980+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.173980+0000","last_undegraded":"2024-04-26T23:46:34.173980+0000","last_fullsized":"2024-04-26T23:46:34.173980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.175531+0000","last_change":"2024-04-26T23:46:34.175531+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.175531+0000","last_undegraded":"2024-04-26T23:46:34.175531+0000","last_fullsized":"2024-04-26T23:46:34.175531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165096+0000","last_change":"2024-04-26T23:46:34.165096+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165096+0000","last_undegraded":"2024-04-26T23:46:34.165096+0000","last_fullsized":"2024-04-26T23:46:34.165096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161893+0000","last_change":"2024-04-26T23:46:34.161893+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161893+0000","last_undegraded":"2024-04-26T23:46:34.161893+0000","last_fullsized":"2024-04-26T23:46:34.161893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159667+0000","last_change":"2024-04-26T23:46:34.159667+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159667+0000","last_undegraded":"2024-04-26T23:46:34.159667+0000","last_fullsized":"2024-04-26T23:46:34.159667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156027+0000","last_change":"2024-04-26T23:46:34.156027+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156027+0000","last_undegraded":"2024-04-26T23:46:34.156027+0000","last_fullsized":"2024-04-26T23:46:34.156027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166901+0000","last_change":"2024-04-26T23:46:34.166901+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166901+0000","last_undegraded":"2024-04-26T23:46:34.166901+0000","last_fullsized":"2024-04-26T23:46:34.166901+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.172216+0000","last_change":"2024-04-26T23:46:34.172216+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.172216+0000","last_undegraded":"2024-04-26T23:46:34.172216+0000","last_fullsized":"2024-04-26T23:46:34.172216+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160044+0000","last_change":"2024-04-26T23:46:34.160044+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160044+0000","last_undegraded":"2024-04-26T23:46:34.160044+0000","last_fullsized":"2024-04-26T23:46:34.160044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157626+0000","last_change":"2024-04-26T23:46:34.157626+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157626+0000","last_undegraded":"2024-04-26T23:46:34.157626+0000","last_fullsized":"2024-04-26T23:46:34.157626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161360+0000","last_change":"2024-04-26T23:46:34.161360+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161360+0000","last_undegraded":"2024-04-26T23:46:34.161360+0000","last_fullsized":"2024-04-26T23:46:34.161360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166188+0000","last_change":"2024-04-26T23:46:34.166188+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166188+0000","last_undegraded":"2024-04-26T23:46:34.166188+0000","last_fullsized":"2024-04-26T23:46:34.166188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160799+0000","last_change":"2024-04-26T23:46:34.160799+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160799+0000","last_undegraded":"2024-04-26T23:46:34.160799+0000","last_fullsized":"2024-04-26T23:46:34.160799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167805+0000","last_change":"2024-04-26T23:46:34.167805+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167805+0000","last_undegraded":"2024-04-26T23:46:34.167805+0000","last_fullsized":"2024-04-26T23:46:34.167805+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.176749+0000","last_change":"2024-04-26T23:46:34.175419+0000","last_active":"2024-04-26T23:46:34.176749+0000","last_peered":"2024-04-26T23:46:34.176749+0000","last_clean":"2024-04-26T23:46:34.176749+0000","last_became_active":"2024-04-26T23:46:34.175127+0000","last_became_peered":"2024-04-26T23:46:34.175127+0000","last_unstale":"2024-04-26T23:46:34.176749+0000","last_undegraded":"2024-04-26T23:46:34.176749+0000","last_fullsized":"2024-04-26T23:46:34.176749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:41.721074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161088+0000","last_change":"2024-04-26T23:46:34.161088+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161088+0000","last_undegraded":"2024-04-26T23:46:34.161088+0000","last_fullsized":"2024-04-26T23:46:34.161088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162105+0000","last_change":"2024-04-26T23:46:34.162105+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162105+0000","last_undegraded":"2024-04-26T23:46:34.162105+0000","last_fullsized":"2024-04-26T23:46:34.162105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188518+0000","last_change":"2024-04-26T23:46:34.187217+0000","last_active":"2024-04-26T23:46:34.188518+0000","last_peered":"2024-04-26T23:46:34.188518+0000","last_clean":"2024-04-26T23:46:34.188518+0000","last_became_active":"2024-04-26T23:46:34.186901+0000","last_became_peered":"2024-04-26T23:46:34.186901+0000","last_unstale":"2024-04-26T23:46:34.188518+0000","last_undegraded":"2024-04-26T23:46:34.188518+0000","last_fullsized":"2024-04-26T23:46:34.188518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:11.450124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159503+0000","last_change":"2024-04-26T23:46:34.159503+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159503+0000","last_undegraded":"2024-04-26T23:46:34.159503+0000","last_fullsized":"2024-04-26T23:46:34.159503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.180930+0000","last_change":"2024-04-26T23:46:34.179542+0000","last_active":"2024-04-26T23:46:34.180930+0000","last_peered":"2024-04-26T23:46:34.180930+0000","last_clean":"2024-04-26T23:46:34.180930+0000","last_became_active":"2024-04-26T23:46:34.179230+0000","last_became_peered":"2024-04-26T23:46:34.179230+0000","last_unstale":"2024-04-26T23:46:34.180930+0000","last_undegraded":"2024-04-26T23:46:34.180930+0000","last_fullsized":"2024-04-26T23:46:34.180930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:13.695920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165465+0000","last_change":"2024-04-26T23:46:34.165465+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165465+0000","last_undegraded":"2024-04-26T23:46:34.165465+0000","last_fullsized":"2024-04-26T23:46:34.165465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.182027+0000","last_change":"2024-04-26T23:46:34.178810+0000","last_active":"2024-04-26T23:46:34.182027+0000","last_peered":"2024-04-26T23:46:34.182027+0000","last_clean":"2024-04-26T23:46:34.182027+0000","last_became_active":"2024-04-26T23:46:34.177743+0000","last_became_peered":"2024-04-26T23:46:34.177743+0000","last_unstale":"2024-04-26T23:46:34.182027+0000","last_undegraded":"2024-04-26T23:46:34.182027+0000","last_fullsized":"2024-04-26T23:46:34.182027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:01.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156199+0000","last_change":"2024-04-26T23:46:34.156199+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156199+0000","last_undegraded":"2024-04-26T23:46:34.156199+0000","last_fullsized":"2024-04-26T23:46:34.156199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.190298+0000","last_change":"2024-04-26T23:46:34.186701+0000","last_active":"2024-04-26T23:46:34.190298+0000","last_peered":"2024-04-26T23:46:34.190298+0000","last_clean":"2024-04-26T23:46:34.190298+0000","last_became_active":"2024-04-26T23:46:34.186448+0000","last_became_peered":"2024-04-26T23:46:34.186448+0000","last_unstale":"2024-04-26T23:46:34.190298+0000","last_undegraded":"2024-04-26T23:46:34.190298+0000","last_fullsized":"2024-04-26T23:46:34.190298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:18.240827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162949+0000","last_change":"2024-04-26T23:46:34.162949+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162949+0000","last_undegraded":"2024-04-26T23:46:34.162949+0000","last_fullsized":"2024-04-26T23:46:34.162949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184937+0000","last_change":"2024-04-26T23:46:34.181576+0000","last_active":"2024-04-26T23:46:34.184937+0000","last_peered":"2024-04-26T23:46:34.184937+0000","last_clean":"2024-04-26T23:46:34.184937+0000","last_became_active":"2024-04-26T23:46:34.181279+0000","last_became_peered":"2024-04-26T23:46:34.181279+0000","last_unstale":"2024-04-26T23:46:34.184937+0000","last_undegraded":"2024-04-26T23:46:34.184937+0000","last_fullsized":"2024-04-26T23:46:34.184937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:28.087390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159251+0000","last_change":"2024-04-26T23:46:34.159251+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159251+0000","last_undegraded":"2024-04-26T23:46:34.159251+0000","last_fullsized":"2024-04-26T23:46:34.159251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.172754+0000","last_change":"2024-04-26T23:46:34.169490+0000","last_active":"2024-04-26T23:46:34.172754+0000","last_peered":"2024-04-26T23:46:34.172754+0000","last_clean":"2024-04-26T23:46:34.172754+0000","last_became_active":"2024-04-26T23:46:34.169205+0000","last_became_peered":"2024-04-26T23:46:34.169205+0000","last_unstale":"2024-04-26T23:46:34.172754+0000","last_undegraded":"2024-04-26T23:46:34.172754+0000","last_fullsized":"2024-04-26T23:46:34.172754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:24.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157309+0000","last_change":"2024-04-26T23:46:34.157309+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157309+0000","last_undegraded":"2024-04-26T23:46:34.157309+0000","last_fullsized":"2024-04-26T23:46:34.157309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184816+0000","last_change":"2024-04-26T23:46:34.179582+0000","last_active":"2024-04-26T23:46:34.184816+0000","last_peered":"2024-04-26T23:46:34.184816+0000","last_clean":"2024-04-26T23:46:34.184816+0000","last_became_active":"2024-04-26T23:46:34.179049+0000","last_became_peered":"2024-04-26T23:46:34.179049+0000","last_unstale":"2024-04-26T23:46:34.184816+0000","last_undegraded":"2024-04-26T23:46:34.184816+0000","last_fullsized":"2024-04-26T23:46:34.184816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.842965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.170777+0000","last_change":"2024-04-26T23:46:34.170777+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.170777+0000","last_undegraded":"2024-04-26T23:46:34.170777+0000","last_fullsized":"2024-04-26T23:46:34.170777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.171721+0000","last_change":"2024-04-26T23:46:34.171721+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.171721+0000","last_undegraded":"2024-04-26T23:46:34.171721+0000","last_fullsized":"2024-04-26T23:46:34.171721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181722+0000","last_change":"2024-04-26T23:46:34.179540+0000","last_active":"2024-04-26T23:46:34.181722+0000","last_peered":"2024-04-26T23:46:34.181722+0000","last_clean":"2024-04-26T23:46:34.181722+0000","last_became_active":"2024-04-26T23:46:34.179281+0000","last_became_peered":"2024-04-26T23:46:34.179281+0000","last_unstale":"2024-04-26T23:46:34.181722+0000","last_undegraded":"2024-04-26T23:46:34.181722+0000","last_fullsized":"2024-04-26T23:46:34.181722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:13.248964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157318+0000","last_change":"2024-04-26T23:46:34.157318+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157318+0000","last_undegraded":"2024-04-26T23:46:34.157318+0000","last_fullsized":"2024-04-26T23:46:34.157318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188122+0000","last_change":"2024-04-26T23:46:34.186637+0000","last_active":"2024-04-26T23:46:34.188122+0000","last_peered":"2024-04-26T23:46:34.188122+0000","last_clean":"2024-04-26T23:46:34.188122+0000","last_became_active":"2024-04-26T23:46:34.186389+0000","last_became_peered":"2024-04-26T23:46:34.186389+0000","last_unstale":"2024-04-26T23:46:34.188122+0000","last_undegraded":"2024-04-26T23:46:34.188122+0000","last_fullsized":"2024-04-26T23:46:34.188122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:31:14.942666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160482+0000","last_change":"2024-04-26T23:46:34.160482+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160482+0000","last_undegraded":"2024-04-26T23:46:34.160482+0000","last_fullsized":"2024-04-26T23:46:34.160482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.171972+0000","last_change":"2024-04-26T23:46:34.166497+0000","last_active":"2024-04-26T23:46:34.171972+0000","last_peered":"2024-04-26T23:46:34.171972+0000","last_clean":"2024-04-26T23:46:34.171972+0000","last_became_active":"2024-04-26T23:46:34.165705+0000","last_became_peered":"2024-04-26T23:46:34.165705+0000","last_unstale":"2024-04-26T23:46:34.171972+0000","last_undegraded":"2024-04-26T23:46:34.171972+0000","last_fullsized":"2024-04-26T23:46:34.171972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:43.245922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167478+0000","last_change":"2024-04-26T23:46:34.167478+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167478+0000","last_undegraded":"2024-04-26T23:46:34.167478+0000","last_fullsized":"2024-04-26T23:46:34.167478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186054+0000","last_change":"2024-04-26T23:46:34.173170+0000","last_active":"2024-04-26T23:46:34.186054+0000","last_peered":"2024-04-26T23:46:34.186054+0000","last_clean":"2024-04-26T23:46:34.186054+0000","last_became_active":"2024-04-26T23:46:34.172917+0000","last_became_peered":"2024-04-26T23:46:34.172917+0000","last_unstale":"2024-04-26T23:46:34.186054+0000","last_undegraded":"2024-04-26T23:46:34.186054+0000","last_fullsized":"2024-04-26T23:46:34.186054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167368+0000","last_change":"2024-04-26T23:46:34.167368+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167368+0000","last_undegraded":"2024-04-26T23:46:34.167368+0000","last_fullsized":"2024-04-26T23:46:34.167368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184693+0000","last_change":"2024-04-26T23:46:34.179239+0000","last_active":"2024-04-26T23:46:34.184693+0000","last_peered":"2024-04-26T23:46:34.184693+0000","last_clean":"2024-04-26T23:46:34.184693+0000","last_became_active":"2024-04-26T23:46:34.178903+0000","last_became_peered":"2024-04-26T23:46:34.178903+0000","last_unstale":"2024-04-26T23:46:34.184693+0000","last_undegraded":"2024-04-26T23:46:34.184693+0000","last_fullsized":"2024-04-26T23:46:34.184693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:59.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160224+0000","last_change":"2024-04-26T23:46:34.160224+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160224+0000","last_undegraded":"2024-04-26T23:46:34.160224+0000","last_fullsized":"2024-04-26T23:46:34.160224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188048+0000","last_change":"2024-04-26T23:46:34.186295+0000","last_active":"2024-04-26T23:46:34.188048+0000","last_peered":"2024-04-26T23:46:34.188048+0000","last_clean":"2024-04-26T23:46:34.188048+0000","last_became_active":"2024-04-26T23:46:34.186014+0000","last_became_peered":"2024-04-26T23:46:34.186014+0000","last_unstale":"2024-04-26T23:46:34.188048+0000","last_undegraded":"2024-04-26T23:46:34.188048+0000","last_fullsized":"2024-04-26T23:46:34.188048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:30.093195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162935+0000","last_change":"2024-04-26T23:46:34.162935+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162935+0000","last_undegraded":"2024-04-26T23:46:34.162935+0000","last_fullsized":"2024-04-26T23:46:34.162935+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186304+0000","last_change":"2024-04-26T23:46:34.180474+0000","last_active":"2024-04-26T23:46:34.186304+0000","last_peered":"2024-04-26T23:46:34.186304+0000","last_clean":"2024-04-26T23:46:34.186304+0000","last_became_active":"2024-04-26T23:46:34.180195+0000","last_became_peered":"2024-04-26T23:46:34.180195+0000","last_unstale":"2024-04-26T23:46:34.186304+0000","last_undegraded":"2024-04-26T23:46:34.186304+0000","last_fullsized":"2024-04-26T23:46:34.186304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:31.072186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157176+0000","last_change":"2024-04-26T23:46:34.157176+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157176+0000","last_undegraded":"2024-04-26T23:46:34.157176+0000","last_fullsized":"2024-04-26T23:46:34.157176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175236+0000","last_change":"2024-04-26T23:46:34.171710+0000","last_active":"2024-04-26T23:46:34.175236+0000","last_peered":"2024-04-26T23:46:34.175236+0000","last_clean":"2024-04-26T23:46:34.175236+0000","last_became_active":"2024-04-26T23:46:34.171422+0000","last_became_peered":"2024-04-26T23:46:34.171422+0000","last_unstale":"2024-04-26T23:46:34.175236+0000","last_undegraded":"2024-04-26T23:46:34.175236+0000","last_fullsized":"2024-04-26T23:46:34.175236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:52:49.894347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159624+0000","last_change":"2024-04-26T23:46:34.159624+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159624+0000","last_undegraded":"2024-04-26T23:46:34.159624+0000","last_fullsized":"2024-04-26T23:46:34.159624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175284+0000","last_change":"2024-04-26T23:46:34.173257+0000","last_active":"2024-04-26T23:46:34.175284+0000","last_peered":"2024-04-26T23:46:34.175284+0000","last_clean":"2024-04-26T23:46:34.175284+0000","last_became_active":"2024-04-26T23:46:34.172921+0000","last_became_peered":"2024-04-26T23:46:34.172921+0000","last_unstale":"2024-04-26T23:46:34.175284+0000","last_undegraded":"2024-04-26T23:46:34.175284+0000","last_fullsized":"2024-04-26T23:46:34.175284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:27.275026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164196+0000","last_change":"2024-04-26T23:46:34.164196+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164196+0000","last_undegraded":"2024-04-26T23:46:34.164196+0000","last_fullsized":"2024-04-26T23:46:34.164196+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181672+0000","last_change":"2024-04-26T23:46:34.178125+0000","last_active":"2024-04-26T23:46:34.181672+0000","last_peered":"2024-04-26T23:46:34.181672+0000","last_clean":"2024-04-26T23:46:34.181672+0000","last_became_active":"2024-04-26T23:46:34.177837+0000","last_became_peered":"2024-04-26T23:46:34.177837+0000","last_unstale":"2024-04-26T23:46:34.181672+0000","last_undegraded":"2024-04-26T23:46:34.181672+0000","last_fullsized":"2024-04-26T23:46:34.181672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:25.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163748+0000","last_change":"2024-04-26T23:46:34.163748+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163748+0000","last_undegraded":"2024-04-26T23:46:34.163748+0000","last_fullsized":"2024-04-26T23:46:34.163748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164590+0000","last_change":"2024-04-26T23:46:34.164590+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164590+0000","last_undegraded":"2024-04-26T23:46:34.164590+0000","last_fullsized":"2024-04-26T23:46:34.164590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.179394+0000","last_change":"2024-04-26T23:46:34.178182+0000","last_active":"2024-04-26T23:46:34.179394+0000","last_peered":"2024-04-26T23:46:34.179394+0000","last_clean":"2024-04-26T23:46:34.179394+0000","last_became_active":"2024-04-26T23:46:34.177914+0000","last_became_peered":"2024-04-26T23:46:34.177914+0000","last_unstale":"2024-04-26T23:46:34.179394+0000","last_undegraded":"2024-04-26T23:46:34.179394+0000","last_fullsized":"2024-04-26T23:46:34.179394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164290+0000","last_change":"2024-04-26T23:46:34.164290+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164290+0000","last_undegraded":"2024-04-26T23:46:34.164290+0000","last_fullsized":"2024-04-26T23:46:34.164290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175327+0000","last_change":"2024-04-26T23:46:34.171217+0000","last_active":"2024-04-26T23:46:34.175327+0000","last_peered":"2024-04-26T23:46:34.175327+0000","last_clean":"2024-04-26T23:46:34.175327+0000","last_became_active":"2024-04-26T23:46:34.170668+0000","last_became_peered":"2024-04-26T23:46:34.170668+0000","last_unstale":"2024-04-26T23:46:34.175327+0000","last_undegraded":"2024-04-26T23:46:34.175327+0000","last_fullsized":"2024-04-26T23:46:34.175327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:13.695920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166401+0000","last_change":"2024-04-26T23:46:34.166401+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166401+0000","last_undegraded":"2024-04-26T23:46:34.166401+0000","last_fullsized":"2024-04-26T23:46:34.166401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181678+0000","last_change":"2024-04-26T23:46:34.179422+0000","last_active":"2024-04-26T23:46:34.181678+0000","last_peered":"2024-04-26T23:46:34.181678+0000","last_clean":"2024-04-26T23:46:34.181678+0000","last_became_active":"2024-04-26T23:46:34.179130+0000","last_became_peered":"2024-04-26T23:46:34.179130+0000","last_unstale":"2024-04-26T23:46:34.181678+0000","last_undegraded":"2024-04-26T23:46:34.181678+0000","last_fullsized":"2024-04-26T23:46:34.181678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:53.287265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164912+0000","last_change":"2024-04-26T23:46:34.164912+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164912+0000","last_undegraded":"2024-04-26T23:46:34.164912+0000","last_fullsized":"2024-04-26T23:46:34.164912+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186289+0000","last_change":"2024-04-26T23:46:34.176531+0000","last_active":"2024-04-26T23:46:34.186289+0000","last_peered":"2024-04-26T23:46:34.186289+0000","last_clean":"2024-04-26T23:46:34.186289+0000","last_became_active":"2024-04-26T23:46:34.176220+0000","last_became_peered":"2024-04-26T23:46:34.176220+0000","last_unstale":"2024-04-26T23:46:34.186289+0000","last_undegraded":"2024-04-26T23:46:34.186289+0000","last_fullsized":"2024-04-26T23:46:34.186289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:12.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156089+0000","last_change":"2024-04-26T23:46:34.156089+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156089+0000","last_undegraded":"2024-04-26T23:46:34.156089+0000","last_fullsized":"2024-04-26T23:46:34.156089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.185930+0000","last_change":"2024-04-26T23:46:34.170536+0000","last_active":"2024-04-26T23:46:34.185930+0000","last_peered":"2024-04-26T23:46:34.185930+0000","last_clean":"2024-04-26T23:46:34.185930+0000","last_became_active":"2024-04-26T23:46:34.169534+0000","last_became_peered":"2024-04-26T23:46:34.169534+0000","last_unstale":"2024-04-26T23:46:34.185930+0000","last_undegraded":"2024-04-26T23:46:34.185930+0000","last_fullsized":"2024-04-26T23:46:34.185930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160365+0000","last_change":"2024-04-26T23:46:34.160365+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160365+0000","last_undegraded":"2024-04-26T23:46:34.160365+0000","last_fullsized":"2024-04-26T23:46:34.160365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186083+0000","last_change":"2024-04-26T23:46:34.175739+0000","last_active":"2024-04-26T23:46:34.186083+0000","last_peered":"2024-04-26T23:46:34.186083+0000","last_clean":"2024-04-26T23:46:34.186083+0000","last_became_active":"2024-04-26T23:46:34.175510+0000","last_became_peered":"2024-04-26T23:46:34.175510+0000","last_unstale":"2024-04-26T23:46:34.186083+0000","last_undegraded":"2024-04-26T23:46:34.186083+0000","last_fullsized":"2024-04-26T23:46:34.186083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:32:54.994053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161524+0000","last_change":"2024-04-26T23:46:34.161524+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161524+0000","last_undegraded":"2024-04-26T23:46:34.161524+0000","last_fullsized":"2024-04-26T23:46:34.161524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175307+0000","last_change":"2024-04-26T23:46:34.170955+0000","last_active":"2024-04-26T23:46:34.175307+0000","last_peered":"2024-04-26T23:46:34.175307+0000","last_clean":"2024-04-26T23:46:34.175307+0000","last_became_active":"2024-04-26T23:46:34.170342+0000","last_became_peered":"2024-04-26T23:46:34.170342+0000","last_unstale":"2024-04-26T23:46:34.175307+0000","last_undegraded":"2024-04-26T23:46:34.175307+0000","last_fullsized":"2024-04-26T23:46:34.175307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:42.613416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162564+0000","last_change":"2024-04-26T23:46:34.162564+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162564+0000","last_undegraded":"2024-04-26T23:46:34.162564+0000","last_fullsized":"2024-04-26T23:46:34.162564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184737+0000","last_change":"2024-04-26T23:46:34.179277+0000","last_active":"2024-04-26T23:46:34.184737+0000","last_peered":"2024-04-26T23:46:34.184737+0000","last_clean":"2024-04-26T23:46:34.184737+0000","last_became_active":"2024-04-26T23:46:34.178980+0000","last_became_peered":"2024-04-26T23:46:34.178980+0000","last_unstale":"2024-04-26T23:46:34.184737+0000","last_undegraded":"2024-04-26T23:46:34.184737+0000","last_fullsized":"2024-04-26T23:46:34.184737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:44.753454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.168175+0000","last_change":"2024-04-26T23:46:34.168175+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.168175+0000","last_undegraded":"2024-04-26T23:46:34.168175+0000","last_fullsized":"2024-04-26T23:46:34.168175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.177607+0000","last_change":"2024-04-26T23:46:34.176449+0000","last_active":"2024-04-26T23:46:34.177607+0000","last_peered":"2024-04-26T23:46:34.177607+0000","last_clean":"2024-04-26T23:46:34.177607+0000","last_became_active":"2024-04-26T23:46:34.176138+0000","last_became_peered":"2024-04-26T23:46:34.176138+0000","last_unstale":"2024-04-26T23:46:34.177607+0000","last_undegraded":"2024-04-26T23:46:34.177607+0000","last_fullsized":"2024-04-26T23:46:34.177607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.172214+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:46:34.172214+0000","last_peered":"2024-04-26T23:46:34.172214+0000","last_clean":"2024-04-26T23:46:34.172214+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:46:34.172214+0000","last_undegraded":"2024-04-26T23:46:34.172214+0000","last_fullsized":"2024-04-26T23:46:34.172214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":727825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":946176,"data_stored":722008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:46:39.714 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:46:39.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4656800640 1 Processor -- start 2024-04-26T23:46:39.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4656800640 1 -- start start 2024-04-26T23:46:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4656800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f465015bec0 0x7f465006fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4656800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46500b6b60 con 0x7f4650073730 2024-04-26T23:46:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4656800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4650070150 con 0x7f46500b09d0 2024-04-26T23:46:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4656800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4650070d60 con 0x7f465015bec0 2024-04-26T23:46:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4655e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4650073730 0x7f46500b4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59746/0 (socket says 172.21.15.47:59746) 2024-04-26T23:46:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4655e00640 1 -- 172.21.15.47:0/1297616576 learned_addr learned my addr 172.21.15.47:0/1297616576 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:39.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4655400640 1 --2- 172.21.15.47:0/1297616576 >> v2:172.21.15.203:3300/0 conn(0x7f465015bec0 0x7f465006fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f464fe00640 1 -- 172.21.15.47:0/1297616576 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289259637 0 0) 0x7f46500b6b60 con 0x7f4650073730 2024-04-26T23:46:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f464fe00640 1 -- 172.21.15.47:0/1297616576 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4638003530 con 0x7f4650073730 2024-04-26T23:46:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4655400640 1 -- 172.21.15.47:0/1297616576 >> v1:172.21.15.203:6789/0 conn(0x7f46500b09d0 legacy=0x7f4650073020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4655400640 1 -- 172.21.15.47:0/1297616576 >> v1:172.21.15.47:6789/0 conn(0x7f4650073730 legacy=0x7f46500b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.888+0000 7f4655400640 1 -- 172.21.15.47:0/1297616576 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4650070430 con 0x7f465015bec0 2024-04-26T23:46:39.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4655400640 1 --2- 172.21.15.47:0/1297616576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f465015bec0 0x7f465006fb00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46440097c0 tx=0x7f464401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53a1e66c05e97ec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f464fe00640 1 -- 172.21.15.47:0/1297616576 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440b1070 con 0x7f465015bec0 2024-04-26T23:46:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f464fe00640 1 -- 172.21.15.47:0/1297616576 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46440ac5f0 con 0x7f465015bec0 2024-04-26T23:46:39.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f464fe00640 1 -- 172.21.15.47:0/1297616576 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440ac9c0 con 0x7f465015bec0 2024-04-26T23:46:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 -- 172.21.15.47:0/1297616576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f465015bec0 msgr2=0x7f465006fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 --2- 172.21.15.47:0/1297616576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f465015bec0 0x7f465006fb00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46440097c0 tx=0x7f464401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 -- 172.21.15.47:0/1297616576 shutdown_connections 2024-04-26T23:46:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 --2- 172.21.15.47:0/1297616576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f465015bec0 0x7f465006fb00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 -- 172.21.15.47:0/1297616576 >> 172.21.15.47:0/1297616576 conn(0x7f46500b39c0 msgr2=0x7f46500b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 -- 172.21.15.47:0/1297616576 shutdown_connections 2024-04-26T23:46:39.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 -- 172.21.15.47:0/1297616576 wait complete. 2024-04-26T23:46:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 Processor -- start 2024-04-26T23:46:39.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.892+0000 7f4656800640 1 -- start start 2024-04-26T23:46:39.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4650073730 0x7f465014f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46500b09d0 0x7f465014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f465015bec0 0x7f4650156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f46500b5df0 con 0x7f4650073730 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46500b5c70 con 0x7f46500b09d0 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f46500b5f70 con 0x7f465015bec0 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4650073730 0x7f465014f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4650073730 0x7f465014f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38654/0 (socket says 172.21.15.47:38654) 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 -- 172.21.15.47:0/1561821607 learned_addr learned my addr 172.21.15.47:0/1561821607 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4654a00640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46500b09d0 0x7f465014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655e00640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f465015bec0 0x7f4650156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 -- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f465015bec0 msgr2=0x7f4650156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f465015bec0 0x7f4650156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 -- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46500b09d0 msgr2=0x7f465014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46500b09d0 0x7f465014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 -- 172.21.15.47:0/1561821607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465015d6b0 con 0x7f4650073730 2024-04-26T23:46:39.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4654a00640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46500b09d0 0x7f465014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:39.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4655400640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4650073730 0x7f465014f800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f46440af040 tx=0x7f464401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f464d600640 1 -- 172.21.15.47:0/1561821607 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440b1050 con 0x7f4650073730 2024-04-26T23:46:39.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f464d600640 1 -- 172.21.15.47:0/1561821607 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46440bd070 con 0x7f4650073730 2024-04-26T23:46:39.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f464d600640 1 -- 172.21.15.47:0/1561821607 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46440b6830 con 0x7f4650073730 2024-04-26T23:46:39.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465015d990 con 0x7f4650073730 2024-04-26T23:46:39.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465015df50 con 0x7f4650073730 2024-04-26T23:46:39.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.896+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4650069b80 con 0x7f4650073730 2024-04-26T23:46:39.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.900+0000 7f464d600640 1 -- 172.21.15.47:0/1561821607 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f46440b69d0 con 0x7f4650073730 2024-04-26T23:46:39.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.900+0000 7f464d600640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4630068380 0x7f463006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:39.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.900+0000 7f464d600640 1 -- 172.21.15.47:0/1561821607 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f4644121120 con 0x7f4650073730 2024-04-26T23:46:39.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.900+0000 7f4654a00640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4630068380 0x7f463006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:39.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.900+0000 7f4654a00640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4630068380 0x7f463006a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f46500d1200 tx=0x7f463c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:39.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:39.904+0000 7f464d600640 1 -- 172.21.15.47:0/1561821607 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f46440a9070 con 0x7f4650073730 2024-04-26T23:46:40.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.064+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f465015d450 con 0x7f4630068380 2024-04-26T23:46:40.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.072+0000 7f464d600640 1 -- 172.21.15.47:0/1561821607 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245467 (secure 0 0 0) 0x7f463c001c60 con 0x7f4630068380 2024-04-26T23:46:40.081 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:40.083 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.072+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4630068380 msgr2=0x7f463006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.072+0000 7f4656800640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4630068380 0x7f463006a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f46500d1200 tx=0x7f463c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.072+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4650073730 msgr2=0x7f465014f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.072+0000 7f4656800640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4650073730 0x7f465014f800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f46440af040 tx=0x7f464401ace0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 shutdown_connections 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4630068380 0x7f463006a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f465015bec0 0x7f4650156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46500b09d0 0x7f465014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 --2- 172.21.15.47:0/1561821607 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4650073730 0x7f465014f800 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 >> 172.21.15.47:0/1561821607 conn(0x7f46500b39c0 msgr2=0x7f46500b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 shutdown_connections 2024-04-26T23:46:40.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.076+0000 7f4656800640 1 -- 172.21.15.47:0/1561821607 wait complete. 2024-04-26T23:46:40.102 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-26T23:46:38.169543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236840,"kb_used_data":4020,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737880,"statfs":{"total":773094113280,"available":772851589120,"internally_reserved":0,"allocated":4116480,"data_stored":2287109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.019498"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161614+0000","last_change":"2024-04-26T23:46:34.161614+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161614+0000","last_undegraded":"2024-04-26T23:46:34.161614+0000","last_fullsized":"2024-04-26T23:46:34.161614+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.177583+0000","last_change":"2024-04-26T23:46:34.177583+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.177583+0000","last_undegraded":"2024-04-26T23:46:34.177583+0000","last_fullsized":"2024-04-26T23:46:34.177583+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156663+0000","last_change":"2024-04-26T23:46:34.156663+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156663+0000","last_undegraded":"2024-04-26T23:46:34.156663+0000","last_fullsized":"2024-04-26T23:46:34.156663+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163721+0000","last_change":"2024-04-26T23:46:34.163721+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163721+0000","last_undegraded":"2024-04-26T23:46:34.163721+0000","last_fullsized":"2024-04-26T23:46:34.163721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165896+0000","last_change":"2024-04-26T23:46:34.165896+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165896+0000","last_undegraded":"2024-04-26T23:46:34.165896+0000","last_fullsized":"2024-04-26T23:46:34.165896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.175149+0000","last_change":"2024-04-26T23:46:34.175149+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.175149+0000","last_undegraded":"2024-04-26T23:46:34.175149+0000","last_fullsized":"2024-04-26T23:46:34.175149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165651+0000","last_change":"2024-04-26T23:46:34.165651+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165651+0000","last_undegraded":"2024-04-26T23:46:34.165651+0000","last_fullsized":"2024-04-26T23:46:34.165651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.168244+0000","last_change":"2024-04-26T23:46:34.168244+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.168244+0000","last_undegraded":"2024-04-26T23:46:34.168244+0000","last_fullsized":"2024-04-26T23:46:34.168244+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161511+0000","last_change":"2024-04-26T23:46:34.161511+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161511+0000","last_undegraded":"2024-04-26T23:46:34.161511+0000","last_fullsized":"2024-04-26T23:46:34.161511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163713+0000","last_change":"2024-04-26T23:46:34.163713+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163713+0000","last_undegraded":"2024-04-26T23:46:34.163713+0000","last_fullsized":"2024-04-26T23:46:34.163713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.170071+0000","last_change":"2024-04-26T23:46:34.170071+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.170071+0000","last_undegraded":"2024-04-26T23:46:34.170071+0000","last_fullsized":"2024-04-26T23:46:34.170071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.158087+0000","last_change":"2024-04-26T23:46:34.158087+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.158087+0000","last_undegraded":"2024-04-26T23:46:34.158087+0000","last_fullsized":"2024-04-26T23:46:34.158087+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165351+0000","last_change":"2024-04-26T23:46:34.165351+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165351+0000","last_undegraded":"2024-04-26T23:46:34.165351+0000","last_fullsized":"2024-04-26T23:46:34.165351+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.174096+0000","last_change":"2024-04-26T23:46:34.174096+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.174096+0000","last_undegraded":"2024-04-26T23:46:34.174096+0000","last_fullsized":"2024-04-26T23:46:34.174096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156020+0000","last_change":"2024-04-26T23:46:34.156020+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156020+0000","last_undegraded":"2024-04-26T23:46:34.156020+0000","last_fullsized":"2024-04-26T23:46:34.156020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165834+0000","last_change":"2024-04-26T23:46:34.165834+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165834+0000","last_undegraded":"2024-04-26T23:46:34.165834+0000","last_fullsized":"2024-04-26T23:46:34.165834+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167694+0000","last_change":"2024-04-26T23:46:34.167694+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167694+0000","last_undegraded":"2024-04-26T23:46:34.167694+0000","last_fullsized":"2024-04-26T23:46:34.167694+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.173980+0000","last_change":"2024-04-26T23:46:34.173980+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.173980+0000","last_undegraded":"2024-04-26T23:46:34.173980+0000","last_fullsized":"2024-04-26T23:46:34.173980+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.175531+0000","last_change":"2024-04-26T23:46:34.175531+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.175531+0000","last_undegraded":"2024-04-26T23:46:34.175531+0000","last_fullsized":"2024-04-26T23:46:34.175531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165096+0000","last_change":"2024-04-26T23:46:34.165096+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165096+0000","last_undegraded":"2024-04-26T23:46:34.165096+0000","last_fullsized":"2024-04-26T23:46:34.165096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161893+0000","last_change":"2024-04-26T23:46:34.161893+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161893+0000","last_undegraded":"2024-04-26T23:46:34.161893+0000","last_fullsized":"2024-04-26T23:46:34.161893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159667+0000","last_change":"2024-04-26T23:46:34.159667+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159667+0000","last_undegraded":"2024-04-26T23:46:34.159667+0000","last_fullsized":"2024-04-26T23:46:34.159667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156027+0000","last_change":"2024-04-26T23:46:34.156027+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156027+0000","last_undegraded":"2024-04-26T23:46:34.156027+0000","last_fullsized":"2024-04-26T23:46:34.156027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166901+0000","last_change":"2024-04-26T23:46:34.166901+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166901+0000","last_undegraded":"2024-04-26T23:46:34.166901+0000","last_fullsized":"2024-04-26T23:46:34.166901+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.172216+0000","last_change":"2024-04-26T23:46:34.172216+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.172216+0000","last_undegraded":"2024-04-26T23:46:34.172216+0000","last_fullsized":"2024-04-26T23:46:34.172216+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160044+0000","last_change":"2024-04-26T23:46:34.160044+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160044+0000","last_undegraded":"2024-04-26T23:46:34.160044+0000","last_fullsized":"2024-04-26T23:46:34.160044+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157626+0000","last_change":"2024-04-26T23:46:34.157626+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157626+0000","last_undegraded":"2024-04-26T23:46:34.157626+0000","last_fullsized":"2024-04-26T23:46:34.157626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161360+0000","last_change":"2024-04-26T23:46:34.161360+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161360+0000","last_undegraded":"2024-04-26T23:46:34.161360+0000","last_fullsized":"2024-04-26T23:46:34.161360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166188+0000","last_change":"2024-04-26T23:46:34.166188+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166188+0000","last_undegraded":"2024-04-26T23:46:34.166188+0000","last_fullsized":"2024-04-26T23:46:34.166188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160799+0000","last_change":"2024-04-26T23:46:34.160799+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160799+0000","last_undegraded":"2024-04-26T23:46:34.160799+0000","last_fullsized":"2024-04-26T23:46:34.160799+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167805+0000","last_change":"2024-04-26T23:46:34.167805+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167805+0000","last_undegraded":"2024-04-26T23:46:34.167805+0000","last_fullsized":"2024-04-26T23:46:34.167805+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.176749+0000","last_change":"2024-04-26T23:46:34.175419+0000","last_active":"2024-04-26T23:46:34.176749+0000","last_peered":"2024-04-26T23:46:34.176749+0000","last_clean":"2024-04-26T23:46:34.176749+0000","last_became_active":"2024-04-26T23:46:34.175127+0000","last_became_peered":"2024-04-26T23:46:34.175127+0000","last_unstale":"2024-04-26T23:46:34.176749+0000","last_undegraded":"2024-04-26T23:46:34.176749+0000","last_fullsized":"2024-04-26T23:46:34.176749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:47:41.721074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161088+0000","last_change":"2024-04-26T23:46:34.161088+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161088+0000","last_undegraded":"2024-04-26T23:46:34.161088+0000","last_fullsized":"2024-04-26T23:46:34.161088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162105+0000","last_change":"2024-04-26T23:46:34.162105+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162105+0000","last_undegraded":"2024-04-26T23:46:34.162105+0000","last_fullsized":"2024-04-26T23:46:34.162105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188518+0000","last_change":"2024-04-26T23:46:34.187217+0000","last_active":"2024-04-26T23:46:34.188518+0000","last_peered":"2024-04-26T23:46:34.188518+0000","last_clean":"2024-04-26T23:46:34.188518+0000","last_became_active":"2024-04-26T23:46:34.186901+0000","last_became_peered":"2024-04-26T23:46:34.186901+0000","last_unstale":"2024-04-26T23:46:34.188518+0000","last_undegraded":"2024-04-26T23:46:34.188518+0000","last_fullsized":"2024-04-26T23:46:34.188518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:11.450124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159503+0000","last_change":"2024-04-26T23:46:34.159503+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159503+0000","last_undegraded":"2024-04-26T23:46:34.159503+0000","last_fullsized":"2024-04-26T23:46:34.159503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.180930+0000","last_change":"2024-04-26T23:46:34.179542+0000","last_active":"2024-04-26T23:46:34.180930+0000","last_peered":"2024-04-26T23:46:34.180930+0000","last_clean":"2024-04-26T23:46:34.180930+0000","last_became_active":"2024-04-26T23:46:34.179230+0000","last_became_peered":"2024-04-26T23:46:34.179230+0000","last_unstale":"2024-04-26T23:46:34.180930+0000","last_undegraded":"2024-04-26T23:46:34.180930+0000","last_fullsized":"2024-04-26T23:46:34.180930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:13.695920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.165465+0000","last_change":"2024-04-26T23:46:34.165465+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.165465+0000","last_undegraded":"2024-04-26T23:46:34.165465+0000","last_fullsized":"2024-04-26T23:46:34.165465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.182027+0000","last_change":"2024-04-26T23:46:34.178810+0000","last_active":"2024-04-26T23:46:34.182027+0000","last_peered":"2024-04-26T23:46:34.182027+0000","last_clean":"2024-04-26T23:46:34.182027+0000","last_became_active":"2024-04-26T23:46:34.177743+0000","last_became_peered":"2024-04-26T23:46:34.177743+0000","last_unstale":"2024-04-26T23:46:34.182027+0000","last_undegraded":"2024-04-26T23:46:34.182027+0000","last_fullsized":"2024-04-26T23:46:34.182027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:01.740212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156199+0000","last_change":"2024-04-26T23:46:34.156199+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156199+0000","last_undegraded":"2024-04-26T23:46:34.156199+0000","last_fullsized":"2024-04-26T23:46:34.156199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.190298+0000","last_change":"2024-04-26T23:46:34.186701+0000","last_active":"2024-04-26T23:46:34.190298+0000","last_peered":"2024-04-26T23:46:34.190298+0000","last_clean":"2024-04-26T23:46:34.190298+0000","last_became_active":"2024-04-26T23:46:34.186448+0000","last_became_peered":"2024-04-26T23:46:34.186448+0000","last_unstale":"2024-04-26T23:46:34.190298+0000","last_undegraded":"2024-04-26T23:46:34.190298+0000","last_fullsized":"2024-04-26T23:46:34.190298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:18.240827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162949+0000","last_change":"2024-04-26T23:46:34.162949+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162949+0000","last_undegraded":"2024-04-26T23:46:34.162949+0000","last_fullsized":"2024-04-26T23:46:34.162949+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184937+0000","last_change":"2024-04-26T23:46:34.181576+0000","last_active":"2024-04-26T23:46:34.184937+0000","last_peered":"2024-04-26T23:46:34.184937+0000","last_clean":"2024-04-26T23:46:34.184937+0000","last_became_active":"2024-04-26T23:46:34.181279+0000","last_became_peered":"2024-04-26T23:46:34.181279+0000","last_unstale":"2024-04-26T23:46:34.184937+0000","last_undegraded":"2024-04-26T23:46:34.184937+0000","last_fullsized":"2024-04-26T23:46:34.184937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:28.087390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159251+0000","last_change":"2024-04-26T23:46:34.159251+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159251+0000","last_undegraded":"2024-04-26T23:46:34.159251+0000","last_fullsized":"2024-04-26T23:46:34.159251+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.172754+0000","last_change":"2024-04-26T23:46:34.169490+0000","last_active":"2024-04-26T23:46:34.172754+0000","last_peered":"2024-04-26T23:46:34.172754+0000","last_clean":"2024-04-26T23:46:34.172754+0000","last_became_active":"2024-04-26T23:46:34.169205+0000","last_became_peered":"2024-04-26T23:46:34.169205+0000","last_unstale":"2024-04-26T23:46:34.172754+0000","last_undegraded":"2024-04-26T23:46:34.172754+0000","last_fullsized":"2024-04-26T23:46:34.172754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:51:24.869646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157309+0000","last_change":"2024-04-26T23:46:34.157309+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157309+0000","last_undegraded":"2024-04-26T23:46:34.157309+0000","last_fullsized":"2024-04-26T23:46:34.157309+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184816+0000","last_change":"2024-04-26T23:46:34.179582+0000","last_active":"2024-04-26T23:46:34.184816+0000","last_peered":"2024-04-26T23:46:34.184816+0000","last_clean":"2024-04-26T23:46:34.184816+0000","last_became_active":"2024-04-26T23:46:34.179049+0000","last_became_peered":"2024-04-26T23:46:34.179049+0000","last_unstale":"2024-04-26T23:46:34.184816+0000","last_undegraded":"2024-04-26T23:46:34.184816+0000","last_fullsized":"2024-04-26T23:46:34.184816+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.842965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.170777+0000","last_change":"2024-04-26T23:46:34.170777+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.170777+0000","last_undegraded":"2024-04-26T23:46:34.170777+0000","last_fullsized":"2024-04-26T23:46:34.170777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.171721+0000","last_change":"2024-04-26T23:46:34.171721+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.171721+0000","last_undegraded":"2024-04-26T23:46:34.171721+0000","last_fullsized":"2024-04-26T23:46:34.171721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181722+0000","last_change":"2024-04-26T23:46:34.179540+0000","last_active":"2024-04-26T23:46:34.181722+0000","last_peered":"2024-04-26T23:46:34.181722+0000","last_clean":"2024-04-26T23:46:34.181722+0000","last_became_active":"2024-04-26T23:46:34.179281+0000","last_became_peered":"2024-04-26T23:46:34.179281+0000","last_unstale":"2024-04-26T23:46:34.181722+0000","last_undegraded":"2024-04-26T23:46:34.181722+0000","last_fullsized":"2024-04-26T23:46:34.181722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:13.248964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157318+0000","last_change":"2024-04-26T23:46:34.157318+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157318+0000","last_undegraded":"2024-04-26T23:46:34.157318+0000","last_fullsized":"2024-04-26T23:46:34.157318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188122+0000","last_change":"2024-04-26T23:46:34.186637+0000","last_active":"2024-04-26T23:46:34.188122+0000","last_peered":"2024-04-26T23:46:34.188122+0000","last_clean":"2024-04-26T23:46:34.188122+0000","last_became_active":"2024-04-26T23:46:34.186389+0000","last_became_peered":"2024-04-26T23:46:34.186389+0000","last_unstale":"2024-04-26T23:46:34.188122+0000","last_undegraded":"2024-04-26T23:46:34.188122+0000","last_fullsized":"2024-04-26T23:46:34.188122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:31:14.942666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160482+0000","last_change":"2024-04-26T23:46:34.160482+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160482+0000","last_undegraded":"2024-04-26T23:46:34.160482+0000","last_fullsized":"2024-04-26T23:46:34.160482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.171972+0000","last_change":"2024-04-26T23:46:34.166497+0000","last_active":"2024-04-26T23:46:34.171972+0000","last_peered":"2024-04-26T23:46:34.171972+0000","last_clean":"2024-04-26T23:46:34.171972+0000","last_became_active":"2024-04-26T23:46:34.165705+0000","last_became_peered":"2024-04-26T23:46:34.165705+0000","last_unstale":"2024-04-26T23:46:34.171972+0000","last_undegraded":"2024-04-26T23:46:34.171972+0000","last_fullsized":"2024-04-26T23:46:34.171972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:17:43.245922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167478+0000","last_change":"2024-04-26T23:46:34.167478+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167478+0000","last_undegraded":"2024-04-26T23:46:34.167478+0000","last_fullsized":"2024-04-26T23:46:34.167478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186054+0000","last_change":"2024-04-26T23:46:34.173170+0000","last_active":"2024-04-26T23:46:34.186054+0000","last_peered":"2024-04-26T23:46:34.186054+0000","last_clean":"2024-04-26T23:46:34.186054+0000","last_became_active":"2024-04-26T23:46:34.172917+0000","last_became_peered":"2024-04-26T23:46:34.172917+0000","last_unstale":"2024-04-26T23:46:34.186054+0000","last_undegraded":"2024-04-26T23:46:34.186054+0000","last_fullsized":"2024-04-26T23:46:34.186054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.167368+0000","last_change":"2024-04-26T23:46:34.167368+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.167368+0000","last_undegraded":"2024-04-26T23:46:34.167368+0000","last_fullsized":"2024-04-26T23:46:34.167368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184693+0000","last_change":"2024-04-26T23:46:34.179239+0000","last_active":"2024-04-26T23:46:34.184693+0000","last_peered":"2024-04-26T23:46:34.184693+0000","last_clean":"2024-04-26T23:46:34.184693+0000","last_became_active":"2024-04-26T23:46:34.178903+0000","last_became_peered":"2024-04-26T23:46:34.178903+0000","last_unstale":"2024-04-26T23:46:34.184693+0000","last_undegraded":"2024-04-26T23:46:34.184693+0000","last_fullsized":"2024-04-26T23:46:34.184693+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:59.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160224+0000","last_change":"2024-04-26T23:46:34.160224+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160224+0000","last_undegraded":"2024-04-26T23:46:34.160224+0000","last_fullsized":"2024-04-26T23:46:34.160224+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.188048+0000","last_change":"2024-04-26T23:46:34.186295+0000","last_active":"2024-04-26T23:46:34.188048+0000","last_peered":"2024-04-26T23:46:34.188048+0000","last_clean":"2024-04-26T23:46:34.188048+0000","last_became_active":"2024-04-26T23:46:34.186014+0000","last_became_peered":"2024-04-26T23:46:34.186014+0000","last_unstale":"2024-04-26T23:46:34.188048+0000","last_undegraded":"2024-04-26T23:46:34.188048+0000","last_fullsized":"2024-04-26T23:46:34.188048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:30.093195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162935+0000","last_change":"2024-04-26T23:46:34.162935+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162935+0000","last_undegraded":"2024-04-26T23:46:34.162935+0000","last_fullsized":"2024-04-26T23:46:34.162935+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186304+0000","last_change":"2024-04-26T23:46:34.180474+0000","last_active":"2024-04-26T23:46:34.186304+0000","last_peered":"2024-04-26T23:46:34.186304+0000","last_clean":"2024-04-26T23:46:34.186304+0000","last_became_active":"2024-04-26T23:46:34.180195+0000","last_became_peered":"2024-04-26T23:46:34.180195+0000","last_unstale":"2024-04-26T23:46:34.186304+0000","last_undegraded":"2024-04-26T23:46:34.186304+0000","last_fullsized":"2024-04-26T23:46:34.186304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:31.072186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.157176+0000","last_change":"2024-04-26T23:46:34.157176+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.157176+0000","last_undegraded":"2024-04-26T23:46:34.157176+0000","last_fullsized":"2024-04-26T23:46:34.157176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175236+0000","last_change":"2024-04-26T23:46:34.171710+0000","last_active":"2024-04-26T23:46:34.175236+0000","last_peered":"2024-04-26T23:46:34.175236+0000","last_clean":"2024-04-26T23:46:34.175236+0000","last_became_active":"2024-04-26T23:46:34.171422+0000","last_became_peered":"2024-04-26T23:46:34.171422+0000","last_unstale":"2024-04-26T23:46:34.175236+0000","last_undegraded":"2024-04-26T23:46:34.175236+0000","last_fullsized":"2024-04-26T23:46:34.175236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:52:49.894347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.159624+0000","last_change":"2024-04-26T23:46:34.159624+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.159624+0000","last_undegraded":"2024-04-26T23:46:34.159624+0000","last_fullsized":"2024-04-26T23:46:34.159624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175284+0000","last_change":"2024-04-26T23:46:34.173257+0000","last_active":"2024-04-26T23:46:34.175284+0000","last_peered":"2024-04-26T23:46:34.175284+0000","last_clean":"2024-04-26T23:46:34.175284+0000","last_became_active":"2024-04-26T23:46:34.172921+0000","last_became_peered":"2024-04-26T23:46:34.172921+0000","last_unstale":"2024-04-26T23:46:34.175284+0000","last_undegraded":"2024-04-26T23:46:34.175284+0000","last_fullsized":"2024-04-26T23:46:34.175284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:04:27.275026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164196+0000","last_change":"2024-04-26T23:46:34.164196+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164196+0000","last_undegraded":"2024-04-26T23:46:34.164196+0000","last_fullsized":"2024-04-26T23:46:34.164196+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181672+0000","last_change":"2024-04-26T23:46:34.178125+0000","last_active":"2024-04-26T23:46:34.181672+0000","last_peered":"2024-04-26T23:46:34.181672+0000","last_clean":"2024-04-26T23:46:34.181672+0000","last_became_active":"2024-04-26T23:46:34.177837+0000","last_became_peered":"2024-04-26T23:46:34.177837+0000","last_unstale":"2024-04-26T23:46:34.181672+0000","last_undegraded":"2024-04-26T23:46:34.181672+0000","last_fullsized":"2024-04-26T23:46:34.181672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:25.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.163748+0000","last_change":"2024-04-26T23:46:34.163748+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.163748+0000","last_undegraded":"2024-04-26T23:46:34.163748+0000","last_fullsized":"2024-04-26T23:46:34.163748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164590+0000","last_change":"2024-04-26T23:46:34.164590+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164590+0000","last_undegraded":"2024-04-26T23:46:34.164590+0000","last_fullsized":"2024-04-26T23:46:34.164590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.179394+0000","last_change":"2024-04-26T23:46:34.178182+0000","last_active":"2024-04-26T23:46:34.179394+0000","last_peered":"2024-04-26T23:46:34.179394+0000","last_clean":"2024-04-26T23:46:34.179394+0000","last_became_active":"2024-04-26T23:46:34.177914+0000","last_became_peered":"2024-04-26T23:46:34.177914+0000","last_unstale":"2024-04-26T23:46:34.179394+0000","last_undegraded":"2024-04-26T23:46:34.179394+0000","last_fullsized":"2024-04-26T23:46:34.179394+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164290+0000","last_change":"2024-04-26T23:46:34.164290+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164290+0000","last_undegraded":"2024-04-26T23:46:34.164290+0000","last_fullsized":"2024-04-26T23:46:34.164290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175327+0000","last_change":"2024-04-26T23:46:34.171217+0000","last_active":"2024-04-26T23:46:34.175327+0000","last_peered":"2024-04-26T23:46:34.175327+0000","last_clean":"2024-04-26T23:46:34.175327+0000","last_became_active":"2024-04-26T23:46:34.170668+0000","last_became_peered":"2024-04-26T23:46:34.170668+0000","last_unstale":"2024-04-26T23:46:34.175327+0000","last_undegraded":"2024-04-26T23:46:34.175327+0000","last_fullsized":"2024-04-26T23:46:34.175327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:41:13.695920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.166401+0000","last_change":"2024-04-26T23:46:34.166401+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.166401+0000","last_undegraded":"2024-04-26T23:46:34.166401+0000","last_fullsized":"2024-04-26T23:46:34.166401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.181678+0000","last_change":"2024-04-26T23:46:34.179422+0000","last_active":"2024-04-26T23:46:34.181678+0000","last_peered":"2024-04-26T23:46:34.181678+0000","last_clean":"2024-04-26T23:46:34.181678+0000","last_became_active":"2024-04-26T23:46:34.179130+0000","last_became_peered":"2024-04-26T23:46:34.179130+0000","last_unstale":"2024-04-26T23:46:34.181678+0000","last_undegraded":"2024-04-26T23:46:34.181678+0000","last_fullsized":"2024-04-26T23:46:34.181678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:53.287265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.164912+0000","last_change":"2024-04-26T23:46:34.164912+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.164912+0000","last_undegraded":"2024-04-26T23:46:34.164912+0000","last_fullsized":"2024-04-26T23:46:34.164912+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186289+0000","last_change":"2024-04-26T23:46:34.176531+0000","last_active":"2024-04-26T23:46:34.186289+0000","last_peered":"2024-04-26T23:46:34.186289+0000","last_clean":"2024-04-26T23:46:34.186289+0000","last_became_active":"2024-04-26T23:46:34.176220+0000","last_became_peered":"2024-04-26T23:46:34.176220+0000","last_unstale":"2024-04-26T23:46:34.186289+0000","last_undegraded":"2024-04-26T23:46:34.186289+0000","last_fullsized":"2024-04-26T23:46:34.186289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:12.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.156089+0000","last_change":"2024-04-26T23:46:34.156089+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.156089+0000","last_undegraded":"2024-04-26T23:46:34.156089+0000","last_fullsized":"2024-04-26T23:46:34.156089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.185930+0000","last_change":"2024-04-26T23:46:34.170536+0000","last_active":"2024-04-26T23:46:34.185930+0000","last_peered":"2024-04-26T23:46:34.185930+0000","last_clean":"2024-04-26T23:46:34.185930+0000","last_became_active":"2024-04-26T23:46:34.169534+0000","last_became_peered":"2024-04-26T23:46:34.169534+0000","last_unstale":"2024-04-26T23:46:34.185930+0000","last_undegraded":"2024-04-26T23:46:34.185930+0000","last_fullsized":"2024-04-26T23:46:34.185930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.160365+0000","last_change":"2024-04-26T23:46:34.160365+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.160365+0000","last_undegraded":"2024-04-26T23:46:34.160365+0000","last_fullsized":"2024-04-26T23:46:34.160365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:33.141980+0000","last_change":"2024-04-26T23:46:33.141980+0000","last_active":"2024-04-26T23:46:33.141980+0000","last_peered":"2024-04-26T23:46:33.141980+0000","last_clean":"2024-04-26T23:46:33.141980+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:33.141980+0000","last_undegraded":"2024-04-26T23:46:33.141980+0000","last_fullsized":"2024-04-26T23:46:33.141980+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:46:34.147822+0000","last_change":"2024-04-26T23:46:34.147822+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.147822+0000","last_undegraded":"2024-04-26T23:46:34.147822+0000","last_fullsized":"2024-04-26T23:46:34.147822+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.186083+0000","last_change":"2024-04-26T23:46:34.175739+0000","last_active":"2024-04-26T23:46:34.186083+0000","last_peered":"2024-04-26T23:46:34.186083+0000","last_clean":"2024-04-26T23:46:34.186083+0000","last_became_active":"2024-04-26T23:46:34.175510+0000","last_became_peered":"2024-04-26T23:46:34.175510+0000","last_unstale":"2024-04-26T23:46:34.186083+0000","last_undegraded":"2024-04-26T23:46:34.186083+0000","last_fullsized":"2024-04-26T23:46:34.186083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:32:54.994053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.161524+0000","last_change":"2024-04-26T23:46:34.161524+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.161524+0000","last_undegraded":"2024-04-26T23:46:34.161524+0000","last_fullsized":"2024-04-26T23:46:34.161524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.175307+0000","last_change":"2024-04-26T23:46:34.170955+0000","last_active":"2024-04-26T23:46:34.175307+0000","last_peered":"2024-04-26T23:46:34.175307+0000","last_clean":"2024-04-26T23:46:34.175307+0000","last_became_active":"2024-04-26T23:46:34.170342+0000","last_became_peered":"2024-04-26T23:46:34.170342+0000","last_unstale":"2024-04-26T23:46:34.175307+0000","last_undegraded":"2024-04-26T23:46:34.175307+0000","last_fullsized":"2024-04-26T23:46:34.175307+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:42.613416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.162564+0000","last_change":"2024-04-26T23:46:34.162564+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.162564+0000","last_undegraded":"2024-04-26T23:46:34.162564+0000","last_fullsized":"2024-04-26T23:46:34.162564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.184737+0000","last_change":"2024-04-26T23:46:34.179277+0000","last_active":"2024-04-26T23:46:34.184737+0000","last_peered":"2024-04-26T23:46:34.184737+0000","last_clean":"2024-04-26T23:46:34.184737+0000","last_became_active":"2024-04-26T23:46:34.178980+0000","last_became_peered":"2024-04-26T23:46:34.178980+0000","last_unstale":"2024-04-26T23:46:34.184737+0000","last_undegraded":"2024-04-26T23:46:34.184737+0000","last_fullsized":"2024-04-26T23:46:34.184737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:44.753454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-04-26T23:46:34.168175+0000","last_change":"2024-04-26T23:46:34.168175+0000","last_active":"2024-04-26T23:46:34.147822+0000","last_peered":"2024-04-26T23:46:34.147822+0000","last_clean":"2024-04-26T23:46:34.147822+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:46:34.168175+0000","last_undegraded":"2024-04-26T23:46:34.168175+0000","last_fullsized":"2024-04-26T23:46:34.168175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.177607+0000","last_change":"2024-04-26T23:46:34.176449+0000","last_active":"2024-04-26T23:46:34.177607+0000","last_peered":"2024-04-26T23:46:34.177607+0000","last_clean":"2024-04-26T23:46:34.177607+0000","last_became_active":"2024-04-26T23:46:34.176138+0000","last_became_peered":"2024-04-26T23:46:34.176138+0000","last_unstale":"2024-04-26T23:46:34.177607+0000","last_undegraded":"2024-04-26T23:46:34.177607+0000","last_fullsized":"2024-04-26T23:46:34.177607+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":188,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-26T23:46:34.172214+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:46:34.172214+0000","last_peered":"2024-04-26T23:46:34.172214+0000","last_clean":"2024-04-26T23:46:34.172214+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:46:34.172214+0000","last_undegraded":"2024-04-26T23:46:34.172214+0000","last_fullsized":"2024-04-26T23:46:34.172214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":727825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":376832,"data_stored":143724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":137457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":946176,"data_stored":722008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:46:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-26T23:46:40.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.161614+0000', 'last_change': '2024-04-26T23:46:34.161614+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.161614+0000', 'last_undegraded': '2024-04-26T23:46:34.161614+0000', 'last_fullsized': '2024-04-26T23:46:34.161614+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.177583+0000', 'last_change': '2024-04-26T23:46:34.177583+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.177583+0000', 'last_undegraded': '2024-04-26T23:46:34.177583+0000', 'last_fullsized': '2024-04-26T23:46:34.177583+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.156663+0000', 'last_change': '2024-04-26T23:46:34.156663+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.156663+0000', 'last_undegraded': '2024-04-26T23:46:34.156663+0000', 'last_fullsized': '2024-04-26T23:46:34.156663+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.163721+0000', 'last_change': '2024-04-26T23:46:34.163721+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.163721+0000', 'last_undegraded': '2024-04-26T23:46:34.163721+0000', 'last_fullsized': '2024-04-26T23:46:34.163721+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.165896+0000', 'last_change': '2024-04-26T23:46:34.165896+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.165896+0000', 'last_undegraded': '2024-04-26T23:46:34.165896+0000', 'last_fullsized': '2024-04-26T23:46:34.165896+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.175149+0000', 'last_change': '2024-04-26T23:46:34.175149+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.175149+0000', 'last_undegraded': '2024-04-26T23:46:34.175149+0000', 'last_fullsized': '2024-04-26T23:46:34.175149+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.165651+0000', 'last_change': '2024-04-26T23:46:34.165651+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.165651+0000', 'last_undegraded': '2024-04-26T23:46:34.165651+0000', 'last_fullsized': '2024-04-26T23:46:34.165651+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.168244+0000', 'last_change': '2024-04-26T23:46:34.168244+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.168244+0000', 'last_undegraded': '2024-04-26T23:46:34.168244+0000', 'last_fullsized': '2024-04-26T23:46:34.168244+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.161511+0000', 'last_change': '2024-04-26T23:46:34.161511+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.161511+0000', 'last_undegraded': '2024-04-26T23:46:34.161511+0000', 'last_fullsized': '2024-04-26T23:46:34.161511+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.163713+0000', 'last_change': '2024-04-26T23:46:34.163713+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.163713+0000', 'last_undegraded': '2024-04-26T23:46:34.163713+0000', 'last_fullsized': '2024-04-26T23:46:34.163713+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.170071+0000', 'last_change': '2024-04-26T23:46:34.170071+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.170071+0000', 'last_undegraded': '2024-04-26T23:46:34.170071+0000', 'last_fullsized': '2024-04-26T23:46:34.170071+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-26T23:46:40.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.158087+0000', 'last_change': '2024-04-26T23:46:34.158087+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.158087+0000', 'last_undegraded': '2024-04-26T23:46:34.158087+0000', 'last_fullsized': '2024-04-26T23:46:34.158087+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.165351+0000', 'last_change': '2024-04-26T23:46:34.165351+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.165351+0000', 'last_undegraded': '2024-04-26T23:46:34.165351+0000', 'last_fullsized': '2024-04-26T23:46:34.165351+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.174096+0000', 'last_change': '2024-04-26T23:46:34.174096+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.174096+0000', 'last_undegraded': '2024-04-26T23:46:34.174096+0000', 'last_fullsized': '2024-04-26T23:46:34.174096+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.156020+0000', 'last_change': '2024-04-26T23:46:34.156020+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.156020+0000', 'last_undegraded': '2024-04-26T23:46:34.156020+0000', 'last_fullsized': '2024-04-26T23:46:34.156020+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.165834+0000', 'last_change': '2024-04-26T23:46:34.165834+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.165834+0000', 'last_undegraded': '2024-04-26T23:46:34.165834+0000', 'last_fullsized': '2024-04-26T23:46:34.165834+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.167694+0000', 'last_change': '2024-04-26T23:46:34.167694+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.167694+0000', 'last_undegraded': '2024-04-26T23:46:34.167694+0000', 'last_fullsized': '2024-04-26T23:46:34.167694+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-26T23:46:40.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.173980+0000', 'last_change': '2024-04-26T23:46:34.173980+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.173980+0000', 'last_undegraded': '2024-04-26T23:46:34.173980+0000', 'last_fullsized': '2024-04-26T23:46:34.173980+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.175531+0000', 'last_change': '2024-04-26T23:46:34.175531+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.175531+0000', 'last_undegraded': '2024-04-26T23:46:34.175531+0000', 'last_fullsized': '2024-04-26T23:46:34.175531+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.165096+0000', 'last_change': '2024-04-26T23:46:34.165096+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.165096+0000', 'last_undegraded': '2024-04-26T23:46:34.165096+0000', 'last_fullsized': '2024-04-26T23:46:34.165096+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.161893+0000', 'last_change': '2024-04-26T23:46:34.161893+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.161893+0000', 'last_undegraded': '2024-04-26T23:46:34.161893+0000', 'last_fullsized': '2024-04-26T23:46:34.161893+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.159667+0000', 'last_change': '2024-04-26T23:46:34.159667+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.159667+0000', 'last_undegraded': '2024-04-26T23:46:34.159667+0000', 'last_fullsized': '2024-04-26T23:46:34.159667+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:34.147822+0000', 'last_change': '2024-04-26T23:46:34.147822+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.147822+0000', 'last_undegraded': '2024-04-26T23:46:34.147822+0000', 'last_fullsized': '2024-04-26T23:46:34.147822+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.156027+0000', 'last_change': '2024-04-26T23:46:34.156027+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.156027+0000', 'last_undegraded': '2024-04-26T23:46:34.156027+0000', 'last_fullsized': '2024-04-26T23:46:34.156027+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.166901+0000', 'last_change': '2024-04-26T23:46:34.166901+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.166901+0000', 'last_undegraded': '2024-04-26T23:46:34.166901+0000', 'last_fullsized': '2024-04-26T23:46:34.166901+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.172216+0000', 'last_change': '2024-04-26T23:46:34.172216+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.172216+0000', 'last_undegraded': '2024-04-26T23:46:34.172216+0000', 'last_fullsized': '2024-04-26T23:46:34.172216+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.160044+0000', 'last_change': '2024-04-26T23:46:34.160044+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.160044+0000', 'last_undegraded': '2024-04-26T23:46:34.160044+0000', 'last_fullsized': '2024-04-26T23:46:34.160044+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.157626+0000', 'last_change': '2024-04-26T23:46:34.157626+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.157626+0000', 'last_undegraded': '2024-04-26T23:46:34.157626+0000', 'last_fullsized': '2024-04-26T23:46:34.157626+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.161360+0000', 'last_change': '2024-04-26T23:46:34.161360+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.161360+0000', 'last_undegraded': '2024-04-26T23:46:34.161360+0000', 'last_fullsized': '2024-04-26T23:46:34.161360+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.166188+0000', 'last_change': '2024-04-26T23:46:34.166188+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.166188+0000', 'last_undegraded': '2024-04-26T23:46:34.166188+0000', 'last_fullsized': '2024-04-26T23:46:34.166188+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.160799+0000', 'last_change': '2024-04-26T23:46:34.160799+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.160799+0000', 'last_undegraded': '2024-04-26T23:46:34.160799+0000', 'last_fullsized': '2024-04-26T23:46:34.160799+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.167805+0000', 'last_change': '2024-04-26T23:46:34.167805+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.167805+0000', 'last_undegraded': '2024-04-26T23:46:34.167805+0000', 'last_fullsized': '2024-04-26T23:46:34.167805+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:34.147822+0000', 'last_change': '2024-04-26T23:46:34.147822+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.147822+0000', 'last_undegraded': '2024-04-26T23:46:34.147822+0000', 'last_fullsized': '2024-04-26T23:46:34.147822+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.161088+0000', 'last_change': '2024-04-26T23:46:34.161088+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.161088+0000', 'last_undegraded': '2024-04-26T23:46:34.161088+0000', 'last_fullsized': '2024-04-26T23:46:34.161088+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-26T23:46:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:33.141980+0000', 'last_change': '2024-04-26T23:46:33.141980+0000', 'last_active': '2024-04-26T23:46:33.141980+0000', 'last_peered': '2024-04-26T23:46:33.141980+0000', 'last_clean': '2024-04-26T23:46:33.141980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:33.141980+0000', 'last_undegraded': '2024-04-26T23:46:33.141980+0000', 'last_fullsized': '2024-04-26T23:46:33.141980+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.162105+0000', 'last_change': '2024-04-26T23:46:34.162105+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.162105+0000', 'last_undegraded': '2024-04-26T23:46:34.162105+0000', 'last_fullsized': '2024-04-26T23:46:34.162105+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.159503+0000', 'last_change': '2024-04-26T23:46:34.159503+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.159503+0000', 'last_undegraded': '2024-04-26T23:46:34.159503+0000', 'last_fullsized': '2024-04-26T23:46:34.159503+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.165465+0000', 'last_change': '2024-04-26T23:46:34.165465+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.165465+0000', 'last_undegraded': '2024-04-26T23:46:34.165465+0000', 'last_fullsized': '2024-04-26T23:46:34.165465+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.156199+0000', 'last_change': '2024-04-26T23:46:34.156199+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.156199+0000', 'last_undegraded': '2024-04-26T23:46:34.156199+0000', 'last_fullsized': '2024-04-26T23:46:34.156199+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.162949+0000', 'last_change': '2024-04-26T23:46:34.162949+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.162949+0000', 'last_undegraded': '2024-04-26T23:46:34.162949+0000', 'last_fullsized': '2024-04-26T23:46:34.162949+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-26T23:46:40.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.159251+0000', 'last_change': '2024-04-26T23:46:34.159251+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.159251+0000', 'last_undegraded': '2024-04-26T23:46:34.159251+0000', 'last_fullsized': '2024-04-26T23:46:34.159251+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.157309+0000', 'last_change': '2024-04-26T23:46:34.157309+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.157309+0000', 'last_undegraded': '2024-04-26T23:46:34.157309+0000', 'last_fullsized': '2024-04-26T23:46:34.157309+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.170777+0000', 'last_change': '2024-04-26T23:46:34.170777+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.170777+0000', 'last_undegraded': '2024-04-26T23:46:34.170777+0000', 'last_fullsized': '2024-04-26T23:46:34.170777+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:33.141980+0000', 'last_change': '2024-04-26T23:46:33.141980+0000', 'last_active': '2024-04-26T23:46:33.141980+0000', 'last_peered': '2024-04-26T23:46:33.141980+0000', 'last_clean': '2024-04-26T23:46:33.141980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:33.141980+0000', 'last_undegraded': '2024-04-26T23:46:33.141980+0000', 'last_fullsized': '2024-04-26T23:46:33.141980+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.171721+0000', 'last_change': '2024-04-26T23:46:34.171721+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.171721+0000', 'last_undegraded': '2024-04-26T23:46:34.171721+0000', 'last_fullsized': '2024-04-26T23:46:34.171721+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.157318+0000', 'last_change': '2024-04-26T23:46:34.157318+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.157318+0000', 'last_undegraded': '2024-04-26T23:46:34.157318+0000', 'last_fullsized': '2024-04-26T23:46:34.157318+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.160482+0000', 'last_change': '2024-04-26T23:46:34.160482+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.160482+0000', 'last_undegraded': '2024-04-26T23:46:34.160482+0000', 'last_fullsized': '2024-04-26T23:46:34.160482+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.167478+0000', 'last_change': '2024-04-26T23:46:34.167478+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.167478+0000', 'last_undegraded': '2024-04-26T23:46:34.167478+0000', 'last_fullsized': '2024-04-26T23:46:34.167478+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.167368+0000', 'last_change': '2024-04-26T23:46:34.167368+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.167368+0000', 'last_undegraded': '2024-04-26T23:46:34.167368+0000', 'last_fullsized': '2024-04-26T23:46:34.167368+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.160224+0000', 'last_change': '2024-04-26T23:46:34.160224+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.160224+0000', 'last_undegraded': '2024-04-26T23:46:34.160224+0000', 'last_fullsized': '2024-04-26T23:46:34.160224+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.162935+0000', 'last_change': '2024-04-26T23:46:34.162935+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.162935+0000', 'last_undegraded': '2024-04-26T23:46:34.162935+0000', 'last_fullsized': '2024-04-26T23:46:34.162935+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-26T23:46:40.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.157176+0000', 'last_change': '2024-04-26T23:46:34.157176+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.157176+0000', 'last_undegraded': '2024-04-26T23:46:34.157176+0000', 'last_fullsized': '2024-04-26T23:46:34.157176+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.159624+0000', 'last_change': '2024-04-26T23:46:34.159624+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.159624+0000', 'last_undegraded': '2024-04-26T23:46:34.159624+0000', 'last_fullsized': '2024-04-26T23:46:34.159624+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.164196+0000', 'last_change': '2024-04-26T23:46:34.164196+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.164196+0000', 'last_undegraded': '2024-04-26T23:46:34.164196+0000', 'last_fullsized': '2024-04-26T23:46:34.164196+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.163748+0000', 'last_change': '2024-04-26T23:46:34.163748+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.163748+0000', 'last_undegraded': '2024-04-26T23:46:34.163748+0000', 'last_fullsized': '2024-04-26T23:46:34.163748+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:33.141980+0000', 'last_change': '2024-04-26T23:46:33.141980+0000', 'last_active': '2024-04-26T23:46:33.141980+0000', 'last_peered': '2024-04-26T23:46:33.141980+0000', 'last_clean': '2024-04-26T23:46:33.141980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:33.141980+0000', 'last_undegraded': '2024-04-26T23:46:33.141980+0000', 'last_fullsized': '2024-04-26T23:46:33.141980+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.164590+0000', 'last_change': '2024-04-26T23:46:34.164590+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.164590+0000', 'last_undegraded': '2024-04-26T23:46:34.164590+0000', 'last_fullsized': '2024-04-26T23:46:34.164590+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-26T23:46:40.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.164290+0000', 'last_change': '2024-04-26T23:46:34.164290+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.164290+0000', 'last_undegraded': '2024-04-26T23:46:34.164290+0000', 'last_fullsized': '2024-04-26T23:46:34.164290+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.166401+0000', 'last_change': '2024-04-26T23:46:34.166401+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.166401+0000', 'last_undegraded': '2024-04-26T23:46:34.166401+0000', 'last_fullsized': '2024-04-26T23:46:34.166401+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.164912+0000', 'last_change': '2024-04-26T23:46:34.164912+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.164912+0000', 'last_undegraded': '2024-04-26T23:46:34.164912+0000', 'last_fullsized': '2024-04-26T23:46:34.164912+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.156089+0000', 'last_change': '2024-04-26T23:46:34.156089+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.156089+0000', 'last_undegraded': '2024-04-26T23:46:34.156089+0000', 'last_fullsized': '2024-04-26T23:46:34.156089+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:33.141980+0000', 'last_change': '2024-04-26T23:46:33.141980+0000', 'last_active': '2024-04-26T23:46:33.141980+0000', 'last_peered': '2024-04-26T23:46:33.141980+0000', 'last_clean': '2024-04-26T23:46:33.141980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:33.141980+0000', 'last_undegraded': '2024-04-26T23:46:33.141980+0000', 'last_fullsized': '2024-04-26T23:46:33.141980+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:34.147822+0000', 'last_change': '2024-04-26T23:46:34.147822+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.147822+0000', 'last_undegraded': '2024-04-26T23:46:34.147822+0000', 'last_fullsized': '2024-04-26T23:46:34.147822+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.160365+0000', 'last_change': '2024-04-26T23:46:34.160365+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.160365+0000', 'last_undegraded': '2024-04-26T23:46:34.160365+0000', 'last_fullsized': '2024-04-26T23:46:34.160365+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:33.141980+0000', 'last_change': '2024-04-26T23:46:33.141980+0000', 'last_active': '2024-04-26T23:46:33.141980+0000', 'last_peered': '2024-04-26T23:46:33.141980+0000', 'last_clean': '2024-04-26T23:46:33.141980+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:33.141980+0000', 'last_undegraded': '2024-04-26T23:46:33.141980+0000', 'last_fullsized': '2024-04-26T23:46:33.141980+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:33.141980+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:46:34.147822+0000', 'last_change': '2024-04-26T23:46:34.147822+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.147822+0000', 'last_undegraded': '2024-04-26T23:46:34.147822+0000', 'last_fullsized': '2024-04-26T23:46:34.147822+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.161524+0000', 'last_change': '2024-04-26T23:46:34.161524+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.161524+0000', 'last_undegraded': '2024-04-26T23:46:34.161524+0000', 'last_fullsized': '2024-04-26T23:46:34.161524+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.162564+0000', 'last_change': '2024-04-26T23:46:34.162564+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.162564+0000', 'last_undegraded': '2024-04-26T23:46:34.162564+0000', 'last_fullsized': '2024-04-26T23:46:34.162564+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-26T23:46:40.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:46:34.168175+0000', 'last_change': '2024-04-26T23:46:34.168175+0000', 'last_active': '2024-04-26T23:46:34.147822+0000', 'last_peered': '2024-04-26T23:46:34.147822+0000', 'last_clean': '2024-04-26T23:46:34.147822+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:46:34.168175+0000', 'last_undegraded': '2024-04-26T23:46:34.168175+0000', 'last_fullsized': '2024-04-26T23:46:34.168175+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'last_clean_scrub_stamp': '2024-04-26T23:46:34.147822+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:46:40.119 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T23:46:40.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.276+0000 7fd24ec00640 1 Processor -- start 2024-04-26T23:46:40.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd24ec00640 1 -- start start 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd24ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24809c170 0x7fd2480d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd24ec00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd248070390 0x7fd248070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd24ec00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2480d2340 con 0x7fd24806f0a0 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd24ec00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd2480cf350 con 0x7fd248070390 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd24ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd2480cd580 con 0x7fd24809c170 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd247e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd24806f0a0 0x7fd24809ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59748/0 (socket says 172.21.15.47:59748) 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd247e00640 1 -- 172.21.15.47:0/4247050636 learned_addr learned my addr 172.21.15.47:0/4247050636 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd23f400640 1 --2- 172.21.15.47:0/4247050636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24809c170 0x7fd2480d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd24cc00640 1 --2- 172.21.15.47:0/4247050636 >> v2:172.21.15.203:3300/0 conn(0x7fd248070390 0x7fd248070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd247400640 1 -- 172.21.15.47:0/4247050636 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182088202 0 0) 0x7fd2480d2340 con 0x7fd24806f0a0 2024-04-26T23:46:40.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd247400640 1 -- 172.21.15.47:0/4247050636 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd22c003530 con 0x7fd24806f0a0 2024-04-26T23:46:40.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd247400640 1 -- 172.21.15.47:0/4247050636 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1900264981 0 0) 0x7fd22c003530 con 0x7fd24806f0a0 2024-04-26T23:46:40.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd23f400640 1 -- 172.21.15.47:0/4247050636 >> v2:172.21.15.203:3300/0 conn(0x7fd248070390 msgr2=0x7fd248070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:40.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd23f400640 1 --2- 172.21.15.47:0/4247050636 >> v2:172.21.15.203:3300/0 conn(0x7fd248070390 0x7fd248070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd23f400640 1 -- 172.21.15.47:0/4247050636 >> v1:172.21.15.47:6789/0 conn(0x7fd24806f0a0 legacy=0x7fd24809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.280+0000 7fd23f400640 1 -- 172.21.15.47:0/4247050636 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2480cd860 con 0x7fd24809c170 2024-04-26T23:46:40.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd23f400640 1 --2- 172.21.15.47:0/4247050636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24809c170 0x7fd2480d0fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097c0 tx=0x7fd23001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7298d5ab558643de server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:40.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd247400640 1 -- 172.21.15.47:0/4247050636 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2300b0070 con 0x7fd24809c170 2024-04-26T23:46:40.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd247400640 1 -- 172.21.15.47:0/4247050636 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2300ab400 con 0x7fd24809c170 2024-04-26T23:46:40.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd247400640 1 -- 172.21.15.47:0/4247050636 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238001680 con 0x7fd24809c170 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 -- 172.21.15.47:0/4247050636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24809c170 msgr2=0x7fd2480d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 --2- 172.21.15.47:0/4247050636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24809c170 0x7fd2480d0fb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd2300097c0 tx=0x7fd23001c3c0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 -- 172.21.15.47:0/4247050636 shutdown_connections 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 --2- 172.21.15.47:0/4247050636 >> v2:172.21.15.203:3300/0 conn(0x7fd248070390 0x7fd248070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 --2- 172.21.15.47:0/4247050636 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24809c170 0x7fd2480d0fb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 -- 172.21.15.47:0/4247050636 >> 172.21.15.47:0/4247050636 conn(0x7fd2480d2e90 msgr2=0x7fd2480d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 -- 172.21.15.47:0/4247050636 shutdown_connections 2024-04-26T23:46:40.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 -- 172.21.15.47:0/4247050636 wait complete. 2024-04-26T23:46:40.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 Processor -- start 2024-04-26T23:46:40.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.284+0000 7fd24ec00640 1 -- start start 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24806f0a0 0x7fd2481563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd248070390 0x7fd248169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd24809c170 0x7fd2480b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd2480d2120 con 0x7fd248070390 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd2480d1fa0 con 0x7fd24809c170 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd24806d510 con 0x7fd24806f0a0 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd248070390 0x7fd248169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd248070390 0x7fd248169750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38660/0 (socket says 172.21.15.47:38660) 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 -- 172.21.15.47:0/1073328914 learned_addr learned my addr 172.21.15.47:0/1073328914 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:40.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd247e00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24806f0a0 0x7fd2481563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24cc00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd24809c170 0x7fd2480b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 -- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24806f0a0 msgr2=0x7fd2481563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24806f0a0 0x7fd2481563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 -- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd24809c170 msgr2=0x7fd2480b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd24809c170 0x7fd2480b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 -- 172.21.15.47:0/1073328914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2480c7aa0 con 0x7fd248070390 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24cc00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd24809c170 0x7fd2480b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:40.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd23f400640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd248070390 0x7fd248169750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd23001cc60 tx=0x7fd230019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:40.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd244c00640 1 -- 172.21.15.47:0/1073328914 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2300b0040 con 0x7fd248070390 2024-04-26T23:46:40.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd244c00640 1 -- 172.21.15.47:0/1073328914 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2300be070 con 0x7fd248070390 2024-04-26T23:46:40.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2480c7d80 con 0x7fd248070390 2024-04-26T23:46:40.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd244c00640 1 -- 172.21.15.47:0/1073328914 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2300b7660 con 0x7fd248070390 2024-04-26T23:46:40.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2480c8340 con 0x7fd248070390 2024-04-26T23:46:40.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.288+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd248069700 con 0x7fd248070390 2024-04-26T23:46:40.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.292+0000 7fd244c00640 1 -- 172.21.15.47:0/1073328914 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2300b3040 con 0x7fd248070390 2024-04-26T23:46:40.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.292+0000 7fd244c00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd224068380 0x7fd22406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.292+0000 7fd244c00640 1 -- 172.21.15.47:0/1073328914 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fd230120c90 con 0x7fd248070390 2024-04-26T23:46:40.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.292+0000 7fd247e00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd224068380 0x7fd22406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.292+0000 7fd247e00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd224068380 0x7fd22406a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd238007950 tx=0x7fd238009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:40.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.296+0000 7fd244c00640 1 -- 172.21.15.47:0/1073328914 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd230015fb0 con 0x7fd248070390 2024-04-26T23:46:40.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd2480b1620 con 0x7fd248070390 2024-04-26T23:46:40.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd244c00640 1 -- 172.21.15.47:0/1073328914 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1173 (secure 0 0 0) 0x7fd2300f1240 con 0x7fd248070390 2024-04-26T23:46:40.527 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:40.527 INFO:teuthology.orchestra.run.smithi047.stdout:{"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":36,"num_osds":8,"num_up_osds":8,"osd_up_since":1714175118,"num_in_osds":8,"osd_in_since":1714175109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":242851840,"bytes_avail":772851261440,"bytes_total":773094113280,"write_bytes_sec":2382,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5301}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-04-26T23:46:28.167275+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd224068380 msgr2=0x7fd22406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd224068380 0x7fd22406a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd238007950 tx=0x7fd238009040 comp rx=0 tx=0).stop 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd248070390 msgr2=0x7fd248169750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd248070390 0x7fd248169750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd23001cc60 tx=0x7fd230019160 comp rx=0 tx=0).stop 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 shutdown_connections 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd224068380 0x7fd22406a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd24809c170 0x7fd2480b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd248070390 0x7fd248169750 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 --2- 172.21.15.47:0/1073328914 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd24806f0a0 0x7fd2481563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 >> 172.21.15.47:0/1073328914 conn(0x7fd2480d2e90 msgr2=0x7fd2480d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 shutdown_connections 2024-04-26T23:46:40.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.520+0000 7fd24ec00640 1 -- 172.21.15.47:0/1073328914 wait complete. 2024-04-26T23:46:40.548 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T23:46:40.548 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:46:40.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a3c00640 1 Processor -- start 2024-04-26T23:46:40.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a3c00640 1 -- start start 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a3c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 0x7fc59c15da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a3c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc59c0cdc00 0x7fc59c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a3c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc59c15e050 con 0x7fc59c0b4360 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a3c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc59c15e330 con 0x7fc59c0cdc00 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a3c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc59c0ceda0 con 0x7fc59c15d5b0 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a1200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc59c0b4360 0x7fc59c0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59750/0 (socket says 172.21.15.47:59750) 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a1200640 1 -- 172.21.15.47:0/2508144377 learned_addr learned my addr 172.21.15.47:0/2508144377 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:40.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a1c00640 1 --2- 172.21.15.47:0/2508144377 >> v2:172.21.15.47:3300/0 conn(0x7fc59c0cdc00 0x7fc59c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc59be00640 1 -- 172.21.15.47:0/2508144377 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866174950 0 0) 0x7fc59c15e050 con 0x7fc59c0b4360 2024-04-26T23:46:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc59be00640 1 -- 172.21.15.47:0/2508144377 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc580003530 con 0x7fc59c0b4360 2024-04-26T23:46:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a1c00640 1 -- 172.21.15.47:0/2508144377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 msgr2=0x7fc59c15da40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T23:46:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a1c00640 1 --2- 172.21.15.47:0/2508144377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 0x7fc59c15da40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a1c00640 1 -- 172.21.15.47:0/2508144377 >> v1:172.21.15.47:6789/0 conn(0x7fc59c0b4360 legacy=0x7fc59c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.680+0000 7fc5a1c00640 1 -- 172.21.15.47:0/2508144377 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c0cf080 con 0x7fc59c0cdc00 2024-04-26T23:46:40.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a1c00640 1 --2- 172.21.15.47:0/2508144377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c0ce0b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc594009d90 tx=0x7fc59401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9db0ba9304b9545 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc59be00640 1 -- 172.21.15.47:0/2508144377 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940b2070 con 0x7fc59c0cdc00 2024-04-26T23:46:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc59be00640 1 -- 172.21.15.47:0/2508144377 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5940a5850 con 0x7fc59c0cdc00 2024-04-26T23:46:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc59be00640 1 -- 172.21.15.47:0/2508144377 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5940a5c20 con 0x7fc59c0cdc00 2024-04-26T23:46:40.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 -- 172.21.15.47:0/2508144377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 msgr2=0x7fc59c0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/2508144377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c0ce0b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc594009d90 tx=0x7fc59401c990 comp rx=0 tx=0).stop 2024-04-26T23:46:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 -- 172.21.15.47:0/2508144377 shutdown_connections 2024-04-26T23:46:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/2508144377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c0ce0b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/2508144377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 0x7fc59c15da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 -- 172.21.15.47:0/2508144377 >> 172.21.15.47:0/2508144377 conn(0x7fc59c06c800 msgr2=0x7fc59c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 -- 172.21.15.47:0/2508144377 shutdown_connections 2024-04-26T23:46:40.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.684+0000 7fc5a3c00640 1 -- 172.21.15.47:0/2508144377 wait complete. 2024-04-26T23:46:40.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 Processor -- start 2024-04-26T23:46:40.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 -- start start 2024-04-26T23:46:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc59c0b4360 0x7fc59c155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 0x7fc59c140a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c169f40 con 0x7fc59c0cdc00 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc59c15f190 con 0x7fc59c0b4360 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc59c16a0c0 con 0x7fc59c15d5b0 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38670/0 (socket says 172.21.15.47:38670) 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 -- 172.21.15.47:0/1253132404 learned_addr learned my addr 172.21.15.47:0/1253132404 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a1200640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc59c0b4360 0x7fc59c155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a1c00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 0x7fc59c140a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 -- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 msgr2=0x7fc59c140a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 0x7fc59c140a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 -- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc59c0b4360 msgr2=0x7fc59c155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc59c0b4360 0x7fc59c155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 -- 172.21.15.47:0/1253132404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59c13f0f0 con 0x7fc59c0cdc00 2024-04-26T23:46:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc593e00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c140520 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc58400b3c0 tx=0x7fc58400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc599600640 1 -- 172.21.15.47:0/1253132404 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584005d40 con 0x7fc59c0cdc00 2024-04-26T23:46:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc599600640 1 -- 172.21.15.47:0/1253132404 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc584016070 con 0x7fc59c0cdc00 2024-04-26T23:46:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc599600640 1 -- 172.21.15.47:0/1253132404 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584006250 con 0x7fc59c0cdc00 2024-04-26T23:46:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc59c142900 con 0x7fc59c0cdc00 2024-04-26T23:46:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc59c161580 con 0x7fc59c0cdc00 2024-04-26T23:46:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.688+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59c069700 con 0x7fc59c0cdc00 2024-04-26T23:46:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.692+0000 7fc599600640 1 -- 172.21.15.47:0/1253132404 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5840063f0 con 0x7fc59c0cdc00 2024-04-26T23:46:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.692+0000 7fc599600640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc578068380 0x7fc57806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.692+0000 7fc599600640 1 -- 172.21.15.47:0/1253132404 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fc584086720 con 0x7fc59c0cdc00 2024-04-26T23:46:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.692+0000 7fc5a1200640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc578068380 0x7fc57806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.692+0000 7fc5a1200640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc578068380 0x7fc57806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc58c005890 tx=0x7fc58c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:40.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.696+0000 7fc599600640 1 -- 172.21.15.47:0/1253132404 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc584056c40 con 0x7fc59c0cdc00 2024-04-26T23:46:40.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.856+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc59c143c80 con 0x7fc578068380 2024-04-26T23:46:40.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc599600640 1 -- 172.21.15.47:0/1253132404 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251951 (secure 0 0 0) 0x7fc59c143c80 con 0x7fc578068380 2024-04-26T23:46:40.874 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:40.876 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc578068380 msgr2=0x7fc57806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc578068380 0x7fc57806a840 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc58c005890 tx=0x7fc58c009040 comp rx=0 tx=0).stop 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 msgr2=0x7fc59c140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c140520 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc58400b3c0 tx=0x7fc58400b880 comp rx=0 tx=0).stop 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 shutdown_connections 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc578068380 0x7fc57806a840 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc59c15d5b0 0x7fc59c140a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc59c0cdc00 0x7fc59c140520 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 --2- 172.21.15.47:0/1253132404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc59c0b4360 0x7fc59c155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 >> 172.21.15.47:0/1253132404 conn(0x7fc59c06c800 msgr2=0x7fc59c0cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:40.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 shutdown_connections 2024-04-26T23:46:40.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:40.868+0000 7fc5a3c00640 1 -- 172.21.15.47:0/1253132404 wait complete. 2024-04-26T23:46:40.895 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-26T23:46:40.170074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237160,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737560,"statfs":{"total":773094113280,"available":772851261440,"internally_reserved":0,"allocated":4464640,"data_stored":2439948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.016392"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545703+0000","last_change":"2024-04-26T23:46:35.190712+0000","last_active":"2024-04-26T23:46:36.545703+0000","last_peered":"2024-04-26T23:46:36.545703+0000","last_clean":"2024-04-26T23:46:36.545703+0000","last_became_active":"2024-04-26T23:46:35.190424+0000","last_became_peered":"2024-04-26T23:46:35.190424+0000","last_unstale":"2024-04-26T23:46:36.545703+0000","last_undegraded":"2024-04-26T23:46:36.545703+0000","last_fullsized":"2024-04-26T23:46:36.545703+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:03.942682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053063+0000","last_change":"2024-04-26T23:46:35.201949+0000","last_active":"2024-04-26T23:46:38.053063+0000","last_peered":"2024-04-26T23:46:38.053063+0000","last_clean":"2024-04-26T23:46:38.053063+0000","last_became_active":"2024-04-26T23:46:35.201646+0000","last_became_peered":"2024-04-26T23:46:35.201646+0000","last_unstale":"2024-04-26T23:46:38.053063+0000","last_undegraded":"2024-04-26T23:46:38.053063+0000","last_fullsized":"2024-04-26T23:46:38.053063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:56.717980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192647+0000","last_change":"2024-04-26T23:46:35.194659+0000","last_active":"2024-04-26T23:46:36.192647+0000","last_peered":"2024-04-26T23:46:36.192647+0000","last_clean":"2024-04-26T23:46:36.192647+0000","last_became_active":"2024-04-26T23:46:35.189309+0000","last_became_peered":"2024-04-26T23:46:35.189309+0000","last_unstale":"2024-04-26T23:46:36.192647+0000","last_undegraded":"2024-04-26T23:46:36.192647+0000","last_fullsized":"2024-04-26T23:46:36.192647+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:55.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190002+0000","last_change":"2024-04-26T23:46:35.193007+0000","last_active":"2024-04-26T23:46:36.190002+0000","last_peered":"2024-04-26T23:46:36.190002+0000","last_clean":"2024-04-26T23:46:36.190002+0000","last_became_active":"2024-04-26T23:46:35.192710+0000","last_became_peered":"2024-04-26T23:46:35.192710+0000","last_unstale":"2024-04-26T23:46:36.190002+0000","last_undegraded":"2024-04-26T23:46:36.190002+0000","last_fullsized":"2024-04-26T23:46:36.190002+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:34:40.141821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548277+0000","last_change":"2024-04-26T23:46:35.193931+0000","last_active":"2024-04-26T23:46:37.548277+0000","last_peered":"2024-04-26T23:46:37.548277+0000","last_clean":"2024-04-26T23:46:37.548277+0000","last_became_active":"2024-04-26T23:46:35.193668+0000","last_became_peered":"2024-04-26T23:46:35.193668+0000","last_unstale":"2024-04-26T23:46:37.548277+0000","last_undegraded":"2024-04-26T23:46:37.548277+0000","last_fullsized":"2024-04-26T23:46:37.548277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:54.848807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052676+0000","last_change":"2024-04-26T23:46:35.184470+0000","last_active":"2024-04-26T23:46:38.052676+0000","last_peered":"2024-04-26T23:46:38.052676+0000","last_clean":"2024-04-26T23:46:38.052676+0000","last_became_active":"2024-04-26T23:46:35.184130+0000","last_became_peered":"2024-04-26T23:46:35.184130+0000","last_unstale":"2024-04-26T23:46:38.052676+0000","last_undegraded":"2024-04-26T23:46:38.052676+0000","last_fullsized":"2024-04-26T23:46:38.052676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:55.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192045+0000","last_change":"2024-04-26T23:46:35.191681+0000","last_active":"2024-04-26T23:46:36.192045+0000","last_peered":"2024-04-26T23:46:36.192045+0000","last_clean":"2024-04-26T23:46:36.192045+0000","last_became_active":"2024-04-26T23:46:35.191288+0000","last_became_peered":"2024-04-26T23:46:35.191288+0000","last_unstale":"2024-04-26T23:46:36.192045+0000","last_undegraded":"2024-04-26T23:46:36.192045+0000","last_fullsized":"2024-04-26T23:46:36.192045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:30.472463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191373+0000","last_change":"2024-04-26T23:46:35.199502+0000","last_active":"2024-04-26T23:46:36.191373+0000","last_peered":"2024-04-26T23:46:36.191373+0000","last_clean":"2024-04-26T23:46:36.191373+0000","last_became_active":"2024-04-26T23:46:35.199261+0000","last_became_peered":"2024-04-26T23:46:35.199261+0000","last_unstale":"2024-04-26T23:46:36.191373+0000","last_undegraded":"2024-04-26T23:46:36.191373+0000","last_fullsized":"2024-04-26T23:46:36.191373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:30.167198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054260+0000","last_change":"2024-04-26T23:46:35.207981+0000","last_active":"2024-04-26T23:46:38.054260+0000","last_peered":"2024-04-26T23:46:38.054260+0000","last_clean":"2024-04-26T23:46:38.054260+0000","last_became_active":"2024-04-26T23:46:35.207635+0000","last_became_peered":"2024-04-26T23:46:35.207635+0000","last_unstale":"2024-04-26T23:46:38.054260+0000","last_undegraded":"2024-04-26T23:46:38.054260+0000","last_fullsized":"2024-04-26T23:46:38.054260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:07.858089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190199+0000","last_change":"2024-04-26T23:46:35.209231+0000","last_active":"2024-04-26T23:46:36.190199+0000","last_peered":"2024-04-26T23:46:36.190199+0000","last_clean":"2024-04-26T23:46:36.190199+0000","last_became_active":"2024-04-26T23:46:35.208963+0000","last_became_peered":"2024-04-26T23:46:35.208963+0000","last_unstale":"2024-04-26T23:46:36.190199+0000","last_undegraded":"2024-04-26T23:46:36.190199+0000","last_fullsized":"2024-04-26T23:46:36.190199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:49.613237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191787+0000","last_change":"2024-04-26T23:46:35.200908+0000","last_active":"2024-04-26T23:46:36.191787+0000","last_peered":"2024-04-26T23:46:36.191787+0000","last_clean":"2024-04-26T23:46:36.191787+0000","last_became_active":"2024-04-26T23:46:35.200589+0000","last_became_peered":"2024-04-26T23:46:35.200589+0000","last_unstale":"2024-04-26T23:46:36.191787+0000","last_undegraded":"2024-04-26T23:46:36.191787+0000","last_fullsized":"2024-04-26T23:46:36.191787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:30:08.620409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192593+0000","last_change":"2024-04-26T23:46:35.194993+0000","last_active":"2024-04-26T23:46:36.192593+0000","last_peered":"2024-04-26T23:46:36.192593+0000","last_clean":"2024-04-26T23:46:36.192593+0000","last_became_active":"2024-04-26T23:46:35.194708+0000","last_became_peered":"2024-04-26T23:46:35.194708+0000","last_unstale":"2024-04-26T23:46:36.192593+0000","last_undegraded":"2024-04-26T23:46:36.192593+0000","last_fullsized":"2024-04-26T23:46:36.192593+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:15:22.887219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548441+0000","last_change":"2024-04-26T23:46:35.205067+0000","last_active":"2024-04-26T23:46:37.548441+0000","last_peered":"2024-04-26T23:46:37.548441+0000","last_clean":"2024-04-26T23:46:37.548441+0000","last_became_active":"2024-04-26T23:46:35.204430+0000","last_became_peered":"2024-04-26T23:46:35.204430+0000","last_unstale":"2024-04-26T23:46:37.548441+0000","last_undegraded":"2024-04-26T23:46:37.548441+0000","last_fullsized":"2024-04-26T23:46:37.548441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:31.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052667+0000","last_change":"2024-04-26T23:46:35.197329+0000","last_active":"2024-04-26T23:46:38.052667+0000","last_peered":"2024-04-26T23:46:38.052667+0000","last_clean":"2024-04-26T23:46:38.052667+0000","last_became_active":"2024-04-26T23:46:35.197023+0000","last_became_peered":"2024-04-26T23:46:35.197023+0000","last_unstale":"2024-04-26T23:46:38.052667+0000","last_undegraded":"2024-04-26T23:46:38.052667+0000","last_fullsized":"2024-04-26T23:46:38.052667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:15:22.887219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192152+0000","last_change":"2024-04-26T23:46:35.195776+0000","last_active":"2024-04-26T23:46:36.192152+0000","last_peered":"2024-04-26T23:46:36.192152+0000","last_clean":"2024-04-26T23:46:36.192152+0000","last_became_active":"2024-04-26T23:46:35.195476+0000","last_became_peered":"2024-04-26T23:46:35.195476+0000","last_unstale":"2024-04-26T23:46:36.192152+0000","last_undegraded":"2024-04-26T23:46:36.192152+0000","last_fullsized":"2024-04-26T23:46:36.192152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:03.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191861+0000","last_change":"2024-04-26T23:46:35.196299+0000","last_active":"2024-04-26T23:46:36.191861+0000","last_peered":"2024-04-26T23:46:36.191861+0000","last_clean":"2024-04-26T23:46:36.191861+0000","last_became_active":"2024-04-26T23:46:35.195804+0000","last_became_peered":"2024-04-26T23:46:35.195804+0000","last_unstale":"2024-04-26T23:46:36.191861+0000","last_undegraded":"2024-04-26T23:46:36.191861+0000","last_fullsized":"2024-04-26T23:46:36.191861+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:15:22.887219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192120+0000","last_change":"2024-04-26T23:46:35.192517+0000","last_active":"2024-04-26T23:46:36.192120+0000","last_peered":"2024-04-26T23:46:36.192120+0000","last_clean":"2024-04-26T23:46:36.192120+0000","last_became_active":"2024-04-26T23:46:35.191746+0000","last_became_peered":"2024-04-26T23:46:35.191746+0000","last_unstale":"2024-04-26T23:46:36.192120+0000","last_undegraded":"2024-04-26T23:46:36.192120+0000","last_fullsized":"2024-04-26T23:46:36.192120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:14:02.371036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053084+0000","last_change":"2024-04-26T23:46:35.191840+0000","last_active":"2024-04-26T23:46:38.053084+0000","last_peered":"2024-04-26T23:46:38.053084+0000","last_clean":"2024-04-26T23:46:38.053084+0000","last_became_active":"2024-04-26T23:46:35.191558+0000","last_became_peered":"2024-04-26T23:46:35.191558+0000","last_unstale":"2024-04-26T23:46:38.053084+0000","last_undegraded":"2024-04-26T23:46:38.053084+0000","last_fullsized":"2024-04-26T23:46:38.053084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:13.982490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052972+0000","last_change":"2024-04-26T23:46:35.193523+0000","last_active":"2024-04-26T23:46:38.052972+0000","last_peered":"2024-04-26T23:46:38.052972+0000","last_clean":"2024-04-26T23:46:38.052972+0000","last_became_active":"2024-04-26T23:46:35.193286+0000","last_became_peered":"2024-04-26T23:46:35.193286+0000","last_unstale":"2024-04-26T23:46:38.052972+0000","last_undegraded":"2024-04-26T23:46:38.052972+0000","last_fullsized":"2024-04-26T23:46:38.052972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:53.815915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548530+0000","last_change":"2024-04-26T23:46:35.184914+0000","last_active":"2024-04-26T23:46:37.548530+0000","last_peered":"2024-04-26T23:46:37.548530+0000","last_clean":"2024-04-26T23:46:37.548530+0000","last_became_active":"2024-04-26T23:46:35.184642+0000","last_became_peered":"2024-04-26T23:46:35.184642+0000","last_unstale":"2024-04-26T23:46:37.548530+0000","last_undegraded":"2024-04-26T23:46:37.548530+0000","last_fullsized":"2024-04-26T23:46:37.548530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:31:15.948509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053750+0000","last_change":"2024-04-26T23:46:35.203971+0000","last_active":"2024-04-26T23:46:38.053750+0000","last_peered":"2024-04-26T23:46:38.053750+0000","last_clean":"2024-04-26T23:46:38.053750+0000","last_became_active":"2024-04-26T23:46:35.203745+0000","last_became_peered":"2024-04-26T23:46:35.203745+0000","last_unstale":"2024-04-26T23:46:38.053750+0000","last_undegraded":"2024-04-26T23:46:38.053750+0000","last_fullsized":"2024-04-26T23:46:38.053750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:34:40.141821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053650+0000","last_change":"2024-04-26T23:46:35.203003+0000","last_active":"2024-04-26T23:46:38.053650+0000","last_peered":"2024-04-26T23:46:38.053650+0000","last_clean":"2024-04-26T23:46:38.053650+0000","last_became_active":"2024-04-26T23:46:35.202721+0000","last_became_peered":"2024-04-26T23:46:35.202721+0000","last_unstale":"2024-04-26T23:46:38.053650+0000","last_undegraded":"2024-04-26T23:46:38.053650+0000","last_fullsized":"2024-04-26T23:46:38.053650+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:48.547701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177902+0000","last_change":"2024-04-26T23:46:35.199219+0000","last_active":"2024-04-26T23:46:37.177902+0000","last_peered":"2024-04-26T23:46:37.177902+0000","last_clean":"2024-04-26T23:46:37.177902+0000","last_became_active":"2024-04-26T23:46:35.198950+0000","last_became_peered":"2024-04-26T23:46:35.198950+0000","last_unstale":"2024-04-26T23:46:37.177902+0000","last_undegraded":"2024-04-26T23:46:37.177902+0000","last_fullsized":"2024-04-26T23:46:37.177902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:13:42.942480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191189+0000","last_change":"2024-04-26T23:46:35.184689+0000","last_active":"2024-04-26T23:46:36.191189+0000","last_peered":"2024-04-26T23:46:36.191189+0000","last_clean":"2024-04-26T23:46:36.191189+0000","last_became_active":"2024-04-26T23:46:35.184405+0000","last_became_peered":"2024-04-26T23:46:35.184405+0000","last_unstale":"2024-04-26T23:46:36.191189+0000","last_undegraded":"2024-04-26T23:46:36.191189+0000","last_fullsized":"2024-04-26T23:46:36.191189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:00.041295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190086+0000","last_change":"2024-04-26T23:46:35.196912+0000","last_active":"2024-04-26T23:46:36.190086+0000","last_peered":"2024-04-26T23:46:36.190086+0000","last_clean":"2024-04-26T23:46:36.190086+0000","last_became_active":"2024-04-26T23:46:35.196593+0000","last_became_peered":"2024-04-26T23:46:35.196593+0000","last_unstale":"2024-04-26T23:46:36.190086+0000","last_undegraded":"2024-04-26T23:46:36.190086+0000","last_fullsized":"2024-04-26T23:46:36.190086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:51.105741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053205+0000","last_change":"2024-04-26T23:46:35.184459+0000","last_active":"2024-04-26T23:46:38.053205+0000","last_peered":"2024-04-26T23:46:38.053205+0000","last_clean":"2024-04-26T23:46:38.053205+0000","last_became_active":"2024-04-26T23:46:35.182073+0000","last_became_peered":"2024-04-26T23:46:35.182073+0000","last_unstale":"2024-04-26T23:46:38.053205+0000","last_undegraded":"2024-04-26T23:46:38.053205+0000","last_fullsized":"2024-04-26T23:46:38.053205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:51.663370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190366+0000","last_change":"2024-04-26T23:46:35.190578+0000","last_active":"2024-04-26T23:46:36.190366+0000","last_peered":"2024-04-26T23:46:36.190366+0000","last_clean":"2024-04-26T23:46:36.190366+0000","last_became_active":"2024-04-26T23:46:35.190270+0000","last_became_peered":"2024-04-26T23:46:35.190270+0000","last_unstale":"2024-04-26T23:46:36.190366+0000","last_undegraded":"2024-04-26T23:46:36.190366+0000","last_fullsized":"2024-04-26T23:46:36.190366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:07.858089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192585+0000","last_change":"2024-04-26T23:46:35.204588+0000","last_active":"2024-04-26T23:46:36.192585+0000","last_peered":"2024-04-26T23:46:36.192585+0000","last_clean":"2024-04-26T23:46:36.192585+0000","last_became_active":"2024-04-26T23:46:35.204181+0000","last_became_peered":"2024-04-26T23:46:35.204181+0000","last_unstale":"2024-04-26T23:46:36.192585+0000","last_undegraded":"2024-04-26T23:46:36.192585+0000","last_fullsized":"2024-04-26T23:46:36.192585+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:30:08.620409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053804+0000","last_change":"2024-04-26T23:46:35.205771+0000","last_active":"2024-04-26T23:46:38.053804+0000","last_peered":"2024-04-26T23:46:38.053804+0000","last_clean":"2024-04-26T23:46:38.053804+0000","last_became_active":"2024-04-26T23:46:35.204646+0000","last_became_peered":"2024-04-26T23:46:35.204646+0000","last_unstale":"2024-04-26T23:46:38.053804+0000","last_undegraded":"2024-04-26T23:46:38.053804+0000","last_fullsized":"2024-04-26T23:46:38.053804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:51.105741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192153+0000","last_change":"2024-04-26T23:46:35.191273+0000","last_active":"2024-04-26T23:46:36.192153+0000","last_peered":"2024-04-26T23:46:36.192153+0000","last_clean":"2024-04-26T23:46:36.192153+0000","last_became_active":"2024-04-26T23:46:35.189990+0000","last_became_peered":"2024-04-26T23:46:35.189990+0000","last_unstale":"2024-04-26T23:46:36.192153+0000","last_undegraded":"2024-04-26T23:46:36.192153+0000","last_fullsized":"2024-04-26T23:46:36.192153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:53.815915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545561+0000","last_change":"2024-04-26T23:46:35.200085+0000","last_active":"2024-04-26T23:46:36.545561+0000","last_peered":"2024-04-26T23:46:36.545561+0000","last_clean":"2024-04-26T23:46:36.545561+0000","last_became_active":"2024-04-26T23:46:35.199809+0000","last_became_peered":"2024-04-26T23:46:35.199809+0000","last_unstale":"2024-04-26T23:46:36.545561+0000","last_undegraded":"2024-04-26T23:46:36.545561+0000","last_fullsized":"2024-04-26T23:46:36.545561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:14.254807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191503+0000","last_change":"2024-04-26T23:46:35.192529+0000","last_active":"2024-04-26T23:46:36.191503+0000","last_peered":"2024-04-26T23:46:36.191503+0000","last_clean":"2024-04-26T23:46:36.191503+0000","last_became_active":"2024-04-26T23:46:35.186590+0000","last_became_peered":"2024-04-26T23:46:35.186590+0000","last_unstale":"2024-04-26T23:46:36.191503+0000","last_undegraded":"2024-04-26T23:46:36.191503+0000","last_fullsized":"2024-04-26T23:46:36.191503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:00.041295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177991+0000","last_change":"2024-04-26T23:46:35.212650+0000","last_active":"2024-04-26T23:46:37.177991+0000","last_peered":"2024-04-26T23:46:37.177991+0000","last_clean":"2024-04-26T23:46:37.177991+0000","last_became_active":"2024-04-26T23:46:35.212352+0000","last_became_peered":"2024-04-26T23:46:35.212352+0000","last_unstale":"2024-04-26T23:46:37.177991+0000","last_undegraded":"2024-04-26T23:46:37.177991+0000","last_fullsized":"2024-04-26T23:46:37.177991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:25.037275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545775+0000","last_change":"2024-04-26T23:46:34.175419+0000","last_active":"2024-04-26T23:46:36.545775+0000","last_peered":"2024-04-26T23:46:36.545775+0000","last_clean":"2024-04-26T23:46:36.545775+0000","last_became_active":"2024-04-26T23:46:34.175127+0000","last_became_peered":"2024-04-26T23:46:34.175127+0000","last_unstale":"2024-04-26T23:46:36.545775+0000","last_undegraded":"2024-04-26T23:46:36.545775+0000","last_fullsized":"2024-04-26T23:46:36.545775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:31.072186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545764+0000","last_change":"2024-04-26T23:46:35.203025+0000","last_active":"2024-04-26T23:46:36.545764+0000","last_peered":"2024-04-26T23:46:36.545764+0000","last_clean":"2024-04-26T23:46:36.545764+0000","last_became_active":"2024-04-26T23:46:35.202771+0000","last_became_peered":"2024-04-26T23:46:35.202771+0000","last_unstale":"2024-04-26T23:46:36.545764+0000","last_undegraded":"2024-04-26T23:46:36.545764+0000","last_fullsized":"2024-04-26T23:46:36.545764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:51.107397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177987+0000","last_change":"2024-04-26T23:46:34.179522+0000","last_active":"2024-04-26T23:46:37.177987+0000","last_peered":"2024-04-26T23:46:37.177987+0000","last_clean":"2024-04-26T23:46:37.177987+0000","last_became_active":"2024-04-26T23:46:34.178898+0000","last_became_peered":"2024-04-26T23:46:34.178898+0000","last_unstale":"2024-04-26T23:46:37.177987+0000","last_undegraded":"2024-04-26T23:46:37.177987+0000","last_fullsized":"2024-04-26T23:46:37.177987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:48:28.007472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053869+0000","last_change":"2024-04-26T23:46:35.202999+0000","last_active":"2024-04-26T23:46:38.053869+0000","last_peered":"2024-04-26T23:46:38.053869+0000","last_clean":"2024-04-26T23:46:38.053869+0000","last_became_active":"2024-04-26T23:46:35.202641+0000","last_became_peered":"2024-04-26T23:46:35.202641+0000","last_unstale":"2024-04-26T23:46:38.053869+0000","last_undegraded":"2024-04-26T23:46:38.053869+0000","last_fullsized":"2024-04-26T23:46:38.053869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:40.275347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052877+0000","last_change":"2024-04-26T23:46:34.187217+0000","last_active":"2024-04-26T23:46:38.052877+0000","last_peered":"2024-04-26T23:46:38.052877+0000","last_clean":"2024-04-26T23:46:38.052877+0000","last_became_active":"2024-04-26T23:46:34.186901+0000","last_became_peered":"2024-04-26T23:46:34.186901+0000","last_unstale":"2024-04-26T23:46:38.052877+0000","last_undegraded":"2024-04-26T23:46:38.052877+0000","last_fullsized":"2024-04-26T23:46:38.052877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:53.287265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190441+0000","last_change":"2024-04-26T23:46:35.195152+0000","last_active":"2024-04-26T23:46:36.190441+0000","last_peered":"2024-04-26T23:46:36.190441+0000","last_clean":"2024-04-26T23:46:36.190441+0000","last_became_active":"2024-04-26T23:46:35.194872+0000","last_became_peered":"2024-04-26T23:46:35.194872+0000","last_unstale":"2024-04-26T23:46:36.190441+0000","last_undegraded":"2024-04-26T23:46:36.190441+0000","last_fullsized":"2024-04-26T23:46:36.190441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:34.408393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548581+0000","last_change":"2024-04-26T23:46:34.179542+0000","last_active":"2024-04-26T23:46:37.548581+0000","last_peered":"2024-04-26T23:46:37.548581+0000","last_clean":"2024-04-26T23:46:37.548581+0000","last_became_active":"2024-04-26T23:46:34.179230+0000","last_became_peered":"2024-04-26T23:46:34.179230+0000","last_unstale":"2024-04-26T23:46:37.548581+0000","last_undegraded":"2024-04-26T23:46:37.548581+0000","last_fullsized":"2024-04-26T23:46:37.548581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:25.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192288+0000","last_change":"2024-04-26T23:46:35.197627+0000","last_active":"2024-04-26T23:46:36.192288+0000","last_peered":"2024-04-26T23:46:36.192288+0000","last_clean":"2024-04-26T23:46:36.192288+0000","last_became_active":"2024-04-26T23:46:35.197349+0000","last_became_peered":"2024-04-26T23:46:35.197349+0000","last_unstale":"2024-04-26T23:46:36.192288+0000","last_undegraded":"2024-04-26T23:46:36.192288+0000","last_fullsized":"2024-04-26T23:46:36.192288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:56.717980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053873+0000","last_change":"2024-04-26T23:46:34.178810+0000","last_active":"2024-04-26T23:46:38.053873+0000","last_peered":"2024-04-26T23:46:38.053873+0000","last_clean":"2024-04-26T23:46:38.053873+0000","last_became_active":"2024-04-26T23:46:34.177743+0000","last_became_peered":"2024-04-26T23:46:34.177743+0000","last_unstale":"2024-04-26T23:46:38.053873+0000","last_undegraded":"2024-04-26T23:46:38.053873+0000","last_fullsized":"2024-04-26T23:46:38.053873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:32:54.994053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192497+0000","last_change":"2024-04-26T23:46:35.204554+0000","last_active":"2024-04-26T23:46:36.192497+0000","last_peered":"2024-04-26T23:46:36.192497+0000","last_clean":"2024-04-26T23:46:36.192497+0000","last_became_active":"2024-04-26T23:46:35.204174+0000","last_became_peered":"2024-04-26T23:46:35.204174+0000","last_unstale":"2024-04-26T23:46:36.192497+0000","last_undegraded":"2024-04-26T23:46:36.192497+0000","last_fullsized":"2024-04-26T23:46:36.192497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:15.266045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053670+0000","last_change":"2024-04-26T23:46:34.186701+0000","last_active":"2024-04-26T23:46:38.053670+0000","last_peered":"2024-04-26T23:46:38.053670+0000","last_clean":"2024-04-26T23:46:38.053670+0000","last_became_active":"2024-04-26T23:46:34.186448+0000","last_became_peered":"2024-04-26T23:46:34.186448+0000","last_unstale":"2024-04-26T23:46:38.053670+0000","last_undegraded":"2024-04-26T23:46:38.053670+0000","last_fullsized":"2024-04-26T23:46:38.053670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.842965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053492+0000","last_change":"2024-04-26T23:46:35.192096+0000","last_active":"2024-04-26T23:46:38.053492+0000","last_peered":"2024-04-26T23:46:38.053492+0000","last_clean":"2024-04-26T23:46:38.053492+0000","last_became_active":"2024-04-26T23:46:35.191748+0000","last_became_peered":"2024-04-26T23:46:35.191748+0000","last_unstale":"2024-04-26T23:46:38.053492+0000","last_undegraded":"2024-04-26T23:46:38.053492+0000","last_fullsized":"2024-04-26T23:46:38.053492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:41.001799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052434+0000","last_change":"2024-04-26T23:46:34.181576+0000","last_active":"2024-04-26T23:46:38.052434+0000","last_peered":"2024-04-26T23:46:38.052434+0000","last_clean":"2024-04-26T23:46:38.052434+0000","last_became_active":"2024-04-26T23:46:34.181279+0000","last_became_peered":"2024-04-26T23:46:34.181279+0000","last_unstale":"2024-04-26T23:46:38.052434+0000","last_undegraded":"2024-04-26T23:46:38.052434+0000","last_fullsized":"2024-04-26T23:46:38.052434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:30.110501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189807+0000","last_change":"2024-04-26T23:46:35.195635+0000","last_active":"2024-04-26T23:46:36.189807+0000","last_peered":"2024-04-26T23:46:36.189807+0000","last_clean":"2024-04-26T23:46:36.189807+0000","last_became_active":"2024-04-26T23:46:35.188492+0000","last_became_peered":"2024-04-26T23:46:35.188492+0000","last_unstale":"2024-04-26T23:46:36.189807+0000","last_undegraded":"2024-04-26T23:46:36.189807+0000","last_fullsized":"2024-04-26T23:46:36.189807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:40.275347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053426+0000","last_change":"2024-04-26T23:46:34.169490+0000","last_active":"2024-04-26T23:46:38.053426+0000","last_peered":"2024-04-26T23:46:38.053426+0000","last_clean":"2024-04-26T23:46:38.053426+0000","last_became_active":"2024-04-26T23:46:34.169205+0000","last_became_peered":"2024-04-26T23:46:34.169205+0000","last_unstale":"2024-04-26T23:46:38.053426+0000","last_undegraded":"2024-04-26T23:46:38.053426+0000","last_fullsized":"2024-04-26T23:46:38.053426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:12.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192999+0000","last_change":"2024-04-26T23:46:35.196760+0000","last_active":"2024-04-26T23:46:36.192999+0000","last_peered":"2024-04-26T23:46:36.192999+0000","last_clean":"2024-04-26T23:46:36.192999+0000","last_became_active":"2024-04-26T23:46:35.196241+0000","last_became_peered":"2024-04-26T23:46:35.196241+0000","last_unstale":"2024-04-26T23:46:36.192999+0000","last_undegraded":"2024-04-26T23:46:36.192999+0000","last_fullsized":"2024-04-26T23:46:36.192999+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:14:02.371036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053059+0000","last_change":"2024-04-26T23:46:34.179582+0000","last_active":"2024-04-26T23:46:38.053059+0000","last_peered":"2024-04-26T23:46:38.053059+0000","last_clean":"2024-04-26T23:46:38.053059+0000","last_became_active":"2024-04-26T23:46:34.179049+0000","last_became_peered":"2024-04-26T23:46:34.179049+0000","last_unstale":"2024-04-26T23:46:38.053059+0000","last_undegraded":"2024-04-26T23:46:38.053059+0000","last_fullsized":"2024-04-26T23:46:38.053059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:11:53.337552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053078+0000","last_change":"2024-04-26T23:46:35.192689+0000","last_active":"2024-04-26T23:46:38.053078+0000","last_peered":"2024-04-26T23:46:38.053078+0000","last_clean":"2024-04-26T23:46:38.053078+0000","last_became_active":"2024-04-26T23:46:35.192450+0000","last_became_peered":"2024-04-26T23:46:35.192450+0000","last_unstale":"2024-04-26T23:46:38.053078+0000","last_undegraded":"2024-04-26T23:46:38.053078+0000","last_fullsized":"2024-04-26T23:46:38.053078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:46:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178104+0000","last_change":"2024-04-26T23:46:34.184484+0000","last_active":"2024-04-26T23:46:37.178104+0000","last_peered":"2024-04-26T23:46:37.178104+0000","last_clean":"2024-04-26T23:46:37.178104+0000","last_became_active":"2024-04-26T23:46:34.184146+0000","last_became_peered":"2024-04-26T23:46:34.184146+0000","last_unstale":"2024-04-26T23:46:37.178104+0000","last_undegraded":"2024-04-26T23:46:37.178104+0000","last_fullsized":"2024-04-26T23:46:37.178104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:07.516736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052837+0000","last_change":"2024-04-26T23:46:35.181947+0000","last_active":"2024-04-26T23:46:38.052837+0000","last_peered":"2024-04-26T23:46:38.052837+0000","last_clean":"2024-04-26T23:46:38.052837+0000","last_became_active":"2024-04-26T23:46:35.181657+0000","last_became_peered":"2024-04-26T23:46:35.181657+0000","last_unstale":"2024-04-26T23:46:38.052837+0000","last_undegraded":"2024-04-26T23:46:38.052837+0000","last_fullsized":"2024-04-26T23:46:38.052837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:14:02.371036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192827+0000","last_change":"2024-04-26T23:46:34.179540+0000","last_active":"2024-04-26T23:46:36.192827+0000","last_peered":"2024-04-26T23:46:36.192827+0000","last_clean":"2024-04-26T23:46:36.192827+0000","last_became_active":"2024-04-26T23:46:34.179281+0000","last_became_peered":"2024-04-26T23:46:34.179281+0000","last_unstale":"2024-04-26T23:46:36.192827+0000","last_undegraded":"2024-04-26T23:46:36.192827+0000","last_fullsized":"2024-04-26T23:46:36.192827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:30.110501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192840+0000","last_change":"2024-04-26T23:46:35.195141+0000","last_active":"2024-04-26T23:46:36.192840+0000","last_peered":"2024-04-26T23:46:36.192840+0000","last_clean":"2024-04-26T23:46:36.192840+0000","last_became_active":"2024-04-26T23:46:35.194861+0000","last_became_peered":"2024-04-26T23:46:35.194861+0000","last_unstale":"2024-04-26T23:46:36.192840+0000","last_undegraded":"2024-04-26T23:46:36.192840+0000","last_fullsized":"2024-04-26T23:46:36.192840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:30.472463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052842+0000","last_change":"2024-04-26T23:46:34.186637+0000","last_active":"2024-04-26T23:46:38.052842+0000","last_peered":"2024-04-26T23:46:38.052842+0000","last_clean":"2024-04-26T23:46:38.052842+0000","last_became_active":"2024-04-26T23:46:34.186389+0000","last_became_peered":"2024-04-26T23:46:34.186389+0000","last_unstale":"2024-04-26T23:46:38.052842+0000","last_undegraded":"2024-04-26T23:46:38.052842+0000","last_fullsized":"2024-04-26T23:46:38.052842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:13.248964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189808+0000","last_change":"2024-04-26T23:46:35.193016+0000","last_active":"2024-04-26T23:46:36.189808+0000","last_peered":"2024-04-26T23:46:36.189808+0000","last_clean":"2024-04-26T23:46:36.189808+0000","last_became_active":"2024-04-26T23:46:35.184083+0000","last_became_peered":"2024-04-26T23:46:35.184083+0000","last_unstale":"2024-04-26T23:46:36.189808+0000","last_undegraded":"2024-04-26T23:46:36.189808+0000","last_fullsized":"2024-04-26T23:46:36.189808+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:41.001799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053919+0000","last_change":"2024-04-26T23:46:34.166497+0000","last_active":"2024-04-26T23:46:38.053919+0000","last_peered":"2024-04-26T23:46:38.053919+0000","last_clean":"2024-04-26T23:46:38.053919+0000","last_became_active":"2024-04-26T23:46:34.165705+0000","last_became_peered":"2024-04-26T23:46:34.165705+0000","last_unstale":"2024-04-26T23:46:38.053919+0000","last_undegraded":"2024-04-26T23:46:38.053919+0000","last_fullsized":"2024-04-26T23:46:38.053919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:31.072186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052708+0000","last_change":"2024-04-26T23:46:35.205542+0000","last_active":"2024-04-26T23:46:38.052708+0000","last_peered":"2024-04-26T23:46:38.052708+0000","last_clean":"2024-04-26T23:46:38.052708+0000","last_became_active":"2024-04-26T23:46:35.205164+0000","last_became_peered":"2024-04-26T23:46:35.205164+0000","last_unstale":"2024-04-26T23:46:38.052708+0000","last_undegraded":"2024-04-26T23:46:38.052708+0000","last_fullsized":"2024-04-26T23:46:38.052708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:30.472463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189913+0000","last_change":"2024-04-26T23:46:34.173170+0000","last_active":"2024-04-26T23:46:36.189913+0000","last_peered":"2024-04-26T23:46:36.189913+0000","last_clean":"2024-04-26T23:46:36.189913+0000","last_became_active":"2024-04-26T23:46:34.172917+0000","last_became_peered":"2024-04-26T23:46:34.172917+0000","last_unstale":"2024-04-26T23:46:36.189913+0000","last_undegraded":"2024-04-26T23:46:36.189913+0000","last_fullsized":"2024-04-26T23:46:36.189913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:59.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191586+0000","last_change":"2024-04-26T23:46:35.187403+0000","last_active":"2024-04-26T23:46:36.191586+0000","last_peered":"2024-04-26T23:46:36.191586+0000","last_clean":"2024-04-26T23:46:36.191586+0000","last_became_active":"2024-04-26T23:46:35.186132+0000","last_became_peered":"2024-04-26T23:46:35.186132+0000","last_unstale":"2024-04-26T23:46:36.191586+0000","last_undegraded":"2024-04-26T23:46:36.191586+0000","last_fullsized":"2024-04-26T23:46:36.191586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:03.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052705+0000","last_change":"2024-04-26T23:46:34.179239+0000","last_active":"2024-04-26T23:46:38.052705+0000","last_peered":"2024-04-26T23:46:38.052705+0000","last_clean":"2024-04-26T23:46:38.052705+0000","last_became_active":"2024-04-26T23:46:34.178903+0000","last_became_peered":"2024-04-26T23:46:34.178903+0000","last_unstale":"2024-04-26T23:46:38.052705+0000","last_undegraded":"2024-04-26T23:46:38.052705+0000","last_fullsized":"2024-04-26T23:46:38.052705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:50.101554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545727+0000","last_change":"2024-04-26T23:46:35.206287+0000","last_active":"2024-04-26T23:46:36.545727+0000","last_peered":"2024-04-26T23:46:36.545727+0000","last_clean":"2024-04-26T23:46:36.545727+0000","last_became_active":"2024-04-26T23:46:35.204661+0000","last_became_peered":"2024-04-26T23:46:35.204661+0000","last_unstale":"2024-04-26T23:46:36.545727+0000","last_undegraded":"2024-04-26T23:46:36.545727+0000","last_fullsized":"2024-04-26T23:46:36.545727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:31.116344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052448+0000","last_change":"2024-04-26T23:46:34.186295+0000","last_active":"2024-04-26T23:46:38.052448+0000","last_peered":"2024-04-26T23:46:38.052448+0000","last_clean":"2024-04-26T23:46:38.052448+0000","last_became_active":"2024-04-26T23:46:34.186014+0000","last_became_peered":"2024-04-26T23:46:34.186014+0000","last_unstale":"2024-04-26T23:46:38.052448+0000","last_undegraded":"2024-04-26T23:46:38.052448+0000","last_fullsized":"2024-04-26T23:46:38.052448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:39.995956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054068+0000","last_change":"2024-04-26T23:46:35.186529+0000","last_active":"2024-04-26T23:46:38.054068+0000","last_peered":"2024-04-26T23:46:38.054068+0000","last_clean":"2024-04-26T23:46:38.054068+0000","last_became_active":"2024-04-26T23:46:35.185597+0000","last_became_peered":"2024-04-26T23:46:35.185597+0000","last_unstale":"2024-04-26T23:46:38.054068+0000","last_undegraded":"2024-04-26T23:46:38.054068+0000","last_fullsized":"2024-04-26T23:46:38.054068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:49.613237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190184+0000","last_change":"2024-04-26T23:46:34.180474+0000","last_active":"2024-04-26T23:46:36.190184+0000","last_peered":"2024-04-26T23:46:36.190184+0000","last_clean":"2024-04-26T23:46:36.190184+0000","last_became_active":"2024-04-26T23:46:34.180195+0000","last_became_peered":"2024-04-26T23:46:34.180195+0000","last_unstale":"2024-04-26T23:46:36.190184+0000","last_undegraded":"2024-04-26T23:46:36.190184+0000","last_fullsized":"2024-04-26T23:46:36.190184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:28.087390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.193176+0000","last_change":"2024-04-26T23:46:35.186698+0000","last_active":"2024-04-26T23:46:36.193176+0000","last_peered":"2024-04-26T23:46:36.193176+0000","last_clean":"2024-04-26T23:46:36.193176+0000","last_became_active":"2024-04-26T23:46:35.186005+0000","last_became_peered":"2024-04-26T23:46:35.186005+0000","last_unstale":"2024-04-26T23:46:36.193176+0000","last_undegraded":"2024-04-26T23:46:36.193176+0000","last_fullsized":"2024-04-26T23:46:36.193176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:53.815915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054066+0000","last_change":"2024-04-26T23:46:34.171710+0000","last_active":"2024-04-26T23:46:38.054066+0000","last_peered":"2024-04-26T23:46:38.054066+0000","last_clean":"2024-04-26T23:46:38.054066+0000","last_became_active":"2024-04-26T23:46:34.171422+0000","last_became_peered":"2024-04-26T23:46:34.171422+0000","last_unstale":"2024-04-26T23:46:38.054066+0000","last_undegraded":"2024-04-26T23:46:38.054066+0000","last_fullsized":"2024-04-26T23:46:38.054066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:59.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190006+0000","last_change":"2024-04-26T23:46:35.207197+0000","last_active":"2024-04-26T23:46:36.190006+0000","last_peered":"2024-04-26T23:46:36.190006+0000","last_clean":"2024-04-26T23:46:36.190006+0000","last_became_active":"2024-04-26T23:46:35.206948+0000","last_became_peered":"2024-04-26T23:46:35.206948+0000","last_unstale":"2024-04-26T23:46:36.190006+0000","last_undegraded":"2024-04-26T23:46:36.190006+0000","last_fullsized":"2024-04-26T23:46:36.190006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:48.547701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054073+0000","last_change":"2024-04-26T23:46:34.173257+0000","last_active":"2024-04-26T23:46:38.054073+0000","last_peered":"2024-04-26T23:46:38.054073+0000","last_clean":"2024-04-26T23:46:38.054073+0000","last_became_active":"2024-04-26T23:46:34.172921+0000","last_became_peered":"2024-04-26T23:46:34.172921+0000","last_unstale":"2024-04-26T23:46:38.054073+0000","last_undegraded":"2024-04-26T23:46:38.054073+0000","last_fullsized":"2024-04-26T23:46:38.054073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:28.087390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548574+0000","last_change":"2024-04-26T23:46:35.183489+0000","last_active":"2024-04-26T23:46:37.548574+0000","last_peered":"2024-04-26T23:46:37.548574+0000","last_clean":"2024-04-26T23:46:37.548574+0000","last_became_active":"2024-04-26T23:46:35.183205+0000","last_became_peered":"2024-04-26T23:46:35.183205+0000","last_unstale":"2024-04-26T23:46:37.548574+0000","last_undegraded":"2024-04-26T23:46:37.548574+0000","last_fullsized":"2024-04-26T23:46:37.548574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:12.455967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053814+0000","last_change":"2024-04-26T23:46:34.178125+0000","last_active":"2024-04-26T23:46:38.053814+0000","last_peered":"2024-04-26T23:46:38.053814+0000","last_clean":"2024-04-26T23:46:38.053814+0000","last_became_active":"2024-04-26T23:46:34.177837+0000","last_became_peered":"2024-04-26T23:46:34.177837+0000","last_unstale":"2024-04-26T23:46:38.053814+0000","last_undegraded":"2024-04-26T23:46:38.053814+0000","last_fullsized":"2024-04-26T23:46:38.053814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:44.753454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548307+0000","last_change":"2024-04-26T23:46:35.187104+0000","last_active":"2024-04-26T23:46:37.548307+0000","last_peered":"2024-04-26T23:46:37.548307+0000","last_clean":"2024-04-26T23:46:37.548307+0000","last_became_active":"2024-04-26T23:46:35.186712+0000","last_became_peered":"2024-04-26T23:46:35.186712+0000","last_unstale":"2024-04-26T23:46:37.548307+0000","last_undegraded":"2024-04-26T23:46:37.548307+0000","last_fullsized":"2024-04-26T23:46:37.548307+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:29.093232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178215+0000","last_change":"2024-04-26T23:46:34.166608+0000","last_active":"2024-04-26T23:46:37.178215+0000","last_peered":"2024-04-26T23:46:37.178215+0000","last_clean":"2024-04-26T23:46:37.178215+0000","last_became_active":"2024-04-26T23:46:34.166347+0000","last_became_peered":"2024-04-26T23:46:34.166347+0000","last_unstale":"2024-04-26T23:46:37.178215+0000","last_undegraded":"2024-04-26T23:46:37.178215+0000","last_fullsized":"2024-04-26T23:46:37.178215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:21.196486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548445+0000","last_change":"2024-04-26T23:46:35.205435+0000","last_active":"2024-04-26T23:46:37.548445+0000","last_peered":"2024-04-26T23:46:37.548445+0000","last_clean":"2024-04-26T23:46:37.548445+0000","last_became_active":"2024-04-26T23:46:35.204772+0000","last_became_peered":"2024-04-26T23:46:35.204772+0000","last_unstale":"2024-04-26T23:46:37.548445+0000","last_undegraded":"2024-04-26T23:46:37.548445+0000","last_fullsized":"2024-04-26T23:46:37.548445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:14.254807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545518+0000","last_change":"2024-04-26T23:46:34.178182+0000","last_active":"2024-04-26T23:46:36.545518+0000","last_peered":"2024-04-26T23:46:36.545518+0000","last_clean":"2024-04-26T23:46:36.545518+0000","last_became_active":"2024-04-26T23:46:34.177914+0000","last_became_peered":"2024-04-26T23:46:34.177914+0000","last_unstale":"2024-04-26T23:46:36.545518+0000","last_undegraded":"2024-04-26T23:46:36.545518+0000","last_fullsized":"2024-04-26T23:46:36.545518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:32:54.994053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548194+0000","last_change":"2024-04-26T23:46:35.198438+0000","last_active":"2024-04-26T23:46:37.548194+0000","last_peered":"2024-04-26T23:46:37.548194+0000","last_clean":"2024-04-26T23:46:37.548194+0000","last_became_active":"2024-04-26T23:46:35.198139+0000","last_became_peered":"2024-04-26T23:46:35.198139+0000","last_unstale":"2024-04-26T23:46:37.548194+0000","last_undegraded":"2024-04-26T23:46:37.548194+0000","last_fullsized":"2024-04-26T23:46:37.548194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:45.759296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053473+0000","last_change":"2024-04-26T23:46:34.171217+0000","last_active":"2024-04-26T23:46:38.053473+0000","last_peered":"2024-04-26T23:46:38.053473+0000","last_clean":"2024-04-26T23:46:38.053473+0000","last_became_active":"2024-04-26T23:46:34.170668+0000","last_became_peered":"2024-04-26T23:46:34.170668+0000","last_unstale":"2024-04-26T23:46:38.053473+0000","last_undegraded":"2024-04-26T23:46:38.053473+0000","last_fullsized":"2024-04-26T23:46:38.053473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191713+0000","last_change":"2024-04-26T23:46:35.194407+0000","last_active":"2024-04-26T23:46:36.191713+0000","last_peered":"2024-04-26T23:46:36.191713+0000","last_clean":"2024-04-26T23:46:36.191713+0000","last_became_active":"2024-04-26T23:46:35.192229+0000","last_became_peered":"2024-04-26T23:46:35.192229+0000","last_unstale":"2024-04-26T23:46:36.191713+0000","last_undegraded":"2024-04-26T23:46:36.191713+0000","last_fullsized":"2024-04-26T23:46:36.191713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:15.266045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191142+0000","last_change":"2024-04-26T23:46:34.179422+0000","last_active":"2024-04-26T23:46:36.191142+0000","last_peered":"2024-04-26T23:46:36.191142+0000","last_clean":"2024-04-26T23:46:36.191142+0000","last_became_active":"2024-04-26T23:46:34.179130+0000","last_became_peered":"2024-04-26T23:46:34.179130+0000","last_unstale":"2024-04-26T23:46:36.191142+0000","last_undegraded":"2024-04-26T23:46:36.191142+0000","last_fullsized":"2024-04-26T23:46:36.191142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:02.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548590+0000","last_change":"2024-04-26T23:46:35.190732+0000","last_active":"2024-04-26T23:46:37.548590+0000","last_peered":"2024-04-26T23:46:37.548590+0000","last_clean":"2024-04-26T23:46:37.548590+0000","last_became_active":"2024-04-26T23:46:35.189908+0000","last_became_peered":"2024-04-26T23:46:35.189908+0000","last_unstale":"2024-04-26T23:46:37.548590+0000","last_undegraded":"2024-04-26T23:46:37.548590+0000","last_fullsized":"2024-04-26T23:46:37.548590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:54.293107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190261+0000","last_change":"2024-04-26T23:46:34.176531+0000","last_active":"2024-04-26T23:46:36.190261+0000","last_peered":"2024-04-26T23:46:36.190261+0000","last_clean":"2024-04-26T23:46:36.190261+0000","last_became_active":"2024-04-26T23:46:34.176220+0000","last_became_peered":"2024-04-26T23:46:34.176220+0000","last_unstale":"2024-04-26T23:46:36.190261+0000","last_undegraded":"2024-04-26T23:46:36.190261+0000","last_fullsized":"2024-04-26T23:46:36.190261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:30.093195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.193240+0000","last_change":"2024-04-26T23:46:35.195106+0000","last_active":"2024-04-26T23:46:36.193240+0000","last_peered":"2024-04-26T23:46:36.193240+0000","last_clean":"2024-04-26T23:46:36.193240+0000","last_became_active":"2024-04-26T23:46:35.189319+0000","last_became_peered":"2024-04-26T23:46:35.189319+0000","last_unstale":"2024-04-26T23:46:36.193240+0000","last_undegraded":"2024-04-26T23:46:36.193240+0000","last_fullsized":"2024-04-26T23:46:36.193240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:56.717980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.179642+0000","last_change":"2024-04-26T23:46:34.179775+0000","last_active":"2024-04-26T23:46:37.179642+0000","last_peered":"2024-04-26T23:46:37.179642+0000","last_clean":"2024-04-26T23:46:37.179642+0000","last_became_active":"2024-04-26T23:46:34.179263+0000","last_became_peered":"2024-04-26T23:46:34.179263+0000","last_unstale":"2024-04-26T23:46:37.179642+0000","last_undegraded":"2024-04-26T23:46:37.179642+0000","last_fullsized":"2024-04-26T23:46:37.179642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:06.779214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177990+0000","last_change":"2024-04-26T23:46:35.216748+0000","last_active":"2024-04-26T23:46:37.177990+0000","last_peered":"2024-04-26T23:46:37.177990+0000","last_clean":"2024-04-26T23:46:37.177990+0000","last_became_active":"2024-04-26T23:46:35.216496+0000","last_became_peered":"2024-04-26T23:46:35.216496+0000","last_unstale":"2024-04-26T23:46:37.177990+0000","last_undegraded":"2024-04-26T23:46:37.177990+0000","last_fullsized":"2024-04-26T23:46:37.177990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:28.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190117+0000","last_change":"2024-04-26T23:46:34.170536+0000","last_active":"2024-04-26T23:46:36.190117+0000","last_peered":"2024-04-26T23:46:36.190117+0000","last_clean":"2024-04-26T23:46:36.190117+0000","last_became_active":"2024-04-26T23:46:34.169534+0000","last_became_peered":"2024-04-26T23:46:34.169534+0000","last_unstale":"2024-04-26T23:46:36.190117+0000","last_undegraded":"2024-04-26T23:46:36.190117+0000","last_fullsized":"2024-04-26T23:46:36.190117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.842965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545547+0000","last_change":"2024-04-26T23:46:35.203559+0000","last_active":"2024-04-26T23:46:36.545547+0000","last_peered":"2024-04-26T23:46:36.545547+0000","last_clean":"2024-04-26T23:46:36.545547+0000","last_became_active":"2024-04-26T23:46:35.203247+0000","last_became_peered":"2024-04-26T23:46:35.203247+0000","last_unstale":"2024-04-26T23:46:36.545547+0000","last_undegraded":"2024-04-26T23:46:36.545547+0000","last_fullsized":"2024-04-26T23:46:36.545547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:54.293107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178282+0000","last_change":"2024-04-26T23:46:34.172190+0000","last_active":"2024-04-26T23:46:37.178282+0000","last_peered":"2024-04-26T23:46:37.178282+0000","last_clean":"2024-04-26T23:46:37.178282+0000","last_became_active":"2024-04-26T23:46:34.171719+0000","last_became_peered":"2024-04-26T23:46:34.171719+0000","last_unstale":"2024-04-26T23:46:37.178282+0000","last_undegraded":"2024-04-26T23:46:37.178282+0000","last_fullsized":"2024-04-26T23:46:37.178282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:30.994345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178124+0000","last_change":"2024-04-26T23:46:35.203022+0000","last_active":"2024-04-26T23:46:37.178124+0000","last_peered":"2024-04-26T23:46:37.178124+0000","last_clean":"2024-04-26T23:46:37.178124+0000","last_became_active":"2024-04-26T23:46:35.202511+0000","last_became_peered":"2024-04-26T23:46:35.202511+0000","last_unstale":"2024-04-26T23:46:37.178124+0000","last_undegraded":"2024-04-26T23:46:37.178124+0000","last_fullsized":"2024-04-26T23:46:37.178124+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:34.104236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189996+0000","last_change":"2024-04-26T23:46:34.175739+0000","last_active":"2024-04-26T23:46:36.189996+0000","last_peered":"2024-04-26T23:46:36.189996+0000","last_clean":"2024-04-26T23:46:36.189996+0000","last_became_active":"2024-04-26T23:46:34.175510+0000","last_became_peered":"2024-04-26T23:46:34.175510+0000","last_unstale":"2024-04-26T23:46:36.189996+0000","last_undegraded":"2024-04-26T23:46:36.189996+0000","last_fullsized":"2024-04-26T23:46:36.189996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:44.753454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052440+0000","last_change":"2024-04-26T23:46:35.188940+0000","last_active":"2024-04-26T23:46:38.052440+0000","last_peered":"2024-04-26T23:46:38.052440+0000","last_clean":"2024-04-26T23:46:38.052440+0000","last_became_active":"2024-04-26T23:46:35.188660+0000","last_became_peered":"2024-04-26T23:46:35.188660+0000","last_unstale":"2024-04-26T23:46:38.052440+0000","last_undegraded":"2024-04-26T23:46:38.052440+0000","last_fullsized":"2024-04-26T23:46:38.052440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:30:08.620409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053602+0000","last_change":"2024-04-26T23:46:34.170955+0000","last_active":"2024-04-26T23:46:38.053602+0000","last_peered":"2024-04-26T23:46:38.053602+0000","last_clean":"2024-04-26T23:46:38.053602+0000","last_became_active":"2024-04-26T23:46:34.170342+0000","last_became_peered":"2024-04-26T23:46:34.170342+0000","last_unstale":"2024-04-26T23:46:38.053602+0000","last_undegraded":"2024-04-26T23:46:38.053602+0000","last_fullsized":"2024-04-26T23:46:38.053602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053463+0000","last_change":"2024-04-26T23:46:35.203593+0000","last_active":"2024-04-26T23:46:38.053463+0000","last_peered":"2024-04-26T23:46:38.053463+0000","last_clean":"2024-04-26T23:46:38.053463+0000","last_became_active":"2024-04-26T23:46:35.203363+0000","last_became_peered":"2024-04-26T23:46:35.203363+0000","last_unstale":"2024-04-26T23:46:38.053463+0000","last_undegraded":"2024-04-26T23:46:38.053463+0000","last_fullsized":"2024-04-26T23:46:38.053463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:11:54.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052577+0000","last_change":"2024-04-26T23:46:34.179277+0000","last_active":"2024-04-26T23:46:38.052577+0000","last_peered":"2024-04-26T23:46:38.052577+0000","last_clean":"2024-04-26T23:46:38.052577+0000","last_became_active":"2024-04-26T23:46:34.178980+0000","last_became_peered":"2024-04-26T23:46:34.178980+0000","last_unstale":"2024-04-26T23:46:38.052577+0000","last_undegraded":"2024-04-26T23:46:38.052577+0000","last_fullsized":"2024-04-26T23:46:38.052577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:02.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191562+0000","last_change":"2024-04-26T23:46:35.190865+0000","last_active":"2024-04-26T23:46:36.191562+0000","last_peered":"2024-04-26T23:46:36.191562+0000","last_clean":"2024-04-26T23:46:36.191562+0000","last_became_active":"2024-04-26T23:46:35.190580+0000","last_became_peered":"2024-04-26T23:46:35.190580+0000","last_unstale":"2024-04-26T23:46:36.191562+0000","last_undegraded":"2024-04-26T23:46:36.191562+0000","last_fullsized":"2024-04-26T23:46:36.191562+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:55.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545472+0000","last_change":"2024-04-26T23:46:34.176449+0000","last_active":"2024-04-26T23:46:36.545472+0000","last_peered":"2024-04-26T23:46:36.545472+0000","last_clean":"2024-04-26T23:46:36.545472+0000","last_became_active":"2024-04-26T23:46:34.176138+0000","last_became_peered":"2024-04-26T23:46:34.176138+0000","last_unstale":"2024-04-26T23:46:36.545472+0000","last_undegraded":"2024-04-26T23:46:36.545472+0000","last_fullsized":"2024-04-26T23:46:36.545472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:12.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191967+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:46:36.191967+0000","last_peered":"2024-04-26T23:46:36.191967+0000","last_clean":"2024-04-26T23:46:36.191967+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:46:36.191967+0000","last_undegraded":"2024-04-26T23:46:36.191967+0000","last_fullsized":"2024-04-26T23:46:36.191967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":747257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":156903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":158433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":156869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":158433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":995328,"data_stored":747167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:46:43.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:46:44.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.044+0000 7f59d8600640 1 Processor -- start 2024-04-26T23:46:44.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.044+0000 7f59d8600640 1 -- start start 2024-04-26T23:46:44.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.044+0000 7f59d8600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f59d015d5b0 0x7f59d015da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.044+0000 7f59d8600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d015e050 con 0x7f59d00b4360 2024-04-26T23:46:44.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d8600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d015e330 con 0x7f59d00cdc00 2024-04-26T23:46:44.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d8600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f59d00ceda0 con 0x7f59d015d5b0 2024-04-26T23:46:44.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d5c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f59d00b4360 0x7f59d00cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59752/0 (socket says 172.21.15.47:59752) 2024-04-26T23:46:44.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d5c00640 1 -- 172.21.15.47:0/575255561 learned_addr learned my addr 172.21.15.47:0/575255561 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d5200640 1 --2- 172.21.15.47:0/575255561 >> v2:172.21.15.203:3300/0 conn(0x7f59d015d5b0 0x7f59d015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963405433 0 0) 0x7f59d015e050 con 0x7f59d00b4360 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59b8003530 con 0x7f59d00b4360 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2105493275 0 0) 0x7f59b8003530 con 0x7f59d00b4360 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 >> v2:172.21.15.203:3300/0 conn(0x7f59d015d5b0 msgr2=0x7f59d015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 --2- 172.21.15.47:0/575255561 >> v2:172.21.15.203:3300/0 conn(0x7f59d015d5b0 0x7f59d015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 >> v1:172.21.15.203:6789/0 conn(0x7f59d00cdc00 legacy=0x7f59d015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00cf080 con 0x7f59d00b4360 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f59c4001a00 con 0x7f59d00b4360 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 >> v1:172.21.15.47:6789/0 conn(0x7f59d00b4360 legacy=0x7f59d00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59b80039c0 0x7f59b8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59b80043c0 0x7f59b8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59d00ceda0 con 0x7f59b8005090 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f59b800bff0 con 0x7f59b80039c0 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f59b800c1f0 con 0x7f59b80043c0 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d6600640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d5c00640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59b80039c0 0x7f59b8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d5200640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59b80043c0 0x7f59b8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d6600640 1 -- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59b80043c0 msgr2=0x7f59b8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d6600640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59b80043c0 0x7f59b8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d6600640 1 -- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59b80039c0 msgr2=0x7f59b8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d6600640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59b80039c0 0x7f59b8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.048+0000 7f59d6600640 1 -- 172.21.15.47:0/575255561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b8003530 con 0x7f59b8005090 2024-04-26T23:46:44.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d6600640 1 -- 172.21.15.47:0/575255561 reap_dead start 2024-04-26T23:46:44.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d6600640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59b800b9d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f59c8001860 tx=0x7f59c801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8abae3513c5a8242 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8001460 con 0x7f59b8005090 2024-04-26T23:46:44.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c80052d0 con 0x7f59b8005090 2024-04-26T23:46:44.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59cfe00640 1 -- 172.21.15.47:0/575255561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8003820 con 0x7f59b8005090 2024-04-26T23:46:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 -- 172.21.15.47:0/575255561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 msgr2=0x7f59b800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59b800b9d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f59c8001860 tx=0x7f59c801c500 comp rx=0 tx=0).stop 2024-04-26T23:46:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 -- 172.21.15.47:0/575255561 shutdown_connections 2024-04-26T23:46:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 --2- 172.21.15.47:0/575255561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59b800b9d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 -- 172.21.15.47:0/575255561 >> 172.21.15.47:0/575255561 conn(0x7f59d006c800 msgr2=0x7f59d006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 -- 172.21.15.47:0/575255561 shutdown_connections 2024-04-26T23:46:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 -- 172.21.15.47:0/575255561 wait complete. 2024-04-26T23:46:44.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 Processor -- start 2024-04-26T23:46:44.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.052+0000 7f59d8600640 1 -- start start 2024-04-26T23:46:44.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59d015c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59d01e3320 0x7f59d01f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59d00b1d70 0x7f59d00b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f59d00b60f0 con 0x7f59b8005090 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f59d00b5f70 con 0x7f59d01e3320 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f59d015da40 con 0x7f59d00b1d70 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59d015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59d015c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38688/0 (socket says 172.21.15.47:38688) 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 -- 172.21.15.47:0/4252570947 learned_addr learned my addr 172.21.15.47:0/4252570947 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5200640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59d01e3320 0x7f59d01f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d6600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59d00b1d70 0x7f59d00b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 -- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59d00b1d70 msgr2=0x7f59d00b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59d00b1d70 0x7f59d00b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 -- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59d01e3320 msgr2=0x7f59d01f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59d01e3320 0x7f59d01f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 -- 172.21.15.47:0/4252570947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d00735d0 con 0x7f59b8005090 2024-04-26T23:46:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d5c00640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59d015c740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f59c40076d0 tx=0x7f59c4007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59cd600640 1 -- 172.21.15.47:0/4252570947 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c401c070 con 0x7f59b8005090 2024-04-26T23:46:44.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59cd600640 1 -- 172.21.15.47:0/4252570947 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c4011870 con 0x7f59b8005090 2024-04-26T23:46:44.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59cd600640 1 -- 172.21.15.47:0/4252570947 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4010040 con 0x7f59b8005090 2024-04-26T23:46:44.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d01e3800 con 0x7f59b8005090 2024-04-26T23:46:44.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d01f4060 con 0x7f59b8005090 2024-04-26T23:46:44.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d0069700 con 0x7f59b8005090 2024-04-26T23:46:44.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.056+0000 7f59cd600640 1 -- 172.21.15.47:0/4252570947 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59c4011c60 con 0x7f59b8005090 2024-04-26T23:46:44.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.060+0000 7f59cd600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59b00683b0 0x7f59b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.060+0000 7f59cd600640 1 -- 172.21.15.47:0/4252570947 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f59c4089770 con 0x7f59b8005090 2024-04-26T23:46:44.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.060+0000 7f59d5200640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59b00683b0 0x7f59b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.060+0000 7f59d5200640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59b00683b0 0x7f59b006a870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f59d01f04d0 tx=0x7f59bc006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.064+0000 7f59cd600640 1 -- 172.21.15.47:0/4252570947 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f59c4059640 con 0x7f59b8005090 2024-04-26T23:46:44.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.224+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59d00d06a0 con 0x7f59b00683b0 2024-04-26T23:46:44.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.232+0000 7f59cd600640 1 -- 172.21.15.47:0/4252570947 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f59d00d06a0 con 0x7f59b00683b0 2024-04-26T23:46:44.242 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:44.243 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:46:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59b00683b0 msgr2=0x7f59b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59b00683b0 0x7f59b006a870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f59d01f04d0 tx=0x7f59bc006f90 comp rx=0 tx=0).stop 2024-04-26T23:46:44.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 msgr2=0x7f59d015c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59d015c740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f59c40076d0 tx=0x7f59c4007ad0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 shutdown_connections 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f59b00683b0 0x7f59b006a870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59d00b1d70 0x7f59d00b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f59d01e3320 0x7f59d01f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 --2- 172.21.15.47:0/4252570947 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59b8005090 0x7f59d015c740 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 >> 172.21.15.47:0/4252570947 conn(0x7f59d006c800 msgr2=0x7f59d006cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 shutdown_connections 2024-04-26T23:46:44.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.236+0000 7f59d8600640 1 -- 172.21.15.47:0/4252570947 wait complete. 2024-04-26T23:46:44.262 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-04-26T23:46:44.171218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237160,"kb_used_data":4360,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737560,"statfs":{"total":773094113280,"available":772851261440,"internally_reserved":0,"allocated":4464640,"data_stored":2439948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.001297"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545703+0000","last_change":"2024-04-26T23:46:35.190712+0000","last_active":"2024-04-26T23:46:36.545703+0000","last_peered":"2024-04-26T23:46:36.545703+0000","last_clean":"2024-04-26T23:46:36.545703+0000","last_became_active":"2024-04-26T23:46:35.190424+0000","last_became_peered":"2024-04-26T23:46:35.190424+0000","last_unstale":"2024-04-26T23:46:36.545703+0000","last_undegraded":"2024-04-26T23:46:36.545703+0000","last_fullsized":"2024-04-26T23:46:36.545703+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:03.942682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053063+0000","last_change":"2024-04-26T23:46:35.201949+0000","last_active":"2024-04-26T23:46:38.053063+0000","last_peered":"2024-04-26T23:46:38.053063+0000","last_clean":"2024-04-26T23:46:38.053063+0000","last_became_active":"2024-04-26T23:46:35.201646+0000","last_became_peered":"2024-04-26T23:46:35.201646+0000","last_unstale":"2024-04-26T23:46:38.053063+0000","last_undegraded":"2024-04-26T23:46:38.053063+0000","last_fullsized":"2024-04-26T23:46:38.053063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:56.717980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192647+0000","last_change":"2024-04-26T23:46:35.194659+0000","last_active":"2024-04-26T23:46:36.192647+0000","last_peered":"2024-04-26T23:46:36.192647+0000","last_clean":"2024-04-26T23:46:36.192647+0000","last_became_active":"2024-04-26T23:46:35.189309+0000","last_became_peered":"2024-04-26T23:46:35.189309+0000","last_unstale":"2024-04-26T23:46:36.192647+0000","last_undegraded":"2024-04-26T23:46:36.192647+0000","last_fullsized":"2024-04-26T23:46:36.192647+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:55.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190002+0000","last_change":"2024-04-26T23:46:35.193007+0000","last_active":"2024-04-26T23:46:36.190002+0000","last_peered":"2024-04-26T23:46:36.190002+0000","last_clean":"2024-04-26T23:46:36.190002+0000","last_became_active":"2024-04-26T23:46:35.192710+0000","last_became_peered":"2024-04-26T23:46:35.192710+0000","last_unstale":"2024-04-26T23:46:36.190002+0000","last_undegraded":"2024-04-26T23:46:36.190002+0000","last_fullsized":"2024-04-26T23:46:36.190002+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:34:40.141821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548277+0000","last_change":"2024-04-26T23:46:35.193931+0000","last_active":"2024-04-26T23:46:37.548277+0000","last_peered":"2024-04-26T23:46:37.548277+0000","last_clean":"2024-04-26T23:46:37.548277+0000","last_became_active":"2024-04-26T23:46:35.193668+0000","last_became_peered":"2024-04-26T23:46:35.193668+0000","last_unstale":"2024-04-26T23:46:37.548277+0000","last_undegraded":"2024-04-26T23:46:37.548277+0000","last_fullsized":"2024-04-26T23:46:37.548277+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:54.848807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052676+0000","last_change":"2024-04-26T23:46:35.184470+0000","last_active":"2024-04-26T23:46:38.052676+0000","last_peered":"2024-04-26T23:46:38.052676+0000","last_clean":"2024-04-26T23:46:38.052676+0000","last_became_active":"2024-04-26T23:46:35.184130+0000","last_became_peered":"2024-04-26T23:46:35.184130+0000","last_unstale":"2024-04-26T23:46:38.052676+0000","last_undegraded":"2024-04-26T23:46:38.052676+0000","last_fullsized":"2024-04-26T23:46:38.052676+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:55.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192045+0000","last_change":"2024-04-26T23:46:35.191681+0000","last_active":"2024-04-26T23:46:36.192045+0000","last_peered":"2024-04-26T23:46:36.192045+0000","last_clean":"2024-04-26T23:46:36.192045+0000","last_became_active":"2024-04-26T23:46:35.191288+0000","last_became_peered":"2024-04-26T23:46:35.191288+0000","last_unstale":"2024-04-26T23:46:36.192045+0000","last_undegraded":"2024-04-26T23:46:36.192045+0000","last_fullsized":"2024-04-26T23:46:36.192045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:30.472463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191373+0000","last_change":"2024-04-26T23:46:35.199502+0000","last_active":"2024-04-26T23:46:36.191373+0000","last_peered":"2024-04-26T23:46:36.191373+0000","last_clean":"2024-04-26T23:46:36.191373+0000","last_became_active":"2024-04-26T23:46:35.199261+0000","last_became_peered":"2024-04-26T23:46:35.199261+0000","last_unstale":"2024-04-26T23:46:36.191373+0000","last_undegraded":"2024-04-26T23:46:36.191373+0000","last_fullsized":"2024-04-26T23:46:36.191373+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:30.167198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054260+0000","last_change":"2024-04-26T23:46:35.207981+0000","last_active":"2024-04-26T23:46:38.054260+0000","last_peered":"2024-04-26T23:46:38.054260+0000","last_clean":"2024-04-26T23:46:38.054260+0000","last_became_active":"2024-04-26T23:46:35.207635+0000","last_became_peered":"2024-04-26T23:46:35.207635+0000","last_unstale":"2024-04-26T23:46:38.054260+0000","last_undegraded":"2024-04-26T23:46:38.054260+0000","last_fullsized":"2024-04-26T23:46:38.054260+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:07.858089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190199+0000","last_change":"2024-04-26T23:46:35.209231+0000","last_active":"2024-04-26T23:46:36.190199+0000","last_peered":"2024-04-26T23:46:36.190199+0000","last_clean":"2024-04-26T23:46:36.190199+0000","last_became_active":"2024-04-26T23:46:35.208963+0000","last_became_peered":"2024-04-26T23:46:35.208963+0000","last_unstale":"2024-04-26T23:46:36.190199+0000","last_undegraded":"2024-04-26T23:46:36.190199+0000","last_fullsized":"2024-04-26T23:46:36.190199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:49.613237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191787+0000","last_change":"2024-04-26T23:46:35.200908+0000","last_active":"2024-04-26T23:46:36.191787+0000","last_peered":"2024-04-26T23:46:36.191787+0000","last_clean":"2024-04-26T23:46:36.191787+0000","last_became_active":"2024-04-26T23:46:35.200589+0000","last_became_peered":"2024-04-26T23:46:35.200589+0000","last_unstale":"2024-04-26T23:46:36.191787+0000","last_undegraded":"2024-04-26T23:46:36.191787+0000","last_fullsized":"2024-04-26T23:46:36.191787+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:30:08.620409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192593+0000","last_change":"2024-04-26T23:46:35.194993+0000","last_active":"2024-04-26T23:46:36.192593+0000","last_peered":"2024-04-26T23:46:36.192593+0000","last_clean":"2024-04-26T23:46:36.192593+0000","last_became_active":"2024-04-26T23:46:35.194708+0000","last_became_peered":"2024-04-26T23:46:35.194708+0000","last_unstale":"2024-04-26T23:46:36.192593+0000","last_undegraded":"2024-04-26T23:46:36.192593+0000","last_fullsized":"2024-04-26T23:46:36.192593+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:15:22.887219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548441+0000","last_change":"2024-04-26T23:46:35.205067+0000","last_active":"2024-04-26T23:46:37.548441+0000","last_peered":"2024-04-26T23:46:37.548441+0000","last_clean":"2024-04-26T23:46:37.548441+0000","last_became_active":"2024-04-26T23:46:35.204430+0000","last_became_peered":"2024-04-26T23:46:35.204430+0000","last_unstale":"2024-04-26T23:46:37.548441+0000","last_undegraded":"2024-04-26T23:46:37.548441+0000","last_fullsized":"2024-04-26T23:46:37.548441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:31.099037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052667+0000","last_change":"2024-04-26T23:46:35.197329+0000","last_active":"2024-04-26T23:46:38.052667+0000","last_peered":"2024-04-26T23:46:38.052667+0000","last_clean":"2024-04-26T23:46:38.052667+0000","last_became_active":"2024-04-26T23:46:35.197023+0000","last_became_peered":"2024-04-26T23:46:35.197023+0000","last_unstale":"2024-04-26T23:46:38.052667+0000","last_undegraded":"2024-04-26T23:46:38.052667+0000","last_fullsized":"2024-04-26T23:46:38.052667+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:15:22.887219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192152+0000","last_change":"2024-04-26T23:46:35.195776+0000","last_active":"2024-04-26T23:46:36.192152+0000","last_peered":"2024-04-26T23:46:36.192152+0000","last_clean":"2024-04-26T23:46:36.192152+0000","last_became_active":"2024-04-26T23:46:35.195476+0000","last_became_peered":"2024-04-26T23:46:35.195476+0000","last_unstale":"2024-04-26T23:46:36.192152+0000","last_undegraded":"2024-04-26T23:46:36.192152+0000","last_fullsized":"2024-04-26T23:46:36.192152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:03.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191861+0000","last_change":"2024-04-26T23:46:35.196299+0000","last_active":"2024-04-26T23:46:36.191861+0000","last_peered":"2024-04-26T23:46:36.191861+0000","last_clean":"2024-04-26T23:46:36.191861+0000","last_became_active":"2024-04-26T23:46:35.195804+0000","last_became_peered":"2024-04-26T23:46:35.195804+0000","last_unstale":"2024-04-26T23:46:36.191861+0000","last_undegraded":"2024-04-26T23:46:36.191861+0000","last_fullsized":"2024-04-26T23:46:36.191861+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:15:22.887219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192120+0000","last_change":"2024-04-26T23:46:35.192517+0000","last_active":"2024-04-26T23:46:36.192120+0000","last_peered":"2024-04-26T23:46:36.192120+0000","last_clean":"2024-04-26T23:46:36.192120+0000","last_became_active":"2024-04-26T23:46:35.191746+0000","last_became_peered":"2024-04-26T23:46:35.191746+0000","last_unstale":"2024-04-26T23:46:36.192120+0000","last_undegraded":"2024-04-26T23:46:36.192120+0000","last_fullsized":"2024-04-26T23:46:36.192120+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:14:02.371036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053084+0000","last_change":"2024-04-26T23:46:35.191840+0000","last_active":"2024-04-26T23:46:38.053084+0000","last_peered":"2024-04-26T23:46:38.053084+0000","last_clean":"2024-04-26T23:46:38.053084+0000","last_became_active":"2024-04-26T23:46:35.191558+0000","last_became_peered":"2024-04-26T23:46:35.191558+0000","last_unstale":"2024-04-26T23:46:38.053084+0000","last_undegraded":"2024-04-26T23:46:38.053084+0000","last_fullsized":"2024-04-26T23:46:38.053084+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:13.982490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052972+0000","last_change":"2024-04-26T23:46:35.193523+0000","last_active":"2024-04-26T23:46:38.052972+0000","last_peered":"2024-04-26T23:46:38.052972+0000","last_clean":"2024-04-26T23:46:38.052972+0000","last_became_active":"2024-04-26T23:46:35.193286+0000","last_became_peered":"2024-04-26T23:46:35.193286+0000","last_unstale":"2024-04-26T23:46:38.052972+0000","last_undegraded":"2024-04-26T23:46:38.052972+0000","last_fullsized":"2024-04-26T23:46:38.052972+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:53.815915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548530+0000","last_change":"2024-04-26T23:46:35.184914+0000","last_active":"2024-04-26T23:46:37.548530+0000","last_peered":"2024-04-26T23:46:37.548530+0000","last_clean":"2024-04-26T23:46:37.548530+0000","last_became_active":"2024-04-26T23:46:35.184642+0000","last_became_peered":"2024-04-26T23:46:35.184642+0000","last_unstale":"2024-04-26T23:46:37.548530+0000","last_undegraded":"2024-04-26T23:46:37.548530+0000","last_fullsized":"2024-04-26T23:46:37.548530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:31:15.948509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053750+0000","last_change":"2024-04-26T23:46:35.203971+0000","last_active":"2024-04-26T23:46:38.053750+0000","last_peered":"2024-04-26T23:46:38.053750+0000","last_clean":"2024-04-26T23:46:38.053750+0000","last_became_active":"2024-04-26T23:46:35.203745+0000","last_became_peered":"2024-04-26T23:46:35.203745+0000","last_unstale":"2024-04-26T23:46:38.053750+0000","last_undegraded":"2024-04-26T23:46:38.053750+0000","last_fullsized":"2024-04-26T23:46:38.053750+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:34:40.141821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053650+0000","last_change":"2024-04-26T23:46:35.203003+0000","last_active":"2024-04-26T23:46:38.053650+0000","last_peered":"2024-04-26T23:46:38.053650+0000","last_clean":"2024-04-26T23:46:38.053650+0000","last_became_active":"2024-04-26T23:46:35.202721+0000","last_became_peered":"2024-04-26T23:46:35.202721+0000","last_unstale":"2024-04-26T23:46:38.053650+0000","last_undegraded":"2024-04-26T23:46:38.053650+0000","last_fullsized":"2024-04-26T23:46:38.053650+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:48.547701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177902+0000","last_change":"2024-04-26T23:46:35.199219+0000","last_active":"2024-04-26T23:46:37.177902+0000","last_peered":"2024-04-26T23:46:37.177902+0000","last_clean":"2024-04-26T23:46:37.177902+0000","last_became_active":"2024-04-26T23:46:35.198950+0000","last_became_peered":"2024-04-26T23:46:35.198950+0000","last_unstale":"2024-04-26T23:46:37.177902+0000","last_undegraded":"2024-04-26T23:46:37.177902+0000","last_fullsized":"2024-04-26T23:46:37.177902+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:13:42.942480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191189+0000","last_change":"2024-04-26T23:46:35.184689+0000","last_active":"2024-04-26T23:46:36.191189+0000","last_peered":"2024-04-26T23:46:36.191189+0000","last_clean":"2024-04-26T23:46:36.191189+0000","last_became_active":"2024-04-26T23:46:35.184405+0000","last_became_peered":"2024-04-26T23:46:35.184405+0000","last_unstale":"2024-04-26T23:46:36.191189+0000","last_undegraded":"2024-04-26T23:46:36.191189+0000","last_fullsized":"2024-04-26T23:46:36.191189+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:00.041295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190086+0000","last_change":"2024-04-26T23:46:35.196912+0000","last_active":"2024-04-26T23:46:36.190086+0000","last_peered":"2024-04-26T23:46:36.190086+0000","last_clean":"2024-04-26T23:46:36.190086+0000","last_became_active":"2024-04-26T23:46:35.196593+0000","last_became_peered":"2024-04-26T23:46:35.196593+0000","last_unstale":"2024-04-26T23:46:36.190086+0000","last_undegraded":"2024-04-26T23:46:36.190086+0000","last_fullsized":"2024-04-26T23:46:36.190086+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:51.105741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053205+0000","last_change":"2024-04-26T23:46:35.184459+0000","last_active":"2024-04-26T23:46:38.053205+0000","last_peered":"2024-04-26T23:46:38.053205+0000","last_clean":"2024-04-26T23:46:38.053205+0000","last_became_active":"2024-04-26T23:46:35.182073+0000","last_became_peered":"2024-04-26T23:46:35.182073+0000","last_unstale":"2024-04-26T23:46:38.053205+0000","last_undegraded":"2024-04-26T23:46:38.053205+0000","last_fullsized":"2024-04-26T23:46:38.053205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:10:51.663370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190366+0000","last_change":"2024-04-26T23:46:35.190578+0000","last_active":"2024-04-26T23:46:36.190366+0000","last_peered":"2024-04-26T23:46:36.190366+0000","last_clean":"2024-04-26T23:46:36.190366+0000","last_became_active":"2024-04-26T23:46:35.190270+0000","last_became_peered":"2024-04-26T23:46:35.190270+0000","last_unstale":"2024-04-26T23:46:36.190366+0000","last_undegraded":"2024-04-26T23:46:36.190366+0000","last_fullsized":"2024-04-26T23:46:36.190366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:07.858089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192585+0000","last_change":"2024-04-26T23:46:35.204588+0000","last_active":"2024-04-26T23:46:36.192585+0000","last_peered":"2024-04-26T23:46:36.192585+0000","last_clean":"2024-04-26T23:46:36.192585+0000","last_became_active":"2024-04-26T23:46:35.204181+0000","last_became_peered":"2024-04-26T23:46:35.204181+0000","last_unstale":"2024-04-26T23:46:36.192585+0000","last_undegraded":"2024-04-26T23:46:36.192585+0000","last_fullsized":"2024-04-26T23:46:36.192585+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:30:08.620409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053804+0000","last_change":"2024-04-26T23:46:35.205771+0000","last_active":"2024-04-26T23:46:38.053804+0000","last_peered":"2024-04-26T23:46:38.053804+0000","last_clean":"2024-04-26T23:46:38.053804+0000","last_became_active":"2024-04-26T23:46:35.204646+0000","last_became_peered":"2024-04-26T23:46:35.204646+0000","last_unstale":"2024-04-26T23:46:38.053804+0000","last_undegraded":"2024-04-26T23:46:38.053804+0000","last_fullsized":"2024-04-26T23:46:38.053804+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:48:51.105741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192153+0000","last_change":"2024-04-26T23:46:35.191273+0000","last_active":"2024-04-26T23:46:36.192153+0000","last_peered":"2024-04-26T23:46:36.192153+0000","last_clean":"2024-04-26T23:46:36.192153+0000","last_became_active":"2024-04-26T23:46:35.189990+0000","last_became_peered":"2024-04-26T23:46:35.189990+0000","last_unstale":"2024-04-26T23:46:36.192153+0000","last_undegraded":"2024-04-26T23:46:36.192153+0000","last_fullsized":"2024-04-26T23:46:36.192153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:53.815915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545561+0000","last_change":"2024-04-26T23:46:35.200085+0000","last_active":"2024-04-26T23:46:36.545561+0000","last_peered":"2024-04-26T23:46:36.545561+0000","last_clean":"2024-04-26T23:46:36.545561+0000","last_became_active":"2024-04-26T23:46:35.199809+0000","last_became_peered":"2024-04-26T23:46:35.199809+0000","last_unstale":"2024-04-26T23:46:36.545561+0000","last_undegraded":"2024-04-26T23:46:36.545561+0000","last_fullsized":"2024-04-26T23:46:36.545561+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:14.254807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191503+0000","last_change":"2024-04-26T23:46:35.192529+0000","last_active":"2024-04-26T23:46:36.191503+0000","last_peered":"2024-04-26T23:46:36.191503+0000","last_clean":"2024-04-26T23:46:36.191503+0000","last_became_active":"2024-04-26T23:46:35.186590+0000","last_became_peered":"2024-04-26T23:46:35.186590+0000","last_unstale":"2024-04-26T23:46:36.191503+0000","last_undegraded":"2024-04-26T23:46:36.191503+0000","last_fullsized":"2024-04-26T23:46:36.191503+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:29:00.041295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177991+0000","last_change":"2024-04-26T23:46:35.212650+0000","last_active":"2024-04-26T23:46:37.177991+0000","last_peered":"2024-04-26T23:46:37.177991+0000","last_clean":"2024-04-26T23:46:37.177991+0000","last_became_active":"2024-04-26T23:46:35.212352+0000","last_became_peered":"2024-04-26T23:46:35.212352+0000","last_unstale":"2024-04-26T23:46:37.177991+0000","last_undegraded":"2024-04-26T23:46:37.177991+0000","last_fullsized":"2024-04-26T23:46:37.177991+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:32:25.037275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545775+0000","last_change":"2024-04-26T23:46:34.175419+0000","last_active":"2024-04-26T23:46:36.545775+0000","last_peered":"2024-04-26T23:46:36.545775+0000","last_clean":"2024-04-26T23:46:36.545775+0000","last_became_active":"2024-04-26T23:46:34.175127+0000","last_became_peered":"2024-04-26T23:46:34.175127+0000","last_unstale":"2024-04-26T23:46:36.545775+0000","last_undegraded":"2024-04-26T23:46:36.545775+0000","last_fullsized":"2024-04-26T23:46:36.545775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:31.072186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545764+0000","last_change":"2024-04-26T23:46:35.203025+0000","last_active":"2024-04-26T23:46:36.545764+0000","last_peered":"2024-04-26T23:46:36.545764+0000","last_clean":"2024-04-26T23:46:36.545764+0000","last_became_active":"2024-04-26T23:46:35.202771+0000","last_became_peered":"2024-04-26T23:46:35.202771+0000","last_unstale":"2024-04-26T23:46:36.545764+0000","last_undegraded":"2024-04-26T23:46:36.545764+0000","last_fullsized":"2024-04-26T23:46:36.545764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:51.107397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177987+0000","last_change":"2024-04-26T23:46:34.179522+0000","last_active":"2024-04-26T23:46:37.177987+0000","last_peered":"2024-04-26T23:46:37.177987+0000","last_clean":"2024-04-26T23:46:37.177987+0000","last_became_active":"2024-04-26T23:46:34.178898+0000","last_became_peered":"2024-04-26T23:46:34.178898+0000","last_unstale":"2024-04-26T23:46:37.177987+0000","last_undegraded":"2024-04-26T23:46:37.177987+0000","last_fullsized":"2024-04-26T23:46:37.177987+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:48:28.007472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053869+0000","last_change":"2024-04-26T23:46:35.202999+0000","last_active":"2024-04-26T23:46:38.053869+0000","last_peered":"2024-04-26T23:46:38.053869+0000","last_clean":"2024-04-26T23:46:38.053869+0000","last_became_active":"2024-04-26T23:46:35.202641+0000","last_became_peered":"2024-04-26T23:46:35.202641+0000","last_unstale":"2024-04-26T23:46:38.053869+0000","last_undegraded":"2024-04-26T23:46:38.053869+0000","last_fullsized":"2024-04-26T23:46:38.053869+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:40.275347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052877+0000","last_change":"2024-04-26T23:46:34.187217+0000","last_active":"2024-04-26T23:46:38.052877+0000","last_peered":"2024-04-26T23:46:38.052877+0000","last_clean":"2024-04-26T23:46:38.052877+0000","last_became_active":"2024-04-26T23:46:34.186901+0000","last_became_peered":"2024-04-26T23:46:34.186901+0000","last_unstale":"2024-04-26T23:46:38.052877+0000","last_undegraded":"2024-04-26T23:46:38.052877+0000","last_fullsized":"2024-04-26T23:46:38.052877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:53.287265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190441+0000","last_change":"2024-04-26T23:46:35.195152+0000","last_active":"2024-04-26T23:46:36.190441+0000","last_peered":"2024-04-26T23:46:36.190441+0000","last_clean":"2024-04-26T23:46:36.190441+0000","last_became_active":"2024-04-26T23:46:35.194872+0000","last_became_peered":"2024-04-26T23:46:35.194872+0000","last_unstale":"2024-04-26T23:46:36.190441+0000","last_undegraded":"2024-04-26T23:46:36.190441+0000","last_fullsized":"2024-04-26T23:46:36.190441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:24:34.408393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548581+0000","last_change":"2024-04-26T23:46:34.179542+0000","last_active":"2024-04-26T23:46:37.548581+0000","last_peered":"2024-04-26T23:46:37.548581+0000","last_clean":"2024-04-26T23:46:37.548581+0000","last_became_active":"2024-04-26T23:46:34.179230+0000","last_became_peered":"2024-04-26T23:46:34.179230+0000","last_unstale":"2024-04-26T23:46:37.548581+0000","last_undegraded":"2024-04-26T23:46:37.548581+0000","last_fullsized":"2024-04-26T23:46:37.548581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:25.325186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192288+0000","last_change":"2024-04-26T23:46:35.197627+0000","last_active":"2024-04-26T23:46:36.192288+0000","last_peered":"2024-04-26T23:46:36.192288+0000","last_clean":"2024-04-26T23:46:36.192288+0000","last_became_active":"2024-04-26T23:46:35.197349+0000","last_became_peered":"2024-04-26T23:46:35.197349+0000","last_unstale":"2024-04-26T23:46:36.192288+0000","last_undegraded":"2024-04-26T23:46:36.192288+0000","last_fullsized":"2024-04-26T23:46:36.192288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:56.717980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053873+0000","last_change":"2024-04-26T23:46:34.178810+0000","last_active":"2024-04-26T23:46:38.053873+0000","last_peered":"2024-04-26T23:46:38.053873+0000","last_clean":"2024-04-26T23:46:38.053873+0000","last_became_active":"2024-04-26T23:46:34.177743+0000","last_became_peered":"2024-04-26T23:46:34.177743+0000","last_unstale":"2024-04-26T23:46:38.053873+0000","last_undegraded":"2024-04-26T23:46:38.053873+0000","last_fullsized":"2024-04-26T23:46:38.053873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:32:54.994053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192497+0000","last_change":"2024-04-26T23:46:35.204554+0000","last_active":"2024-04-26T23:46:36.192497+0000","last_peered":"2024-04-26T23:46:36.192497+0000","last_clean":"2024-04-26T23:46:36.192497+0000","last_became_active":"2024-04-26T23:46:35.204174+0000","last_became_peered":"2024-04-26T23:46:35.204174+0000","last_unstale":"2024-04-26T23:46:36.192497+0000","last_undegraded":"2024-04-26T23:46:36.192497+0000","last_fullsized":"2024-04-26T23:46:36.192497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:15.266045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053670+0000","last_change":"2024-04-26T23:46:34.186701+0000","last_active":"2024-04-26T23:46:38.053670+0000","last_peered":"2024-04-26T23:46:38.053670+0000","last_clean":"2024-04-26T23:46:38.053670+0000","last_became_active":"2024-04-26T23:46:34.186448+0000","last_became_peered":"2024-04-26T23:46:34.186448+0000","last_unstale":"2024-04-26T23:46:38.053670+0000","last_undegraded":"2024-04-26T23:46:38.053670+0000","last_fullsized":"2024-04-26T23:46:38.053670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.842965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053492+0000","last_change":"2024-04-26T23:46:35.192096+0000","last_active":"2024-04-26T23:46:38.053492+0000","last_peered":"2024-04-26T23:46:38.053492+0000","last_clean":"2024-04-26T23:46:38.053492+0000","last_became_active":"2024-04-26T23:46:35.191748+0000","last_became_peered":"2024-04-26T23:46:35.191748+0000","last_unstale":"2024-04-26T23:46:38.053492+0000","last_undegraded":"2024-04-26T23:46:38.053492+0000","last_fullsized":"2024-04-26T23:46:38.053492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:41.001799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052434+0000","last_change":"2024-04-26T23:46:34.181576+0000","last_active":"2024-04-26T23:46:38.052434+0000","last_peered":"2024-04-26T23:46:38.052434+0000","last_clean":"2024-04-26T23:46:38.052434+0000","last_became_active":"2024-04-26T23:46:34.181279+0000","last_became_peered":"2024-04-26T23:46:34.181279+0000","last_unstale":"2024-04-26T23:46:38.052434+0000","last_undegraded":"2024-04-26T23:46:38.052434+0000","last_fullsized":"2024-04-26T23:46:38.052434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:30.110501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189807+0000","last_change":"2024-04-26T23:46:35.195635+0000","last_active":"2024-04-26T23:46:36.189807+0000","last_peered":"2024-04-26T23:46:36.189807+0000","last_clean":"2024-04-26T23:46:36.189807+0000","last_became_active":"2024-04-26T23:46:35.188492+0000","last_became_peered":"2024-04-26T23:46:35.188492+0000","last_unstale":"2024-04-26T23:46:36.189807+0000","last_undegraded":"2024-04-26T23:46:36.189807+0000","last_fullsized":"2024-04-26T23:46:36.189807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:06:40.275347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053426+0000","last_change":"2024-04-26T23:46:34.169490+0000","last_active":"2024-04-26T23:46:38.053426+0000","last_peered":"2024-04-26T23:46:38.053426+0000","last_clean":"2024-04-26T23:46:38.053426+0000","last_became_active":"2024-04-26T23:46:34.169205+0000","last_became_peered":"2024-04-26T23:46:34.169205+0000","last_unstale":"2024-04-26T23:46:38.053426+0000","last_undegraded":"2024-04-26T23:46:38.053426+0000","last_fullsized":"2024-04-26T23:46:38.053426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:12.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192999+0000","last_change":"2024-04-26T23:46:35.196760+0000","last_active":"2024-04-26T23:46:36.192999+0000","last_peered":"2024-04-26T23:46:36.192999+0000","last_clean":"2024-04-26T23:46:36.192999+0000","last_became_active":"2024-04-26T23:46:35.196241+0000","last_became_peered":"2024-04-26T23:46:35.196241+0000","last_unstale":"2024-04-26T23:46:36.192999+0000","last_undegraded":"2024-04-26T23:46:36.192999+0000","last_fullsized":"2024-04-26T23:46:36.192999+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:14:02.371036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053059+0000","last_change":"2024-04-26T23:46:34.179582+0000","last_active":"2024-04-26T23:46:38.053059+0000","last_peered":"2024-04-26T23:46:38.053059+0000","last_clean":"2024-04-26T23:46:38.053059+0000","last_became_active":"2024-04-26T23:46:34.179049+0000","last_became_peered":"2024-04-26T23:46:34.179049+0000","last_unstale":"2024-04-26T23:46:38.053059+0000","last_undegraded":"2024-04-26T23:46:38.053059+0000","last_fullsized":"2024-04-26T23:46:38.053059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:11:53.337552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053078+0000","last_change":"2024-04-26T23:46:35.192689+0000","last_active":"2024-04-26T23:46:38.053078+0000","last_peered":"2024-04-26T23:46:38.053078+0000","last_clean":"2024-04-26T23:46:38.053078+0000","last_became_active":"2024-04-26T23:46:35.192450+0000","last_became_peered":"2024-04-26T23:46:35.192450+0000","last_unstale":"2024-04-26T23:46:38.053078+0000","last_undegraded":"2024-04-26T23:46:38.053078+0000","last_fullsized":"2024-04-26T23:46:38.053078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:46:14.516901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178104+0000","last_change":"2024-04-26T23:46:34.184484+0000","last_active":"2024-04-26T23:46:37.178104+0000","last_peered":"2024-04-26T23:46:37.178104+0000","last_clean":"2024-04-26T23:46:37.178104+0000","last_became_active":"2024-04-26T23:46:34.184146+0000","last_became_peered":"2024-04-26T23:46:34.184146+0000","last_unstale":"2024-04-26T23:46:37.178104+0000","last_undegraded":"2024-04-26T23:46:37.178104+0000","last_fullsized":"2024-04-26T23:46:37.178104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:34:07.516736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052837+0000","last_change":"2024-04-26T23:46:35.181947+0000","last_active":"2024-04-26T23:46:38.052837+0000","last_peered":"2024-04-26T23:46:38.052837+0000","last_clean":"2024-04-26T23:46:38.052837+0000","last_became_active":"2024-04-26T23:46:35.181657+0000","last_became_peered":"2024-04-26T23:46:35.181657+0000","last_unstale":"2024-04-26T23:46:38.052837+0000","last_undegraded":"2024-04-26T23:46:38.052837+0000","last_fullsized":"2024-04-26T23:46:38.052837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:14:02.371036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192827+0000","last_change":"2024-04-26T23:46:34.179540+0000","last_active":"2024-04-26T23:46:36.192827+0000","last_peered":"2024-04-26T23:46:36.192827+0000","last_clean":"2024-04-26T23:46:36.192827+0000","last_became_active":"2024-04-26T23:46:34.179281+0000","last_became_peered":"2024-04-26T23:46:34.179281+0000","last_unstale":"2024-04-26T23:46:36.192827+0000","last_undegraded":"2024-04-26T23:46:36.192827+0000","last_fullsized":"2024-04-26T23:46:36.192827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:30.110501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.192840+0000","last_change":"2024-04-26T23:46:35.195141+0000","last_active":"2024-04-26T23:46:36.192840+0000","last_peered":"2024-04-26T23:46:36.192840+0000","last_clean":"2024-04-26T23:46:36.192840+0000","last_became_active":"2024-04-26T23:46:35.194861+0000","last_became_peered":"2024-04-26T23:46:35.194861+0000","last_unstale":"2024-04-26T23:46:36.192840+0000","last_undegraded":"2024-04-26T23:46:36.192840+0000","last_fullsized":"2024-04-26T23:46:36.192840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:30.472463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052842+0000","last_change":"2024-04-26T23:46:34.186637+0000","last_active":"2024-04-26T23:46:38.052842+0000","last_peered":"2024-04-26T23:46:38.052842+0000","last_clean":"2024-04-26T23:46:38.052842+0000","last_became_active":"2024-04-26T23:46:34.186389+0000","last_became_peered":"2024-04-26T23:46:34.186389+0000","last_unstale":"2024-04-26T23:46:38.052842+0000","last_undegraded":"2024-04-26T23:46:38.052842+0000","last_fullsized":"2024-04-26T23:46:38.052842+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:13.248964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189808+0000","last_change":"2024-04-26T23:46:35.193016+0000","last_active":"2024-04-26T23:46:36.189808+0000","last_peered":"2024-04-26T23:46:36.189808+0000","last_clean":"2024-04-26T23:46:36.189808+0000","last_became_active":"2024-04-26T23:46:35.184083+0000","last_became_peered":"2024-04-26T23:46:35.184083+0000","last_unstale":"2024-04-26T23:46:36.189808+0000","last_undegraded":"2024-04-26T23:46:36.189808+0000","last_fullsized":"2024-04-26T23:46:36.189808+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:41.001799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053919+0000","last_change":"2024-04-26T23:46:34.166497+0000","last_active":"2024-04-26T23:46:38.053919+0000","last_peered":"2024-04-26T23:46:38.053919+0000","last_clean":"2024-04-26T23:46:38.053919+0000","last_became_active":"2024-04-26T23:46:34.165705+0000","last_became_peered":"2024-04-26T23:46:34.165705+0000","last_unstale":"2024-04-26T23:46:38.053919+0000","last_undegraded":"2024-04-26T23:46:38.053919+0000","last_fullsized":"2024-04-26T23:46:38.053919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:31.072186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052708+0000","last_change":"2024-04-26T23:46:35.205542+0000","last_active":"2024-04-26T23:46:38.052708+0000","last_peered":"2024-04-26T23:46:38.052708+0000","last_clean":"2024-04-26T23:46:38.052708+0000","last_became_active":"2024-04-26T23:46:35.205164+0000","last_became_peered":"2024-04-26T23:46:35.205164+0000","last_unstale":"2024-04-26T23:46:38.052708+0000","last_undegraded":"2024-04-26T23:46:38.052708+0000","last_fullsized":"2024-04-26T23:46:38.052708+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:16:30.472463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189913+0000","last_change":"2024-04-26T23:46:34.173170+0000","last_active":"2024-04-26T23:46:36.189913+0000","last_peered":"2024-04-26T23:46:36.189913+0000","last_clean":"2024-04-26T23:46:36.189913+0000","last_became_active":"2024-04-26T23:46:34.172917+0000","last_became_peered":"2024-04-26T23:46:34.172917+0000","last_unstale":"2024-04-26T23:46:36.189913+0000","last_undegraded":"2024-04-26T23:46:36.189913+0000","last_fullsized":"2024-04-26T23:46:36.189913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:59.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191586+0000","last_change":"2024-04-26T23:46:35.187403+0000","last_active":"2024-04-26T23:46:36.191586+0000","last_peered":"2024-04-26T23:46:36.191586+0000","last_clean":"2024-04-26T23:46:36.191586+0000","last_became_active":"2024-04-26T23:46:35.186132+0000","last_became_peered":"2024-04-26T23:46:35.186132+0000","last_unstale":"2024-04-26T23:46:36.191586+0000","last_undegraded":"2024-04-26T23:46:36.191586+0000","last_fullsized":"2024-04-26T23:46:36.191586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:18:03.006625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052705+0000","last_change":"2024-04-26T23:46:34.179239+0000","last_active":"2024-04-26T23:46:38.052705+0000","last_peered":"2024-04-26T23:46:38.052705+0000","last_clean":"2024-04-26T23:46:38.052705+0000","last_became_active":"2024-04-26T23:46:34.178903+0000","last_became_peered":"2024-04-26T23:46:34.178903+0000","last_unstale":"2024-04-26T23:46:38.052705+0000","last_undegraded":"2024-04-26T23:46:38.052705+0000","last_fullsized":"2024-04-26T23:46:38.052705+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:01:50.101554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545727+0000","last_change":"2024-04-26T23:46:35.206287+0000","last_active":"2024-04-26T23:46:36.545727+0000","last_peered":"2024-04-26T23:46:36.545727+0000","last_clean":"2024-04-26T23:46:36.545727+0000","last_became_active":"2024-04-26T23:46:35.204661+0000","last_became_peered":"2024-04-26T23:46:35.204661+0000","last_unstale":"2024-04-26T23:46:36.545727+0000","last_undegraded":"2024-04-26T23:46:36.545727+0000","last_fullsized":"2024-04-26T23:46:36.545727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:05:31.116344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052448+0000","last_change":"2024-04-26T23:46:34.186295+0000","last_active":"2024-04-26T23:46:38.052448+0000","last_peered":"2024-04-26T23:46:38.052448+0000","last_clean":"2024-04-26T23:46:38.052448+0000","last_became_active":"2024-04-26T23:46:34.186014+0000","last_became_peered":"2024-04-26T23:46:34.186014+0000","last_unstale":"2024-04-26T23:46:38.052448+0000","last_undegraded":"2024-04-26T23:46:38.052448+0000","last_fullsized":"2024-04-26T23:46:38.052448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:17:39.995956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054068+0000","last_change":"2024-04-26T23:46:35.186529+0000","last_active":"2024-04-26T23:46:38.054068+0000","last_peered":"2024-04-26T23:46:38.054068+0000","last_clean":"2024-04-26T23:46:38.054068+0000","last_became_active":"2024-04-26T23:46:35.185597+0000","last_became_peered":"2024-04-26T23:46:35.185597+0000","last_unstale":"2024-04-26T23:46:38.054068+0000","last_undegraded":"2024-04-26T23:46:38.054068+0000","last_fullsized":"2024-04-26T23:46:38.054068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:09:49.613237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190184+0000","last_change":"2024-04-26T23:46:34.180474+0000","last_active":"2024-04-26T23:46:36.190184+0000","last_peered":"2024-04-26T23:46:36.190184+0000","last_clean":"2024-04-26T23:46:36.190184+0000","last_became_active":"2024-04-26T23:46:34.180195+0000","last_became_peered":"2024-04-26T23:46:34.180195+0000","last_unstale":"2024-04-26T23:46:36.190184+0000","last_undegraded":"2024-04-26T23:46:36.190184+0000","last_fullsized":"2024-04-26T23:46:36.190184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:28.087390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.193176+0000","last_change":"2024-04-26T23:46:35.186698+0000","last_active":"2024-04-26T23:46:36.193176+0000","last_peered":"2024-04-26T23:46:36.193176+0000","last_clean":"2024-04-26T23:46:36.193176+0000","last_became_active":"2024-04-26T23:46:35.186005+0000","last_became_peered":"2024-04-26T23:46:35.186005+0000","last_unstale":"2024-04-26T23:46:36.193176+0000","last_undegraded":"2024-04-26T23:46:36.193176+0000","last_fullsized":"2024-04-26T23:46:36.193176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:53.815915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054066+0000","last_change":"2024-04-26T23:46:34.171710+0000","last_active":"2024-04-26T23:46:38.054066+0000","last_peered":"2024-04-26T23:46:38.054066+0000","last_clean":"2024-04-26T23:46:38.054066+0000","last_became_active":"2024-04-26T23:46:34.171422+0000","last_became_peered":"2024-04-26T23:46:34.171422+0000","last_unstale":"2024-04-26T23:46:38.054066+0000","last_undegraded":"2024-04-26T23:46:38.054066+0000","last_fullsized":"2024-04-26T23:46:38.054066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:54:59.387517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190006+0000","last_change":"2024-04-26T23:46:35.207197+0000","last_active":"2024-04-26T23:46:36.190006+0000","last_peered":"2024-04-26T23:46:36.190006+0000","last_clean":"2024-04-26T23:46:36.190006+0000","last_became_active":"2024-04-26T23:46:35.206948+0000","last_became_peered":"2024-04-26T23:46:35.206948+0000","last_unstale":"2024-04-26T23:46:36.190006+0000","last_undegraded":"2024-04-26T23:46:36.190006+0000","last_fullsized":"2024-04-26T23:46:36.190006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:01:48.547701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.054073+0000","last_change":"2024-04-26T23:46:34.173257+0000","last_active":"2024-04-26T23:46:38.054073+0000","last_peered":"2024-04-26T23:46:38.054073+0000","last_clean":"2024-04-26T23:46:38.054073+0000","last_became_active":"2024-04-26T23:46:34.172921+0000","last_became_peered":"2024-04-26T23:46:34.172921+0000","last_unstale":"2024-04-26T23:46:38.054073+0000","last_undegraded":"2024-04-26T23:46:38.054073+0000","last_fullsized":"2024-04-26T23:46:38.054073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:28.087390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548574+0000","last_change":"2024-04-26T23:46:35.183489+0000","last_active":"2024-04-26T23:46:37.548574+0000","last_peered":"2024-04-26T23:46:37.548574+0000","last_clean":"2024-04-26T23:46:37.548574+0000","last_became_active":"2024-04-26T23:46:35.183205+0000","last_became_peered":"2024-04-26T23:46:35.183205+0000","last_unstale":"2024-04-26T23:46:37.548574+0000","last_undegraded":"2024-04-26T23:46:37.548574+0000","last_fullsized":"2024-04-26T23:46:37.548574+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:12.455967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053814+0000","last_change":"2024-04-26T23:46:34.178125+0000","last_active":"2024-04-26T23:46:38.053814+0000","last_peered":"2024-04-26T23:46:38.053814+0000","last_clean":"2024-04-26T23:46:38.053814+0000","last_became_active":"2024-04-26T23:46:34.177837+0000","last_became_peered":"2024-04-26T23:46:34.177837+0000","last_unstale":"2024-04-26T23:46:38.053814+0000","last_undegraded":"2024-04-26T23:46:38.053814+0000","last_fullsized":"2024-04-26T23:46:38.053814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:44.753454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548307+0000","last_change":"2024-04-26T23:46:35.187104+0000","last_active":"2024-04-26T23:46:37.548307+0000","last_peered":"2024-04-26T23:46:37.548307+0000","last_clean":"2024-04-26T23:46:37.548307+0000","last_became_active":"2024-04-26T23:46:35.186712+0000","last_became_peered":"2024-04-26T23:46:35.186712+0000","last_unstale":"2024-04-26T23:46:37.548307+0000","last_undegraded":"2024-04-26T23:46:37.548307+0000","last_fullsized":"2024-04-26T23:46:37.548307+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:32:29.093232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178215+0000","last_change":"2024-04-26T23:46:34.166608+0000","last_active":"2024-04-26T23:46:37.178215+0000","last_peered":"2024-04-26T23:46:37.178215+0000","last_clean":"2024-04-26T23:46:37.178215+0000","last_became_active":"2024-04-26T23:46:34.166347+0000","last_became_peered":"2024-04-26T23:46:34.166347+0000","last_unstale":"2024-04-26T23:46:37.178215+0000","last_undegraded":"2024-04-26T23:46:37.178215+0000","last_fullsized":"2024-04-26T23:46:37.178215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:58:21.196486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548445+0000","last_change":"2024-04-26T23:46:35.205435+0000","last_active":"2024-04-26T23:46:37.548445+0000","last_peered":"2024-04-26T23:46:37.548445+0000","last_clean":"2024-04-26T23:46:37.548445+0000","last_became_active":"2024-04-26T23:46:35.204772+0000","last_became_peered":"2024-04-26T23:46:35.204772+0000","last_unstale":"2024-04-26T23:46:37.548445+0000","last_undegraded":"2024-04-26T23:46:37.548445+0000","last_fullsized":"2024-04-26T23:46:37.548445+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:11:14.254807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545518+0000","last_change":"2024-04-26T23:46:34.178182+0000","last_active":"2024-04-26T23:46:36.545518+0000","last_peered":"2024-04-26T23:46:36.545518+0000","last_clean":"2024-04-26T23:46:36.545518+0000","last_became_active":"2024-04-26T23:46:34.177914+0000","last_became_peered":"2024-04-26T23:46:34.177914+0000","last_unstale":"2024-04-26T23:46:36.545518+0000","last_undegraded":"2024-04-26T23:46:36.545518+0000","last_fullsized":"2024-04-26T23:46:36.545518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:32:54.994053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548194+0000","last_change":"2024-04-26T23:46:35.198438+0000","last_active":"2024-04-26T23:46:37.548194+0000","last_peered":"2024-04-26T23:46:37.548194+0000","last_clean":"2024-04-26T23:46:37.548194+0000","last_became_active":"2024-04-26T23:46:35.198139+0000","last_became_peered":"2024-04-26T23:46:35.198139+0000","last_unstale":"2024-04-26T23:46:37.548194+0000","last_undegraded":"2024-04-26T23:46:37.548194+0000","last_fullsized":"2024-04-26T23:46:37.548194+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:45.759296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053473+0000","last_change":"2024-04-26T23:46:34.171217+0000","last_active":"2024-04-26T23:46:38.053473+0000","last_peered":"2024-04-26T23:46:38.053473+0000","last_clean":"2024-04-26T23:46:38.053473+0000","last_became_active":"2024-04-26T23:46:34.170668+0000","last_became_peered":"2024-04-26T23:46:34.170668+0000","last_unstale":"2024-04-26T23:46:38.053473+0000","last_undegraded":"2024-04-26T23:46:38.053473+0000","last_fullsized":"2024-04-26T23:46:38.053473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:43:53.022594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191713+0000","last_change":"2024-04-26T23:46:35.194407+0000","last_active":"2024-04-26T23:46:36.191713+0000","last_peered":"2024-04-26T23:46:36.191713+0000","last_clean":"2024-04-26T23:46:36.191713+0000","last_became_active":"2024-04-26T23:46:35.192229+0000","last_became_peered":"2024-04-26T23:46:35.192229+0000","last_unstale":"2024-04-26T23:46:36.191713+0000","last_undegraded":"2024-04-26T23:46:36.191713+0000","last_fullsized":"2024-04-26T23:46:36.191713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:46:15.266045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191142+0000","last_change":"2024-04-26T23:46:34.179422+0000","last_active":"2024-04-26T23:46:36.191142+0000","last_peered":"2024-04-26T23:46:36.191142+0000","last_clean":"2024-04-26T23:46:36.191142+0000","last_became_active":"2024-04-26T23:46:34.179130+0000","last_became_peered":"2024-04-26T23:46:34.179130+0000","last_unstale":"2024-04-26T23:46:36.191142+0000","last_undegraded":"2024-04-26T23:46:36.191142+0000","last_fullsized":"2024-04-26T23:46:36.191142+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:02.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.548590+0000","last_change":"2024-04-26T23:46:35.190732+0000","last_active":"2024-04-26T23:46:37.548590+0000","last_peered":"2024-04-26T23:46:37.548590+0000","last_clean":"2024-04-26T23:46:37.548590+0000","last_became_active":"2024-04-26T23:46:35.189908+0000","last_became_peered":"2024-04-26T23:46:35.189908+0000","last_unstale":"2024-04-26T23:46:37.548590+0000","last_undegraded":"2024-04-26T23:46:37.548590+0000","last_fullsized":"2024-04-26T23:46:37.548590+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:54.293107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190261+0000","last_change":"2024-04-26T23:46:34.176531+0000","last_active":"2024-04-26T23:46:36.190261+0000","last_peered":"2024-04-26T23:46:36.190261+0000","last_clean":"2024-04-26T23:46:36.190261+0000","last_became_active":"2024-04-26T23:46:34.176220+0000","last_became_peered":"2024-04-26T23:46:34.176220+0000","last_unstale":"2024-04-26T23:46:36.190261+0000","last_undegraded":"2024-04-26T23:46:36.190261+0000","last_fullsized":"2024-04-26T23:46:36.190261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:30.093195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.193240+0000","last_change":"2024-04-26T23:46:35.195106+0000","last_active":"2024-04-26T23:46:36.193240+0000","last_peered":"2024-04-26T23:46:36.193240+0000","last_clean":"2024-04-26T23:46:36.193240+0000","last_became_active":"2024-04-26T23:46:35.189319+0000","last_became_peered":"2024-04-26T23:46:35.189319+0000","last_unstale":"2024-04-26T23:46:36.193240+0000","last_undegraded":"2024-04-26T23:46:36.193240+0000","last_fullsized":"2024-04-26T23:46:36.193240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:24:56.717980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.179642+0000","last_change":"2024-04-26T23:46:34.179775+0000","last_active":"2024-04-26T23:46:37.179642+0000","last_peered":"2024-04-26T23:46:37.179642+0000","last_clean":"2024-04-26T23:46:37.179642+0000","last_became_active":"2024-04-26T23:46:34.179263+0000","last_became_peered":"2024-04-26T23:46:34.179263+0000","last_unstale":"2024-04-26T23:46:37.179642+0000","last_undegraded":"2024-04-26T23:46:37.179642+0000","last_fullsized":"2024-04-26T23:46:37.179642+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:22:06.779214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.177990+0000","last_change":"2024-04-26T23:46:35.216748+0000","last_active":"2024-04-26T23:46:37.177990+0000","last_peered":"2024-04-26T23:46:37.177990+0000","last_clean":"2024-04-26T23:46:37.177990+0000","last_became_active":"2024-04-26T23:46:35.216496+0000","last_became_peered":"2024-04-26T23:46:35.216496+0000","last_unstale":"2024-04-26T23:46:37.177990+0000","last_undegraded":"2024-04-26T23:46:37.177990+0000","last_fullsized":"2024-04-26T23:46:37.177990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:23:28.165344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.190117+0000","last_change":"2024-04-26T23:46:34.170536+0000","last_active":"2024-04-26T23:46:36.190117+0000","last_peered":"2024-04-26T23:46:36.190117+0000","last_clean":"2024-04-26T23:46:36.190117+0000","last_became_active":"2024-04-26T23:46:34.169534+0000","last_became_peered":"2024-04-26T23:46:34.169534+0000","last_unstale":"2024-04-26T23:46:36.190117+0000","last_undegraded":"2024-04-26T23:46:36.190117+0000","last_fullsized":"2024-04-26T23:46:36.190117+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:24:53.842965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545547+0000","last_change":"2024-04-26T23:46:35.203559+0000","last_active":"2024-04-26T23:46:36.545547+0000","last_peered":"2024-04-26T23:46:36.545547+0000","last_clean":"2024-04-26T23:46:36.545547+0000","last_became_active":"2024-04-26T23:46:35.203247+0000","last_became_peered":"2024-04-26T23:46:35.203247+0000","last_unstale":"2024-04-26T23:46:36.545547+0000","last_undegraded":"2024-04-26T23:46:36.545547+0000","last_fullsized":"2024-04-26T23:46:36.545547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:54.293107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178282+0000","last_change":"2024-04-26T23:46:34.172190+0000","last_active":"2024-04-26T23:46:37.178282+0000","last_peered":"2024-04-26T23:46:37.178282+0000","last_clean":"2024-04-26T23:46:37.178282+0000","last_became_active":"2024-04-26T23:46:34.171719+0000","last_became_peered":"2024-04-26T23:46:34.171719+0000","last_unstale":"2024-04-26T23:46:37.178282+0000","last_undegraded":"2024-04-26T23:46:37.178282+0000","last_fullsized":"2024-04-26T23:46:37.178282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:30.994345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:37.178124+0000","last_change":"2024-04-26T23:46:35.203022+0000","last_active":"2024-04-26T23:46:37.178124+0000","last_peered":"2024-04-26T23:46:37.178124+0000","last_clean":"2024-04-26T23:46:37.178124+0000","last_became_active":"2024-04-26T23:46:35.202511+0000","last_became_peered":"2024-04-26T23:46:35.202511+0000","last_unstale":"2024-04-26T23:46:37.178124+0000","last_undegraded":"2024-04-26T23:46:37.178124+0000","last_fullsized":"2024-04-26T23:46:37.178124+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:59:34.104236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.189996+0000","last_change":"2024-04-26T23:46:34.175739+0000","last_active":"2024-04-26T23:46:36.189996+0000","last_peered":"2024-04-26T23:46:36.189996+0000","last_clean":"2024-04-26T23:46:36.189996+0000","last_became_active":"2024-04-26T23:46:34.175510+0000","last_became_peered":"2024-04-26T23:46:34.175510+0000","last_unstale":"2024-04-26T23:46:36.189996+0000","last_undegraded":"2024-04-26T23:46:36.189996+0000","last_fullsized":"2024-04-26T23:46:36.189996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:37:44.753454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052440+0000","last_change":"2024-04-26T23:46:35.188940+0000","last_active":"2024-04-26T23:46:38.052440+0000","last_peered":"2024-04-26T23:46:38.052440+0000","last_clean":"2024-04-26T23:46:38.052440+0000","last_became_active":"2024-04-26T23:46:35.188660+0000","last_became_peered":"2024-04-26T23:46:35.188660+0000","last_unstale":"2024-04-26T23:46:38.052440+0000","last_undegraded":"2024-04-26T23:46:38.052440+0000","last_fullsized":"2024-04-26T23:46:38.052440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:30:08.620409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053602+0000","last_change":"2024-04-26T23:46:34.170955+0000","last_active":"2024-04-26T23:46:38.053602+0000","last_peered":"2024-04-26T23:46:38.053602+0000","last_clean":"2024-04-26T23:46:38.053602+0000","last_became_active":"2024-04-26T23:46:34.170342+0000","last_became_peered":"2024-04-26T23:46:34.170342+0000","last_unstale":"2024-04-26T23:46:38.053602+0000","last_undegraded":"2024-04-26T23:46:38.053602+0000","last_fullsized":"2024-04-26T23:46:38.053602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:41:13.761664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.053463+0000","last_change":"2024-04-26T23:46:35.203593+0000","last_active":"2024-04-26T23:46:38.053463+0000","last_peered":"2024-04-26T23:46:38.053463+0000","last_clean":"2024-04-26T23:46:38.053463+0000","last_became_active":"2024-04-26T23:46:35.203363+0000","last_became_peered":"2024-04-26T23:46:35.203363+0000","last_unstale":"2024-04-26T23:46:38.053463+0000","last_undegraded":"2024-04-26T23:46:38.053463+0000","last_fullsized":"2024-04-26T23:46:38.053463+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:11:54.343395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:38.052577+0000","last_change":"2024-04-26T23:46:34.179277+0000","last_active":"2024-04-26T23:46:38.052577+0000","last_peered":"2024-04-26T23:46:38.052577+0000","last_clean":"2024-04-26T23:46:38.052577+0000","last_became_active":"2024-04-26T23:46:34.178980+0000","last_became_peered":"2024-04-26T23:46:34.178980+0000","last_unstale":"2024-04-26T23:46:38.052577+0000","last_undegraded":"2024-04-26T23:46:38.052577+0000","last_fullsized":"2024-04-26T23:46:38.052577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:02.936840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191562+0000","last_change":"2024-04-26T23:46:35.190865+0000","last_active":"2024-04-26T23:46:36.191562+0000","last_peered":"2024-04-26T23:46:36.191562+0000","last_clean":"2024-04-26T23:46:36.191562+0000","last_became_active":"2024-04-26T23:46:35.190580+0000","last_became_peered":"2024-04-26T23:46:35.190580+0000","last_unstale":"2024-04-26T23:46:36.191562+0000","last_undegraded":"2024-04-26T23:46:36.191562+0000","last_fullsized":"2024-04-26T23:46:36.191562+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:34.147822+0000","last_clean_scrub_stamp":"2024-04-26T23:46:34.147822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:55.885729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.545472+0000","last_change":"2024-04-26T23:46:34.176449+0000","last_active":"2024-04-26T23:46:36.545472+0000","last_peered":"2024-04-26T23:46:36.545472+0000","last_clean":"2024-04-26T23:46:36.545472+0000","last_became_active":"2024-04-26T23:46:34.176138+0000","last_became_peered":"2024-04-26T23:46:34.176138+0000","last_unstale":"2024-04-26T23:46:36.545472+0000","last_undegraded":"2024-04-26T23:46:36.545472+0000","last_fullsized":"2024-04-26T23:46:36.545472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:46:33.141980+0000","last_clean_scrub_stamp":"2024-04-26T23:46:33.141980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:12.625797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T23:46:36.191967+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:46:36.191967+0000","last_peered":"2024-04-26T23:46:36.191967+0000","last_clean":"2024-04-26T23:46:36.191967+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:46:36.191967+0000","last_undegraded":"2024-04-26T23:46:36.191967+0000","last_fullsized":"2024-04-26T23:46:36.191967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":747257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":157471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":409600,"data_stored":156903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":158433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":156869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":158433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":995328,"data_stored":747167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:46:44.266 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:46:44.266 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:46:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.444+0000 7f8387600640 1 Processor -- start 2024-04-26T23:46:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.444+0000 7f8387600640 1 -- start start 2024-04-26T23:46:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8387600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8380073840 0x7f838006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8387600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83800adfe0 con 0x7f83800af950 2024-04-26T23:46:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8387600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83800ae2c0 con 0x7f8380073e90 2024-04-26T23:46:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8387600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f83800add90 con 0x7f8380073840 2024-04-26T23:46:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8384c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f83800af950 0x7f83800afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59756/0 (socket says 172.21.15.47:59756) 2024-04-26T23:46:44.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8384c00640 1 -- 172.21.15.47:0/4055862128 learned_addr learned my addr 172.21.15.47:0/4055862128 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8377e00640 1 --2- 172.21.15.47:0/4055862128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8380073840 0x7f838006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f837fe00640 1 -- 172.21.15.47:0/4055862128 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975051338 0 0) 0x7f83800adfe0 con 0x7f83800af950 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f837fe00640 1 -- 172.21.15.47:0/4055862128 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8364003530 con 0x7f83800af950 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f837fe00640 1 -- 172.21.15.47:0/4055862128 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181264528 0 0) 0x7f83800ae2c0 con 0x7f8380073e90 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f837fe00640 1 -- 172.21.15.47:0/4055862128 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83800adfe0 con 0x7f8380073e90 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8377e00640 1 -- 172.21.15.47:0/4055862128 >> v1:172.21.15.203:6789/0 conn(0x7f8380073e90 legacy=0x7f838006e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8377e00640 1 -- 172.21.15.47:0/4055862128 >> v1:172.21.15.47:6789/0 conn(0x7f83800af950 legacy=0x7f83800afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.448+0000 7f8377e00640 1 -- 172.21.15.47:0/4055862128 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8380072de0 con 0x7f8380073840 2024-04-26T23:46:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8377e00640 1 --2- 172.21.15.47:0/4055862128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8380073840 0x7f838006de90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83680097f0 tx=0x7f836801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4bf8443a04a42e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f837fe00640 1 -- 172.21.15.47:0/4055862128 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83680b1070 con 0x7f8380073840 2024-04-26T23:46:44.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f837fe00640 1 -- 172.21.15.47:0/4055862128 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83680ac620 con 0x7f8380073840 2024-04-26T23:46:44.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f837fe00640 1 -- 172.21.15.47:0/4055862128 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83680ac9d0 con 0x7f8380073840 2024-04-26T23:46:44.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 -- 172.21.15.47:0/4055862128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8380073840 msgr2=0x7f838006de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 --2- 172.21.15.47:0/4055862128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8380073840 0x7f838006de90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f83680097f0 tx=0x7f836801c4b0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 -- 172.21.15.47:0/4055862128 shutdown_connections 2024-04-26T23:46:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 --2- 172.21.15.47:0/4055862128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8380073840 0x7f838006de90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 -- 172.21.15.47:0/4055862128 >> 172.21.15.47:0/4055862128 conn(0x7f83800b2a40 msgr2=0x7f83800b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 -- 172.21.15.47:0/4055862128 shutdown_connections 2024-04-26T23:46:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 -- 172.21.15.47:0/4055862128 wait complete. 2024-04-26T23:46:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 Processor -- start 2024-04-26T23:46:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.452+0000 7f8387600640 1 -- start start 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8380073840 0x7f838015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8380073e90 0x7f8380147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83800af950 0x7f838015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b3fc0 con 0x7f8380073840 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f83800b3e40 con 0x7f8380073e90 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f83800b4140 con 0x7f83800af950 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8380073840 0x7f838015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8380073840 0x7f838015d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38692/0 (socket says 172.21.15.47:38692) 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 -- 172.21.15.47:0/1967928124 learned_addr learned my addr 172.21.15.47:0/1967928124 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 -- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83800af950 msgr2=0x7f838015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8377e00640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8380073e90 0x7f8380147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8385600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83800af950 0x7f838015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83800af950 0x7f838015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 -- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8380073e90 msgr2=0x7f8380147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8380073e90 0x7f8380147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 -- 172.21.15.47:0/1967928124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838014b960 con 0x7f8380073840 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8377e00640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8380073e90 0x7f8380147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8385600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83800af950 0x7f838015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8384c00640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8380073840 0x7f838015d3e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f837000c4d0 tx=0x7f837000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f837d600640 1 -- 172.21.15.47:0/1967928124 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370017070 con 0x7f8380073840 2024-04-26T23:46:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f837d600640 1 -- 172.21.15.47:0/1967928124 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8370005cf0 con 0x7f8380073840 2024-04-26T23:46:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f837d600640 1 -- 172.21.15.47:0/1967928124 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8370007290 con 0x7f8380073840 2024-04-26T23:46:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838015dcc0 con 0x7f8380073840 2024-04-26T23:46:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838015e560 con 0x7f8380073840 2024-04-26T23:46:44.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.456+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8380069700 con 0x7f8380073840 2024-04-26T23:46:44.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.460+0000 7f837d600640 1 -- 172.21.15.47:0/1967928124 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f837001a070 con 0x7f8380073840 2024-04-26T23:46:44.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.460+0000 7f837d600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f835c068380 0x7f835c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.460+0000 7f837d600640 1 -- 172.21.15.47:0/1967928124 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f8370085dc0 con 0x7f8380073840 2024-04-26T23:46:44.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.460+0000 7f8377e00640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f835c068380 0x7f835c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.460+0000 7f8377e00640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f835c068380 0x7f835c06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f83680ae000 tx=0x7f8368008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.464+0000 7f837d600640 1 -- 172.21.15.47:0/1967928124 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8370056370 con 0x7f8380073840 2024-04-26T23:46:44.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.684+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8380072110 con 0x7f8380073840 2024-04-26T23:46:44.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f837d600640 1 -- 172.21.15.47:0/1967928124 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f837005c030 con 0x7f8380073840 2024-04-26T23:46:44.696 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-26T23:46:44.696 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmSs+fMhAAi6eSRSyhcIwg3ckGbNdS9Q== 2024-04-26T23:46:44.696 INFO:teuthology.orchestra.run.smithi047.stdout: caps mds = "allow" 2024-04-26T23:46:44.696 INFO:teuthology.orchestra.run.smithi047.stdout: caps mon = "allow r" 2024-04-26T23:46:44.696 INFO:teuthology.orchestra.run.smithi047.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:46:44.697 INFO:teuthology.orchestra.run.smithi047.stderr:updated caps for client.0 2024-04-26T23:46:44.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f835c068380 msgr2=0x7f835c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f835c068380 0x7f835c06a840 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f83680ae000 tx=0x7f8368008040 comp rx=0 tx=0).stop 2024-04-26T23:46:44.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8380073840 msgr2=0x7f838015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8380073840 0x7f838015d3e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f837000c4d0 tx=0x7f837000c990 comp rx=0 tx=0).stop 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 shutdown_connections 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f835c068380 0x7f835c06a840 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f83800af950 0x7f838015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8380073e90 0x7f8380147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 --2- 172.21.15.47:0/1967928124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8380073840 0x7f838015d3e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 >> 172.21.15.47:0/1967928124 conn(0x7f83800b2a40 msgr2=0x7f83800b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 shutdown_connections 2024-04-26T23:46:44.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.688+0000 7f8387600640 1 -- 172.21.15.47:0/1967928124 wait complete. 2024-04-26T23:46:44.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:46:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.848+0000 7f2c54c00640 1 Processor -- start 2024-04-26T23:46:44.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.848+0000 7f2c54c00640 1 -- start start 2024-04-26T23:46:44.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c54c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2c5006fcd0 0x7f2c5015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c54c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5015fc50 con 0x7f2c5015c100 2024-04-26T23:46:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c54c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5015ff30 con 0x7f2c500ce310 2024-04-26T23:46:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c54c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2c50160860 con 0x7f2c5006fcd0 2024-04-26T23:46:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4de00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2c5015c100 0x7f2c500cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59764/0 (socket says 172.21.15.47:59764) 2024-04-26T23:46:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4de00640 1 -- 172.21.15.47:0/1477243670 learned_addr learned my addr 172.21.15.47:0/1477243670 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4e800640 1 --2- 172.21.15.47:0/1477243670 >> v2:172.21.15.47:3300/0 conn(0x7f2c5006fcd0 0x7f2c5015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4d400640 1 -- 172.21.15.47:0/1477243670 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23039409 0 0) 0x7f2c5015fc50 con 0x7f2c5015c100 2024-04-26T23:46:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4d400640 1 -- 172.21.15.47:0/1477243670 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c34005740 con 0x7f2c5015c100 2024-04-26T23:46:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4e800640 1 -- 172.21.15.47:0/1477243670 >> v1:172.21.15.203:6789/0 conn(0x7f2c500ce310 legacy=0x7f2c500b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4e800640 1 -- 172.21.15.47:0/1477243670 >> v1:172.21.15.47:6789/0 conn(0x7f2c5015c100 legacy=0x7f2c500cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4e800640 1 -- 172.21.15.47:0/1477243670 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c50160210 con 0x7f2c5006fcd0 2024-04-26T23:46:44.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4e800640 1 --2- 172.21.15.47:0/1477243670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5006fcd0 0x7f2c5015cf60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009d90 tx=0x7f2c4801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3e8992747d2f47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4d400640 1 -- 172.21.15.47:0/1477243670 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480b2070 con 0x7f2c5006fcd0 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4d400640 1 -- 172.21.15.47:0/1477243670 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c480a5940 con 0x7f2c5006fcd0 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.852+0000 7f2c4d400640 1 -- 172.21.15.47:0/1477243670 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480a5cf0 con 0x7f2c5006fcd0 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- 172.21.15.47:0/1477243670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5006fcd0 msgr2=0x7f2c5015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 --2- 172.21.15.47:0/1477243670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5006fcd0 0x7f2c5015cf60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009d90 tx=0x7f2c4801c970 comp rx=0 tx=0).stop 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- 172.21.15.47:0/1477243670 shutdown_connections 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 --2- 172.21.15.47:0/1477243670 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5006fcd0 0x7f2c5015cf60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- 172.21.15.47:0/1477243670 >> 172.21.15.47:0/1477243670 conn(0x7f2c5006c800 msgr2=0x7f2c5006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- 172.21.15.47:0/1477243670 shutdown_connections 2024-04-26T23:46:44.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- 172.21.15.47:0/1477243670 wait complete. 2024-04-26T23:46:44.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 Processor -- start 2024-04-26T23:46:44.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- start start 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c5006fcd0 0x7f2c50152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2c500ce310 0x7f2c50157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5015c100 0x7f2c50158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2c500b6140 con 0x7f2c5015c100 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c500b5fc0 con 0x7f2c5006fcd0 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c54c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2c500cec00 con 0x7f2c500ce310 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5015c100 0x7f2c50158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5015c100 0x7f2c50158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38718/0 (socket says 172.21.15.47:38718) 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 -- 172.21.15.47:0/4073440425 learned_addr learned my addr 172.21.15.47:0/4073440425 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4de00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c5006fcd0 0x7f2c50152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c45400640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2c500ce310 0x7f2c50157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 -- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2c500ce310 msgr2=0x7f2c50157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2c500ce310 0x7f2c50157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 -- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c5006fcd0 msgr2=0x7f2c50152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c5006fcd0 0x7f2c50152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4e800640 1 -- 172.21.15.47:0/4073440425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5009edc0 con 0x7f2c5015c100 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.856+0000 7f2c4de00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c5006fcd0 0x7f2c50152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c4e800640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5015c100 0x7f2c50158650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b0040 tx=0x7f2c48019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c46a00640 1 -- 172.21.15.47:0/4073440425 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480b2050 con 0x7f2c5015c100 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c46a00640 1 -- 172.21.15.47:0/4073440425 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c480b3040 con 0x7f2c5015c100 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c46a00640 1 -- 172.21.15.47:0/4073440425 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480adc20 con 0x7f2c5015c100 2024-04-26T23:46:44.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c50158220 con 0x7f2c5015c100 2024-04-26T23:46:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c50157f40 con 0x7f2c5015c100 2024-04-26T23:46:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c50069700 con 0x7f2c5015c100 2024-04-26T23:46:44.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c46a00640 1 -- 172.21.15.47:0/4073440425 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2c480039a0 con 0x7f2c5015c100 2024-04-26T23:46:44.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c46a00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c2c068380 0x7f2c2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:44.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c46a00640 1 -- 172.21.15.47:0/4073440425 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f2c48121350 con 0x7f2c5015c100 2024-04-26T23:46:44.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.860+0000 7f2c4de00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c2c068380 0x7f2c2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:44.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.864+0000 7f2c4de00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c2c068380 0x7f2c2c06a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c400011f0 tx=0x7f2c40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:44.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:44.864+0000 7f2c46a00640 1 -- 172.21.15.47:0/4073440425 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2c48016560 con 0x7f2c5015c100 2024-04-26T23:46:45.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c500cffe0 con 0x7f2c5015c100 2024-04-26T23:46:45.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c46a00640 1 -- 172.21.15.47:0/4073440425 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f2c480f1870 con 0x7f2c5015c100 2024-04-26T23:46:45.072 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:46:45.073 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3134789300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3134789300},{"type":"v1","addr":"172.21.15.203:6836","nonce":3134789300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/4099074472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4099074472},{"type":"v1","addr":"172.21.15.203:6837","nonce":4099074472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5298,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/789136995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":789136995},{"type":"v1","addr":"172.21.15.47:6834","nonce":789136995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:46:34.565067+0000","modified":"2024-04-26T23:46:37.594167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/2869278725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":2869278725},{"type":"v1","addr":"172.21.15.47:6835","nonce":2869278725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":2}]} 2024-04-26T23:46:45.073 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 17 2024-04-26T23:46:45.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c2c068380 msgr2=0x7f2c2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c2c068380 0x7f2c2c06a840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c400011f0 tx=0x7f2c40009040 comp rx=0 tx=0).stop 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5015c100 msgr2=0x7f2c50158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5015c100 0x7f2c50158650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b0040 tx=0x7f2c48019710 comp rx=0 tx=0).stop 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 shutdown_connections 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c2c068380 0x7f2c2c06a840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2c5015c100 0x7f2c50158650 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2c500ce310 0x7f2c50157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 --2- 172.21.15.47:0/4073440425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c5006fcd0 0x7f2c50152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.064+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 >> 172.21.15.47:0/4073440425 conn(0x7f2c5006c800 msgr2=0x7f2c5006f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.068+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 shutdown_connections 2024-04-26T23:46:45.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.068+0000 7f2c54c00640 1 -- 172.21.15.47:0/4073440425 wait complete. 2024-04-26T23:46:45.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:46:34.565067+0000', 'modified': '2024-04-26T23:46:37.594167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5301}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5301': {'gid': 5301, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6835/2869278725', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6833', 'nonce': 2869278725}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 2869278725}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5301, 'qdb_cluster': [5301]} 2024-04-26T23:46:45.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:46:45.497 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T23:46:45.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.632+0000 7fd512200640 1 Processor -- start 2024-04-26T23:46:45.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.632+0000 7fd512200640 1 -- start start 2024-04-26T23:46:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd512200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fd50c159b70 0x7fd50c06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd512200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 0x7fd50c06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd512200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50c0aea30 con 0x7fd50c0af7f0 2024-04-26T23:46:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd512200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fd50c0af360 con 0x7fd50c159b70 2024-04-26T23:46:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd512200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c0aed10 con 0x7fd50c1603b0 2024-04-26T23:46:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd503e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd50c0af7f0 0x7fd50c15fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59766/0 (socket says 172.21.15.47:59766) 2024-04-26T23:46:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd503e00640 1 -- 172.21.15.47:0/2702763513 learned_addr learned my addr 172.21.15.47:0/2702763513 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915845360 0 0) 0x7fd50c0aea30 con 0x7fd50c0af7f0 2024-04-26T23:46:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f0003530 con 0x7fd50c0af7f0 2024-04-26T23:46:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50be00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 0x7fd50c06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50b400640 1 --2- 172.21.15.47:0/2702763513 >> v2:172.21.15.203:3300/0 conn(0x7fd50c159b70 0x7fd50c06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2849825834 0 0) 0x7fd4f0003530 con 0x7fd50c0af7f0 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 msgr2=0x7fd50c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 0x7fd50c06cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 >> v2:172.21.15.203:3300/0 conn(0x7fd50c159b70 msgr2=0x7fd50c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 --2- 172.21.15.47:0/2702763513 >> v2:172.21.15.203:3300/0 conn(0x7fd50c159b70 0x7fd50c06c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c0aeff0 con 0x7fd50c0af7f0 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fd4f40016a0 con 0x7fd50c0af7f0 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 >> v1:172.21.15.47:6789/0 conn(0x7fd50c0af7f0 legacy=0x7fd50c15fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00039c0 0x7fd4f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 0x7fd4f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4f0004d50 0x7fd4f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c0af360 con 0x7fd4f0004d50 2024-04-26T23:46:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c0aed10 con 0x7fd4f00039c0 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f000dc60 con 0x7fd50c1603b0 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50b400640 1 --2- 172.21.15.47:0/2702763513 >> v2:172.21.15.203:3300/0 conn(0x7fd50c159b70 0x7fd50c06c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50be00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4f0004d50 0x7fd4f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd503e00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 0x7fd4f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50b400640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00039c0 0x7fd4f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50be00640 1 -- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 msgr2=0x7fd4f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50be00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 0x7fd4f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50be00640 1 -- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00039c0 msgr2=0x7fd4f0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50be00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4f00039c0 0x7fd4f0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd50be00640 1 -- 172.21.15.47:0/2702763513 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f0003530 con 0x7fd4f0004d50 2024-04-26T23:46:45.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.636+0000 7fd503e00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd50c1603b0 0x7fd4f0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd50be00640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4f0004d50 0x7fd4f00051d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd504009fc0 tx=0x7fd50401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877fa3cd7bb9d86f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040b2070 con 0x7fd4f0004d50 2024-04-26T23:46:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5040a5c90 con 0x7fd4f0004d50 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd50aa00640 1 -- 172.21.15.47:0/2702763513 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504009c10 con 0x7fd4f0004d50 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 -- 172.21.15.47:0/2702763513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4f0004d50 msgr2=0x7fd4f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 --2- 172.21.15.47:0/2702763513 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4f0004d50 0x7fd4f00051d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd504009fc0 tx=0x7fd50401cc80 comp rx=0 tx=0).stop 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd50be00640 1 -- 172.21.15.47:0/2702763513 reap_dead start 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 -- 172.21.15.47:0/2702763513 shutdown_connections 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 -- 172.21.15.47:0/2702763513 >> 172.21.15.47:0/2702763513 conn(0x7fd50c0b2d40 msgr2=0x7fd50c0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 -- 172.21.15.47:0/2702763513 shutdown_connections 2024-04-26T23:46:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 -- 172.21.15.47:0/2702763513 wait complete. 2024-04-26T23:46:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 Processor -- start 2024-04-26T23:46:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.640+0000 7fd512200640 1 -- start start 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0004d50 0x7fd50c149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd50c0c9fc0 0x7fd50c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd50c073ab0 0x7fd50c0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c06ccf0 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c06cb70 con 0x7fd50c073ab0 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c06ce70 con 0x7fd4f0004d50 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd50c0c9fc0 0x7fd50c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd50c0c9fc0 0x7fd50c0cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38744/0 (socket says 172.21.15.47:38744) 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 -- 172.21.15.47:0/1553199855 learned_addr learned my addr 172.21.15.47:0/1553199855 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd50b400640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0004d50 0x7fd50c149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd50be00640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd50c073ab0 0x7fd50c0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 -- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0004d50 msgr2=0x7fd50c149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0004d50 0x7fd50c149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 -- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd50c073ab0 msgr2=0x7fd50c0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd50c073ab0 0x7fd50c0b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 -- 172.21.15.47:0/1553199855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c149c90 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd50b400640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0004d50 0x7fd50c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd50be00640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd50c073ab0 0x7fd50c0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503e00640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd50c0c9fc0 0x7fd50c0cb5d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400e820 tx=0x7fd4f400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503400640 1 -- 172.21.15.47:0/1553199855 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400c870 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503400640 1 -- 172.21.15.47:0/1553199855 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f4018070 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c0cbb10 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd503400640 1 -- 172.21.15.47:0/1553199855 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400cc10 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.644+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c0ca810 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd503400640 1 -- 172.21.15.47:0/1553199855 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd4f401d460 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd503400640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd4e8068380 0x7fd4e806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd503400640 1 -- 172.21.15.47:0/1553199855 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fd4f40869d0 con 0x7fd50c0c9fc0 2024-04-26T23:46:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 Processor -- start 2024-04-26T23:46:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd4e8068380 0x7fd4e806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 -- start start 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd4e8068380 0x7fd4e806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c850 tx=0x7fd4fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0f9cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9d020 0x55efb0f53200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb0f53b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efb0e0b140 con 0x55efb0f9c700 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55efb0da0e00 con 0x55efb0f9d020 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55efb0d59a00 con 0x55efb0f53740 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0f9cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0f9cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38760/0 (socket says 172.21.15.47:38760) 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 -- 172.21.15.47:0/421156547 learned_addr learned my addr 172.21.15.47:0/421156547 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd503e00640 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9d020 0x55efb0f53200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50be00640 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb0f53b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 -- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 msgr2=0x55efb0f53b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.659 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb0f53b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 -- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9d020 msgr2=0x55efb0f53200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9d020 0x55efb0f53200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 -- 172.21.15.47:0/421156547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb0d5e0e0 con 0x55efb0f9c700 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd503e00640 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9d020 0x55efb0f53200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd50b400640 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0f9cae0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc011bd0 tx=0x7fd4fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27629a67d784441d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd4fbe00640 1 -- 172.21.15.47:0/421156547 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc01d050 con 0x55efb0f9c700 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd4fbe00640 1 -- 172.21.15.47:0/421156547 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc027070 con 0x55efb0f9c700 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.648+0000 7fd4fbe00640 1 -- 172.21.15.47:0/421156547 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00f050 con 0x55efb0f9c700 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- 172.21.15.47:0/421156547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 msgr2=0x55efb0f9cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0f9cae0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc011bd0 tx=0x7fd4fc014000 comp rx=0 tx=0).stop 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- 172.21.15.47:0/421156547 shutdown_connections 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb0f53b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9d020 0x55efb0f53200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 --2- 172.21.15.47:0/421156547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0f9cae0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- 172.21.15.47:0/421156547 >> 172.21.15.47:0/421156547 conn(0x55efb0f4f6f0 msgr2=0x55efb0f51ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- 172.21.15.47:0/421156547 shutdown_connections 2024-04-26T23:46:45.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- 172.21.15.47:0/421156547 wait complete. 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- start start 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 Processor -- start 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f53740 0x55efb0f5e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb0f5e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0f5eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efb0dae200 con 0x55efb0f53740 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55efb0d44e80 con 0x55efb0f9c700 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55efb0d9bae0 con 0x55efb0f9d020 2024-04-26T23:46:45.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 10 client.0 _ll_register_callbacks cb 0x55efb0dadda0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f53740 0x55efb0f5e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f53740 0x55efb0f5e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38766/0 (socket says 172.21.15.47:38766) 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 -- 172.21.15.47:0/1743774213 learned_addr learned my addr 172.21.15.47:0/1743774213 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd503e00640 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb0f5e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50be00640 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0f5eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 -- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 msgr2=0x55efb0f5eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0f5eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 -- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 msgr2=0x55efb0f5e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb0f5e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 -- 172.21.15.47:0/1743774213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb0d404e0 con 0x55efb0f53740 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd50b400640 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f53740 0x55efb0f5e0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc024040 tx=0x7fd4fc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91984c570518f709 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd4f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd4f8c00640 1 -- 172.21.15.47:0/1743774213 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc00f040 con 0x55efb0f53740 2024-04-26T23:46:45.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc027070 con 0x55efb0f53740 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd4f8c00640 1 -- 172.21.15.47:0/1743774213 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fd4fc022a10 con 0x55efb0f53740 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd4f8c00640 1 -- 172.21.15.47:0/1743774213 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd4fc01d020 con 0x55efb0f53740 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 10 client.5505 fetch_fsmap learned FSMap version 17 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.652+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55efb0d26e80 con 0x55efb0f53740 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd4f8c00640 1 -- 172.21.15.47:0/1743774213 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc027070 con 0x55efb0f53740 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd4f8c00640 1 -- 172.21.15.47:0/1743774213 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fd4fc022c10 con 0x55efb0f53740 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 10 client.5505 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 10 client.5505 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 20 client.5505 populate_metadata read hostname 'smithi047' 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb0fac7a0 0x55efb0faeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 4 client.5505 mds_command: new command op to 5301 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 --> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efb0d39bc0 con 0x55efb0fac7a0 2024-04-26T23:46:45.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd503e00640 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb0fac7a0 0x55efb0faeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd503e00640 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb0fac7a0 0x55efb0faeb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af3a931ca038dcab server_cookie=5c9e8e7ee8c19350 in_seq=0 out_seq=0 2024-04-26T23:46:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd4f8c00640 10 client.5505 ms_handle_connect on v2:172.21.15.47:6833/2869278725 2024-04-26T23:46:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd4f8c00640 1 -- 172.21.15.47:0/1743774213 <== mds.0 v2:172.21.15.47:6833/2869278725 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55efb0d39bc0 con 0x55efb0fac7a0 2024-04-26T23:46:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd4f8c00640 10 client.5505 handle_command_reply: tid=0 2024-04-26T23:46:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 client.5505 shutdown 2024-04-26T23:46:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f53740 msgr2=0x55efb0f5e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f53740 0x55efb0f5e0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc024040 tx=0x7fd4fc0046d0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 shutdown_connections 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb0fac7a0 0x55efb0faeb90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0f5eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb0f5e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 --2- 172.21.15.47:0/1743774213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f53740 0x55efb0f5e0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd4f8c00640 0 client.5505 ms_handle_reset on v2:172.21.15.47:6833/2869278725 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 >> 172.21.15.47:0/1743774213 conn(0x55efb0f4f6f0 msgr2=0x55efb0f52370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 shutdown_connections 2024-04-26T23:46:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 1 -- 172.21.15.47:0/1743774213 wait complete. 2024-04-26T23:46:45.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.656+0000 7fd51575e000 20 client.5505 trim_cache size 0 max 16384 2024-04-26T23:46:45.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 Processor -- start 2024-04-26T23:46:45.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- start start 2024-04-26T23:46:45.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb1007b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb1008050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9d020 0x55efb1008590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c200bf0 con 0x55efb0f9d020 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c072e80 con 0x55efb0f9c700 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c0cf1e0 con 0x55efb0f53740 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9d020 0x55efb1008590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9d020 0x55efb1008590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38778/0 (socket says 172.21.15.47:38778) 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 -- 172.21.15.47:0/3827759757 learned_addr learned my addr 172.21.15.47:0/3827759757 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50b400640 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb1007b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd503e00640 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb1008050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 -- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 msgr2=0x55efb1007b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb1007b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 -- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 msgr2=0x55efb1008050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb1008050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 -- 172.21.15.47:0/3827759757 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efb0d59c50 con 0x55efb0f9d020 2024-04-26T23:46:45.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50b400640 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb1007b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd503e00640 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb1008050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd50be00640 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9d020 0x55efb1008590 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd50401cab0 tx=0x7fd50401b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fa2444baded7ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd4fb400640 1 -- 172.21.15.47:0/3827759757 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040b2040 con 0x55efb0f9d020 2024-04-26T23:46:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd4fb400640 1 -- 172.21.15.47:0/3827759757 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5040a5a90 con 0x55efb0f9d020 2024-04-26T23:46:45.686 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd4fb400640 1 -- 172.21.15.47:0/3827759757 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040039a0 con 0x55efb0f9d020 2024-04-26T23:46:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- 172.21.15.47:0/3827759757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9d020 msgr2=0x55efb1008590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9d020 0x55efb1008590 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd50401cab0 tx=0x7fd50401b4c0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- 172.21.15.47:0/3827759757 shutdown_connections 2024-04-26T23:46:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9d020 0x55efb1008590 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f9c700 0x55efb1008050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 --2- 172.21.15.47:0/3827759757 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f53740 0x55efb1007b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- 172.21.15.47:0/3827759757 >> 172.21.15.47:0/3827759757 conn(0x55efb0f4f6f0 msgr2=0x55efb0f5e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- 172.21.15.47:0/3827759757 shutdown_connections 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- 172.21.15.47:0/3827759757 wait complete. 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 -- start start 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.676+0000 7fd51575e000 1 Processor -- start 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f53740 0x55efb0fb0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0fb13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0fc8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55efb0da0110 con 0x55efb0f9c700 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55efb0d367b0 con 0x55efb0f53740 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55efb0da5430 con 0x55efb0f9d020 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 10 client.0 _ll_register_callbacks cb 0x7fd4fc011aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0fb13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0fb13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38782/0 (socket says 172.21.15.47:38782) 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 -- 172.21.15.47:0/346836975 learned_addr learned my addr 172.21.15.47:0/346836975 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd50b400640 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f53740 0x55efb0fb0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd50be00640 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0fc8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 -- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 msgr2=0x55efb0fc8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0fc8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 -- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f53740 msgr2=0x55efb0fb0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f53740 0x55efb0fb0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 -- 172.21.15.47:0/346836975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efb0e23160 con 0x55efb0f9c700 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd503e00640 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0fb13f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c4b0 tx=0x7fd4f4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2dd0d24b1ac704 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 1 -- 172.21.15.47:0/346836975 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40753a0 con 0x55efb0f9c700 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 1 -- 172.21.15.47:0/346836975 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fd4f400cdb0 con 0x55efb0f9c700 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5040a5a90 con 0x55efb0f9c700 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 1 -- 172.21.15.47:0/346836975 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd4f405d0b0 con 0x55efb0f9c700 2024-04-26T23:46:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 10 client.5511 fetch_fsmap learned FSMap version 17 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55efb0a5a0c0 con 0x55efb0f9c700 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 1 -- 172.21.15.47:0/346836975 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5040a5a90 con 0x55efb0f9c700 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 1 -- 172.21.15.47:0/346836975 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7fd4f4052e60 con 0x55efb0f9c700 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 10 client.5511 fetch_fsmap finished waiting for FSMap version 17 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 10 client.5511 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 20 client.5511 populate_metadata read hostname 'smithi047' 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb1011b80 0x55efb1013f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 4 client.5511 mds_command: new command op to 5301 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 --> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] -- command(tid 0: {"prefix": "status"}) -- 0x55efb0daea10 con 0x55efb1011b80 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd50b400640 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb1011b80 0x55efb1013f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd50b400640 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb1011b80 0x55efb1013f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4666cedd923 server_cookie=4e5849f953616595 in_seq=0 out_seq=0 2024-04-26T23:46:45.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 10 client.5511 ms_handle_connect on v2:172.21.15.47:6833/2869278725 2024-04-26T23:46:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 1 -- 172.21.15.47:0/346836975 <== mds.0 v2:172.21.15.47:6833/2869278725 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55efb0daea10 con 0x55efb1011b80 2024-04-26T23:46:45.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 10 client.5511 handle_command_reply: tid=0 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 client.5511 shutdown 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 msgr2=0x55efb0fb13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0fb13f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c4b0 tx=0x7fd4f4012000 comp rx=0 tx=0).stop 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 shutdown_connections 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:6833/2869278725,v1:172.21.15.47:6835/2869278725] conn(0x55efb1011b80 0x55efb1013f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55efb0f9d020 0x55efb0fc8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55efb0f9c700 0x55efb0fb13f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd4f8c00640 0 client.5511 ms_handle_reset on v2:172.21.15.47:6833/2869278725 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 --2- 172.21.15.47:0/346836975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55efb0f53740 0x55efb0fb0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 >> 172.21.15.47:0/346836975 conn(0x55efb0f4f6f0 msgr2=0x55efb0f5e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 shutdown_connections 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 1 -- 172.21.15.47:0/346836975 wait complete. 2024-04-26T23:46:45.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.680+0000 7fd51575e000 20 client.5511 trim_cache size 0 max 16384 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "b64830b3-1e32-4049-b582-6f8b5018205b", 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 5301, 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 10.518956733, 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 17, 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 36, 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 36, 2024-04-26T23:46:45.695 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 18.380481895999999 2024-04-26T23:46:45.696 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:46:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd4e8068380 msgr2=0x7fd4e806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd4e8068380 0x7fd4e806a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00c850 tx=0x7fd4fc008040 comp rx=0 tx=0).stop 2024-04-26T23:46:45.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd50c0c9fc0 msgr2=0x7fd50c0cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd50c0c9fc0 0x7fd50c0cb5d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400e820 tx=0x7fd4f400ece0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 shutdown_connections 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd4e8068380 0x7fd4e806a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd50c073ab0 0x7fd50c0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd50c0c9fc0 0x7fd50c0cb5d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 --2- 172.21.15.47:0/1553199855 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd4f0004d50 0x7fd50c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 >> 172.21.15.47:0/1553199855 conn(0x7fd50c0b2d40 msgr2=0x7fd50c15a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 shutdown_connections 2024-04-26T23:46:45.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.684+0000 7fd512200640 1 -- 172.21.15.47:0/1553199855 wait complete. 2024-04-26T23:46:45.711 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:46:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae35800640 1 Processor -- start 2024-04-26T23:46:45.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae35800640 1 -- start start 2024-04-26T23:46:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae35800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fae300ce310 0x7fae3015da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae35800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae3015e050 con 0x7fae3015d5b0 2024-04-26T23:46:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae35800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae3015e330 con 0x7fae300b4360 2024-04-26T23:46:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae35800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fae300ceda0 con 0x7fae300ce310 2024-04-26T23:46:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae26000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fae3015d5b0 0x7fae300cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59770/0 (socket says 172.21.15.47:59770) 2024-04-26T23:46:45.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae26000640 1 -- 172.21.15.47:0/3657532105 learned_addr learned my addr 172.21.15.47:0/3657532105 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2f400640 1 --2- 172.21.15.47:0/3657532105 >> v2:172.21.15.203:3300/0 conn(0x7fae300ce310 0x7fae3015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979967485 0 0) 0x7fae3015e050 con 0x7fae3015d5b0 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae14003530 con 0x7fae3015d5b0 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1916633034 0 0) 0x7fae14003530 con 0x7fae3015d5b0 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 >> v2:172.21.15.203:3300/0 conn(0x7fae300ce310 msgr2=0x7fae3015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 --2- 172.21.15.47:0/3657532105 >> v2:172.21.15.203:3300/0 conn(0x7fae300ce310 0x7fae3015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 >> v1:172.21.15.203:6789/0 conn(0x7fae300b4360 legacy=0x7fae300cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae300cf080 con 0x7fae3015d5b0 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fae18001800 con 0x7fae3015d5b0 2024-04-26T23:46:45.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2f400640 1 --2- 172.21.15.47:0/3657532105 >> v2:172.21.15.203:3300/0 conn(0x7fae300ce310 0x7fae3015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:45.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 >> v1:172.21.15.47:6789/0 conn(0x7fae3015d5b0 legacy=0x7fae300cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae140039c0 0x7fae14003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae140043c0 0x7fae14004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae14005090 0x7fae1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae300ceda0 con 0x7fae140043c0 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae1400bff0 con 0x7fae14005090 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fae1400c1f0 con 0x7fae140039c0 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae26000640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae140043c0 0x7fae14004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2ea00640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae140039c0 0x7fae14003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.844+0000 7fae2f400640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae14005090 0x7fae1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae26000640 1 -- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae140039c0 msgr2=0x7fae14003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae26000640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae140039c0 0x7fae14003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae26000640 1 -- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae14005090 msgr2=0x7fae1400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:45.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae26000640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae14005090 0x7fae1400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae26000640 1 -- 172.21.15.47:0/3657532105 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae14003530 con 0x7fae140043c0 2024-04-26T23:46:45.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae2f400640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae14005090 0x7fae1400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:45.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae2f400640 1 -- 172.21.15.47:0/3657532105 reap_dead start 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae26000640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae140043c0 0x7fae14004890 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fae1800c240 tx=0x7fae1801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e47fc01b6c5564c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18007d10 con 0x7fae140043c0 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae180a9020 con 0x7fae140043c0 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae2e000640 1 -- 172.21.15.47:0/3657532105 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae180072f0 con 0x7fae140043c0 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae35800640 1 -- 172.21.15.47:0/3657532105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae140043c0 msgr2=0x7fae14004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae35800640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae140043c0 0x7fae14004890 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fae1800c240 tx=0x7fae1801cc20 comp rx=0 tx=0).stop 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae35800640 1 -- 172.21.15.47:0/3657532105 shutdown_connections 2024-04-26T23:46:45.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae35800640 1 --2- 172.21.15.47:0/3657532105 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae140043c0 0x7fae14004890 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae35800640 1 -- 172.21.15.47:0/3657532105 >> 172.21.15.47:0/3657532105 conn(0x7fae3006c800 msgr2=0x7fae3006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:45.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae35800640 1 -- 172.21.15.47:0/3657532105 shutdown_connections 2024-04-26T23:46:45.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.848+0000 7fae35800640 1 -- 172.21.15.47:0/3657532105 wait complete. 2024-04-26T23:46:45.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 Processor -- start 2024-04-26T23:46:45.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 -- start start 2024-04-26T23:46:45.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae140043c0 0x7fae3013ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae30141540 0x7fae301419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae30160cb0 0x7fae30161140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae300b60f0 con 0x7fae30160cb0 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae300b5f70 con 0x7fae140043c0 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fae3015da40 con 0x7fae30141540 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae30160cb0 0x7fae30161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae30160cb0 0x7fae30161140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38806/0 (socket says 172.21.15.47:38806) 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 -- 172.21.15.47:0/747250970 learned_addr learned my addr 172.21.15.47:0/747250970 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae26000640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae30141540 0x7fae301419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2ea00640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae140043c0 0x7fae3013ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 -- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae30141540 msgr2=0x7fae301419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae30141540 0x7fae301419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 -- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae140043c0 msgr2=0x7fae3013ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:45.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae140043c0 0x7fae3013ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:45.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 -- 172.21.15.47:0/747250970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3013f210 con 0x7fae30160cb0 2024-04-26T23:46:45.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae2f400640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae30160cb0 0x7fae30161140 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fae300b5540 tx=0x7fae28011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae27400640 1 -- 172.21.15.47:0/747250970 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28004440 con 0x7fae30160cb0 2024-04-26T23:46:45.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae27400640 1 -- 172.21.15.47:0/747250970 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae2801c070 con 0x7fae30160cb0 2024-04-26T23:46:45.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae30160250 con 0x7fae30160cb0 2024-04-26T23:46:45.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae27400640 1 -- 172.21.15.47:0/747250970 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae28003820 con 0x7fae30160cb0 2024-04-26T23:46:45.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.852+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae30141fc0 con 0x7fae30160cb0 2024-04-26T23:46:45.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.856+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae30069700 con 0x7fae30160cb0 2024-04-26T23:46:45.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.856+0000 7fae27400640 1 -- 172.21.15.47:0/747250970 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae280039c0 con 0x7fae30160cb0 2024-04-26T23:46:45.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.856+0000 7fae27400640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae0c068380 0x7fae0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:45.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.856+0000 7fae27400640 1 -- 172.21.15.47:0/747250970 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fae280866c0 con 0x7fae30160cb0 2024-04-26T23:46:45.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.856+0000 7fae2ea00640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae0c068380 0x7fae0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:45.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.856+0000 7fae2ea00640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae0c068380 0x7fae0c06a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fae300cd440 tx=0x7fae20007460 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:45.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:45.860+0000 7fae27400640 1 -- 172.21.15.47:0/747250970 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fae28025020 con 0x7fae30160cb0 2024-04-26T23:46:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fae3006ce30 con 0x7fae30160cb0 2024-04-26T23:46:46.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae27400640 1 -- 172.21.15.47:0/747250970 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fae30160250 con 0x7fae30160cb0 2024-04-26T23:46:46.072 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae0c068380 msgr2=0x7fae0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae0c068380 0x7fae0c06a840 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fae300cd440 tx=0x7fae20007460 comp rx=0 tx=0).stop 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae30160cb0 msgr2=0x7fae30161140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae30160cb0 0x7fae30161140 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fae300b5540 tx=0x7fae28011a60 comp rx=0 tx=0).stop 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 shutdown_connections 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fae0c068380 0x7fae0c06a840 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae30160cb0 0x7fae30161140 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae30141540 0x7fae301419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 --2- 172.21.15.47:0/747250970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae140043c0 0x7fae3013ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:46.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 >> 172.21.15.47:0/747250970 conn(0x7fae3006c800 msgr2=0x7fae300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:46.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 shutdown_connections 2024-04-26T23:46:46.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46.064+0000 7fae35800640 1 -- 172.21.15.47:0/747250970 wait complete. 2024-04-26T23:46:46.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:46:46.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:46:46.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-26T23:46:46.094 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:46:46.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:46:46.094 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:46:46.094 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:46:46.095 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:46:46.095 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:46:46.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:46.095 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-26T23:46:46.104 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:46:46.104 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-26T23:46:46.105 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42329sec preferred_lft 42329sec 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:46:46.106 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 02:42:b5:29:54:0a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:46.107 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:46:46.107 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.107 INFO:teuthology.orchestra.run.smithi047.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:46:46.107 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:46.108 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:46:46.108 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.108 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:46:46.108 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.108 INFO:teuthology.orchestra.run.smithi047.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:46:46.108 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:46:46.109 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:46:46.109 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.109 INFO:teuthology.orchestra.run.smithi047.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:46:46.109 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:46:46.109 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:46:46.109 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:46.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:46.111 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:46:46.176 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-26T23:46:46.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:46.243 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-26T23:46:46.296 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-26T23:46:46.296 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:46:46.296 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:46:46.296 INFO:teuthology.orchestra.run.smithi047.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:46:46.296 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:46:46.296 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:46:46.297 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:46:46.297 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:46:46.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:46:46.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:46:46.297 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:46:46.297 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:46:46.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:46:46.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:46:46.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:46.435 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-26T23:46:46.443 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:46:46.444 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:46:46.444 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:46:46.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:46.444 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-26T23:46:46.507 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:46:46.507 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:46:46.507 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:46:46.559 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:46:46.559 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:46:46.559 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:46:46.609 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:46:46.673 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:46:46.724 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:46:46.725 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:46:46.726 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:46:46.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:46.727 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:46:46.778 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:46:46.778 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:46:46.821 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:46:46.842 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:46:46.900 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:46:46.901 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:46:46.902 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:46:46.903 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:46:46.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:46.905 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:46:46.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-04-26T23:46:46.912+0000 7ff0b392f580 -1 init, newargv = 0x557c384d60d0 newargc=15 2024-04-26T23:46:46.921 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[36576]: starting ceph client 2024-04-26T23:46:46.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[36576]: starting fuse 2024-04-26T23:46:46.929 INFO:teuthology.orchestra.run.smithi047.stdout:44 2024-04-26T23:46:46.929 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:46:46.930 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-04-26T23:46:46.931 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-04-26T23:46:47.053 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.36576.asok 2024-04-26T23:46:47.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:46:47.065 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.36576.asok 2024-04-26T23:46:47.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:47.065 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.36576.asok status 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "36576", 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-04-26T23:46:47.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 5523, 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 5523 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 4188961507 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:47.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 4188961507 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.5523 192.168.0.1:0/4188961507", 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/4188961507", 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 17, 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 36, 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-04-26T23:46:47.240 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:46:47.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:47.253 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-04-26T23:46:47.253 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:46:47.262 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-04-26T23:46:47.262 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:46:47.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:47.263 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:46:47.326 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:46:47.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.504+0000 7fe3af000640 1 Processor -- start 2024-04-26T23:46:47.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.504+0000 7fe3af000640 1 -- start start 2024-04-26T23:46:47.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3af000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe3a80cdc00 0x7fe3a80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:47.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3af000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80cfa20 con 0x7fe3a80afb60 2024-04-26T23:46:47.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3af000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80ce520 con 0x7fe3a8072150 2024-04-26T23:46:47.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3af000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a8072bf0 con 0x7fe3a80cdc00 2024-04-26T23:46:47.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3ad000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe3a80afb60 0x7fe3a80cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:59784/0 (socket says 172.21.15.47:59784) 2024-04-26T23:46:47.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3ad000640 1 -- 172.21.15.47:0/1700091443 learned_addr learned my addr 172.21.15.47:0/1700091443 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:47.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3a7e00640 1 --2- 172.21.15.47:0/1700091443 >> v2:172.21.15.203:3300/0 conn(0x7fe3a80cdc00 0x7fe3a80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:47.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3a7400640 1 -- 172.21.15.47:0/1700091443 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592177628 0 0) 0x7fe3a80cfa20 con 0x7fe3a80afb60 2024-04-26T23:46:47.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3a7400640 1 -- 172.21.15.47:0/1700091443 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe38c003530 con 0x7fe3a80afb60 2024-04-26T23:46:47.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3a7e00640 1 -- 172.21.15.47:0/1700091443 >> v1:172.21.15.203:6789/0 conn(0x7fe3a8072150 legacy=0x7fe3a80cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:47.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3a7e00640 1 -- 172.21.15.47:0/1700091443 >> v1:172.21.15.47:6789/0 conn(0x7fe3a80afb60 legacy=0x7fe3a80cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:47.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.508+0000 7fe3a7e00640 1 -- 172.21.15.47:0/1700091443 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80add90 con 0x7fe3a80cdc00 2024-04-26T23:46:47.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3a7e00640 1 --2- 172.21.15.47:0/1700091443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80cdc00 0x7fe3a80cdfe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3980097c0 tx=0x7fe39801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24189c0486f40f20 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:47.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3a7400640 1 -- 172.21.15.47:0/1700091443 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3980b2070 con 0x7fe3a80cdc00 2024-04-26T23:46:47.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3a7400640 1 -- 172.21.15.47:0/1700091443 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3980ad680 con 0x7fe3a80cdc00 2024-04-26T23:46:47.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3a7400640 1 -- 172.21.15.47:0/1700091443 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3980ada50 con 0x7fe3a80cdc00 2024-04-26T23:46:47.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 -- 172.21.15.47:0/1700091443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80cdc00 msgr2=0x7fe3a80cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:47.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 --2- 172.21.15.47:0/1700091443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80cdc00 0x7fe3a80cdfe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe3980097c0 tx=0x7fe39801c470 comp rx=0 tx=0).stop 2024-04-26T23:46:47.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 -- 172.21.15.47:0/1700091443 shutdown_connections 2024-04-26T23:46:47.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 --2- 172.21.15.47:0/1700091443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80cdc00 0x7fe3a80cdfe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 -- 172.21.15.47:0/1700091443 >> 172.21.15.47:0/1700091443 conn(0x7fe3a806c800 msgr2=0x7fe3a806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:47.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 -- 172.21.15.47:0/1700091443 shutdown_connections 2024-04-26T23:46:47.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 -- 172.21.15.47:0/1700091443 wait complete. 2024-04-26T23:46:47.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 Processor -- start 2024-04-26T23:46:47.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.512+0000 7fe3af000640 1 -- start start 2024-04-26T23:46:47.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a8072150 0x7fe3a8154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80afb60 0x7fe3a8152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3a80cdc00 0x7fe3a8165280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a815df90 con 0x7fe3a8072150 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a8164ad0 con 0x7fe3a80afb60 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a815e110 con 0x7fe3a80cdc00 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a8072150 0x7fe3a8154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a8072150 0x7fe3a8154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38812/0 (socket says 172.21.15.47:38812) 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 -- 172.21.15.47:0/4279893570 learned_addr learned my addr 172.21.15.47:0/4279893570 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:47.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3ad000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3a80cdc00 0x7fe3a8165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe39fe00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80afb60 0x7fe3a8152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 -- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3a80cdc00 msgr2=0x7fe3a8165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3a80cdc00 0x7fe3a8165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 -- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80afb60 msgr2=0x7fe3a8152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80afb60 0x7fe3a8152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 -- 172.21.15.47:0/4279893570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a81537f0 con 0x7fe3a8072150 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3ad000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3a80cdc00 0x7fe3a8165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe39fe00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80afb60 0x7fe3a8152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:47.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a7e00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a8072150 0x7fe3a8154d40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe398019080 tx=0x7fe39801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:47.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a4c00640 1 -- 172.21.15.47:0/4279893570 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3980bc020 con 0x7fe3a8072150 2024-04-26T23:46:47.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a4c00640 1 -- 172.21.15.47:0/4279893570 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3980adb10 con 0x7fe3a8072150 2024-04-26T23:46:47.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a4c00640 1 -- 172.21.15.47:0/4279893570 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3980b2040 con 0x7fe3a8072150 2024-04-26T23:46:47.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a8153ad0 con 0x7fe3a8072150 2024-04-26T23:46:47.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a8154090 con 0x7fe3a8072150 2024-04-26T23:46:47.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a8069700 con 0x7fe3a8072150 2024-04-26T23:46:47.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.516+0000 7fe3a4c00640 1 -- 172.21.15.47:0/4279893570 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe3980bf020 con 0x7fe3a8072150 2024-04-26T23:46:47.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.520+0000 7fe3a4c00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe3840683b0 0x7fe38406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:47.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.520+0000 7fe3a4c00640 1 -- 172.21.15.47:0/4279893570 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fe398120980 con 0x7fe3a8072150 2024-04-26T23:46:47.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.520+0000 7fe39fe00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe3840683b0 0x7fe38406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:47.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.520+0000 7fe39fe00640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe3840683b0 0x7fe38406a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8165f80 tx=0x7fe390009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:47.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.524+0000 7fe3a4c00640 1 -- 172.21.15.47:0/4279893570 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe3980c6030 con 0x7fe3a8072150 2024-04-26T23:46:47.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.724+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe3a80cfe30 con 0x7fe3a8072150 2024-04-26T23:46:47.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.724+0000 7fe3a4c00640 1 -- 172.21.15.47:0/4279893570 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fe398016090 con 0x7fe3a8072150 2024-04-26T23:46:47.734 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:46:47.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe3840683b0 msgr2=0x7fe38406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:47.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe3840683b0 0x7fe38406a870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8165f80 tx=0x7fe390009040 comp rx=0 tx=0).stop 2024-04-26T23:46:47.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a8072150 msgr2=0x7fe3a8154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:47.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a8072150 0x7fe3a8154d40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe398019080 tx=0x7fe39801acb0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 shutdown_connections 2024-04-26T23:46:47.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe3840683b0 0x7fe38406a870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe3a80cdc00 0x7fe3a8165280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a80afb60 0x7fe3a8152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 --2- 172.21.15.47:0/4279893570 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe3a8072150 0x7fe3a8154d40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:47.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 >> 172.21.15.47:0/4279893570 conn(0x7fe3a806c800 msgr2=0x7fe3a80aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:47.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 shutdown_connections 2024-04-26T23:46:47.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:47.728+0000 7fe3af000640 1 -- 172.21.15.47:0/4279893570 wait complete. 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:46:47.756 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:46:47.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:47.757 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-04-26T23:46:47.766 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:46:47.767 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42333sec preferred_lft 42333sec 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 02:42:b9:62:ce:ce brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:46:47.768 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:46:47.769 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:46:47.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:47.770 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:46:47.831 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-26T23:46:47.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:47.834 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-04-26T23:46:47.888 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:46:47.889 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:46:47.889 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:46:47.890 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:46:47.890 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:46:47.890 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:46:47.890 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:46:47.890 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:46:47.988 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:46:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:46:48.031 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:46:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:46:48.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:48.039 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-26T23:46:48.048 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:46:48.048 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:46:48.048 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:46:48.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:48.048 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2024-04-26T23:46:48.112 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T23:46:48.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:46:48.113 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:48.168 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:46:48.168 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:46:48.168 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:48.219 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:46:48.285 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:46:48.337 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:46:48.337 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:46:48.337 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:46:48.338 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:46:48.339 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:46:48.340 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:46:48.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:48.341 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:46:48.395 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:46:48.396 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T23:46:48.442 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:46:48.463 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:46:48.523 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:46:48.523 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:46:48.524 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:46:48.525 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:46:48.526 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:46:48.526 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:46:48.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:48.527 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:46:48.540 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:2024-04-26T23:46:48.534+0000 7f6abe003580 -1 init, newargv = 0x559e856dfcd0 newargc=15 2024-04-26T23:46:48.540 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33669]: starting ceph client 2024-04-26T23:46:48.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33669]: starting fuse 2024-04-26T23:46:49.649 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:46:49.672 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:46:49.725 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:46:49.725 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:46:49.725 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:46:49.725 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:46:49.726 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:46:49.727 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:46:49.728 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:46:49.728 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:46:49.728 INFO:teuthology.orchestra.run.smithi203.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:49.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:49.729 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:46:49.780 INFO:teuthology.orchestra.run.smithi203.stdout:44 2024-04-26T23:46:49.780 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:46:49.781 DEBUG:teuthology.orchestra.run.smithi203:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:46:49.781 DEBUG:teuthology.orchestra.run.smithi203:> import glob 2024-04-26T23:46:49.781 DEBUG:teuthology.orchestra.run.smithi203:> import re 2024-04-26T23:46:49.781 DEBUG:teuthology.orchestra.run.smithi203:> import os 2024-04-26T23:46:49.781 DEBUG:teuthology.orchestra.run.smithi203:> import subprocess 2024-04-26T23:46:49.781 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:46:49.782 DEBUG:teuthology.orchestra.run.smithi203:> def _find_admin_socket(client_name): 2024-04-26T23:46:49.782 DEBUG:teuthology.orchestra.run.smithi203:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T23:46:49.782 DEBUG:teuthology.orchestra.run.smithi203:> files = glob.glob(asok_path) 2024-04-26T23:46:49.782 DEBUG:teuthology.orchestra.run.smithi203:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T23:46:49.782 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:46:49.782 DEBUG:teuthology.orchestra.run.smithi203:> # Given a non-glob path, it better be there 2024-04-26T23:46:49.783 DEBUG:teuthology.orchestra.run.smithi203:> if "*" not in asok_path: 2024-04-26T23:46:49.783 DEBUG:teuthology.orchestra.run.smithi203:> assert(len(files) == 1) 2024-04-26T23:46:49.783 DEBUG:teuthology.orchestra.run.smithi203:> return files[0] 2024-04-26T23:46:49.783 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:46:49.783 DEBUG:teuthology.orchestra.run.smithi203:> for f in files: 2024-04-26T23:46:49.783 DEBUG:teuthology.orchestra.run.smithi203:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:46:49.783 DEBUG:teuthology.orchestra.run.smithi203:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:46:49.784 DEBUG:teuthology.orchestra.run.smithi203:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:46:49.784 DEBUG:teuthology.orchestra.run.smithi203:> contents = proc_f.read() 2024-04-26T23:46:49.784 DEBUG:teuthology.orchestra.run.smithi203:> if mountpoint in contents: 2024-04-26T23:46:49.784 DEBUG:teuthology.orchestra.run.smithi203:> return f 2024-04-26T23:46:49.784 DEBUG:teuthology.orchestra.run.smithi203:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:46:49.784 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:46:49.785 DEBUG:teuthology.orchestra.run.smithi203:> print(_find_admin_socket("client.1")) 2024-04-26T23:46:49.785 DEBUG:teuthology.orchestra.run.smithi203:> ' 2024-04-26T23:46:49.913 INFO:teuthology.orchestra.run.smithi203.stdout:/var/run/ceph/ceph-client.1.33669.asok 2024-04-26T23:46:49.916 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:46:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:46:49.925 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33669.asok 2024-04-26T23:46:49.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:49.926 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33669.asok status 2024-04-26T23:46:50.098 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-04-26T23:46:50.098 INFO:teuthology.orchestra.run.smithi203.stdout: "metadata": { 2024-04-26T23:46:50.098 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:46:50.099 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:46:50.099 INFO:teuthology.orchestra.run.smithi203.stdout: "entity_id": "1", 2024-04-26T23:46:50.099 INFO:teuthology.orchestra.run.smithi203.stdout: "hostname": "smithi203", 2024-04-26T23:46:50.099 INFO:teuthology.orchestra.run.smithi203.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T23:46:50.099 INFO:teuthology.orchestra.run.smithi203.stdout: "pid": "33669", 2024-04-26T23:46:50.100 INFO:teuthology.orchestra.run.smithi203.stdout: "root": "/" 2024-04-26T23:46:50.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:46:50.100 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_count": 0, 2024-04-26T23:46:50.100 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_pinned_count": 0, 2024-04-26T23:46:50.100 INFO:teuthology.orchestra.run.smithi203.stdout: "id": 4967, 2024-04-26T23:46:50.100 INFO:teuthology.orchestra.run.smithi203.stdout: "inst": { 2024-04-26T23:46:50.100 INFO:teuthology.orchestra.run.smithi203.stdout: "name": { 2024-04-26T23:46:50.101 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "client", 2024-04-26T23:46:50.101 INFO:teuthology.orchestra.run.smithi203.stdout: "num": 4967 2024-04-26T23:46:50.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:46:50.101 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:46:50.101 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:46:50.101 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:46:50.102 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 1475821914 2024-04-26T23:46:50.102 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-04-26T23:46:50.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:46:50.102 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:46:50.102 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:46:50.102 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:46:50.103 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 1475821914 2024-04-26T23:46:50.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:46:50.103 INFO:teuthology.orchestra.run.smithi203.stdout: "inst_str": "client.4967 192.168.0.1:0/1475821914", 2024-04-26T23:46:50.103 INFO:teuthology.orchestra.run.smithi203.stdout: "addr_str": "192.168.0.1:0/1475821914", 2024-04-26T23:46:50.103 INFO:teuthology.orchestra.run.smithi203.stdout: "inode_count": 1, 2024-04-26T23:46:50.103 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_epoch": 17, 2024-04-26T23:46:50.103 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch": 36, 2024-04-26T23:46:50.104 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:46:50.104 INFO:teuthology.orchestra.run.smithi203.stdout: "blocklisted": false, 2024-04-26T23:46:50.104 INFO:teuthology.orchestra.run.smithi203.stdout: "fs_name": "cephfs" 2024-04-26T23:46:50.104 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-04-26T23:46:50.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:50.115 DEBUG:teuthology.orchestra.run.smithi203:> stat --file-system '--printf=%T 2024-04-26T23:46:50.116 DEBUG:teuthology.orchestra.run.smithi203:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:50.125 INFO:teuthology.orchestra.run.smithi203.stdout:fuseblk 2024-04-26T23:46:50.126 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:50.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:50.126 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:46:50.192 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-26T23:46:50.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.328+0000 7f8b5f600640 1 Processor -- start 2024-04-26T23:46:50.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.328+0000 7f8b5f600640 1 -- start start 2024-04-26T23:46:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b5f600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b580b5290 0x7f8b580b5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b5f600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b580b6030 con 0x7f8b58072960 2024-04-26T23:46:50.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b5f600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b580b6310 con 0x7f8b5815bf90 2024-04-26T23:46:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b5f600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f8b580b65f0 con 0x7f8b580b5290 2024-04-26T23:46:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b5cc00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8b58072960 0x7f8b58072d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55752/0 (socket says 172.21.15.47:55752) 2024-04-26T23:46:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b5cc00640 1 -- 172.21.15.47:0/3023389097 learned_addr learned my addr 172.21.15.47:0/3023389097 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b4fe00640 1 --2- 172.21.15.47:0/3023389097 >> v2:172.21.15.47:3300/0 conn(0x7f8b580b5290 0x7f8b580b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b4fe00640 1 -- 172.21.15.47:0/3023389097 >> v1:172.21.15.203:6789/0 conn(0x7f8b5815bf90 legacy=0x7f8b5815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:50.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b4fe00640 1 -- 172.21.15.47:0/3023389097 >> v1:172.21.15.47:6789/0 conn(0x7f8b58072960 legacy=0x7f8b58072d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b4fe00640 1 -- 172.21.15.47:0/3023389097 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580b68d0 con 0x7f8b580b5290 2024-04-26T23:46:50.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.332+0000 7f8b57e00640 1 -- 172.21.15.47:0/3023389097 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436601842 0 0) 0x7f8b580b6030 con 0x7f8b58072960 2024-04-26T23:46:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b4fe00640 1 --2- 172.21.15.47:0/3023389097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b580b5720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097c0 tx=0x7f8b4001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bf9921c0c10ced server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b57e00640 1 -- 172.21.15.47:0/3023389097 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b400ab610 con 0x7f8b580b5290 2024-04-26T23:46:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b57e00640 1 -- 172.21.15.47:0/3023389097 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b400b0070 con 0x7f8b580b5290 2024-04-26T23:46:50.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b57e00640 1 -- 172.21.15.47:0/3023389097 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b400ab9d0 con 0x7f8b580b5290 2024-04-26T23:46:50.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 -- 172.21.15.47:0/3023389097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 msgr2=0x7f8b580b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:50.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3023389097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b580b5720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097c0 tx=0x7f8b4001c470 comp rx=0 tx=0).stop 2024-04-26T23:46:50.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 -- 172.21.15.47:0/3023389097 shutdown_connections 2024-04-26T23:46:50.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3023389097 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b580b5720 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:50.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 -- 172.21.15.47:0/3023389097 >> 172.21.15.47:0/3023389097 conn(0x7f8b58070bc0 msgr2=0x7f8b5806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:50.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 -- 172.21.15.47:0/3023389097 shutdown_connections 2024-04-26T23:46:50.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 -- 172.21.15.47:0/3023389097 wait complete. 2024-04-26T23:46:50.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 Processor -- start 2024-04-26T23:46:50.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.336+0000 7f8b5f600640 1 -- start start 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b58072960 0x7f8b5813f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b5813d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b5815bf90 0x7f8b58140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5815cc90 con 0x7f8b580b5290 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5815cb10 con 0x7f8b58072960 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5815ce10 con 0x7f8b5815bf90 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b5813d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b5813d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57822/0 (socket says 172.21.15.47:57822) 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5cc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b58072960 0x7f8b5813f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b4fe00640 1 -- 172.21.15.47:0/3586191206 learned_addr learned my addr 172.21.15.47:0/3586191206 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:50.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5d600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b5815bf90 0x7f8b58140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5cc00640 1 -- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b5815bf90 msgr2=0x7f8b58140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5cc00640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b5815bf90 0x7f8b58140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5cc00640 1 -- 172.21.15.47:0/3586191206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 msgr2=0x7f8b5813d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5cc00640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b5813d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5cc00640 1 -- 172.21.15.47:0/3586191206 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b581643a0 con 0x7f8b58072960 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b4fe00640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b5813d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5cc00640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b58072960 0x7f8b5813f800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c450 tx=0x7f8b4800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b55600640 1 -- 172.21.15.47:0/3586191206 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b480074e0 con 0x7f8b58072960 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b55600640 1 -- 172.21.15.47:0/3586191206 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b48007680 con 0x7f8b58072960 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5813ed20 con 0x7f8b58072960 2024-04-26T23:46:50.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b55600640 1 -- 172.21.15.47:0/3586191206 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48004a30 con 0x7f8b58072960 2024-04-26T23:46:50.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5813f2e0 con 0x7f8b58072960 2024-04-26T23:46:50.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b58167000 con 0x7f8b58072960 2024-04-26T23:46:50.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.340+0000 7f8b55600640 1 -- 172.21.15.47:0/3586191206 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b48011070 con 0x7f8b58072960 2024-04-26T23:46:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.344+0000 7f8b55600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b34068380 0x7f8b3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.344+0000 7f8b55600640 1 -- 172.21.15.47:0/3586191206 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f8b480864c0 con 0x7f8b58072960 2024-04-26T23:46:50.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.344+0000 7f8b4fe00640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b34068380 0x7f8b3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:50.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.344+0000 7f8b4fe00640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b34068380 0x7f8b3406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097c0 tx=0x7f8b400a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:50.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.348+0000 7f8b55600640 1 -- 172.21.15.47:0/3586191206 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8b48056390 con 0x7f8b58072960 2024-04-26T23:46:50.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:50.552+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f8b580ce660 con 0x7f8b58072960 2024-04-26T23:46:51.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b55600640 1 -- 172.21.15.47:0/3586191206 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) ==== 136+0+0 (secure 0 0 0) 0x7f8b4805a690 con 0x7f8b58072960 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b34068380 msgr2=0x7f8b3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b34068380 0x7f8b3406a840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b400097c0 tx=0x7f8b400a7000 comp rx=0 tx=0).stop 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b58072960 msgr2=0x7f8b5813f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b58072960 0x7f8b5813f800 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c450 tx=0x7f8b4800c910 comp rx=0 tx=0).stop 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 shutdown_connections 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8b34068380 0x7f8b3406a840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8b5815bf90 0x7f8b58140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b580b5290 0x7f8b5813d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 --2- 172.21.15.47:0/3586191206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8b58072960 0x7f8b5813f800 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 >> 172.21.15.47:0/3586191206 conn(0x7f8b58070bc0 msgr2=0x7f8b581445a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:51.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 shutdown_connections 2024-04-26T23:46:51.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.240+0000 7f8b5f600640 1 -- 172.21.15.47:0/3586191206 wait complete. 2024-04-26T23:46:51.274 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-26T23:46:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 Processor -- start 2024-04-26T23:46:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 -- start start 2024-04-26T23:46:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fac000729a0 0x7fac00160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fac00072d80 0x7fac00162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00163330 0x7fac001637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fac000b62e0 con 0x7fac000729a0 2024-04-26T23:46:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fac000739a0 con 0x7fac00072d80 2024-04-26T23:46:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac07400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fac001607c0 con 0x7fac00163330 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fac000729a0 0x7fac00160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fac000729a0 0x7fac00160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57830/0 (socket says 172.21.15.47:57830) 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 -- 172.21.15.47:0/312205212 learned_addr learned my addr 172.21.15.47:0/312205212 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 -- 172.21.15.47:0/312205212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00163330 msgr2=0x7fac001637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 --2- 172.21.15.47:0/312205212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00163330 0x7fac001637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 -- 172.21.15.47:0/312205212 >> v2:172.21.15.203:3300/0 conn(0x7fac00072d80 msgr2=0x7fac00162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 --2- 172.21.15.47:0/312205212 >> v2:172.21.15.203:3300/0 conn(0x7fac00072d80 0x7fac00162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.412+0000 7fac04a00640 1 -- 172.21.15.47:0/312205212 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac000b56d0 con 0x7fac000729a0 2024-04-26T23:46:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac04a00640 1 --2- 172.21.15.47:0/312205212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac00160280 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fac000713b0 tx=0x7fabf401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1975e7cfb1b4cde5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fabff400640 1 -- 172.21.15.47:0/312205212 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40ab620 con 0x7fac000729a0 2024-04-26T23:46:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fabff400640 1 -- 172.21.15.47:0/312205212 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf40b0070 con 0x7fac000729a0 2024-04-26T23:46:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fabff400640 1 -- 172.21.15.47:0/312205212 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40ab9e0 con 0x7fac000729a0 2024-04-26T23:46:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 -- 172.21.15.47:0/312205212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 msgr2=0x7fac00160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 --2- 172.21.15.47:0/312205212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac00160280 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fac000713b0 tx=0x7fabf401c460 comp rx=0 tx=0).stop 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 -- 172.21.15.47:0/312205212 shutdown_connections 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 --2- 172.21.15.47:0/312205212 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00163330 0x7fac001637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 --2- 172.21.15.47:0/312205212 >> v2:172.21.15.203:3300/0 conn(0x7fac00072d80 0x7fac00162df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 --2- 172.21.15.47:0/312205212 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac00160280 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 -- 172.21.15.47:0/312205212 >> 172.21.15.47:0/312205212 conn(0x7fac00070c00 msgr2=0x7fac0006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 -- 172.21.15.47:0/312205212 shutdown_connections 2024-04-26T23:46:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.416+0000 7fac07400640 1 -- 172.21.15.47:0/312205212 wait complete. 2024-04-26T23:46:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 Processor -- start 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 -- start start 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac0014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00072d80 0x7fac001541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac00163330 0x7fac000cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fac0015d0b0 con 0x7fac000729a0 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac000731f0 con 0x7fac00163330 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fac0015d230 con 0x7fac00072d80 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac0014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac0014ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57842/0 (socket says 172.21.15.47:57842) 2024-04-26T23:46:51.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 -- 172.21.15.47:0/2375798102 learned_addr learned my addr 172.21.15.47:0/2375798102 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:51.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 -- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00072d80 msgr2=0x7fac001541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00072d80 0x7fac001541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 -- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac00163330 msgr2=0x7fac000cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac05400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac00163330 0x7fac000cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac00163330 0x7fac000cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 -- 172.21.15.47:0/2375798102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac001555e0 con 0x7fac000729a0 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac05400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac00163330 0x7fac000cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac04a00640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac0014ad80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fabf40ad040 tx=0x7fabf401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fabfcc00640 1 -- 172.21.15.47:0/2375798102 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40abde0 con 0x7fac000729a0 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fabfcc00640 1 -- 172.21.15.47:0/2375798102 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf40be3f0 con 0x7fac000729a0 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fabfcc00640 1 -- 172.21.15.47:0/2375798102 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf40be7e0 con 0x7fac000729a0 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.420+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0014b2c0 con 0x7fac000729a0 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.424+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0015a970 con 0x7fac000729a0 2024-04-26T23:46:51.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.424+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac000695f0 con 0x7fac000729a0 2024-04-26T23:46:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.424+0000 7fabfcc00640 1 -- 172.21.15.47:0/2375798102 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fabf40b43f0 con 0x7fac000729a0 2024-04-26T23:46:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.424+0000 7fabfcc00640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fabe0068380 0x7fabe006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.424+0000 7fabfcc00640 1 -- 172.21.15.47:0/2375798102 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fabf4120e60 con 0x7fac000729a0 2024-04-26T23:46:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.424+0000 7fabffe00640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fabe0068380 0x7fabe006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.424+0000 7fabffe00640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fabe0068380 0x7fabe006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fac0006feb0 tx=0x7fabec006ca0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.428+0000 7fabfcc00640 1 -- 172.21.15.47:0/2375798102 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fabf40c4060 con 0x7fac000729a0 2024-04-26T23:46:51.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.616+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fac00070470 con 0x7fabe0068380 2024-04-26T23:46:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.616+0000 7fabfcc00640 1 -- 172.21.15.47:0/2375798102 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fac00070470 con 0x7fabe0068380 2024-04-26T23:46:51.625 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-26T23:46:51.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:46:51.625 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephfs" 2024-04-26T23:46:51.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:46:51.626 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-26T23:46:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fabe0068380 msgr2=0x7fabe006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fabe0068380 0x7fabe006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fac0006feb0 tx=0x7fabec006ca0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 msgr2=0x7fac0014ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac0014ad80 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fabf40ad040 tx=0x7fabf401aca0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 shutdown_connections 2024-04-26T23:46:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fabe0068380 0x7fabe006a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac00163330 0x7fac000cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fac00072d80 0x7fac001541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 --2- 172.21.15.47:0/2375798102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac000729a0 0x7fac0014ad80 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 >> 172.21.15.47:0/2375798102 conn(0x7fac00070c00 msgr2=0x7fac00160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:51.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 shutdown_connections 2024-04-26T23:46:51.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.620+0000 7fac07400640 1 -- 172.21.15.47:0/2375798102 wait complete. 2024-04-26T23:46:51.647 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:46:51.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.784+0000 7f2849000640 1 Processor -- start 2024-04-26T23:46:51.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.784+0000 7f2849000640 1 -- start start 2024-04-26T23:46:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.784+0000 7f2849000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 0x7f28440af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2849000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f284415fcd0 0x7f2844160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2849000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28440ae6a0 con 0x7f28440d0390 2024-04-26T23:46:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2849000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f28440ae920 con 0x7f284415fcd0 2024-04-26T23:46:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2849000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f28440aec00 con 0x7f284406cd40 2024-04-26T23:46:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f28440d0390 0x7f284406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55768/0 (socket says 172.21.15.47:55768) 2024-04-26T23:46:51.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 -- 172.21.15.47:0/2210102175 learned_addr learned my addr 172.21.15.47:0/2210102175 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2839400640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 0x7f28440af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2842800640 1 --2- 172.21.15.47:0/2210102175 >> v2:172.21.15.203:3300/0 conn(0x7f284415fcd0 0x7f2844160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859195223 0 0) 0x7f2834001120 con 0x7f28440d0390 2024-04-26T23:46:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2828003530 con 0x7f28440d0390 2024-04-26T23:46:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 553464168 0 0) 0x7f2828003530 con 0x7f28440d0390 2024-04-26T23:46:51.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 msgr2=0x7f28440af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 0x7f28440af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 >> v2:172.21.15.203:3300/0 conn(0x7f284415fcd0 msgr2=0x7f2844160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 --2- 172.21.15.47:0/2210102175 >> v2:172.21.15.203:3300/0 conn(0x7f284415fcd0 0x7f2844160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28440aeee0 con 0x7f28440d0390 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f2834001850 con 0x7f28440d0390 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 >> v1:172.21.15.47:6789/0 conn(0x7f28440d0390 legacy=0x7f284406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280039c0 0x7f2828003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828004370 0x7f2828004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 0x7f2828004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f28440ae920 con 0x7f28280039c0 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f28440aec00 con 0x7f2828004370 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f282800b9d0 con 0x7f284406cd40 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280039c0 0x7f2828003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2842800640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 0x7f2828004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2839400640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828004370 0x7f2828004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 -- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 msgr2=0x7f2828004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f284406cd40 0x7f2828004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 -- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828004370 msgr2=0x7f2828004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828004370 0x7f2828004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2841e00640 1 -- 172.21.15.47:0/2210102175 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2828003530 con 0x7f28280039c0 2024-04-26T23:46:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.788+0000 7f2839400640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2828004370 0x7f2828004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:46:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2841e00640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280039c0 0x7f2828003da0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2834005300 tx=0x7f283401d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f07d40679d94e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834004ed0 con 0x7f28280039c0 2024-04-26T23:46:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28340058e0 con 0x7f28280039c0 2024-04-26T23:46:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2841400640 1 -- 172.21.15.47:0/2210102175 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834005cb0 con 0x7f28280039c0 2024-04-26T23:46:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 -- 172.21.15.47:0/2210102175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280039c0 msgr2=0x7f2828003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 --2- 172.21.15.47:0/2210102175 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28280039c0 0x7f2828003da0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2834005300 tx=0x7f283401d330 comp rx=0 tx=0).stop 2024-04-26T23:46:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2842800640 1 -- 172.21.15.47:0/2210102175 reap_dead start 2024-04-26T23:46:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 -- 172.21.15.47:0/2210102175 shutdown_connections 2024-04-26T23:46:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 -- 172.21.15.47:0/2210102175 >> 172.21.15.47:0/2210102175 conn(0x7f28440b2b70 msgr2=0x7f28440b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 -- 172.21.15.47:0/2210102175 shutdown_connections 2024-04-26T23:46:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 -- 172.21.15.47:0/2210102175 wait complete. 2024-04-26T23:46:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 Processor -- start 2024-04-26T23:46:51.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.792+0000 7f2849000640 1 -- start start 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28280039c0 0x7f2844073320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440b1c20 0x7f28440d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28440d1360 0x7f28441f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f284406f860 con 0x7f28440b1c20 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f284406f6e0 con 0x7f28440d1360 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f284406f9e0 con 0x7f28280039c0 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440b1c20 0x7f28440d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440b1c20 0x7f28440d0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57860/0 (socket says 172.21.15.47:57860) 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 -- 172.21.15.47:0/958516869 learned_addr learned my addr 172.21.15.47:0/958516869 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2841e00640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28280039c0 0x7f2844073320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2842800640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28440d1360 0x7f28441f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 -- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28280039c0 msgr2=0x7f2844073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28280039c0 0x7f2844073320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 -- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28440d1360 msgr2=0x7f28441f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28440d1360 0x7f28441f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 -- 172.21.15.47:0/958516869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28441fba10 con 0x7f28440b1c20 2024-04-26T23:46:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2839400640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440b1c20 0x7f28440d0e20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f282c006f90 tx=0x7f282c010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f283aa00640 1 -- 172.21.15.47:0/958516869 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c00eea0 con 0x7f28440b1c20 2024-04-26T23:46:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f283aa00640 1 -- 172.21.15.47:0/958516869 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c004020 con 0x7f28440b1c20 2024-04-26T23:46:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28441fbcf0 con 0x7f28440b1c20 2024-04-26T23:46:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f283aa00640 1 -- 172.21.15.47:0/958516869 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c0043d0 con 0x7f28440b1c20 2024-04-26T23:46:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28441fc2b0 con 0x7f28440b1c20 2024-04-26T23:46:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.796+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2844069700 con 0x7f28440b1c20 2024-04-26T23:46:51.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.800+0000 7f283aa00640 1 -- 172.21.15.47:0/958516869 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f282c003620 con 0x7f28440b1c20 2024-04-26T23:46:51.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.800+0000 7f283aa00640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2820068380 0x7f282006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.800+0000 7f283aa00640 1 -- 172.21.15.47:0/958516869 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f282c0873a0 con 0x7f28440b1c20 2024-04-26T23:46:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.800+0000 7f2841e00640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2820068380 0x7f282006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.800+0000 7f2841e00640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2820068380 0x7f282006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28340052d0 tx=0x7f2834001db0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.804+0000 7f283aa00640 1 -- 172.21.15.47:0/958516869 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f282c057270 con 0x7f28440b1c20 2024-04-26T23:46:51.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f28440d1740 con 0x7f28440b1c20 2024-04-26T23:46:51.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f283aa00640 1 -- 172.21.15.47:0/958516869 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f282c05b570 con 0x7f28440b1c20 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2820068380 msgr2=0x7f282006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2820068380 0x7f282006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f28340052d0 tx=0x7f2834001db0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440b1c20 msgr2=0x7f28440d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440b1c20 0x7f28440d0e20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f282c006f90 tx=0x7f282c010f00 comp rx=0 tx=0).stop 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 shutdown_connections 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2820068380 0x7f282006a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28440d1360 0x7f28441f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28440b1c20 0x7f28440d0e20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 --2- 172.21.15.47:0/958516869 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f28280039c0 0x7f2844073320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 >> 172.21.15.47:0/958516869 conn(0x7f28440b2b70 msgr2=0x7f28440b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:51.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 shutdown_connections 2024-04-26T23:46:51.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:51.968+0000 7f2849000640 1 -- 172.21.15.47:0/958516869 wait complete. 2024-04-26T23:46:52.000 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol25160 --mode=777 2024-04-26T23:46:52.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 Processor -- start 2024-04-26T23:46:52.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 -- start start 2024-04-26T23:46:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c0cd6e0 0x7f299c073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f299c0b41e0 0x7f299c0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f299c0ce000 con 0x7f299c15d2f0 2024-04-26T23:46:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f299c0b46a0 con 0x7f299c0b41e0 2024-04-26T23:46:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f299c0b4980 con 0x7f299c0cd6e0 2024-04-26T23:46:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a2600640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f299c15d2f0 0x7f299c160c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55774/0 (socket says 172.21.15.47:55774) 2024-04-26T23:46:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a2600640 1 -- 172.21.15.47:0/1490958261 learned_addr learned my addr 172.21.15.47:0/1490958261 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a1c00640 1 --2- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c0cd6e0 0x7f299c073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a1200640 1 --2- 172.21.15.47:0/1490958261 >> v2:172.21.15.203:3300/0 conn(0x7f299c0b41e0 0x7f299c0cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f299be00640 1 -- 172.21.15.47:0/1490958261 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1717774560 0 0) 0x7f299c0ce000 con 0x7f299c15d2f0 2024-04-26T23:46:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f299be00640 1 -- 172.21.15.47:0/1490958261 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2984003530 con 0x7f299c15d2f0 2024-04-26T23:46:52.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a1200640 1 -- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c0cd6e0 msgr2=0x7f299c073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:52.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a1200640 1 --2- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c0cd6e0 0x7f299c073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a1200640 1 -- 172.21.15.47:0/1490958261 >> v1:172.21.15.47:6789/0 conn(0x7f299c15d2f0 legacy=0x7f299c160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f299be00640 1 -- 172.21.15.47:0/1490958261 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221176692 0 0) 0x7f2984003530 con 0x7f299c15d2f0 2024-04-26T23:46:52.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a1200640 1 -- 172.21.15.47:0/1490958261 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c0b4c60 con 0x7f299c0b41e0 2024-04-26T23:46:52.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a1200640 1 --2- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0b41e0 0x7f299c0cdac0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f29880097c0 tx=0x7f298801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0845be4214aedbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:52.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f299be00640 1 -- 172.21.15.47:0/1490958261 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29880b0070 con 0x7f299c0b41e0 2024-04-26T23:46:52.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f299be00640 1 -- 172.21.15.47:0/1490958261 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29880ab400 con 0x7f299c0b41e0 2024-04-26T23:46:52.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f299be00640 1 -- 172.21.15.47:0/1490958261 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994001a00 con 0x7f299c0b41e0 2024-04-26T23:46:52.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 -- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0b41e0 msgr2=0x7f299c0cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.144+0000 7f29a4600640 1 --2- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0b41e0 0x7f299c0cdac0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f29880097c0 tx=0x7f298801c3c0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- 172.21.15.47:0/1490958261 shutdown_connections 2024-04-26T23:46:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 --2- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0b41e0 0x7f299c0cdac0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 --2- 172.21.15.47:0/1490958261 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c0cd6e0 0x7f299c073cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- 172.21.15.47:0/1490958261 >> 172.21.15.47:0/1490958261 conn(0x7f299c0d0c90 msgr2=0x7f299c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- 172.21.15.47:0/1490958261 shutdown_connections 2024-04-26T23:46:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- 172.21.15.47:0/1490958261 wait complete. 2024-04-26T23:46:52.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 Processor -- start 2024-04-26T23:46:52.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- start start 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f299c0b41e0 0x7f299c1f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0cd6e0 0x7f299c1fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c15d2f0 0x7f299c0b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f299c169f00 con 0x7f299c0b41e0 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f299c169d80 con 0x7f299c0cd6e0 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f299c16a080 con 0x7f299c15d2f0 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f299c0b41e0 0x7f299c1f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f299c0b41e0 0x7f299c1f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57874/0 (socket says 172.21.15.47:57874) 2024-04-26T23:46:52.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 -- 172.21.15.47:0/1296601096 learned_addr learned my addr 172.21.15.47:0/1296601096 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1200640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0cd6e0 0x7f299c1fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a2600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c15d2f0 0x7f299c0b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 -- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c15d2f0 msgr2=0x7f299c0b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c15d2f0 0x7f299c0b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 -- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0cd6e0 msgr2=0x7f299c1fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0cd6e0 0x7f299c1fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 -- 172.21.15.47:0/1296601096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c160520 con 0x7f299c0b41e0 2024-04-26T23:46:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a2600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c15d2f0 0x7f299c0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a1c00640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f299c0b41e0 0x7f299c1f83c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f299000e930 tx=0x7f299000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f2999600640 1 -- 172.21.15.47:0/1296601096 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2990017070 con 0x7f299c0b41e0 2024-04-26T23:46:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f2999600640 1 -- 172.21.15.47:0/1296601096 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299000ca00 con 0x7f299c0b41e0 2024-04-26T23:46:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c15a8f0 con 0x7f299c0b41e0 2024-04-26T23:46:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.148+0000 7f2999600640 1 -- 172.21.15.47:0/1296601096 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299000cdb0 con 0x7f299c0b41e0 2024-04-26T23:46:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.152+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c15aeb0 con 0x7f299c0b41e0 2024-04-26T23:46:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.152+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c0695f0 con 0x7f299c0b41e0 2024-04-26T23:46:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.152+0000 7f2999600640 1 -- 172.21.15.47:0/1296601096 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f299001a070 con 0x7f299c0b41e0 2024-04-26T23:46:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.152+0000 7f2999600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f297c068380 0x7f297c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.152+0000 7f2999600640 1 -- 172.21.15.47:0/1296601096 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f2990086b10 con 0x7f299c0b41e0 2024-04-26T23:46:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.152+0000 7f29a1200640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f297c068380 0x7f297c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.152+0000 7f29a1200640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f297c068380 0x7f297c06a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29880ad000 tx=0x7f2988008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:52.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.156+0000 7f2999600640 1 -- 172.21.15.47:0/1296601096 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2990057070 con 0x7f299c0b41e0 2024-04-26T23:46:52.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.352+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol25160", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f299c159bb0 con 0x7f297c068380 2024-04-26T23:46:52.366 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:46:52.362+0000 7f5e17a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:46:52.366 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:46:52.362+0000 7f5e17a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:46:52.366 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:46:52.362+0000 7f5e17a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:46:52.366 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:46:52.362+0000 7f5e17a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:46:52.366 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:46:52.362+0000 7f5e17a00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:46:52.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.488+0000 7f2999600640 1 -- 172.21.15.47:0/1296601096 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f299c159bb0 con 0x7f297c068380 2024-04-26T23:46:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f297c068380 msgr2=0x7f297c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f297c068380 0x7f297c06a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29880ad000 tx=0x7f2988008040 comp rx=0 tx=0).stop 2024-04-26T23:46:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f299c0b41e0 msgr2=0x7f299c1f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f299c0b41e0 0x7f299c1f83c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f299000e930 tx=0x7f299000edf0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 shutdown_connections 2024-04-26T23:46:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f297c068380 0x7f297c06a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f299c15d2f0 0x7f299c0b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f299c0cd6e0 0x7f299c1fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 --2- 172.21.15.47:0/1296601096 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f299c0b41e0 0x7f299c1f83c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 >> 172.21.15.47:0/1296601096 conn(0x7f299c0d0c90 msgr2=0x7f299c15a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:52.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 shutdown_connections 2024-04-26T23:46:52.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.496+0000 7f29a4600640 1 -- 172.21.15.47:0/1296601096 wait complete. 2024-04-26T23:46:52.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol25160 2024-04-26T23:46:52.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 Processor -- start 2024-04-26T23:46:52.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- start start 2024-04-26T23:46:52.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea5406c630 0x7fea5406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fea54160b50 0x7fea54160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea540ae030 con 0x7fea5415cf50 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fea540af7a0 con 0x7fea5406c630 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fea5406d000 con 0x7fea54160b50 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea49400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea5406c630 0x7fea5406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea51e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fea5415cf50 0x7fea540cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55780/0 (socket says 172.21.15.47:55780) 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea51e00640 1 -- 172.21.15.47:0/2598536418 learned_addr learned my addr 172.21.15.47:0/2598536418 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:46:52.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea52800640 1 --2- 172.21.15.47:0/2598536418 >> v2:172.21.15.203:3300/0 conn(0x7fea54160b50 0x7fea54160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea49400640 1 -- 172.21.15.47:0/2598536418 >> v2:172.21.15.203:3300/0 conn(0x7fea54160b50 msgr2=0x7fea54160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:46:52.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea49400640 1 --2- 172.21.15.47:0/2598536418 >> v2:172.21.15.203:3300/0 conn(0x7fea54160b50 0x7fea54160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea49400640 1 -- 172.21.15.47:0/2598536418 >> v1:172.21.15.47:6789/0 conn(0x7fea5415cf50 legacy=0x7fea540cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea49400640 1 -- 172.21.15.47:0/2598536418 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea540d0ae0 con 0x7fea5406c630 2024-04-26T23:46:52.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea51400640 1 -- 172.21.15.47:0/2598536418 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048143560 0 0) 0x7fea540ae030 con 0x7fea5415cf50 2024-04-26T23:46:52.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea49400640 1 --2- 172.21.15.47:0/2598536418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5406c630 0x7fea5406cac0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fea54074510 tx=0x7fea3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e7b5b07af63de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:52.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea51400640 1 -- 172.21.15.47:0/2598536418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0b0070 con 0x7fea5406c630 2024-04-26T23:46:52.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea51400640 1 -- 172.21.15.47:0/2598536418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c0ab600 con 0x7fea5406c630 2024-04-26T23:46:52.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea51400640 1 -- 172.21.15.47:0/2598536418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0ab9d0 con 0x7fea5406c630 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- 172.21.15.47:0/2598536418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5406c630 msgr2=0x7fea5406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 --2- 172.21.15.47:0/2598536418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5406c630 0x7fea5406cac0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fea54074510 tx=0x7fea3c01c480 comp rx=0 tx=0).stop 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- 172.21.15.47:0/2598536418 shutdown_connections 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 --2- 172.21.15.47:0/2598536418 >> v2:172.21.15.203:3300/0 conn(0x7fea54160b50 0x7fea54160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 --2- 172.21.15.47:0/2598536418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5406c630 0x7fea5406cac0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- 172.21.15.47:0/2598536418 >> 172.21.15.47:0/2598536418 conn(0x7fea540b2b70 msgr2=0x7fea540b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- 172.21.15.47:0/2598536418 shutdown_connections 2024-04-26T23:46:52.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.664+0000 7fea59200640 1 -- 172.21.15.47:0/2598536418 wait complete. 2024-04-26T23:46:52.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 Processor -- start 2024-04-26T23:46:52.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 -- start start 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea5406c630 0x7fea54156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5415cf50 0x7fea54167740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea54160b50 0x7fea540727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea54161910 con 0x7fea5415cf50 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea5415d330 con 0x7fea54160b50 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea54161a90 con 0x7fea5406c630 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5415cf50 0x7fea54167740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5415cf50 0x7fea54167740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57894/0 (socket says 172.21.15.47:57894) 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 -- 172.21.15.47:0/1674914911 learned_addr learned my addr 172.21.15.47:0/1674914911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea51e00640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea5406c630 0x7fea54156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea52800640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea54160b50 0x7fea540727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 -- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea5406c630 msgr2=0x7fea54156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea5406c630 0x7fea54156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 -- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea54160b50 msgr2=0x7fea540727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea54160b50 0x7fea540727a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 -- 172.21.15.47:0/1674914911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea541569b0 con 0x7fea5415cf50 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea52800640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea54160b50 0x7fea540727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea51e00640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea5406c630 0x7fea54156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea49400640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5415cf50 0x7fea54167740 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0ae040 tx=0x7fea3c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea4aa00640 1 -- 172.21.15.47:0/1674914911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0ba070 con 0x7fea5415cf50 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea4aa00640 1 -- 172.21.15.47:0/1674914911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c0b43f0 con 0x7fea5415cf50 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea4aa00640 1 -- 172.21.15.47:0/1674914911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0b0040 con 0x7fea5415cf50 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea541f7e50 con 0x7fea5415cf50 2024-04-26T23:46:52.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.668+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea541f8410 con 0x7fea5415cf50 2024-04-26T23:46:52.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.672+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea54069700 con 0x7fea5415cf50 2024-04-26T23:46:52.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.672+0000 7fea4aa00640 1 -- 172.21.15.47:0/1674914911 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea3c0bd070 con 0x7fea5415cf50 2024-04-26T23:46:52.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.672+0000 7fea4aa00640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068380 0x7fea3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:46:52.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.672+0000 7fea4aa00640 1 -- 172.21.15.47:0/1674914911 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fea3c11fb30 con 0x7fea5415cf50 2024-04-26T23:46:52.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.672+0000 7fea51e00640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068380 0x7fea3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:46:52.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.672+0000 7fea51e00640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068380 0x7fea3006a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea44000f70 tx=0x7fea44009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:46:52.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.676+0000 7fea4aa00640 1 -- 172.21.15.47:0/1674914911 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fea3c016070 con 0x7fea5415cf50 2024-04-26T23:46:52.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.872+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol25160", "target": ["mon-mgr", ""]}) -- 0x7fea540b4bc0 con 0x7fea30068380 2024-04-26T23:46:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea4aa00640 1 -- 172.21.15.47:0/1674914911 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fea540b4bc0 con 0x7fea30068380 2024-04-26T23:46:52.884 INFO:teuthology.orchestra.run.smithi047.stdout:/volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595 2024-04-26T23:46:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068380 msgr2=0x7fea3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068380 0x7fea3006a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fea44000f70 tx=0x7fea44009040 comp rx=0 tx=0).stop 2024-04-26T23:46:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5415cf50 msgr2=0x7fea54167740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5415cf50 0x7fea54167740 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fea3c0ae040 tx=0x7fea3c019220 comp rx=0 tx=0).stop 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 shutdown_connections 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068380 0x7fea3006a840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea54160b50 0x7fea540727a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea5415cf50 0x7fea54167740 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 --2- 172.21.15.47:0/1674914911 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea5406c630 0x7fea54156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 >> 172.21.15.47:0/1674914911 conn(0x7fea540b2b70 msgr2=0x7fea540d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 shutdown_connections 2024-04-26T23:46:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:46:52.880+0000 7fea59200640 1 -- 172.21.15.47:0/1674914911 wait complete. 2024-04-26T23:46:52.906 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol25160 with 200 files each 1MB size under directory volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595 2024-04-26T23:46:52.906 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:52.906 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:52.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:52.915 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.001 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.001 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.001 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212813 s, 49.3 MB/s 2024-04-26T23:46:53.002 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.002 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.055 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.133 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.133 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.133 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019663 s, 53.3 MB/s 2024-04-26T23:46:53.134 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.134 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.187 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.264 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.264 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.264 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195594 s, 53.6 MB/s 2024-04-26T23:46:53.265 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.265 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.314 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.390 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.390 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.390 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01469 s, 71.4 MB/s 2024-04-26T23:46:53.391 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.391 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.443 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.518 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.519 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.519 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187067 s, 56.1 MB/s 2024-04-26T23:46:53.520 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.520 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.571 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.643 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.644 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154011 s, 68.1 MB/s 2024-04-26T23:46:53.644 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.645 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.695 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.768 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.769 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.769 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168757 s, 62.1 MB/s 2024-04-26T23:46:53.770 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.770 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.819 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:53.892 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:53.892 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:53.892 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161076 s, 65.1 MB/s 2024-04-26T23:46:53.893 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:53.893 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:53.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:53.943 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.8 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.016 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.016 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.016 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159072 s, 65.9 MB/s 2024-04-26T23:46:54.017 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.017 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.067 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.9 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.139 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.139 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.139 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138294 s, 75.8 MB/s 2024-04-26T23:46:54.140 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.140 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.190 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.10 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.264 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.265 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.265 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166538 s, 63.0 MB/s 2024-04-26T23:46:54.266 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.266 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.315 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.11 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.387 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014639 s, 71.6 MB/s 2024-04-26T23:46:54.388 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.388 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.443 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.12 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.515 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.516 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.516 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152224 s, 68.9 MB/s 2024-04-26T23:46:54.517 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.517 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.567 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.13 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.647 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.647 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.647 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157781 s, 66.5 MB/s 2024-04-26T23:46:54.647 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.647 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.703 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.14 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.775 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.775 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.775 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154382 s, 67.9 MB/s 2024-04-26T23:46:54.776 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.776 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.827 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.15 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:54.899 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151796 s, 69.1 MB/s 2024-04-26T23:46:54.900 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:54.900 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:54.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:54.951 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.16 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.022 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.022 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.023 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146602 s, 71.5 MB/s 2024-04-26T23:46:55.023 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.024 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.075 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.17 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.148 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.148 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.148 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163726 s, 64.0 MB/s 2024-04-26T23:46:55.149 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.149 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.199 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.18 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.273 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.274 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169512 s, 61.9 MB/s 2024-04-26T23:46:55.275 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.275 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.327 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.19 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.403 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.404 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.404 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158046 s, 66.3 MB/s 2024-04-26T23:46:55.405 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.405 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.455 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.20 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.529 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158235 s, 66.3 MB/s 2024-04-26T23:46:55.530 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.530 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.579 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.21 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.654 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.654 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.654 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142615 s, 73.5 MB/s 2024-04-26T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.655 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.707 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.22 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.783 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151709 s, 69.1 MB/s 2024-04-26T23:46:55.784 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.784 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.834 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.23 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:55.909 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:55.910 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:55.910 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013553 s, 77.4 MB/s 2024-04-26T23:46:55.911 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:55.911 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:55.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:55.967 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.24 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.039 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.039 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.039 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154416 s, 67.9 MB/s 2024-04-26T23:46:56.040 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.040 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.095 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.25 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.169 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.170 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.170 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138637 s, 75.6 MB/s 2024-04-26T23:46:56.171 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.171 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.227 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.26 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.301 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172257 s, 60.9 MB/s 2024-04-26T23:46:56.302 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.302 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.354 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.27 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.425 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.425 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.425 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135374 s, 77.5 MB/s 2024-04-26T23:46:56.426 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.426 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.486 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.28 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.560 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.561 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.561 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163428 s, 64.2 MB/s 2024-04-26T23:46:56.562 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.562 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.615 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.29 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.685 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.685 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.685 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132434 s, 79.2 MB/s 2024-04-26T23:46:56.686 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.687 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.743 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.30 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.815 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.815 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.815 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148442 s, 70.6 MB/s 2024-04-26T23:46:56.816 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.816 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.867 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.31 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:56.942 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:56.943 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:56.943 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178604 s, 58.7 MB/s 2024-04-26T23:46:56.944 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:56.944 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:56.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:56.995 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.32 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.068 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.069 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.069 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162883 s, 64.4 MB/s 2024-04-26T23:46:57.070 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.070 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.119 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.33 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.190 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.191 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.191 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145818 s, 71.9 MB/s 2024-04-26T23:46:57.192 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.192 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.243 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.34 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.319 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149022 s, 70.4 MB/s 2024-04-26T23:46:57.320 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.320 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.375 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.35 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.445 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155925 s, 67.2 MB/s 2024-04-26T23:46:57.446 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.446 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.499 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.36 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.570 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141897 s, 73.9 MB/s 2024-04-26T23:46:57.571 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.571 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.623 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.37 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140928 s, 74.4 MB/s 2024-04-26T23:46:57.695 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.696 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.746 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.38 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.820 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.821 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.821 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168005 s, 62.4 MB/s 2024-04-26T23:46:57.822 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.822 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.871 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.39 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:57.947 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:57.947 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:57.947 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160786 s, 65.2 MB/s 2024-04-26T23:46:57.948 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:57.948 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:57.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:57.998 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.40 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.071 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157718 s, 66.5 MB/s 2024-04-26T23:46:58.073 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.073 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:58.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:58.123 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.41 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.197 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.197 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.197 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158879 s, 66.0 MB/s 2024-04-26T23:46:58.198 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.198 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:58.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:58.247 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.42 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.319 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.319 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.319 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150355 s, 69.7 MB/s 2024-04-26T23:46:58.320 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.320 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:58.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:58.371 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.43 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.446 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.447 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.447 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151141 s, 69.4 MB/s 2024-04-26T23:46:58.448 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.448 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:58.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:58.502 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.44 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.575 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.575 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.575 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150514 s, 69.7 MB/s 2024-04-26T23:46:58.576 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.576 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:58.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:58.626 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.45 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.701 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.701 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.701 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174578 s, 60.1 MB/s 2024-04-26T23:46:58.702 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.702 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:58.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:58.759 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.46 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.831 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.831 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.831 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157117 s, 66.7 MB/s 2024-04-26T23:46:58.832 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.833 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:58.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:58.883 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.47 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:58.961 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:58.962 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174128 s, 60.2 MB/s 2024-04-26T23:46:58.963 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:58.963 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.015 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.48 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.087 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.087 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.087 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015247 s, 68.8 MB/s 2024-04-26T23:46:59.088 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.088 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.139 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.49 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.213 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.213 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.213 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160282 s, 65.4 MB/s 2024-04-26T23:46:59.214 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.214 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.266 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.50 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.338 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.339 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.339 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145694 s, 72.0 MB/s 2024-04-26T23:46:59.340 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.340 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.395 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.51 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.468 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155237 s, 67.5 MB/s 2024-04-26T23:46:59.469 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.469 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.523 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.52 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.595 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.595 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.595 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142888 s, 73.4 MB/s 2024-04-26T23:46:59.596 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.596 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.651 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.53 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.724 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.724 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.724 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151549 s, 69.2 MB/s 2024-04-26T23:46:59.725 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.725 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.775 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.54 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.848 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.848 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.849 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156991 s, 66.8 MB/s 2024-04-26T23:46:59.850 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.850 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:46:59.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:46:59.899 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.55 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:46:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:46:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:46:59.972 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158053 s, 66.3 MB/s 2024-04-26T23:46:59.973 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:46:59.973 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.027 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.56 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.100 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.100 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.100 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153419 s, 68.3 MB/s 2024-04-26T23:47:00.101 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.101 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.151 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.57 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.225 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.225 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.225 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159347 s, 65.8 MB/s 2024-04-26T23:47:00.226 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.226 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.284 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.58 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.355 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145788 s, 71.9 MB/s 2024-04-26T23:47:00.356 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.356 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.407 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.59 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.480 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149284 s, 70.2 MB/s 2024-04-26T23:47:00.481 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.481 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.535 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.60 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.608 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.608 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.608 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154212 s, 68.0 MB/s 2024-04-26T23:47:00.609 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.609 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.659 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.61 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.738 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.739 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.739 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021731 s, 48.3 MB/s 2024-04-26T23:47:00.740 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.740 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.790 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.62 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.865 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162091 s, 64.7 MB/s 2024-04-26T23:47:00.866 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.866 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:00.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:00.918 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.63 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:00.992 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158006 s, 66.4 MB/s 2024-04-26T23:47:00.993 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:00.993 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.043 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.64 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:01.114 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:01.114 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:01.114 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139598 s, 75.1 MB/s 2024-04-26T23:47:01.115 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:01.115 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.167 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.65 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:01.244 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148901 s, 70.4 MB/s 2024-04-26T23:47:01.245 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:01.245 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.299 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.66 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130702 s, 80.2 MB/s 2024-04-26T23:47:01.371 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:01.371 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.427 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.67 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:01.504 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:01.504 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:01.504 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160529 s, 65.3 MB/s 2024-04-26T23:47:01.505 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:01.505 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.555 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.68 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:01.628 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:01.628 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:01.628 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014611 s, 71.8 MB/s 2024-04-26T23:47:01.629 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:01.629 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.683 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.69 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:01.760 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154497 s, 67.9 MB/s 2024-04-26T23:47:01.761 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:01.761 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.811 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.70 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:01.882 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:01.882 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:01.883 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136514 s, 76.8 MB/s 2024-04-26T23:47:01.884 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:01.884 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:01.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:01.935 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.71 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.006 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.007 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.007 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136836 s, 76.6 MB/s 2024-04-26T23:47:02.008 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.008 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.063 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.72 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.139 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.140 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.140 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015267 s, 68.7 MB/s 2024-04-26T23:47:02.141 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.141 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.191 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.73 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.262 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141677 s, 74.0 MB/s 2024-04-26T23:47:02.263 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.263 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:02.315 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:02.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.321 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.74 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.427 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.428 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014475 s, 72.4 MB/s 2024-04-26T23:47:02.429 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.429 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.479 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.75 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.550 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.550 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.550 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145752 s, 71.9 MB/s 2024-04-26T23:47:02.551 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.551 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.603 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.76 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.675 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147928 s, 70.9 MB/s 2024-04-26T23:47:02.676 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.676 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.731 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.77 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.802 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.802 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.803 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143788 s, 72.9 MB/s 2024-04-26T23:47:02.804 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.804 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.855 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.78 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:02.928 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:02.928 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:02.928 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155773 s, 67.3 MB/s 2024-04-26T23:47:02.929 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:02.929 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:02.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:02.983 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.79 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.060 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.060 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.060 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015963 s, 65.7 MB/s 2024-04-26T23:47:03.062 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.062 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.111 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.80 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.183 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.183 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.183 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155289 s, 67.5 MB/s 2024-04-26T23:47:03.184 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.184 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.235 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.81 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.307 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.307 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.307 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139518 s, 75.2 MB/s 2024-04-26T23:47:03.308 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.308 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.359 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.82 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.436 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.436 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.436 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151929 s, 69.0 MB/s 2024-04-26T23:47:03.437 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.437 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.491 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.83 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.564 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.565 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.565 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151656 s, 69.1 MB/s 2024-04-26T23:47:03.566 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.566 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.619 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.84 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.695 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.695 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.695 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167581 s, 62.6 MB/s 2024-04-26T23:47:03.696 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.696 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.747 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.85 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.819 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.820 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148918 s, 70.4 MB/s 2024-04-26T23:47:03.821 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.821 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.871 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.86 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:03.944 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:03.944 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:03.944 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161324 s, 65.0 MB/s 2024-04-26T23:47:03.945 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:03.945 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:03.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:03.995 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.87 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.067 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.067 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.067 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136262 s, 77.0 MB/s 2024-04-26T23:47:04.068 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.068 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:04.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:04.122 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.88 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.196 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.196 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.196 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154179 s, 68.0 MB/s 2024-04-26T23:47:04.197 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.197 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:04.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:04.247 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.89 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.321 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.321 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.321 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156581 s, 67.0 MB/s 2024-04-26T23:47:04.322 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.322 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:04.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:04.379 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.90 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.453 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.453 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.453 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168275 s, 62.3 MB/s 2024-04-26T23:47:04.454 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.454 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:04.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:04.507 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.91 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.578 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.578 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.578 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140836 s, 74.5 MB/s 2024-04-26T23:47:04.579 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.579 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:04.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:04.631 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.92 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.708 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.708 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.708 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158103 s, 66.3 MB/s 2024-04-26T23:47:04.709 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.709 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:04.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:04.759 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.93 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.834 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.834 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.834 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170935 s, 61.3 MB/s 2024-04-26T23:47:04.835 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.835 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:04.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:04.887 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.94 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:04.961 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165055 s, 63.5 MB/s 2024-04-26T23:47:04.962 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:04.962 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.015 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.95 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.085 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.085 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.085 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134842 s, 77.8 MB/s 2024-04-26T23:47:05.086 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.087 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.143 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.96 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.214 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.215 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.215 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147838 s, 70.9 MB/s 2024-04-26T23:47:05.216 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.216 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.268 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.97 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.338 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.338 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.338 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137049 s, 76.5 MB/s 2024-04-26T23:47:05.340 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.340 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.391 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.98 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.466 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.466 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.466 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135873 s, 77.2 MB/s 2024-04-26T23:47:05.467 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.467 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.519 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.99 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.591 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.591 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.591 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149335 s, 70.2 MB/s 2024-04-26T23:47:05.592 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.592 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.642 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.100 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.715 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149808 s, 70.0 MB/s 2024-04-26T23:47:05.716 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.716 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.766 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.101 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.838 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.838 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.838 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144565 s, 72.5 MB/s 2024-04-26T23:47:05.839 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.839 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:05.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:05.895 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.102 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:05.973 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159522 s, 65.7 MB/s 2024-04-26T23:47:05.974 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:05.974 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.027 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.103 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.103 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156508 s, 67.0 MB/s 2024-04-26T23:47:06.105 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.105 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.155 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.104 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.226 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.227 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.227 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149239 s, 70.3 MB/s 2024-04-26T23:47:06.228 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.228 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.279 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.105 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.351 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.352 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.352 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153287 s, 68.4 MB/s 2024-04-26T23:47:06.353 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.353 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.403 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.106 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.473 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.473 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.473 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133537 s, 78.5 MB/s 2024-04-26T23:47:06.474 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.474 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.527 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.107 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.599 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.599 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.599 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0152866 s, 68.6 MB/s 2024-04-26T23:47:06.600 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.600 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.655 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.108 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.730 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.730 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.730 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139194 s, 75.3 MB/s 2024-04-26T23:47:06.731 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.731 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.782 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.109 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.856 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.857 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161974 s, 64.7 MB/s 2024-04-26T23:47:06.858 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.858 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:06.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:06.915 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.110 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:06.988 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:06.989 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:06.989 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162078 s, 64.7 MB/s 2024-04-26T23:47:06.990 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:06.990 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.043 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.111 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.114 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.114 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.115 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144995 s, 72.3 MB/s 2024-04-26T23:47:07.115 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.116 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.167 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.112 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.237 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.238 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.238 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139587 s, 75.1 MB/s 2024-04-26T23:47:07.239 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.239 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.291 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.113 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.365 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.365 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.365 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153593 s, 68.3 MB/s 2024-04-26T23:47:07.366 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.366 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.422 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.114 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.495 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.495 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.495 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150487 s, 69.7 MB/s 2024-04-26T23:47:07.496 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.496 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.546 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.115 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.619 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153748 s, 68.2 MB/s 2024-04-26T23:47:07.620 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.620 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.671 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.116 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.742 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147309 s, 71.2 MB/s 2024-04-26T23:47:07.744 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.744 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.795 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.117 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.869 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.869 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.869 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167232 s, 62.7 MB/s 2024-04-26T23:47:07.870 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.870 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:07.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:07.923 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.118 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:07.997 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:07.998 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:07.998 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016068 s, 65.3 MB/s 2024-04-26T23:47:07.999 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:07.999 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.056 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.119 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:08.127 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:08.128 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:08.128 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151465 s, 69.2 MB/s 2024-04-26T23:47:08.129 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:08.130 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.180 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.120 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:08.249 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130085 s, 80.6 MB/s 2024-04-26T23:47:08.250 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:08.250 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.307 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.121 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:08.378 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:08.379 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142776 s, 73.4 MB/s 2024-04-26T23:47:08.380 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:08.380 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.431 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.122 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:08.504 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:08.504 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:08.504 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155488 s, 67.4 MB/s 2024-04-26T23:47:08.505 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:08.505 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.559 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.123 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:08.635 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160336 s, 65.4 MB/s 2024-04-26T23:47:08.637 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:08.637 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.690 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.124 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:08.763 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145518 s, 72.1 MB/s 2024-04-26T23:47:08.764 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:08.764 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.819 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.125 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:08.890 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146073 s, 71.8 MB/s 2024-04-26T23:47:08.892 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:08.892 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:08.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:08.943 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.126 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.015 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.015 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.015 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148101 s, 70.8 MB/s 2024-04-26T23:47:09.016 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.017 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.066 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.127 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.144 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156589 s, 67.0 MB/s 2024-04-26T23:47:09.145 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.145 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.194 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.128 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.265 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.265 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.265 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137778 s, 76.1 MB/s 2024-04-26T23:47:09.266 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.267 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.319 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.129 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.391 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.391 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.391 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153991 s, 68.1 MB/s 2024-04-26T23:47:09.392 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.392 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.443 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.130 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.515 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.515 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.515 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150615 s, 69.6 MB/s 2024-04-26T23:47:09.516 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.516 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.571 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.131 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.648 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.649 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.649 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01682 s, 62.3 MB/s 2024-04-26T23:47:09.650 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.650 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.702 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.132 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.774 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.774 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.774 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138171 s, 75.9 MB/s 2024-04-26T23:47:09.775 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.775 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.827 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.133 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:09.899 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:09.899 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:09.900 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153572 s, 68.3 MB/s 2024-04-26T23:47:09.901 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:09.901 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:09.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:09.956 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.134 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.029 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.029 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.030 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168291 s, 62.3 MB/s 2024-04-26T23:47:10.031 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.031 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.087 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.135 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.164 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.164 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.164 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156283 s, 67.1 MB/s 2024-04-26T23:47:10.165 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.165 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.219 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.136 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.293 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.293 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.293 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134793 s, 77.8 MB/s 2024-04-26T23:47:10.294 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.295 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.347 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.137 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.420 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.420 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.420 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154889 s, 67.7 MB/s 2024-04-26T23:47:10.421 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.421 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.471 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.138 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.543 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014831 s, 70.7 MB/s 2024-04-26T23:47:10.544 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.544 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.595 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.139 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.667 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.667 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.667 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151077 s, 69.4 MB/s 2024-04-26T23:47:10.668 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.668 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.719 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.140 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.792 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.792 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.792 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155516 s, 67.4 MB/s 2024-04-26T23:47:10.793 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.793 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.843 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.141 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:10.914 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:10.914 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:10.915 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142311 s, 73.7 MB/s 2024-04-26T23:47:10.916 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:10.916 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:10.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:10.967 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.142 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.040 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154808 s, 67.7 MB/s 2024-04-26T23:47:11.041 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.041 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.091 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.143 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.162 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.163 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014722 s, 71.2 MB/s 2024-04-26T23:47:11.164 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.164 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.219 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.144 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.294 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0136724 s, 76.7 MB/s 2024-04-26T23:47:11.295 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.295 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.350 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.145 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.426 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.426 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.426 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145584 s, 72.0 MB/s 2024-04-26T23:47:11.427 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.428 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.479 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.146 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.555 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150391 s, 69.7 MB/s 2024-04-26T23:47:11.556 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.556 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.611 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.147 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.683 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.683 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.683 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151827 s, 69.1 MB/s 2024-04-26T23:47:11.684 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.684 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.739 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.148 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.816 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.816 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.816 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161264 s, 65.0 MB/s 2024-04-26T23:47:11.817 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.817 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.871 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.149 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:11.946 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:11.946 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:11.946 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143638 s, 73.0 MB/s 2024-04-26T23:47:11.947 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:11.947 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:11.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:11.999 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.150 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.070 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134888 s, 77.7 MB/s 2024-04-26T23:47:12.071 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.071 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:12.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:12.122 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.151 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.198 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.198 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.198 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159132 s, 65.9 MB/s 2024-04-26T23:47:12.199 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.199 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:12.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:12.250 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.152 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.328 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157718 s, 66.5 MB/s 2024-04-26T23:47:12.329 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.329 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:12.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:12.382 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.153 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.454 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.454 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.454 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162907 s, 64.4 MB/s 2024-04-26T23:47:12.455 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.455 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:12.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:12.507 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.154 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.579 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.579 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.580 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158912 s, 66.0 MB/s 2024-04-26T23:47:12.581 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.581 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:12.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:12.630 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.155 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.703 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.703 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.703 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151283 s, 69.3 MB/s 2024-04-26T23:47:12.704 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.704 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:12.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:12.754 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.156 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.828 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.829 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.829 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167294 s, 62.7 MB/s 2024-04-26T23:47:12.830 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.830 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:12.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:12.883 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.157 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:12.958 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:12.958 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:12.958 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162707 s, 64.4 MB/s 2024-04-26T23:47:12.959 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:12.959 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.015 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.158 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.088 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.089 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.089 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150853 s, 69.5 MB/s 2024-04-26T23:47:13.090 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.090 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.139 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.159 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.212 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.212 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.212 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158092 s, 66.3 MB/s 2024-04-26T23:47:13.213 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.213 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.263 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.160 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.334 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.335 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138507 s, 75.7 MB/s 2024-04-26T23:47:13.336 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.336 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.387 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.161 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.460 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.461 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.461 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166354 s, 63.0 MB/s 2024-04-26T23:47:13.462 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.462 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.519 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.162 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146999 s, 71.3 MB/s 2024-04-26T23:47:13.592 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.592 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.647 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.163 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.721 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.721 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.721 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165231 s, 63.5 MB/s 2024-04-26T23:47:13.722 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.723 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.775 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.164 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.848 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.848 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.848 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142701 s, 73.5 MB/s 2024-04-26T23:47:13.849 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.849 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:13.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:13.899 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.165 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:13.972 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:13.973 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:13.973 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162079 s, 64.7 MB/s 2024-04-26T23:47:13.974 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:13.974 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.027 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.166 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.099 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.099 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.100 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153971 s, 68.1 MB/s 2024-04-26T23:47:14.100 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.101 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.151 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.167 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.222 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.223 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143081 s, 73.3 MB/s 2024-04-26T23:47:14.224 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.224 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.275 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.168 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.345 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126007 s, 83.2 MB/s 2024-04-26T23:47:14.346 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.347 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.399 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.169 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.473 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.473 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.473 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166571 s, 63.0 MB/s 2024-04-26T23:47:14.474 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.474 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.527 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.170 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.598 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143674 s, 73.0 MB/s 2024-04-26T23:47:14.599 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.599 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.651 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.171 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.722 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.722 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.722 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142581 s, 73.5 MB/s 2024-04-26T23:47:14.723 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.723 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.779 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.172 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.855 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.856 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.856 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153174 s, 68.5 MB/s 2024-04-26T23:47:14.856 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.857 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:14.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:14.910 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.173 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:14.984 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:14.984 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:14.984 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157604 s, 66.5 MB/s 2024-04-26T23:47:14.985 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:14.985 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.034 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.174 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:15.107 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:15.107 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:15.107 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0150475 s, 69.7 MB/s 2024-04-26T23:47:15.108 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:15.108 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.159 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.175 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:15.229 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:15.230 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:15.230 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0133796 s, 78.4 MB/s 2024-04-26T23:47:15.231 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:15.231 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.283 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.176 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:15.354 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:15.354 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:15.354 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138499 s, 75.7 MB/s 2024-04-26T23:47:15.355 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:15.355 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.410 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.177 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:15.482 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:15.482 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:15.482 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139326 s, 75.3 MB/s 2024-04-26T23:47:15.483 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:15.483 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.539 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.178 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:15.616 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:15.617 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:15.617 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166211 s, 63.1 MB/s 2024-04-26T23:47:15.618 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:15.618 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.671 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.179 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:15.748 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163789 s, 64.0 MB/s 2024-04-26T23:47:15.749 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:15.749 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.799 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.180 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:15.876 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:15.876 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:15.876 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154895 s, 67.7 MB/s 2024-04-26T23:47:15.877 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:15.877 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:15.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:15.927 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.181 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.000 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.001 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.001 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159648 s, 65.7 MB/s 2024-04-26T23:47:16.002 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.002 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.055 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.182 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.128 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.129 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.129 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0166158 s, 63.1 MB/s 2024-04-26T23:47:16.130 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.130 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.182 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.183 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.254 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146064 s, 71.8 MB/s 2024-04-26T23:47:16.255 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.255 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.307 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.184 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.379 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.380 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0155848 s, 67.3 MB/s 2024-04-26T23:47:16.381 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.381 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.431 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.185 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.503 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.504 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.504 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.015213 s, 68.9 MB/s 2024-04-26T23:47:16.505 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.506 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.555 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.186 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.627 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.627 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.628 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153374 s, 68.4 MB/s 2024-04-26T23:47:16.628 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.629 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.683 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.187 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.755 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.755 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.755 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154968 s, 67.7 MB/s 2024-04-26T23:47:16.756 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.756 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.807 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.188 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:16.880 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:16.880 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:16.880 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159884 s, 65.6 MB/s 2024-04-26T23:47:16.881 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:16.881 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:16.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:16.931 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.189 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.005 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.005 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.005 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159015 s, 65.9 MB/s 2024-04-26T23:47:17.006 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.006 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.059 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.190 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.132 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159573 s, 65.7 MB/s 2024-04-26T23:47:17.133 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.133 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.212 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.191 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.253 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.254 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139223 s, 75.3 MB/s 2024-04-26T23:47:17.255 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.255 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.307 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.192 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.376 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.376 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.377 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148433 s, 70.6 MB/s 2024-04-26T23:47:17.377 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.378 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.431 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.193 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.502 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.503 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.503 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148042 s, 70.8 MB/s 2024-04-26T23:47:17.504 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.504 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.555 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.194 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.627 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.628 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.628 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159544 s, 65.7 MB/s 2024-04-26T23:47:17.629 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.629 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.679 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.195 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145015 s, 72.3 MB/s 2024-04-26T23:47:17.751 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.751 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.803 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.196 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.875 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.876 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156712 s, 66.9 MB/s 2024-04-26T23:47:17.877 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:17.877 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:17.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:17.927 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.197 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:17.999 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:17.999 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:17.999 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142288 s, 73.7 MB/s 2024-04-26T23:47:18.000 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:18.000 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:18.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:18.051 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.198 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:18.123 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:18.123 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:18.123 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151482 s, 69.2 MB/s 2024-04-26T23:47:18.124 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:18.124 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:18.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:18.179 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol25160/fce678a8-19c8-416a-9ad1-ed73732ae595/subvolume_file.199 bs=1M conv=fdatasync count=1 seek=0) 2024-04-26T23:47:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-04-26T23:47:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-04-26T23:47:18.250 INFO:teuthology.orchestra.run.smithi047.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0143465 s, 73.1 MB/s 2024-04-26T23:47:18.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol25160 subvol_snap58040 2024-04-26T23:47:18.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2cad400640 1 Processor -- start 2024-04-26T23:47:18.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2cad400640 1 -- start start 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2cad400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2ca815f530 0x7f2ca80d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2cad400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ca806e500 0x7f2ca80ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2cad400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca806e070 con 0x7f2ca80cf0d0 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2cad400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca806de20 con 0x7f2ca806e500 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2cad400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca8160560 con 0x7f2ca815f530 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2c9fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ca806e500 0x7f2ca80ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2c9fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ca806e500 0x7f2ca80ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50224/0 (socket says 172.21.15.47:50224) 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2c9fe00640 1 -- 172.21.15.47:0/3030757517 learned_addr learned my addr 172.21.15.47:0/3030757517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:18.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2ca6800640 1 --2- 172.21.15.47:0/3030757517 >> v2:172.21.15.203:3300/0 conn(0x7f2ca815f530 0x7f2ca80d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2c9fe00640 1 -- 172.21.15.47:0/3030757517 >> v2:172.21.15.203:3300/0 conn(0x7f2ca815f530 msgr2=0x7f2ca80d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:18.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2c9fe00640 1 --2- 172.21.15.47:0/3030757517 >> v2:172.21.15.203:3300/0 conn(0x7f2ca815f530 0x7f2ca80d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2c9fe00640 1 -- 172.21.15.47:0/3030757517 >> v1:172.21.15.47:6789/0 conn(0x7f2ca80cf0d0 legacy=0x7f2ca806ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2c9fe00640 1 -- 172.21.15.47:0/3030757517 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca8160840 con 0x7f2ca806e500 2024-04-26T23:47:18.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.435+0000 7f2ca5e00640 1 -- 172.21.15.47:0/3030757517 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531779989 0 0) 0x7f2ca806e070 con 0x7f2ca80cf0d0 2024-04-26T23:47:18.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2c9fe00640 1 --2- 172.21.15.47:0/3030757517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca806e500 0x7f2ca80ceb90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80764d0 tx=0x7f2c9001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e01c20db2d0b97c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:18.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2ca5e00640 1 -- 172.21.15.47:0/3030757517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900b0070 con 0x7f2ca806e500 2024-04-26T23:47:18.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2ca5e00640 1 -- 172.21.15.47:0/3030757517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c900ab600 con 0x7f2ca806e500 2024-04-26T23:47:18.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2ca5e00640 1 -- 172.21.15.47:0/3030757517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900ab9d0 con 0x7f2ca806e500 2024-04-26T23:47:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 -- 172.21.15.47:0/3030757517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca806e500 msgr2=0x7f2ca80ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 --2- 172.21.15.47:0/3030757517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca806e500 0x7f2ca80ceb90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80764d0 tx=0x7f2c9001c520 comp rx=0 tx=0).stop 2024-04-26T23:47:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 -- 172.21.15.47:0/3030757517 shutdown_connections 2024-04-26T23:47:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 --2- 172.21.15.47:0/3030757517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca806e500 0x7f2ca80ceb90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 --2- 172.21.15.47:0/3030757517 >> v2:172.21.15.203:3300/0 conn(0x7f2ca815f530 0x7f2ca80d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 -- 172.21.15.47:0/3030757517 >> 172.21.15.47:0/3030757517 conn(0x7f2ca80d0c90 msgr2=0x7f2ca80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:18.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 -- 172.21.15.47:0/3030757517 shutdown_connections 2024-04-26T23:47:18.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.439+0000 7f2cad400640 1 -- 172.21.15.47:0/3030757517 wait complete. 2024-04-26T23:47:18.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 Processor -- start 2024-04-26T23:47:18.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 -- start start 2024-04-26T23:47:18.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ca806e500 0x7f2ca8139a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ca80cf0d0 0x7f2ca8158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca815f530 0x7f2ca8152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca816c580 con 0x7f2ca815f530 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca816c400 con 0x7f2ca80cf0d0 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca816c700 con 0x7f2ca806e500 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca815f530 0x7f2ca8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca815f530 0x7f2ca8152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50232/0 (socket says 172.21.15.47:50232) 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 -- 172.21.15.47:0/3851993102 learned_addr learned my addr 172.21.15.47:0/3851993102 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca6800640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ca806e500 0x7f2ca8139a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2c9fe00640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ca80cf0d0 0x7f2ca8158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 -- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ca806e500 msgr2=0x7f2ca8139a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ca806e500 0x7f2ca8139a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 -- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ca80cf0d0 msgr2=0x7f2ca8158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ca80cf0d0 0x7f2ca8158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 -- 172.21.15.47:0/3851993102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca80ae980 con 0x7f2ca815f530 2024-04-26T23:47:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2ca7200640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca815f530 0x7f2ca8152490 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c7b0 tx=0x7f2ca000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2c9ea00640 1 -- 172.21.15.47:0/3851993102 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000ce60 con 0x7f2ca815f530 2024-04-26T23:47:18.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2c9ea00640 1 -- 172.21.15.47:0/3851993102 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca0003db0 con 0x7f2ca815f530 2024-04-26T23:47:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca8072140 con 0x7f2ca815f530 2024-04-26T23:47:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2c9ea00640 1 -- 172.21.15.47:0/3851993102 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00052b0 con 0x7f2ca815f530 2024-04-26T23:47:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca80723b0 con 0x7f2ca815f530 2024-04-26T23:47:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.443+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca80695f0 con 0x7f2ca815f530 2024-04-26T23:47:18.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.447+0000 7f2c9ea00640 1 -- 172.21.15.47:0/3851993102 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f2ca0005450 con 0x7f2ca815f530 2024-04-26T23:47:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.447+0000 7f2c9ea00640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c84068410 0x7f2c8406a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.447+0000 7f2c9ea00640 1 -- 172.21.15.47:0/3851993102 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f2ca0086800 con 0x7f2ca815f530 2024-04-26T23:47:18.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.447+0000 7f2ca6800640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c84068410 0x7f2c8406a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.447+0000 7f2ca6800640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c84068410 0x7f2c8406a8d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2c980079c0 tx=0x7f2c98008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:18.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.451+0000 7f2c9ea00640 1 -- 172.21.15.47:0/3851993102 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2ca00565f0 con 0x7f2ca815f530 2024-04-26T23:47:18.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.643+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol25160", "snap_name": "subvol_snap58040", "target": ["mon-mgr", ""]}) -- 0x7f2ca8158aa0 con 0x7f2c84068410 2024-04-26T23:47:18.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.659+0000 7f2c9ea00640 1 -- 172.21.15.47:0/3851993102 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2c980108d0 con 0x7f2c84068410 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c84068410 msgr2=0x7f2c8406a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c84068410 0x7f2c8406a8d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2c980079c0 tx=0x7f2c98008040 comp rx=0 tx=0).stop 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca815f530 msgr2=0x7f2ca8152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca815f530 0x7f2ca8152490 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c7b0 tx=0x7f2ca000cc70 comp rx=0 tx=0).stop 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 shutdown_connections 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2c84068410 0x7f2c8406a8d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ca815f530 0x7f2ca8152490 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ca80cf0d0 0x7f2ca8158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 --2- 172.21.15.47:0/3851993102 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ca806e500 0x7f2ca8139a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 >> 172.21.15.47:0/3851993102 conn(0x7f2ca80d0c90 msgr2=0x7f2ca806ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 shutdown_connections 2024-04-26T23:47:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.663+0000 7f2cad400640 1 -- 172.21.15.47:0/3851993102 wait complete. 2024-04-26T23:47:18.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/volumes/snapshot_clone_delay 5 2024-04-26T23:47:18.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f0630600640 1 Processor -- start 2024-04-26T23:47:18.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f0630600640 1 -- start start 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f0630600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f062815cf50 0x7f06280cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f0630600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06280d04b0 0x7f062806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f0630600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06280ae030 con 0x7f062806cb70 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f0630600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f06280af7a0 con 0x7f062815cf50 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f0630600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f062806d000 con 0x7f06280d04b0 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f062815cf50 0x7f06280cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f062815cf50 0x7f06280cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50236/0 (socket says 172.21.15.47:50236) 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062dc00640 1 -- 172.21.15.47:0/1418604886 learned_addr learned my addr 172.21.15.47:0/1418604886 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:18.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062d200640 1 --2- 172.21.15.47:0/1418604886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06280d04b0 0x7f062806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062dc00640 1 -- 172.21.15.47:0/1418604886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06280d04b0 msgr2=0x7f062806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:18.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062dc00640 1 --2- 172.21.15.47:0/1418604886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06280d04b0 0x7f062806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062dc00640 1 -- 172.21.15.47:0/1418604886 >> v1:172.21.15.203:6789/0 conn(0x7f062806cb70 legacy=0x7f06280720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.831+0000 7f062dc00640 1 -- 172.21.15.47:0/1418604886 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06280d0ae0 con 0x7f062815cf50 2024-04-26T23:47:18.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f062dc00640 1 --2- 172.21.15.47:0/1418604886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062815cf50 0x7f06280cff70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f061c009870 tx=0x7f061c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf318b503e9f9a24 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:18.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0627e00640 1 -- 172.21.15.47:0/1418604886 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0b0070 con 0x7f062815cf50 2024-04-26T23:47:18.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0627e00640 1 -- 172.21.15.47:0/1418604886 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061c0ab600 con 0x7f062815cf50 2024-04-26T23:47:18.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0627e00640 1 -- 172.21.15.47:0/1418604886 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0ab9d0 con 0x7f062815cf50 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 -- 172.21.15.47:0/1418604886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062815cf50 msgr2=0x7f06280cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 --2- 172.21.15.47:0/1418604886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062815cf50 0x7f06280cff70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f061c009870 tx=0x7f061c01c560 comp rx=0 tx=0).stop 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 -- 172.21.15.47:0/1418604886 shutdown_connections 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 --2- 172.21.15.47:0/1418604886 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06280d04b0 0x7f062806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 --2- 172.21.15.47:0/1418604886 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062815cf50 0x7f06280cff70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 -- 172.21.15.47:0/1418604886 >> 172.21.15.47:0/1418604886 conn(0x7f06280b2b70 msgr2=0x7f06280b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 -- 172.21.15.47:0/1418604886 shutdown_connections 2024-04-26T23:47:18.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.835+0000 7f0630600640 1 -- 172.21.15.47:0/1418604886 wait complete. 2024-04-26T23:47:18.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 Processor -- start 2024-04-26T23:47:18.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 -- start start 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062806cb70 0x7f06281470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06280d04b0 0x7f0628147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f062815cf50 0x7f062814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f062815d330 con 0x7f062806cb70 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f06280af9d0 con 0x7f06280d04b0 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f06280b3c40 con 0x7f062815cf50 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062806cb70 0x7f06281470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062806cb70 0x7f06281470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50246/0 (socket says 172.21.15.47:50246) 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 -- 172.21.15.47:0/3351917074 learned_addr learned my addr 172.21.15.47:0/3351917074 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062d200640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06280d04b0 0x7f0628147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062e600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f062815cf50 0x7f062814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 -- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f062815cf50 msgr2=0x7f062814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f062815cf50 0x7f062814b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 -- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06280d04b0 msgr2=0x7f0628147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06280d04b0 0x7f0628147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 -- 172.21.15.47:0/3351917074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0628147fe0 con 0x7f062806cb70 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062e600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f062815cf50 0x7f062814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f062dc00640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062806cb70 0x7f06281470c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f061c01a190 tx=0x7f061c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0625600640 1 -- 172.21.15.47:0/3351917074 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0b0040 con 0x7f062806cb70 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0625600640 1 -- 172.21.15.47:0/3351917074 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061c0ab400 con 0x7f062806cb70 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0625600640 1 -- 172.21.15.47:0/3351917074 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c0b4660 con 0x7f062806cb70 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06281482c0 con 0x7f062806cb70 2024-04-26T23:47:18.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0628148880 con 0x7f062806cb70 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.839+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0628069700 con 0x7f062806cb70 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.843+0000 7f0625600640 1 -- 172.21.15.47:0/3351917074 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f061c0bb020 con 0x7f062806cb70 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.843+0000 7f0625600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0608068410 0x7f060806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:18.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.843+0000 7f0625600640 1 -- 172.21.15.47:0/3351917074 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f061c11fee0 con 0x7f062806cb70 2024-04-26T23:47:18.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.843+0000 7f062d200640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0608068410 0x7f060806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:18.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.843+0000 7f062d200640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0608068410 0x7f060806a8d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f06281f95a0 tx=0x7f0614008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:18.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:18.847+0000 7f0625600640 1 -- 172.21.15.47:0/3351917074 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f061c0c2020 con 0x7f062806cb70 2024-04-26T23:47:19.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.015+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}] v 0) -- 0x7f0628073d50 con 0x7f062806cb70 2024-04-26T23:47:19.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.019+0000 7f0625600640 1 -- 172.21.15.47:0/3351917074 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/volumes/snapshot_clone_delay}]=0 v11)=0 v11) ==== 130+0+0 (secure 0 0 0) 0x7f061c016150 con 0x7f062806cb70 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0608068410 msgr2=0x7f060806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0608068410 0x7f060806a8d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f06281f95a0 tx=0x7f0614008040 comp rx=0 tx=0).stop 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062806cb70 msgr2=0x7f06281470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062806cb70 0x7f06281470c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f061c01a190 tx=0x7f061c019300 comp rx=0 tx=0).stop 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 shutdown_connections 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0608068410 0x7f060806a8d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f062815cf50 0x7f062814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06280d04b0 0x7f0628147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 --2- 172.21.15.47:0/3351917074 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f062806cb70 0x7f06281470c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 >> 172.21.15.47:0/3351917074 conn(0x7f06280b2b70 msgr2=0x7f06280b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 shutdown_connections 2024-04-26T23:47:19.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.023+0000 7f0630600640 1 -- 172.21.15.47:0/3351917074 wait complete. 2024-04-26T23:47:19.046 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol25160 subvol_snap58040 subvol_clone86260 2024-04-26T23:47:19.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6efa00640 1 Processor -- start 2024-04-26T23:47:19.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6efa00640 1 -- start start 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6efa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd6e809c170 0x7fd6e80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6efa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e8071f90 con 0x7fd6e8160a50 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6efa00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e8072230 con 0x7fd6e8160670 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6efa00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e8070ee0 con 0x7fd6e809c170 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6e7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd6e809c170 0x7fd6e80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6e7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd6e809c170 0x7fd6e80cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32784/0 (socket says 172.21.15.47:32784) 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6eda00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd6e8160a50 0x7fd6e80ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42946/0 (socket says 172.21.15.47:42946) 2024-04-26T23:47:19.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6e7e00640 1 -- 172.21.15.47:0/2465886052 learned_addr learned my addr 172.21.15.47:0/2465886052 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:19.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6e7e00640 1 -- 172.21.15.47:0/2465886052 >> v1:172.21.15.203:6789/0 conn(0x7fd6e8160670 legacy=0x7fd6e809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6e7e00640 1 -- 172.21.15.47:0/2465886052 >> v1:172.21.15.47:6789/0 conn(0x7fd6e8160a50 legacy=0x7fd6e80ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6e7e00640 1 -- 172.21.15.47:0/2465886052 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e8071130 con 0x7fd6e809c170 2024-04-26T23:47:19.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.187+0000 7fd6e7400640 1 -- 172.21.15.47:0/2465886052 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141378066 0 0) 0x7fd6e8071f90 con 0x7fd6e8160a50 2024-04-26T23:47:19.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6e7e00640 1 --2- 172.21.15.47:0/2465886052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e80cdbb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009870 tx=0x7fd6d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e453fddcfb4c987 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6e7400640 1 -- 172.21.15.47:0/2465886052 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40aa650 con 0x7fd6e809c170 2024-04-26T23:47:19.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6e7400640 1 -- 172.21.15.47:0/2465886052 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d40af070 con 0x7fd6e809c170 2024-04-26T23:47:19.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6e7400640 1 -- 172.21.15.47:0/2465886052 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40aaa10 con 0x7fd6e809c170 2024-04-26T23:47:19.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6efa00640 1 -- 172.21.15.47:0/2465886052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 msgr2=0x7fd6e80cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6efa00640 1 --2- 172.21.15.47:0/2465886052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e80cdbb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009870 tx=0x7fd6d401c4d0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6efa00640 1 -- 172.21.15.47:0/2465886052 shutdown_connections 2024-04-26T23:47:19.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6efa00640 1 --2- 172.21.15.47:0/2465886052 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e80cdbb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6efa00640 1 -- 172.21.15.47:0/2465886052 >> 172.21.15.47:0/2465886052 conn(0x7fd6e80b4c00 msgr2=0x7fd6e80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:19.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6efa00640 1 -- 172.21.15.47:0/2465886052 shutdown_connections 2024-04-26T23:47:19.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.191+0000 7fd6efa00640 1 -- 172.21.15.47:0/2465886052 wait complete. 2024-04-26T23:47:19.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 Processor -- start 2024-04-26T23:47:19.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 -- start start 2024-04-26T23:47:19.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e8155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6e8160670 0x7fd6e815a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6e8160a50 0x7fd6e815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e80719a0 con 0x7fd6e809c170 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e80cec10 con 0x7fd6e8160a50 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e8071b20 con 0x7fd6e8160670 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e8155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e8155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32788/0 (socket says 172.21.15.47:32788) 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 -- 172.21.15.47:0/1515548142 learned_addr learned my addr 172.21.15.47:0/1515548142 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6e7e00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6e8160670 0x7fd6e815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6eda00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6e8160a50 0x7fd6e815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 -- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6e8160670 msgr2=0x7fd6e815a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6e8160670 0x7fd6e815a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 -- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6e8160a50 msgr2=0x7fd6e815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6e8160a50 0x7fd6e815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 -- 172.21.15.47:0/1515548142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e80affa0 con 0x7fd6e809c170 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6ed000640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e8155870 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00c530 tx=0x7fd6dc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6e4c00640 1 -- 172.21.15.47:0/1515548142 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc016020 con 0x7fd6e809c170 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6e4c00640 1 -- 172.21.15.47:0/1515548142 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc005220 con 0x7fd6e809c170 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6e4c00640 1 -- 172.21.15.47:0/1515548142 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc007030 con 0x7fd6e809c170 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e80b0280 con 0x7fd6e809c170 2024-04-26T23:47:19.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e80b0840 con 0x7fd6e809c170 2024-04-26T23:47:19.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.195+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e8069700 con 0x7fd6e809c170 2024-04-26T23:47:19.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.199+0000 7fd6e4c00640 1 -- 172.21.15.47:0/1515548142 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7fd6dc0071d0 con 0x7fd6e809c170 2024-04-26T23:47:19.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.199+0000 7fd6e4c00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd6c8068410 0x7fd6c806a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.199+0000 7fd6e4c00640 1 -- 172.21.15.47:0/1515548142 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fd6dc086520 con 0x7fd6e809c170 2024-04-26T23:47:19.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.199+0000 7fd6e7e00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd6c8068410 0x7fd6c806a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.199+0000 7fd6e7e00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd6c8068410 0x7fd6c806a8d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ae000 tx=0x7fd6d40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.203+0000 7fd6e4c00640 1 -- 172.21.15.47:0/1515548142 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd6dc020020 con 0x7fd6e809c170 2024-04-26T23:47:19.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.399+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol25160", "snap_name": "subvol_snap58040", "target_sub_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7fd6e80b8f90 con 0x7fd6c8068410 2024-04-26T23:47:19.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.483+0000 7fd6e4c00640 1 -- 172.21.15.47:0/1515548142 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd6e80b8f90 con 0x7fd6c8068410 2024-04-26T23:47:19.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd6c8068410 msgr2=0x7fd6c806a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd6c8068410 0x7fd6c806a8d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ae000 tx=0x7fd6d40a7000 comp rx=0 tx=0).stop 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 msgr2=0x7fd6e8155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e8155870 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00c530 tx=0x7fd6dc00c9f0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 shutdown_connections 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd6c8068410 0x7fd6c806a8d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6e8160a50 0x7fd6e815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd6e8160670 0x7fd6e815a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 --2- 172.21.15.47:0/1515548142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6e809c170 0x7fd6e8155870 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 >> 172.21.15.47:0/1515548142 conn(0x7fd6e80b4c00 msgr2=0x7fd6e80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 shutdown_connections 2024-04-26T23:47:19.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.487+0000 7fd6efa00640 1 -- 172.21.15.47:0/1515548142 wait complete. 2024-04-26T23:47:19.494 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.489+0000 7f5e1f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.494 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.489+0000 7f5e1f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.494 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.489+0000 7f5e1f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.494 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.489+0000 7f5e1f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.494 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.489+0000 7f5e1f200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:19.512 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo rmdir ./volumes/_nogroup/subvol25160/.snap/subvol_snap58040) 2024-04-26T23:47:19.515 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.509+0000 7f5e1de00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.515 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.509+0000 7f5e1de00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.515 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.509+0000 7f5e1de00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.515 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.509+0000 7f5e1de00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.515 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:19.509+0000 7f5e1de00640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:19.549 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone86260 2024-04-26T23:47:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.731+0000 7f75e8600640 1 Processor -- start 2024-04-26T23:47:19.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.731+0000 7f75e8600640 1 -- start start 2024-04-26T23:47:19.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e8600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75e006cd40 0x7f75e00af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e8600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f75e015fcd0 0x7f75e0160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e8600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e00ae6a0 con 0x7f75e00d0390 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e8600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f75e00ae920 con 0x7f75e006cd40 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e8600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f75e00aec00 con 0x7f75e015fcd0 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e5200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75e006cd40 0x7f75e00af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e5200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75e006cd40 0x7f75e00af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32794/0 (socket says 172.21.15.47:32794) 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e5200640 1 -- 172.21.15.47:0/44665390 learned_addr learned my addr 172.21.15.47:0/44665390 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e6600640 1 --2- 172.21.15.47:0/44665390 >> v2:172.21.15.203:3300/0 conn(0x7f75e015fcd0 0x7f75e0160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e5200640 1 -- 172.21.15.47:0/44665390 >> v2:172.21.15.203:3300/0 conn(0x7f75e015fcd0 msgr2=0x7f75e0160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e5200640 1 --2- 172.21.15.47:0/44665390 >> v2:172.21.15.203:3300/0 conn(0x7f75e015fcd0 0x7f75e0160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e5200640 1 -- 172.21.15.47:0/44665390 >> v1:172.21.15.203:6789/0 conn(0x7f75e00d0390 legacy=0x7f75e006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.735+0000 7f75e5200640 1 -- 172.21.15.47:0/44665390 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e00aeee0 con 0x7f75e006cd40 2024-04-26T23:47:19.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e5200640 1 --2- 172.21.15.47:0/44665390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e006cd40 0x7f75e00af6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f75e0159fc0 tx=0x7f75cc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42b87cfbb172611 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75dfe00640 1 -- 172.21.15.47:0/44665390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0ab5f0 con 0x7f75e006cd40 2024-04-26T23:47:19.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75dfe00640 1 -- 172.21.15.47:0/44665390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc0b0070 con 0x7f75e006cd40 2024-04-26T23:47:19.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75dfe00640 1 -- 172.21.15.47:0/44665390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0ab9b0 con 0x7f75e006cd40 2024-04-26T23:47:19.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 -- 172.21.15.47:0/44665390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e006cd40 msgr2=0x7f75e00af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 --2- 172.21.15.47:0/44665390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e006cd40 0x7f75e00af6e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f75e0159fc0 tx=0x7f75cc01c460 comp rx=0 tx=0).stop 2024-04-26T23:47:19.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 -- 172.21.15.47:0/44665390 shutdown_connections 2024-04-26T23:47:19.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 --2- 172.21.15.47:0/44665390 >> v2:172.21.15.203:3300/0 conn(0x7f75e015fcd0 0x7f75e0160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 --2- 172.21.15.47:0/44665390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e006cd40 0x7f75e00af6e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 -- 172.21.15.47:0/44665390 >> 172.21.15.47:0/44665390 conn(0x7f75e00b2b70 msgr2=0x7f75e00b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:19.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 -- 172.21.15.47:0/44665390 shutdown_connections 2024-04-26T23:47:19.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 -- 172.21.15.47:0/44665390 wait complete. 2024-04-26T23:47:19.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 Processor -- start 2024-04-26T23:47:19.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 -- start start 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.739+0000 7f75e8600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75e006cd40 0x7f75e014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e00d0390 0x7f75e014cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75e015fcd0 0x7f75e014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f75e006f860 con 0x7f75e00d0390 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75e006f6e0 con 0x7f75e006cd40 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75e006f9e0 con 0x7f75e015fcd0 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e00d0390 0x7f75e014cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e00d0390 0x7f75e014cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32802/0 (socket says 172.21.15.47:32802) 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 -- 172.21.15.47:0/4060260591 learned_addr learned my addr 172.21.15.47:0/4060260591 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5c00640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75e006cd40 0x7f75e014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e6600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75e015fcd0 0x7f75e014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 -- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75e015fcd0 msgr2=0x7f75e014f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75e015fcd0 0x7f75e014f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 -- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75e006cd40 msgr2=0x7f75e014d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75e006cd40 0x7f75e014d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 -- 172.21.15.47:0/4060260591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e014d190 con 0x7f75e00d0390 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5c00640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75e006cd40 0x7f75e014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e5200640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e00d0390 0x7f75e014cc50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0ad040 tx=0x7f75cc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75dd600640 1 -- 172.21.15.47:0/4060260591 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0be5f0 con 0x7f75e00d0390 2024-04-26T23:47:19.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75dd600640 1 -- 172.21.15.47:0/4060260591 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc0be790 con 0x7f75e00d0390 2024-04-26T23:47:19.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75dd600640 1 -- 172.21.15.47:0/4060260591 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0beb40 con 0x7f75e00d0390 2024-04-26T23:47:19.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e0165380 con 0x7f75e00d0390 2024-04-26T23:47:19.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e0165940 con 0x7f75e00d0390 2024-04-26T23:47:19.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e0069700 con 0x7f75e00d0390 2024-04-26T23:47:19.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.743+0000 7f75dd600640 1 -- 172.21.15.47:0/4060260591 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 6) ==== 88038+0+0 (secure 0 0 0) 0x7f75cc0b43f0 con 0x7f75e00d0390 2024-04-26T23:47:19.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.747+0000 7f75dd600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75c0068410 0x7f75c006a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:19.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.747+0000 7f75dd600640 1 -- 172.21.15.47:0/4060260591 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f75cc121440 con 0x7f75e00d0390 2024-04-26T23:47:19.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.747+0000 7f75e5c00640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75c0068410 0x7f75c006a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:19.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.747+0000 7f75e5c00640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75c0068410 0x7f75c006a8d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f75e015bbf0 tx=0x7f75d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:19.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.751+0000 7f75dd600640 1 -- 172.21.15.47:0/4060260591 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f75cc016110 con 0x7f75e00d0390 2024-04-26T23:47:19.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.967+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7f75e015c880 con 0x7f75c0068410 2024-04-26T23:47:19.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75dd600640 1 -- 172.21.15.47:0/4060260591 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7f75e015c880 con 0x7f75c0068410 2024-04-26T23:47:19.979 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:47:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "status": { 2024-04-26T23:47:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "pending", 2024-04-26T23:47:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "source": { 2024-04-26T23:47:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "volume": "cephfs", 2024-04-26T23:47:19.979 INFO:teuthology.orchestra.run.smithi047.stdout: "subvolume": "subvol25160", 2024-04-26T23:47:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot": "subvol_snap58040" 2024-04-26T23:47:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:19.980 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:19.980 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:47:19.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75c0068410 msgr2=0x7f75c006a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75c0068410 0x7f75c006a8d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f75e015bbf0 tx=0x7f75d4009040 comp rx=0 tx=0).stop 2024-04-26T23:47:19.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e00d0390 msgr2=0x7f75e014cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:19.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e00d0390 0x7f75e014cc50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0ad040 tx=0x7f75cc01aca0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 shutdown_connections 2024-04-26T23:47:19.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75c0068410 0x7f75c006a8d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75e015fcd0 0x7f75e014f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75e00d0390 0x7f75e014cc50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 --2- 172.21.15.47:0/4060260591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75e006cd40 0x7f75e014d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 >> 172.21.15.47:0/4060260591 conn(0x7f75e00b2b70 msgr2=0x7f75e015df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 shutdown_connections 2024-04-26T23:47:19.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:19.975+0000 7f75e8600640 1 -- 172.21.15.47:0/4060260591 wait complete. 2024-04-26T23:47:21.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone86260 2024-04-26T23:47:21.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc28b800640 1 Processor -- start 2024-04-26T23:47:21.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc28b800640 1 -- start start 2024-04-26T23:47:21.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc28b800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc28415cee0 0x7fc2840b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc28b800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2840af250 con 0x7fc28406cb10 2024-04-26T23:47:21.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc28b800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2840af510 con 0x7fc2840aeda0 2024-04-26T23:47:21.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc28b800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc2840af7f0 con 0x7fc28415cee0 2024-04-26T23:47:21.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc289800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc28406cb10 0x7fc2840b50f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42962/0 (socket says 172.21.15.47:42962) 2024-04-26T23:47:21.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc289800640 1 -- 172.21.15.47:0/1089579451 learned_addr learned my addr 172.21.15.47:0/1089579451 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:21.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc288e00640 1 --2- 172.21.15.47:0/1089579451 >> v2:172.21.15.203:3300/0 conn(0x7fc28415cee0 0x7fc2840b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798830074 0 0) 0x7fc2840af250 con 0x7fc28406cb10 2024-04-26T23:47:21.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc268003530 con 0x7fc28406cb10 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4197378561 0 0) 0x7fc268003530 con 0x7fc28406cb10 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 >> v2:172.21.15.203:3300/0 conn(0x7fc28415cee0 msgr2=0x7fc2840b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 --2- 172.21.15.47:0/1089579451 >> v2:172.21.15.203:3300/0 conn(0x7fc28415cee0 0x7fc2840b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 >> v1:172.21.15.203:6789/0 conn(0x7fc2840aeda0 legacy=0x7fc28406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28415f9d0 con 0x7fc28406cb10 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fc27c001a00 con 0x7fc28406cb10 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 >> v1:172.21.15.47:6789/0 conn(0x7fc28406cb10 legacy=0x7fc2840b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2680039c0 0x7fc268003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc268004810 0x7fc268004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2680051d0 0x7fc26800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2840af7f0 con 0x7fc268004810 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc26800c170 con 0x7fc2680039c0 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc26800c370 con 0x7fc2680051d0 2024-04-26T23:47:21.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc27be00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc268004810 0x7fc268004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc288e00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2680039c0 0x7fc268003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc289800640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2680051d0 0x7fc26800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc27be00640 1 -- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2680051d0 msgr2=0x7fc26800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc27be00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2680051d0 0x7fc26800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc27be00640 1 -- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2680039c0 msgr2=0x7fc268003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.155+0000 7fc27be00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2680039c0 0x7fc268003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc27be00640 1 -- 172.21.15.47:0/1089579451 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc268003530 con 0x7fc268004810 2024-04-26T23:47:21.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc289800640 1 -- 172.21.15.47:0/1089579451 reap_dead start 2024-04-26T23:47:21.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc27be00640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc268004810 0x7fc268004c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc26c001780 tx=0x7fc26c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d0dac546540a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0013a0 con 0x7fc268004810 2024-04-26T23:47:21.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26c0052f0 con 0x7fc268004810 2024-04-26T23:47:21.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc283e00640 1 -- 172.21.15.47:0/1089579451 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0a4e60 con 0x7fc268004810 2024-04-26T23:47:21.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc28b800640 1 -- 172.21.15.47:0/1089579451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc268004810 msgr2=0x7fc268004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc28b800640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc268004810 0x7fc268004c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc26c001780 tx=0x7fc26c01c3d0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc28b800640 1 -- 172.21.15.47:0/1089579451 shutdown_connections 2024-04-26T23:47:21.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc28b800640 1 --2- 172.21.15.47:0/1089579451 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc268004810 0x7fc268004c90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc28b800640 1 -- 172.21.15.47:0/1089579451 >> 172.21.15.47:0/1089579451 conn(0x7fc2840b4400 msgr2=0x7fc2840d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:21.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc28b800640 1 -- 172.21.15.47:0/1089579451 shutdown_connections 2024-04-26T23:47:21.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.159+0000 7fc28b800640 1 -- 172.21.15.47:0/1089579451 wait complete. 2024-04-26T23:47:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 Processor -- start 2024-04-26T23:47:21.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 -- start start 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc268004810 0x7fc284158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2840c6d00 0x7fc2841fba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2841f8b80 0x7fc2841f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc2840b5900 con 0x7fc2841f8b80 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2840b1670 con 0x7fc268004810 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc2840b5a80 con 0x7fc2840c6d00 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2841f8b80 0x7fc2841f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2841f8b80 0x7fc2841f9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32818/0 (socket says 172.21.15.47:32818) 2024-04-26T23:47:21.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 -- 172.21.15.47:0/1328716373 learned_addr learned my addr 172.21.15.47:0/1328716373 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:21.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc27be00640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2840c6d00 0x7fc2841fba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc288e00640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc268004810 0x7fc284158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 -- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2840c6d00 msgr2=0x7fc2841fba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2840c6d00 0x7fc2841fba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 -- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc268004810 msgr2=0x7fc284158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc268004810 0x7fc284158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 -- 172.21.15.47:0/1328716373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2840ca1e0 con 0x7fc2841f8b80 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc289800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2841f8b80 0x7fc2841f9000 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc28409fed0 tx=0x7fc27c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc281600640 1 -- 172.21.15.47:0/1328716373 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c00e9e0 con 0x7fc2841f8b80 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc281600640 1 -- 172.21.15.47:0/1328716373 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc27c018070 con 0x7fc2841f8b80 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc281600640 1 -- 172.21.15.47:0/1328716373 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c00ede0 con 0x7fc2841f8b80 2024-04-26T23:47:21.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.163+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2841fc1d0 con 0x7fc2841f8b80 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.167+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2841fc790 con 0x7fc2841f8b80 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.167+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc284069700 con 0x7fc2841f8b80 2024-04-26T23:47:21.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.167+0000 7fc281600640 1 -- 172.21.15.47:0/1328716373 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fc27c01d460 con 0x7fc2841f8b80 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.167+0000 7fc281600640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc260068530 0x7fc26006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:21.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.167+0000 7fc281600640 1 -- 172.21.15.47:0/1328716373 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fc27c086dc0 con 0x7fc2841f8b80 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.167+0000 7fc288e00640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc260068530 0x7fc26006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:21.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.171+0000 7fc288e00640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc260068530 0x7fc26006a9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc274009c60 tx=0x7fc274009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:21.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.171+0000 7fc281600640 1 -- 172.21.15.47:0/1328716373 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc27c057190 con 0x7fc2841f8b80 2024-04-26T23:47:21.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.371+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7fc2841fc9d0 con 0x7fc260068530 2024-04-26T23:47:21.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc281600640 1 -- 172.21.15.47:0/1328716373 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7fc2740098b0 con 0x7fc260068530 2024-04-26T23:47:21.383 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: "status": { 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "pending", 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: "source": { 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: "volume": "cephfs", 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: "subvolume": "subvol25160", 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot": "subvol_snap58040" 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:21.384 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:47:21.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc260068530 msgr2=0x7fc26006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc260068530 0x7fc26006a9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc274009c60 tx=0x7fc274009190 comp rx=0 tx=0).stop 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2841f8b80 msgr2=0x7fc2841f9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2841f8b80 0x7fc2841f9000 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc28409fed0 tx=0x7fc27c007b00 comp rx=0 tx=0).stop 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 shutdown_connections 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc260068530 0x7fc26006a9f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc2841f8b80 0x7fc2841f9000 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc2840c6d00 0x7fc2841fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 --2- 172.21.15.47:0/1328716373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc268004810 0x7fc284158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 >> 172.21.15.47:0/1328716373 conn(0x7fc2840b4400 msgr2=0x7fc28406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:21.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 shutdown_connections 2024-04-26T23:47:21.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:21.379+0000 7fc28b800640 1 -- 172.21.15.47:0/1328716373 wait complete. 2024-04-26T23:47:22.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone86260 2024-04-26T23:47:22.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.555+0000 7f150ca00640 1 Processor -- start 2024-04-26T23:47:22.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.555+0000 7f150ca00640 1 -- start start 2024-04-26T23:47:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.555+0000 7f150ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 0x7f15080729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.555+0000 7f150ca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f15080b55a0 0x7f1508072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.555+0000 7f150ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f150806f000 con 0x7f1508162970 2024-04-26T23:47:22.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f150ca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f150806f2e0 con 0x7f15080b55a0 2024-04-26T23:47:22.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f150ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f150806f5c0 con 0x7f150806ea90 2024-04-26T23:47:22.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1508162970 0x7f15080700a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42964/0 (socket says 172.21.15.47:42964) 2024-04-26T23:47:22.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505e00640 1 -- 172.21.15.47:0/2338054617 learned_addr learned my addr 172.21.15.47:0/2338054617 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:22.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f14fd400640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 0x7f15080729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1506800640 1 --2- 172.21.15.47:0/2338054617 >> v2:172.21.15.203:3300/0 conn(0x7f15080b55a0 0x7f1508072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1064658393 0 0) 0x7f150806f000 con 0x7f1508162970 2024-04-26T23:47:22.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14ec003530 con 0x7f1508162970 2024-04-26T23:47:22.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2500670605 0 0) 0x7f14ec003530 con 0x7f1508162970 2024-04-26T23:47:22.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 msgr2=0x7f15080729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:22.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 0x7f15080729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 >> v2:172.21.15.203:3300/0 conn(0x7f15080b55a0 msgr2=0x7f1508072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 --2- 172.21.15.47:0/2338054617 >> v2:172.21.15.203:3300/0 conn(0x7f15080b55a0 0x7f1508072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150806f8a0 con 0x7f1508162970 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f14f8001680 con 0x7f1508162970 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 >> v1:172.21.15.47:6789/0 conn(0x7f1508162970 legacy=0x7f15080700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14ec0039c0 0x7f14ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 0x7f14ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14ec004d50 0x7f14ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f150806f2e0 con 0x7f14ec004d50 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f150806f5c0 con 0x7f14ec0039c0 2024-04-26T23:47:22.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f14ec00b9d0 con 0x7f150806ea90 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1506800640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14ec004d50 0x7f14ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1505e00640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14ec0039c0 0x7f14ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f14fd400640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 0x7f14ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1506800640 1 -- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 msgr2=0x7f14ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1506800640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f150806ea90 0x7f14ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1506800640 1 -- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14ec0039c0 msgr2=0x7f14ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1506800640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14ec0039c0 0x7f14ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.559+0000 7f1506800640 1 -- 172.21.15.47:0/2338054617 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec003530 con 0x7f14ec004d50 2024-04-26T23:47:22.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f1506800640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14ec004d50 0x7f14ec0051d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1500009fc0 tx=0x7f150001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766fae7d62946a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:22.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15000b2070 con 0x7f14ec004d50 2024-04-26T23:47:22.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15000a5cd0 con 0x7f14ec004d50 2024-04-26T23:47:22.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f1505400640 1 -- 172.21.15.47:0/2338054617 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500009c10 con 0x7f14ec004d50 2024-04-26T23:47:22.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 -- 172.21.15.47:0/2338054617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14ec004d50 msgr2=0x7f14ec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:22.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 --2- 172.21.15.47:0/2338054617 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f14ec004d50 0x7f14ec0051d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1500009fc0 tx=0x7f150001ccc0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f1506800640 1 -- 172.21.15.47:0/2338054617 reap_dead start 2024-04-26T23:47:22.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 -- 172.21.15.47:0/2338054617 shutdown_connections 2024-04-26T23:47:22.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 -- 172.21.15.47:0/2338054617 >> 172.21.15.47:0/2338054617 conn(0x7f1508070c00 msgr2=0x7f150806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:22.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 -- 172.21.15.47:0/2338054617 shutdown_connections 2024-04-26T23:47:22.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 -- 172.21.15.47:0/2338054617 wait complete. 2024-04-26T23:47:22.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 Processor -- start 2024-04-26T23:47:22.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.563+0000 7f150ca00640 1 -- start start 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14ec004d50 0x7f15081f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15080b0c30 0x7f15080b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15080b10b0 0x7f15080b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15080b4840 con 0x7f15080b10b0 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1508162d50 con 0x7f15080b0c30 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f15080b49c0 con 0x7f14ec004d50 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15080b10b0 0x7f15080b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15080b10b0 0x7f15080b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32826/0 (socket says 172.21.15.47:32826) 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 -- 172.21.15.47:0/1453114938 learned_addr learned my addr 172.21.15.47:0/1453114938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1505e00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14ec004d50 0x7f15081f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f14fd400640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15080b0c30 0x7f15080b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 -- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14ec004d50 msgr2=0x7f15081f47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14ec004d50 0x7f15081f47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 -- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15080b0c30 msgr2=0x7f15080b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15080b0c30 0x7f15080b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 -- 172.21.15.47:0/1453114938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15081567c0 con 0x7f15080b10b0 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f14fd400640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15080b0c30 0x7f15080b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f1506800640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15080b10b0 0x7f15080b2420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f15000b0040 tx=0x7f1500009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f14fea00640 1 -- 172.21.15.47:0/1453114938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15000bd070 con 0x7f15080b10b0 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f14fea00640 1 -- 172.21.15.47:0/1453114938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15000a5ad0 con 0x7f15080b10b0 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1508156aa0 con 0x7f15080b10b0 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f14fea00640 1 -- 172.21.15.47:0/1453114938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15000b2040 con 0x7f15080b10b0 2024-04-26T23:47:22.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1508157060 con 0x7f15080b10b0 2024-04-26T23:47:22.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f150806d390 con 0x7f15080b10b0 2024-04-26T23:47:22.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.567+0000 7f14fea00640 1 -- 172.21.15.47:0/1453114938 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f15000c0070 con 0x7f15080b10b0 2024-04-26T23:47:22.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.571+0000 7f14fea00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f14e4068530 0x7f14e406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:22.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.571+0000 7f14fea00640 1 -- 172.21.15.47:0/1453114938 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f15001206d0 con 0x7f15080b10b0 2024-04-26T23:47:22.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.571+0000 7f1505e00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f14e4068530 0x7f14e406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.571+0000 7f1505e00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f14e4068530 0x7f14e406a9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f14f8000c10 tx=0x7f14f8007900 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:22.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.575+0000 7f14fea00640 1 -- 172.21.15.47:0/1453114938 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f15000169d0 con 0x7f15080b10b0 2024-04-26T23:47:22.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.775+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7f15080b0030 con 0x7f14e4068530 2024-04-26T23:47:22.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.783+0000 7f14fea00640 1 -- 172.21.15.47:0/1453114938 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7f15080b0030 con 0x7f14e4068530 2024-04-26T23:47:22.788 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "status": { 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "pending", 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "source": { 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "volume": "cephfs", 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "subvolume": "subvol25160", 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot": "subvol_snap58040" 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:22.789 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:22.790 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f14e4068530 msgr2=0x7f14e406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f14e4068530 0x7f14e406a9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f14f8000c10 tx=0x7f14f8007900 comp rx=0 tx=0).stop 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15080b10b0 msgr2=0x7f15080b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15080b10b0 0x7f15080b2420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f15000b0040 tx=0x7f1500009750 comp rx=0 tx=0).stop 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 shutdown_connections 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f14e4068530 0x7f14e406a9f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15080b10b0 0x7f15080b2420 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15080b0c30 0x7f15080b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 --2- 172.21.15.47:0/1453114938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f14ec004d50 0x7f15081f47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 >> 172.21.15.47:0/1453114938 conn(0x7f1508070c00 msgr2=0x7f15080b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 shutdown_connections 2024-04-26T23:47:22.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:22.787+0000 7f150ca00640 1 -- 172.21.15.47:0/1453114938 wait complete. 2024-04-26T23:47:23.812 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone86260 2024-04-26T23:47:23.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbafc00640 1 Processor -- start 2024-04-26T23:47:23.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbafc00640 1 -- start start 2024-04-26T23:47:23.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbafc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbba806c630 0x7fbba80b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:23.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbafc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba806f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbafc00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbba806e370 con 0x7fbba806ca10 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbafc00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbba806e650 con 0x7fbba806c630 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbafc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbba806e930 con 0x7fbba806f410 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.963+0000 7fbbad200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbba806c630 0x7fbba80b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbb9fe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fbba806ca10 0x7fbba8073dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42976/0 (socket says 172.21.15.47:42976) 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbb9fe00640 1 -- 172.21.15.47:0/977080331 learned_addr learned my addr 172.21.15.47:0/977080331 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbbadc00640 1 --2- 172.21.15.47:0/977080331 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba806f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbbad200640 1 -- 172.21.15.47:0/977080331 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 msgr2=0x7fbba806f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbbad200640 1 --2- 172.21.15.47:0/977080331 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba806f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbbad200640 1 -- 172.21.15.47:0/977080331 >> v1:172.21.15.47:6789/0 conn(0x7fbba806ca10 legacy=0x7fbba8073dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbbad200640 1 -- 172.21.15.47:0/977080331 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba806ec10 con 0x7fbba806c630 2024-04-26T23:47:23.971 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbbadc00640 1 --2- 172.21.15.47:0/977080331 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:23.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbbad200640 1 --2- 172.21.15.47:0/977080331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806c630 0x7fbba80b5c30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbb980097c0 tx=0x7fbb9801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6ddd2c2ff17c3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:23.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbba7e00640 1 -- 172.21.15.47:0/977080331 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb980b0070 con 0x7fbba806c630 2024-04-26T23:47:23.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbba7e00640 1 -- 172.21.15.47:0/977080331 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb980ab600 con 0x7fbba806c630 2024-04-26T23:47:23.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.967+0000 7fbba7e00640 1 -- 172.21.15.47:0/977080331 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb980ab9d0 con 0x7fbba806c630 2024-04-26T23:47:23.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- 172.21.15.47:0/977080331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806c630 msgr2=0x7fbba80b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:23.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 --2- 172.21.15.47:0/977080331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806c630 0x7fbba80b5c30 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbb980097c0 tx=0x7fbb9801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:47:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- 172.21.15.47:0/977080331 shutdown_connections 2024-04-26T23:47:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 --2- 172.21.15.47:0/977080331 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 --2- 172.21.15.47:0/977080331 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806c630 0x7fbba80b5c30 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- 172.21.15.47:0/977080331 >> 172.21.15.47:0/977080331 conn(0x7fbba80b2b70 msgr2=0x7fbba80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- 172.21.15.47:0/977080331 shutdown_connections 2024-04-26T23:47:23.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- 172.21.15.47:0/977080331 wait complete. 2024-04-26T23:47:23.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 Processor -- start 2024-04-26T23:47:23.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- start start 2024-04-26T23:47:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba806c630 0x7fbba815d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806ca10 0x7fbba8136060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba80af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:23.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbba81481c0 con 0x7fbba806ca10 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbba8148040 con 0x7fbba806c630 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbafc00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbba816bd40 con 0x7fbba806f410 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806ca10 0x7fbba8136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806ca10 0x7fbba8136060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32836/0 (socket says 172.21.15.47:32836) 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 -- 172.21.15.47:0/1202761338 learned_addr learned my addr 172.21.15.47:0/1202761338 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbad200640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba806c630 0x7fbba815d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbbadc00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba80af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 -- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 msgr2=0x7fbba80af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba80af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 -- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba806c630 msgr2=0x7fbba815d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba806c630 0x7fbba815d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:23.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 -- 172.21.15.47:0/1202761338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba8140e80 con 0x7fbba806ca10 2024-04-26T23:47:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbb9fe00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806ca10 0x7fbba8136060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c370 tx=0x7fbb9000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.971+0000 7fbba5600640 1 -- 172.21.15.47:0/1202761338 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb90017070 con 0x7fbba806ca10 2024-04-26T23:47:23.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbba5600640 1 -- 172.21.15.47:0/1202761338 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb90005cf0 con 0x7fbba806ca10 2024-04-26T23:47:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba8136e50 con 0x7fbba806ca10 2024-04-26T23:47:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbba5600640 1 -- 172.21.15.47:0/1202761338 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb900072f0 con 0x7fbba806ca10 2024-04-26T23:47:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba8137410 con 0x7fbba806ca10 2024-04-26T23:47:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba8069700 con 0x7fbba806ca10 2024-04-26T23:47:23.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbba5600640 1 -- 172.21.15.47:0/1202761338 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fbb9001a070 con 0x7fbba806ca10 2024-04-26T23:47:23.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbba5600640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbb84068530 0x7fbb8406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:23.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbba5600640 1 -- 172.21.15.47:0/1202761338 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7fbb900860d0 con 0x7fbba806ca10 2024-04-26T23:47:23.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.975+0000 7fbbad200640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbb84068530 0x7fbb8406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:23.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.979+0000 7fbbad200640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbb84068530 0x7fbb8406a9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb980ad000 tx=0x7fbb980a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:23.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:23.979+0000 7fbba5600640 1 -- 172.21.15.47:0/1202761338 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbb90056360 con 0x7fbba806ca10 2024-04-26T23:47:24.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.179+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7fbba806fba0 con 0x7fbb84068530 2024-04-26T23:47:24.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbba5600640 1 -- 172.21.15.47:0/1202761338 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+165 (secure 0 0 0) 0x7fbba806fba0 con 0x7fbb84068530 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: "status": { 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "pending", 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: "source": { 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: "volume": "cephfs", 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: "subvolume": "subvol25160", 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot": "subvol_snap58040" 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:24.191 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbb84068530 msgr2=0x7fbb8406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbb84068530 0x7fbb8406a9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbb980ad000 tx=0x7fbb980a6000 comp rx=0 tx=0).stop 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806ca10 msgr2=0x7fbba8136060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806ca10 0x7fbba8136060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c370 tx=0x7fbb9000c830 comp rx=0 tx=0).stop 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 shutdown_connections 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbb84068530 0x7fbb8406a9f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbba806f410 0x7fbba80af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbba806ca10 0x7fbba8136060 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 --2- 172.21.15.47:0/1202761338 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbba806c630 0x7fbba815d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 >> 172.21.15.47:0/1202761338 conn(0x7fbba80b2b70 msgr2=0x7fbba8145fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:24.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 shutdown_connections 2024-04-26T23:47:24.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:24.187+0000 7fbbafc00640 1 -- 172.21.15.47:0/1202761338 wait complete. 2024-04-26T23:47:25.213 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone86260 2024-04-26T23:47:25.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 Processor -- start 2024-04-26T23:47:25.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 -- start start 2024-04-26T23:47:25.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02980d0390 0x7f02980af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f029806c630 0x7f029806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f029815fcd0 0x7f0298160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f02980ae6a0 con 0x7f029815fcd0 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f02980ae920 con 0x7f029806c630 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f02980aec00 con 0x7f02980d0390 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f029815fcd0 0x7f0298160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f029815fcd0 0x7f0298160160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32844/0 (socket says 172.21.15.47:32844) 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 -- 172.21.15.47:0/2112125014 learned_addr learned my addr 172.21.15.47:0/2112125014 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f0297e00640 1 --2- 172.21.15.47:0/2112125014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02980d0390 0x7f02980af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f028f400640 1 --2- 172.21.15.47:0/2112125014 >> v2:172.21.15.203:3300/0 conn(0x7f029806c630 0x7f029806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 -- 172.21.15.47:0/2112125014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02980d0390 msgr2=0x7f02980af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:25.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 --2- 172.21.15.47:0/2112125014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02980d0390 0x7f02980af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:25.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 -- 172.21.15.47:0/2112125014 >> v2:172.21.15.203:3300/0 conn(0x7f029806c630 msgr2=0x7f029806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:25.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 --2- 172.21.15.47:0/2112125014 >> v2:172.21.15.203:3300/0 conn(0x7f029806c630 0x7f029806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:25.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f029d200640 1 -- 172.21.15.47:0/2112125014 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02980aeee0 con 0x7f029815fcd0 2024-04-26T23:47:25.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.363+0000 7f028f400640 1 --2- 172.21.15.47:0/2112125014 >> v2:172.21.15.203:3300/0 conn(0x7f029806c630 0x7f029806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:25.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029d200640 1 --2- 172.21.15.47:0/2112125014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029815fcd0 0x7f0298160160 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f02980742f0 tx=0x7f029001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99fc8942bd76825 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:25.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f0297400640 1 -- 172.21.15.47:0/2112125014 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02900a5660 con 0x7f029815fcd0 2024-04-26T23:47:25.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f0297400640 1 -- 172.21.15.47:0/2112125014 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02900a5800 con 0x7f029815fcd0 2024-04-26T23:47:25.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f0297400640 1 -- 172.21.15.47:0/2112125014 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02900a5bd0 con 0x7f029815fcd0 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 -- 172.21.15.47:0/2112125014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029815fcd0 msgr2=0x7f0298160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 --2- 172.21.15.47:0/2112125014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029815fcd0 0x7f0298160160 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f02980742f0 tx=0x7f029001c960 comp rx=0 tx=0).stop 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 -- 172.21.15.47:0/2112125014 shutdown_connections 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 --2- 172.21.15.47:0/2112125014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029815fcd0 0x7f0298160160 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 --2- 172.21.15.47:0/2112125014 >> v2:172.21.15.203:3300/0 conn(0x7f029806c630 0x7f029806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 --2- 172.21.15.47:0/2112125014 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f02980d0390 0x7f02980af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 -- 172.21.15.47:0/2112125014 >> 172.21.15.47:0/2112125014 conn(0x7f02980b2b70 msgr2=0x7f02980b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 -- 172.21.15.47:0/2112125014 shutdown_connections 2024-04-26T23:47:25.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.367+0000 7f029f200640 1 -- 172.21.15.47:0/2112125014 wait complete. 2024-04-26T23:47:25.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 Processor -- start 2024-04-26T23:47:25.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 -- start start 2024-04-26T23:47:25.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029806c630 0x7f02981fb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02980d0390 0x7f029814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029815fcd0 0x7f02981525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f029806f860 con 0x7f029806c630 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f029806f6e0 con 0x7f02980d0390 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f029806f9e0 con 0x7f029815fcd0 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029806c630 0x7f02981fb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029806c630 0x7f02981fb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:32846/0 (socket says 172.21.15.47:32846) 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 -- 172.21.15.47:0/2498824524 learned_addr learned my addr 172.21.15.47:0/2498824524 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 -- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029815fcd0 msgr2=0x7f02981525f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029815fcd0 0x7f02981525f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 -- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02980d0390 msgr2=0x7f029814cde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02980d0390 0x7f029814cde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:25.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 -- 172.21.15.47:0/2498824524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029814dcd0 con 0x7f029806c630 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0297e00640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029806c630 0x7f02981fb1f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f028800e960 tx=0x7f028800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0294c00640 1 -- 172.21.15.47:0/2498824524 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288017070 con 0x7f029806c630 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0294c00640 1 -- 172.21.15.47:0/2498824524 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028800ca00 con 0x7f029806c630 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f0294c00640 1 -- 172.21.15.47:0/2498824524 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028800cdb0 con 0x7f029806c630 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02981fb8f0 con 0x7f029806c630 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.371+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02981fbeb0 con 0x7f029806c630 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.375+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02981fc0f0 con 0x7f029806c630 2024-04-26T23:47:25.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.375+0000 7f0294c00640 1 -- 172.21.15.47:0/2498824524 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f028801a070 con 0x7f029806c630 2024-04-26T23:47:25.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.375+0000 7f0294c00640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0274068530 0x7f027406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:25.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.375+0000 7f0294c00640 1 -- 172.21.15.47:0/2498824524 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5709+0+0 (secure 0 0 0) 0x7f0288087160 con 0x7f029806c630 2024-04-26T23:47:25.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.375+0000 7f028f400640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0274068530 0x7f027406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:25.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.379+0000 7f028f400640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0274068530 0x7f027406a9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f02981597b0 tx=0x7f0280008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:25.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.379+0000 7f0294c00640 1 -- 172.21.15.47:0/2498824524 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f02981fc0f0 con 0x7f029806c630 2024-04-26T23:47:25.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:25.579+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7f0298069700 con 0x7f0274068530 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f0294c00640 1 -- 172.21.15.47:0/2498824524 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+169 (secure 0 0 0) 0x7f0298069700 con 0x7f0274068530 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "status": { 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "in-progress", 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "source": { 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "volume": "cephfs", 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "subvolume": "subvol25160", 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot": "subvol_snap58040" 2024-04-26T23:47:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:32.329 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:47:32.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0274068530 msgr2=0x7f027406a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0274068530 0x7f027406a9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f02981597b0 tx=0x7f0280008040 comp rx=0 tx=0).stop 2024-04-26T23:47:32.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029806c630 msgr2=0x7f02981fb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029806c630 0x7f02981fb1f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f028800e960 tx=0x7f028800ee20 comp rx=0 tx=0).stop 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 shutdown_connections 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0274068530 0x7f027406a9f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f029815fcd0 0x7f02981525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02980d0390 0x7f029814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 --2- 172.21.15.47:0/2498824524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f029806c630 0x7f02981fb1f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.323+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 >> 172.21.15.47:0/2498824524 conn(0x7f02980b2b70 msgr2=0x7f0298072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.327+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 shutdown_connections 2024-04-26T23:47:32.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:32.327+0000 7f029f200640 1 -- 172.21.15.47:0/2498824524 wait complete. 2024-04-26T23:47:32.371 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:32.375 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:47:33.356 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone86260 2024-04-26T23:47:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.507+0000 7f906ce00640 1 Processor -- start 2024-04-26T23:47:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.507+0000 7f906ce00640 1 -- start start 2024-04-26T23:47:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.507+0000 7f906ce00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 0x7f90681603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.507+0000 7f906ce00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90680ae6a0 con 0x7f906806cd40 2024-04-26T23:47:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.507+0000 7f906ce00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90680ae920 con 0x7f90680d0390 2024-04-26T23:47:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.507+0000 7f906ce00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f90680aec00 con 0x7f90680af6e0 2024-04-26T23:47:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f906806cd40 0x7f906815fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36604/0 (socket says 172.21.15.47:36604) 2024-04-26T23:47:33.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065400640 1 -- 172.21.15.47:0/1767709154 learned_addr learned my addr 172.21.15.47:0/1767709154 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9066800640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 0x7f90681603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138265418 0 0) 0x7f9054001120 con 0x7f906806cd40 2024-04-26T23:47:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f904c003530 con 0x7f906806cd40 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2316146070 0 0) 0x7f904c003530 con 0x7f906806cd40 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 msgr2=0x7f90681603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 0x7f90681603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 >> v1:172.21.15.203:6789/0 conn(0x7f90680d0390 legacy=0x7f906806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90680aeee0 con 0x7f906806cd40 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f9054001850 con 0x7f906806cd40 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 >> v1:172.21.15.47:6789/0 conn(0x7f906806cd40 legacy=0x7f906815fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c0039f0 0x7f904c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 0x7f904c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c004d50 0x7f904c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f90680aec00 con 0x7f904c0039f0 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f904c00ba80 con 0x7f904c004d50 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f904c00bc80 con 0x7f90680af6e0 2024-04-26T23:47:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065e00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c0039f0 0x7f904c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065400640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 0x7f904c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065e00640 1 -- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 msgr2=0x7f904c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065e00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90680af6e0 0x7f904c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065e00640 1 -- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c004d50 msgr2=0x7f904c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065e00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c004d50 0x7f904c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.511+0000 7f9065e00640 1 -- 172.21.15.47:0/1767709154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904c003530 con 0x7f904c0039f0 2024-04-26T23:47:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f9065e00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c0039f0 0x7f904c003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9058001860 tx=0x7f905801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb3230cf6b92e71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90580b0070 con 0x7f904c0039f0 2024-04-26T23:47:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90580ab600 con 0x7f904c0039f0 2024-04-26T23:47:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f9064a00640 1 -- 172.21.15.47:0/1767709154 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9058001460 con 0x7f904c0039f0 2024-04-26T23:47:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 -- 172.21.15.47:0/1767709154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c0039f0 msgr2=0x7f904c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 --2- 172.21.15.47:0/1767709154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f904c0039f0 0x7f904c003dd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9058001860 tx=0x7f905801c4f0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f9066800640 1 -- 172.21.15.47:0/1767709154 reap_dead start 2024-04-26T23:47:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 -- 172.21.15.47:0/1767709154 shutdown_connections 2024-04-26T23:47:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 -- 172.21.15.47:0/1767709154 >> 172.21.15.47:0/1767709154 conn(0x7f90680b2b70 msgr2=0x7f90680b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 -- 172.21.15.47:0/1767709154 shutdown_connections 2024-04-26T23:47:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 -- 172.21.15.47:0/1767709154 wait complete. 2024-04-26T23:47:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 Processor -- start 2024-04-26T23:47:33.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.515+0000 7f906ce00640 1 -- start start 2024-04-26T23:47:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c0039f0 0x7f9068152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90681f80d0 0x7f9068164f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90681f8550 0x7f9068165460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f906806fab0 con 0x7f90681f8550 2024-04-26T23:47:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f906806f930 con 0x7f904c0039f0 2024-04-26T23:47:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f906806fc30 con 0x7f90681f80d0 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90681f8550 0x7f9068165460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90681f8550 0x7f9068165460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42544/0 (socket says 172.21.15.47:42544) 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 -- 172.21.15.47:0/3314901009 learned_addr learned my addr 172.21.15.47:0/3314901009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9065400640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90681f80d0 0x7f9068164f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9065e00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c0039f0 0x7f9068152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 -- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90681f80d0 msgr2=0x7f9068164f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90681f80d0 0x7f9068164f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 -- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c0039f0 msgr2=0x7f9068152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c0039f0 0x7f9068152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 -- 172.21.15.47:0/3314901009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9068158f50 con 0x7f90681f8550 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9065400640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90681f80d0 0x7f9068164f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9065e00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c0039f0 0x7f9068152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f9066800640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90681f8550 0x7f9068165460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f906809f0e0 tx=0x7f906000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f905e000640 1 -- 172.21.15.47:0/3314901009 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906000bce0 con 0x7f90681f8550 2024-04-26T23:47:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f905e000640 1 -- 172.21.15.47:0/3314901009 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f906001a070 con 0x7f90681f8550 2024-04-26T23:47:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9068159230 con 0x7f90681f8550 2024-04-26T23:47:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f905e000640 1 -- 172.21.15.47:0/3314901009 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060014640 con 0x7f90681f8550 2024-04-26T23:47:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90681597f0 con 0x7f90681f8550 2024-04-26T23:47:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9068069700 con 0x7f90681f8550 2024-04-26T23:47:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.519+0000 7f905e000640 1 -- 172.21.15.47:0/3314901009 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f9060013070 con 0x7f90681f8550 2024-04-26T23:47:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.523+0000 7f905e000640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9048068560 0x7f904806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.523+0000 7f905e000640 1 -- 172.21.15.47:0/3314901009 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f9060087110 con 0x7f90681f8550 2024-04-26T23:47:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.523+0000 7f9065e00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9048068560 0x7f904806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:33.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.523+0000 7f9065e00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9048068560 0x7f904806aa20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f90580ad000 tx=0x7f90580a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:33.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.527+0000 7f905e000640 1 -- 172.21.15.47:0/3314901009 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9060024020 con 0x7f90681f8550 2024-04-26T23:47:33.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:33.723+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7f906809eec0 con 0x7f9048068560 2024-04-26T23:47:37.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.319+0000 7f905e000640 1 -- 172.21.15.47:0/3314901009 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+272 (secure 0 0 0) 0x7f906809eec0 con 0x7f9048068560 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "status": { 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "failed", 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "source": { 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "volume": "cephfs", 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "subvolume": "subvol25160", 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot": "subvol_snap58040" 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "failure": { 2024-04-26T23:47:37.327 INFO:teuthology.orchestra.run.smithi047.stdout: "errno": "2", 2024-04-26T23:47:37.328 INFO:teuthology.orchestra.run.smithi047.stdout: "error_msg": "snapshot 'subvol_snap58040' does not exist" 2024-04-26T23:47:37.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:37.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:37.328 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:47:37.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9048068560 msgr2=0x7f904806aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9048068560 0x7f904806aa20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f90580ad000 tx=0x7f90580a6000 comp rx=0 tx=0).stop 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90681f8550 msgr2=0x7f9068165460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90681f8550 0x7f9068165460 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f906809f0e0 tx=0x7f906000b480 comp rx=0 tx=0).stop 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 shutdown_connections 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9048068560 0x7f904806aa20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90681f8550 0x7f9068165460 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90681f80d0 0x7f9068164f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 --2- 172.21.15.47:0/3314901009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f904c0039f0 0x7f9068152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 >> 172.21.15.47:0/3314901009 conn(0x7f90680b2b70 msgr2=0x7f90681535e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 shutdown_connections 2024-04-26T23:47:37.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.323+0000 7f906ce00640 1 -- 172.21.15.47:0/3314901009 wait complete. 2024-04-26T23:47:37.354 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone86260 2024-04-26T23:47:37.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1437000640 1 Processor -- start 2024-04-26T23:47:37.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1437000640 1 -- start start 2024-04-26T23:47:37.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1437000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f14301577f0 0x7f14300b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1437000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143015f4f0 con 0x7f1430161240 2024-04-26T23:47:37.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1437000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143015f7d0 con 0x7f1430160590 2024-04-26T23:47:37.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1437000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f14300b71e0 con 0x7f14301577f0 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1435000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1430161240 0x7f143015b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36620/0 (socket says 172.21.15.47:36620) 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f1435000640 1 -- 172.21.15.47:0/3893664182 learned_addr learned my addr 172.21.15.47:0/3893664182 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f142fe00640 1 --2- 172.21.15.47:0/3893664182 >> v2:172.21.15.203:3300/0 conn(0x7f14301577f0 0x7f14300b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f142ea00640 1 -- 172.21.15.47:0/3893664182 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738445370 0 0) 0x7f143015f4f0 con 0x7f1430161240 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f142ea00640 1 -- 172.21.15.47:0/3893664182 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1414003530 con 0x7f1430161240 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f142ea00640 1 -- 172.21.15.47:0/3893664182 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1558503615 0 0) 0x7f1414003530 con 0x7f1430161240 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f142fe00640 1 -- 172.21.15.47:0/3893664182 >> v1:172.21.15.203:6789/0 conn(0x7f1430160590 legacy=0x7f1430160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f142fe00640 1 -- 172.21.15.47:0/3893664182 >> v1:172.21.15.47:6789/0 conn(0x7f1430161240 legacy=0x7f143015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.499+0000 7f142fe00640 1 -- 172.21.15.47:0/3893664182 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143015fab0 con 0x7f14301577f0 2024-04-26T23:47:37.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f142fe00640 1 --2- 172.21.15.47:0/3893664182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14301577f0 0x7f14300b6ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14200097c0 tx=0x7f142001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de9f5910e4a6e6c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f142ea00640 1 -- 172.21.15.47:0/3893664182 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14200b0070 con 0x7f14301577f0 2024-04-26T23:47:37.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f142ea00640 1 -- 172.21.15.47:0/3893664182 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14200ab400 con 0x7f14301577f0 2024-04-26T23:47:37.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f142ea00640 1 -- 172.21.15.47:0/3893664182 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428001a00 con 0x7f14301577f0 2024-04-26T23:47:37.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f1437000640 1 -- 172.21.15.47:0/3893664182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14301577f0 msgr2=0x7f14300b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f1437000640 1 --2- 172.21.15.47:0/3893664182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14301577f0 0x7f14300b6ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f14200097c0 tx=0x7f142001c390 comp rx=0 tx=0).stop 2024-04-26T23:47:37.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f1437000640 1 -- 172.21.15.47:0/3893664182 shutdown_connections 2024-04-26T23:47:37.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f1437000640 1 --2- 172.21.15.47:0/3893664182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f14301577f0 0x7f14300b6ca0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f1437000640 1 -- 172.21.15.47:0/3893664182 >> 172.21.15.47:0/3893664182 conn(0x7f1430072a00 msgr2=0x7f14300b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:37.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f1437000640 1 -- 172.21.15.47:0/3893664182 shutdown_connections 2024-04-26T23:47:37.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.503+0000 7f1437000640 1 -- 172.21.15.47:0/3893664182 wait complete. 2024-04-26T23:47:37.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 Processor -- start 2024-04-26T23:47:37.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 -- start start 2024-04-26T23:47:37.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1430160590 0x7f143013b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1430161240 0x7f14300b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1430157c40 0x7f14301580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f143015f290 con 0x7f1430157c40 2024-04-26T23:47:37.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f143015f110 con 0x7f1430160590 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f143016aee0 con 0x7f1430161240 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1430157c40 0x7f14301580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1430157c40 0x7f14301580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42558/0 (socket says 172.21.15.47:42558) 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 -- 172.21.15.47:0/1486287668 learned_addr learned my addr 172.21.15.47:0/1486287668 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f142fe00640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1430160590 0x7f143013b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f142f400640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1430161240 0x7f14300b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 -- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1430161240 msgr2=0x7f14300b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1430161240 0x7f14300b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 -- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1430160590 msgr2=0x7f143013b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1430160590 0x7f143013b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 -- 172.21.15.47:0/1486287668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143013b8b0 con 0x7f1430157c40 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f142fe00640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1430160590 0x7f143013b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1435000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1430157c40 0x7f14301580d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f142800cc00 tx=0x7f142800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1427e00640 1 -- 172.21.15.47:0/1486287668 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142800ace0 con 0x7f1430157c40 2024-04-26T23:47:37.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1427e00640 1 -- 172.21.15.47:0/1486287668 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1428012400 con 0x7f1430157c40 2024-04-26T23:47:37.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1427e00640 1 -- 172.21.15.47:0/1486287668 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14280127f0 con 0x7f1430157c40 2024-04-26T23:47:37.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143014dbc0 con 0x7f1430157c40 2024-04-26T23:47:37.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f143014e180 con 0x7f1430157c40 2024-04-26T23:47:37.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.507+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1430069700 con 0x7f1430157c40 2024-04-26T23:47:37.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.511+0000 7f1427e00640 1 -- 172.21.15.47:0/1486287668 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f1428012990 con 0x7f1430157c40 2024-04-26T23:47:37.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.511+0000 7f1427e00640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1410068530 0x7f141006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.511+0000 7f1427e00640 1 -- 172.21.15.47:0/1486287668 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f14280874e0 con 0x7f1430157c40 2024-04-26T23:47:37.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.511+0000 7f142fe00640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1410068530 0x7f141006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.511+0000 7f142fe00640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1410068530 0x7f141006a9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f14200ad000 tx=0x7f1420008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.515+0000 7f1427e00640 1 -- 172.21.15.47:0/1486287668 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f14280182b0 con 0x7f1430157c40 2024-04-26T23:47:37.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.715+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone86260", "target": ["mon-mgr", ""]}) -- 0x7f14300b3710 con 0x7f1410068530 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.719+0000 7f1427e00640 1 -- 172.21.15.47:0/1486287668 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+272 (secure 0 0 0) 0x7f14300b3710 con 0x7f1410068530 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout: "status": { 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "failed", 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout: "source": { 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout: "volume": "cephfs", 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout: "subvolume": "subvol25160", 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout: "snapshot": "subvol_snap58040" 2024-04-26T23:47:37.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:47:37.727 INFO:teuthology.orchestra.run.smithi047.stdout: "failure": { 2024-04-26T23:47:37.727 INFO:teuthology.orchestra.run.smithi047.stdout: "errno": "2", 2024-04-26T23:47:37.727 INFO:teuthology.orchestra.run.smithi047.stdout: "error_msg": "snapshot 'subvol_snap58040' does not exist" 2024-04-26T23:47:37.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:37.727 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:47:37.727 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:47:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1410068530 msgr2=0x7f141006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1410068530 0x7f141006a9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f14200ad000 tx=0x7f1420008040 comp rx=0 tx=0).stop 2024-04-26T23:47:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1430157c40 msgr2=0x7f14301580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1430157c40 0x7f14301580d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f142800cc00 tx=0x7f142800a430 comp rx=0 tx=0).stop 2024-04-26T23:47:37.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 shutdown_connections 2024-04-26T23:47:37.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1410068530 0x7f141006a9f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1430157c40 0x7f14301580d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1430161240 0x7f14300b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 --2- 172.21.15.47:0/1486287668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1430160590 0x7f143013b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 >> 172.21.15.47:0/1486287668 conn(0x7f1430072a00 msgr2=0x7f143006e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:37.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 shutdown_connections 2024-04-26T23:47:37.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.723+0000 7f1437000640 1 -- 172.21.15.47:0/1486287668 wait complete. 2024-04-26T23:47:37.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone86260 --force 2024-04-26T23:47:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49da400640 1 Processor -- start 2024-04-26T23:47:37.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49da400640 1 -- start start 2024-04-26T23:47:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49da400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d415d0d0 0x7f49d40d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49da400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49d415d4b0 0x7f49d40d31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49da400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d40ce400 con 0x7f49d40cd840 2024-04-26T23:47:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49da400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f49d40cec30 con 0x7f49d415d4b0 2024-04-26T23:47:37.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49da400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f49d40ce670 con 0x7f49d415d0d0 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49cbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49d415d4b0 0x7f49d40d31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49d3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f49d40cd840 0x7f49d40cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36628/0 (socket says 172.21.15.47:36628) 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49d3e00640 1 -- 172.21.15.47:0/2730840655 learned_addr learned my addr 172.21.15.47:0/2730840655 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49d3400640 1 --2- 172.21.15.47:0/2730840655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d415d0d0 0x7f49d40d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49cbe00640 1 -- 172.21.15.47:0/2730840655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d415d0d0 msgr2=0x7f49d40d2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49cbe00640 1 --2- 172.21.15.47:0/2730840655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d415d0d0 0x7f49d40d2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49cbe00640 1 -- 172.21.15.47:0/2730840655 >> v1:172.21.15.47:6789/0 conn(0x7f49d40cd840 legacy=0x7f49d40cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49d2a00640 1 -- 172.21.15.47:0/2730840655 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013507899 0 0) 0x7f49d40ce400 con 0x7f49d40cd840 2024-04-26T23:47:37.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.887+0000 7f49cbe00640 1 -- 172.21.15.47:0/2730840655 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d40ce950 con 0x7f49d415d4b0 2024-04-26T23:47:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49cbe00640 1 --2- 172.21.15.47:0/2730840655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d40d31a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0097c0 tx=0x7f49bc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49583548d6c4d249 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49d2a00640 1 -- 172.21.15.47:0/2730840655 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0b0070 con 0x7f49d415d4b0 2024-04-26T23:47:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49d2a00640 1 -- 172.21.15.47:0/2730840655 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49bc0ab600 con 0x7f49d415d4b0 2024-04-26T23:47:37.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49d2a00640 1 -- 172.21.15.47:0/2730840655 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0ab9d0 con 0x7f49d415d4b0 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 -- 172.21.15.47:0/2730840655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 msgr2=0x7f49d40d31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 --2- 172.21.15.47:0/2730840655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d40d31a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f49bc0097c0 tx=0x7f49bc01c410 comp rx=0 tx=0).stop 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 -- 172.21.15.47:0/2730840655 shutdown_connections 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 --2- 172.21.15.47:0/2730840655 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d40d31a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 --2- 172.21.15.47:0/2730840655 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d415d0d0 0x7f49d40d2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 -- 172.21.15.47:0/2730840655 >> 172.21.15.47:0/2730840655 conn(0x7f49d409ba60 msgr2=0x7f49d409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 -- 172.21.15.47:0/2730840655 shutdown_connections 2024-04-26T23:47:37.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.891+0000 7f49da400640 1 -- 172.21.15.47:0/2730840655 wait complete. 2024-04-26T23:47:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 Processor -- start 2024-04-26T23:47:37.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 -- start start 2024-04-26T23:47:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d40cd840 0x7f49d4159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d415d0d0 0x7f49d4158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d4154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f49d40c7e80 con 0x7f49d415d4b0 2024-04-26T23:47:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f49d40c7d00 con 0x7f49d415d0d0 2024-04-26T23:47:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f49d40c8000 con 0x7f49d40cd840 2024-04-26T23:47:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d4154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d4154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42568/0 (socket says 172.21.15.47:42568) 2024-04-26T23:47:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 -- 172.21.15.47:0/3067717667 learned_addr learned my addr 172.21.15.47:0/3067717667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49cbe00640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d415d0d0 0x7f49d4158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d40cd840 0x7f49d4159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 -- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d40cd840 msgr2=0x7f49d4159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d40cd840 0x7f49d4159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 -- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d415d0d0 msgr2=0x7f49d4158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d415d0d0 0x7f49d4158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 -- 172.21.15.47:0/3067717667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d4158a90 con 0x7f49d415d4b0 2024-04-26T23:47:37.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49d3e00640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d4154700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c810 tx=0x7f49cc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49cb400640 1 -- 172.21.15.47:0/3067717667 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc018070 con 0x7f49d415d4b0 2024-04-26T23:47:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49cb400640 1 -- 172.21.15.47:0/3067717667 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc00a640 con 0x7f49d415d4b0 2024-04-26T23:47:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49cb400640 1 -- 172.21.15.47:0/3067717667 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00aa30 con 0x7f49d415d4b0 2024-04-26T23:47:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d4158d70 con 0x7f49d415d4b0 2024-04-26T23:47:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.895+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d4159330 con 0x7f49d415d4b0 2024-04-26T23:47:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.899+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d40695f0 con 0x7f49d415d4b0 2024-04-26T23:47:37.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.899+0000 7f49cb400640 1 -- 172.21.15.47:0/3067717667 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7f49cc01b070 con 0x7f49d415d4b0 2024-04-26T23:47:37.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.899+0000 7f49cb400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f49b0068530 0x7f49b006a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:37.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.899+0000 7f49cb400640 1 -- 172.21.15.47:0/3067717667 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f49cc086200 con 0x7f49d415d4b0 2024-04-26T23:47:37.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.899+0000 7f49d3400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f49b0068530 0x7f49b006a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:37.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.899+0000 7f49d3400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f49b0068530 0x7f49b006a9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009b60 tx=0x7f49c4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:37.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:37.903+0000 7f49cb400640 1 -- 172.21.15.47:0/3067717667 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49cc055f70 con 0x7f49d415d4b0 2024-04-26T23:47:38.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.095+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone86260", "force": true, "target": ["mon-mgr", ""]}) -- 0x7f49d40d3080 con 0x7f49b0068530 2024-04-26T23:47:38.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49cb400640 1 -- 172.21.15.47:0/3067717667 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f49d40d3080 con 0x7f49b0068530 2024-04-26T23:47:38.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f49b0068530 msgr2=0x7f49b006a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f49b0068530 0x7f49b006a9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009b60 tx=0x7f49c4009190 comp rx=0 tx=0).stop 2024-04-26T23:47:38.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 msgr2=0x7f49d4154700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d4154700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00c810 tx=0x7f49cc00ccd0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 shutdown_connections 2024-04-26T23:47:38.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f49b0068530 0x7f49b006a9f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49d415d4b0 0x7f49d4154700 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49d415d0d0 0x7f49d4158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 --2- 172.21.15.47:0/3067717667 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49d40cd840 0x7f49d4159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 >> 172.21.15.47:0/3067717667 conn(0x7f49d409ba60 msgr2=0x7f49d415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 shutdown_connections 2024-04-26T23:47:38.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.111+0000 7f49da400640 1 -- 172.21.15.47:0/3067717667 wait complete. 2024-04-26T23:47:38.120 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.117+0000 7f5e1b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.120 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.117+0000 7f5e1b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.120 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.117+0000 7f5e1b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.121 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.117+0000 7f5e1b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.121 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.117+0000 7f5e1b600640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.138 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.133+0000 7f5e1a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.138 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.133+0000 7f5e1a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.138 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.133+0000 7f5e1a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.138 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.133+0000 7f5e1a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.138 INFO:tasks.ceph.mgr.x.smithi203.stderr:2024-04-26T23:47:38.133+0000 7f5e1a200640 -1 client.0 error registering admin socket command: (17) File exists 2024-04-26T23:47:38.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol25160 2024-04-26T23:47:38.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.283+0000 7fc411400640 1 Processor -- start 2024-04-26T23:47:38.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.283+0000 7fc411400640 1 -- start start 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc411400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc40c06c660 0x7fc40c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc411400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc40c1601b0 0x7fc40c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc411400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c0b0bf0 con 0x7fc40c06ca40 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc411400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c160640 con 0x7fc40c1601b0 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc411400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c0b0e90 con 0x7fc40c06c660 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc410a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc40c1601b0 0x7fc40c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc403400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fc40c06ca40 0x7fc40c15faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36632/0 (socket says 172.21.15.47:36632) 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc403400640 1 -- 172.21.15.47:0/2638011485 learned_addr learned my addr 172.21.15.47:0/2638011485 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc40be00640 1 --2- 172.21.15.47:0/2638011485 >> v2:172.21.15.203:3300/0 conn(0x7fc40c06c660 0x7fc40c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc410a00640 1 -- 172.21.15.47:0/2638011485 >> v2:172.21.15.203:3300/0 conn(0x7fc40c06c660 msgr2=0x7fc40c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc410a00640 1 --2- 172.21.15.47:0/2638011485 >> v2:172.21.15.203:3300/0 conn(0x7fc40c06c660 0x7fc40c0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc410a00640 1 -- 172.21.15.47:0/2638011485 >> v1:172.21.15.47:6789/0 conn(0x7fc40c06ca40 legacy=0x7fc40c15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.287+0000 7fc410a00640 1 -- 172.21.15.47:0/2638011485 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c0b1170 con 0x7fc40c1601b0 2024-04-26T23:47:38.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc410a00640 1 --2- 172.21.15.47:0/2638011485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c1601b0 0x7fc40c158f00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc40c06cfa0 tx=0x7fc40401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ba0a9811363238 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc40b400640 1 -- 172.21.15.47:0/2638011485 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040b2070 con 0x7fc40c1601b0 2024-04-26T23:47:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc40b400640 1 -- 172.21.15.47:0/2638011485 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4040a5730 con 0x7fc40c1601b0 2024-04-26T23:47:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc40b400640 1 -- 172.21.15.47:0/2638011485 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040a5b00 con 0x7fc40c1601b0 2024-04-26T23:47:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- 172.21.15.47:0/2638011485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c1601b0 msgr2=0x7fc40c158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 --2- 172.21.15.47:0/2638011485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c1601b0 0x7fc40c158f00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc40c06cfa0 tx=0x7fc40401c870 comp rx=0 tx=0).stop 2024-04-26T23:47:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- 172.21.15.47:0/2638011485 shutdown_connections 2024-04-26T23:47:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 --2- 172.21.15.47:0/2638011485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c1601b0 0x7fc40c158f00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 --2- 172.21.15.47:0/2638011485 >> v2:172.21.15.203:3300/0 conn(0x7fc40c06c660 0x7fc40c0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- 172.21.15.47:0/2638011485 >> 172.21.15.47:0/2638011485 conn(0x7fc40c06d510 msgr2=0x7fc40c06d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- 172.21.15.47:0/2638011485 shutdown_connections 2024-04-26T23:47:38.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- 172.21.15.47:0/2638011485 wait complete. 2024-04-26T23:47:38.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 Processor -- start 2024-04-26T23:47:38.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- start start 2024-04-26T23:47:38.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c06c660 0x7fc40c0b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:38.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c06ca40 0x7fc40c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:38.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc40c1601b0 0x7fc40c15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:38.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c0b53a0 con 0x7fc40c06ca40 2024-04-26T23:47:38.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c070ef0 con 0x7fc40c06c660 2024-04-26T23:47:38.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc411400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc40c0d1920 con 0x7fc40c1601b0 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc403400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c06ca40 0x7fc40c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc403400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c06ca40 0x7fc40c15a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:42590/0 (socket says 172.21.15.47:42590) 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.291+0000 7fc403400640 1 -- 172.21.15.47:0/3278611332 learned_addr learned my addr 172.21.15.47:0/3278611332 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc410a00640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc40c1601b0 0x7fc40c15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc403400640 1 -- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc40c1601b0 msgr2=0x7fc40c15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc40be00640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c06c660 0x7fc40c0b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc403400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc40c1601b0 0x7fc40c15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc403400640 1 -- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c06c660 msgr2=0x7fc40c0b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc403400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c06c660 0x7fc40c0b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc403400640 1 -- 172.21.15.47:0/3278611332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c15c290 con 0x7fc40c06ca40 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc410a00640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc40c1601b0 0x7fc40c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc40be00640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c06c660 0x7fc40c0b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:38.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc403400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c06ca40 0x7fc40c15a620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c420 tx=0x7fc3f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:38.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc408c00640 1 -- 172.21.15.47:0/3278611332 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f4017070 con 0x7fc40c06ca40 2024-04-26T23:47:38.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc408c00640 1 -- 172.21.15.47:0/3278611332 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f4005cf0 con 0x7fc40c06ca40 2024-04-26T23:47:38.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc408c00640 1 -- 172.21.15.47:0/3278611332 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f40072f0 con 0x7fc40c06ca40 2024-04-26T23:47:38.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c15c570 con 0x7fc40c06ca40 2024-04-26T23:47:38.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c15c850 con 0x7fc40c06ca40 2024-04-26T23:47:38.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c069470 con 0x7fc40c06ca40 2024-04-26T23:47:38.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc408c00640 1 -- 172.21.15.47:0/3278611332 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 7) ==== 88140+0+0 (secure 0 0 0) 0x7fc3f401a070 con 0x7fc40c06ca40 2024-04-26T23:47:38.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc408c00640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc3e8068560 0x7fc3e806aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:38.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.295+0000 7fc408c00640 1 -- 172.21.15.47:0/3278611332 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7fc3f4085ff0 con 0x7fc40c06ca40 2024-04-26T23:47:38.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.299+0000 7fc40be00640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc3e8068560 0x7fc3e806aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:38.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.299+0000 7fc40be00640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc3e8068560 0x7fc3e806aa20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009ae0 tx=0x7fc3fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:38.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.299+0000 7fc408c00640 1 -- 172.21.15.47:0/3278611332 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc3f4056360 con 0x7fc40c06ca40 2024-04-26T23:47:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.491+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol25160", "target": ["mon-mgr", ""]}) -- 0x7fc40c15a340 con 0x7fc3e8068560 2024-04-26T23:47:38.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc408c00640 1 -- 172.21.15.47:0/3278611332 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc40c15a340 con 0x7fc3e8068560 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc3e8068560 msgr2=0x7fc3e806aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc3e8068560 0x7fc3e806aa20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009ae0 tx=0x7fc3fc008040 comp rx=0 tx=0).stop 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c06ca40 msgr2=0x7fc40c15a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c06ca40 0x7fc40c15a620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc3f400c420 tx=0x7fc3f400c8e0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 shutdown_connections 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc3e8068560 0x7fc3e806aa20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc40c1601b0 0x7fc40c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc40c06ca40 0x7fc40c15a620 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 --2- 172.21.15.47:0/3278611332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc40c06c660 0x7fc40c0b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 >> 172.21.15.47:0/3278611332 conn(0x7fc40c06d510 msgr2=0x7fc40c0af630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 shutdown_connections 2024-04-26T23:47:38.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38.519+0000 7fc411400640 1 -- 172.21.15.47:0/3278611332 wait complete. 2024-04-26T23:47:38.547 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-26T23:47:38.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:47:38.605 INFO:teuthology.orchestra.run.smithi047.stdout:3 2024-04-26T23:47:38.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:47:43.613 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-04-26T23:47:43.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T23:47:43.676 INFO:teuthology.orchestra.run.smithi047.stdout:2 2024-04-26T23:47:43.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:47:43.683 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:47:43.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:47:43.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:47:43.846 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:47:43.846 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:47:43.846 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:43.846 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:43.855 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:43.855 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:43.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:47:44.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6d400640 1 Processor -- start 2024-04-26T23:47:44.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6d400640 1 -- start start 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c6815f230 0x7f4c680cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c680d0220 0x7f4c680cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6d400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c680cd440 con 0x7f4c680b1de0 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6d400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4c680cd740 con 0x7f4c680d0220 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6d400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6806e200 con 0x7f4c6815f230 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c680d0220 0x7f4c680cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6ca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4c680d0220 0x7f4c680cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37970/0 (socket says 172.21.15.47:37970) 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6ca00640 1 -- 172.21.15.47:0/235868815 learned_addr learned my addr 172.21.15.47:0/235868815 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:44.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c67e00640 1 --2- 172.21.15.47:0/235868815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c6815f230 0x7f4c680cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6ca00640 1 -- 172.21.15.47:0/235868815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c6815f230 msgr2=0x7f4c680cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:44.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6ca00640 1 --2- 172.21.15.47:0/235868815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c6815f230 0x7f4c680cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6ca00640 1 -- 172.21.15.47:0/235868815 >> v1:172.21.15.203:6789/0 conn(0x7f4c680b1de0 legacy=0x7f4c680cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.099+0000 7f4c6ca00640 1 -- 172.21.15.47:0/235868815 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6806e4e0 con 0x7f4c680d0220 2024-04-26T23:47:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6ca00640 1 --2- 172.21.15.47:0/235868815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680cdbd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009e50 tx=0x7f4c6001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2dd003cab2ed03 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c67400640 1 -- 172.21.15.47:0/235868815 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c600b4070 con 0x7f4c680d0220 2024-04-26T23:47:44.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c67400640 1 -- 172.21.15.47:0/235868815 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c600af400 con 0x7f4c680d0220 2024-04-26T23:47:44.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c67400640 1 -- 172.21.15.47:0/235868815 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c600af7d0 con 0x7f4c680d0220 2024-04-26T23:47:44.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 -- 172.21.15.47:0/235868815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 msgr2=0x7f4c680cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 --2- 172.21.15.47:0/235868815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680cdbd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009e50 tx=0x7f4c6001f210 comp rx=0 tx=0).stop 2024-04-26T23:47:44.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 -- 172.21.15.47:0/235868815 shutdown_connections 2024-04-26T23:47:44.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 --2- 172.21.15.47:0/235868815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680cdbd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 --2- 172.21.15.47:0/235868815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c6815f230 0x7f4c680cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 -- 172.21.15.47:0/235868815 >> 172.21.15.47:0/235868815 conn(0x7f4c680b48e0 msgr2=0x7f4c680b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 -- 172.21.15.47:0/235868815 shutdown_connections 2024-04-26T23:47:44.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.103+0000 7f4c6d400640 1 -- 172.21.15.47:0/235868815 wait complete. 2024-04-26T23:47:44.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 Processor -- start 2024-04-26T23:47:44.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 -- start start 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c680b1de0 0x7f4c6815f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c6815f230 0x7f4c681f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6806e7c0 con 0x7f4c680d0220 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4c6815f610 con 0x7f4c6815f230 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4c6806e940 con 0x7f4c680b1de0 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37974/0 (socket says 172.21.15.47:37974) 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 -- 172.21.15.47:0/425696478 learned_addr learned my addr 172.21.15.47:0/425696478 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6ca00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c6815f230 0x7f4c681f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c67e00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c680b1de0 0x7f4c6815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 -- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c680b1de0 msgr2=0x7f4c6815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c680b1de0 0x7f4c6815f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 -- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c6815f230 msgr2=0x7f4c681f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c6815f230 0x7f4c681f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 -- 172.21.15.47:0/425696478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c68162110 con 0x7f4c680d0220 2024-04-26T23:47:44.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c5fe00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680c7f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c370 tx=0x7f4c5000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c64c00640 1 -- 172.21.15.47:0/425696478 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c500052d0 con 0x7f4c680d0220 2024-04-26T23:47:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c64c00640 1 -- 172.21.15.47:0/425696478 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c50005470 con 0x7f4c680d0220 2024-04-26T23:47:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c64c00640 1 -- 172.21.15.47:0/425696478 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c50007260 con 0x7f4c680d0220 2024-04-26T23:47:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c68162380 con 0x7f4c680d0220 2024-04-26T23:47:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.107+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c68162940 con 0x7f4c680d0220 2024-04-26T23:47:44.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.111+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c68069b80 con 0x7f4c680d0220 2024-04-26T23:47:44.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.111+0000 7f4c64c00640 1 -- 172.21.15.47:0/425696478 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f4c50007400 con 0x7f4c680d0220 2024-04-26T23:47:44.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.111+0000 7f4c64c00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c44068650 0x7f4c4406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.111+0000 7f4c64c00640 1 -- 172.21.15.47:0/425696478 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f4c500861d0 con 0x7f4c680d0220 2024-04-26T23:47:44.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.111+0000 7f4c67e00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c44068650 0x7f4c4406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.111+0000 7f4c67e00640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c44068650 0x7f4c4406ab10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c6806d910 tx=0x7f4c58009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.115+0000 7f4c64c00640 1 -- 172.21.15.47:0/425696478 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4c50055e20 con 0x7f4c680d0220 2024-04-26T23:47:44.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.279+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c681f80f0 con 0x7f4c680d0220 2024-04-26T23:47:44.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c64c00640 1 -- 172.21.15.47:0/425696478 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16722 (secure 0 0 0) 0x7f4c5005a120 con 0x7f4c680d0220 2024-04-26T23:47:44.287 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:44.287 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:47:31.889557+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c44068650 msgr2=0x7f4c4406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c44068650 0x7f4c4406ab10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c6806d910 tx=0x7f4c58009190 comp rx=0 tx=0).stop 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 msgr2=0x7f4c680c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680c7f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c370 tx=0x7f4c5000c830 comp rx=0 tx=0).stop 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 shutdown_connections 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4c44068650 0x7f4c4406ab10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4c6815f230 0x7f4c681f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4c680d0220 0x7f4c680c7f70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 --2- 172.21.15.47:0/425696478 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4c680b1de0 0x7f4c6815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 >> 172.21.15.47:0/425696478 conn(0x7f4c680b48e0 msgr2=0x7f4c680b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:44.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 shutdown_connections 2024-04-26T23:47:44.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.283+0000 7f4c6d400640 1 -- 172.21.15.47:0/425696478 wait complete. 2024-04-26T23:47:44.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:46:32.386905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:46:33.526173+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:47:44.309 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:47:44.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1648600640 1 Processor -- start 2024-04-26T23:47:44.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1648600640 1 -- start start 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1648600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006c630 0x7f16400b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1648600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f164006ca10 0x7f1640073dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1648600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1640070420 con 0x7f16400720c0 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1648600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f164006e370 con 0x7f164006ca10 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1648600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f164006e650 con 0x7f164006c630 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1645200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f164006ca10 0x7f1640073dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1646600640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f16400720c0 0x7f1640072550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36878/0 (socket says 172.21.15.47:36878) 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1646600640 1 -- 172.21.15.47:0/2699808195 learned_addr learned my addr 172.21.15.47:0/2699808195 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1645c00640 1 --2- 172.21.15.47:0/2699808195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006c630 0x7f16400b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1645200640 1 -- 172.21.15.47:0/2699808195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006c630 msgr2=0x7f16400b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1645200640 1 --2- 172.21.15.47:0/2699808195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006c630 0x7f16400b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1645200640 1 -- 172.21.15.47:0/2699808195 >> v1:172.21.15.47:6789/0 conn(0x7f16400720c0 legacy=0x7f1640072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f1645200640 1 -- 172.21.15.47:0/2699808195 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164006e930 con 0x7f164006ca10 2024-04-26T23:47:44.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.447+0000 7f163fe00640 1 -- 172.21.15.47:0/2699808195 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920738325 0 0) 0x7f16380014a0 con 0x7f16400720c0 2024-04-26T23:47:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1645200640 1 --2- 172.21.15.47:0/2699808195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006ca10 0x7f1640073dd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f162c0097c0 tx=0x7f162c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cd287e4b0986ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f163fe00640 1 -- 172.21.15.47:0/2699808195 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c0b2070 con 0x7f164006ca10 2024-04-26T23:47:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f163fe00640 1 -- 172.21.15.47:0/2699808195 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162c0ad640 con 0x7f164006ca10 2024-04-26T23:47:44.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f163fe00640 1 -- 172.21.15.47:0/2699808195 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c0ada10 con 0x7f164006ca10 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 -- 172.21.15.47:0/2699808195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006ca10 msgr2=0x7f1640073dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 --2- 172.21.15.47:0/2699808195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006ca10 0x7f1640073dd0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f162c0097c0 tx=0x7f162c01c4a0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 -- 172.21.15.47:0/2699808195 shutdown_connections 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 --2- 172.21.15.47:0/2699808195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006ca10 0x7f1640073dd0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 --2- 172.21.15.47:0/2699808195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006c630 0x7f16400b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 -- 172.21.15.47:0/2699808195 >> 172.21.15.47:0/2699808195 conn(0x7f16400b2b70 msgr2=0x7f16400b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 -- 172.21.15.47:0/2699808195 shutdown_connections 2024-04-26T23:47:44.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.451+0000 7f1648600640 1 -- 172.21.15.47:0/2699808195 wait complete. 2024-04-26T23:47:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 Processor -- start 2024-04-26T23:47:44.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 -- start start 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006c630 0x7f16401603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006ca10 0x7f1640144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16400720c0 0x7f1640140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f164006ce70 con 0x7f164006c630 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16400add90 con 0x7f16400720c0 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1640148040 con 0x7f164006ca10 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006c630 0x7f16401603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006c630 0x7f16401603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37996/0 (socket says 172.21.15.47:37996) 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 -- 172.21.15.47:0/2135851466 learned_addr learned my addr 172.21.15.47:0/2135851466 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645200640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006ca10 0x7f1640144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1646600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16400720c0 0x7f1640140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 -- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006ca10 msgr2=0x7f1640144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006ca10 0x7f1640144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 -- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16400720c0 msgr2=0x7f1640140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16400720c0 0x7f1640140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 -- 172.21.15.47:0/2135851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16400cfce0 con 0x7f164006c630 2024-04-26T23:47:44.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1645c00640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006c630 0x7f16401603f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f163400d5f0 tx=0x7f163400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f163d600640 1 -- 172.21.15.47:0/2135851466 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16340125f0 con 0x7f164006c630 2024-04-26T23:47:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f163d600640 1 -- 172.21.15.47:0/2135851466 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1634019070 con 0x7f164006c630 2024-04-26T23:47:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16400cfa00 con 0x7f164006c630 2024-04-26T23:47:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f163d600640 1 -- 172.21.15.47:0/2135851466 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16340129b0 con 0x7f164006c630 2024-04-26T23:47:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16401619b0 con 0x7f164006c630 2024-04-26T23:47:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.455+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1640069700 con 0x7f164006c630 2024-04-26T23:47:44.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.459+0000 7f163d600640 1 -- 172.21.15.47:0/2135851466 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f1634012b50 con 0x7f164006c630 2024-04-26T23:47:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.459+0000 7f163d600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1620068680 0x7f162006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.459+0000 7f163d600640 1 -- 172.21.15.47:0/2135851466 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f1634087270 con 0x7f164006c630 2024-04-26T23:47:44.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.459+0000 7f1645200640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1620068680 0x7f162006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.459+0000 7f1645200640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1620068680 0x7f162006ab40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f162c0af000 tx=0x7f162c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.463+0000 7f163d600640 1 -- 172.21.15.47:0/2135851466 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1634057480 con 0x7f164006c630 2024-04-26T23:47:44.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.627+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1640072a40 con 0x7f164006c630 2024-04-26T23:47:44.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.627+0000 7f163d600640 1 -- 172.21.15.47:0/2135851466 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7f1634056d80 con 0x7f164006c630 2024-04-26T23:47:44.634 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:47:44.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1620068680 msgr2=0x7f162006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1620068680 0x7f162006ab40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f162c0af000 tx=0x7f162c0a7070 comp rx=0 tx=0).stop 2024-04-26T23:47:44.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006c630 msgr2=0x7f16401603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006c630 0x7f16401603f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f163400d5f0 tx=0x7f163400dab0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 shutdown_connections 2024-04-26T23:47:44.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1620068680 0x7f162006ab40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16400720c0 0x7f1640140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f164006ca10 0x7f1640144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 --2- 172.21.15.47:0/2135851466 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f164006c630 0x7f16401603f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 >> 172.21.15.47:0/2135851466 conn(0x7f16400b2b70 msgr2=0x7f16400b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:44.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 shutdown_connections 2024-04-26T23:47:44.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.631+0000 7f1648600640 1 -- 172.21.15.47:0/2135851466 wait complete. 2024-04-26T23:47:44.656 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:47:44.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 Processor -- start 2024-04-26T23:47:44.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 -- start start 2024-04-26T23:47:44.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f309c06ea90 0x7f309c0729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f309c0b55a0 0x7f309c072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f309c06f000 con 0x7f309c06ea90 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f309c06f2e0 con 0x7f309c0b55a0 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f30a2200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f309c06f5c0 con 0x7f309c162970 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f309c06ea90 0x7f309c0729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f309c06ea90 0x7f309c0729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38004/0 (socket says 172.21.15.47:38004) 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 -- 172.21.15.47:0/1741638322 learned_addr learned my addr 172.21.15.47:0/1741638322 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f309b400640 1 --2- 172.21.15.47:0/1741638322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f309be00640 1 --2- 172.21.15.47:0/1741638322 >> v2:172.21.15.203:3300/0 conn(0x7f309c0b55a0 0x7f309c072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 -- 172.21.15.47:0/1741638322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 msgr2=0x7f309c0700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 --2- 172.21.15.47:0/1741638322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c0700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 -- 172.21.15.47:0/1741638322 >> v2:172.21.15.203:3300/0 conn(0x7f309c0b55a0 msgr2=0x7f309c072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 --2- 172.21.15.47:0/1741638322 >> v2:172.21.15.203:3300/0 conn(0x7f309c0b55a0 0x7f309c072ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.795+0000 7f3092a00640 1 -- 172.21.15.47:0/1741638322 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c06f8a0 con 0x7f309c06ea90 2024-04-26T23:47:44.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f3092a00640 1 --2- 172.21.15.47:0/1741638322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c06ea90 0x7f309c0729a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f309c0b44d0 tx=0x7f308401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d4e7e5c438d12d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f309aa00640 1 -- 172.21.15.47:0/1741638322 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30840aa430 con 0x7f309c06ea90 2024-04-26T23:47:44.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f309aa00640 1 -- 172.21.15.47:0/1741638322 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30840af070 con 0x7f309c06ea90 2024-04-26T23:47:44.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f309aa00640 1 -- 172.21.15.47:0/1741638322 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30840aa7f0 con 0x7f309c06ea90 2024-04-26T23:47:44.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 -- 172.21.15.47:0/1741638322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c06ea90 msgr2=0x7f309c0729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 --2- 172.21.15.47:0/1741638322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c06ea90 0x7f309c0729a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f309c0b44d0 tx=0x7f308401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 -- 172.21.15.47:0/1741638322 shutdown_connections 2024-04-26T23:47:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 --2- 172.21.15.47:0/1741638322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c06ea90 0x7f309c0729a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 --2- 172.21.15.47:0/1741638322 >> v2:172.21.15.203:3300/0 conn(0x7f309c0b55a0 0x7f309c072ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 --2- 172.21.15.47:0/1741638322 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c0700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 -- 172.21.15.47:0/1741638322 >> 172.21.15.47:0/1741638322 conn(0x7f309c070c00 msgr2=0x7f309c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 -- 172.21.15.47:0/1741638322 shutdown_connections 2024-04-26T23:47:44.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 -- 172.21.15.47:0/1741638322 wait complete. 2024-04-26T23:47:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 Processor -- start 2024-04-26T23:47:44.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.799+0000 7f30a2200640 1 -- start start 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f309c06ea90 0x7f309c15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c0b55a0 0x7f309c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c13da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f309c0b49c0 con 0x7f309c0b55a0 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f309c0b4840 con 0x7f309c06ea90 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f309c0cbd70 con 0x7f309c162970 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c0b55a0 0x7f309c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c0b55a0 0x7f309c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38010/0 (socket says 172.21.15.47:38010) 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 -- 172.21.15.47:0/1403886010 learned_addr learned my addr 172.21.15.47:0/1403886010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f309be00640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c13da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f309b400640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f309c06ea90 0x7f309c15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 -- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 msgr2=0x7f309c13da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c13da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 -- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f309c06ea90 msgr2=0x7f309c15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f309c06ea90 0x7f309c15dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 -- 172.21.15.47:0/1403886010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c15bec0 con 0x7f309c0b55a0 2024-04-26T23:47:44.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3092a00640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c0b55a0 0x7f309c154da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f30840ac040 tx=0x7f308401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3093e00640 1 -- 172.21.15.47:0/1403886010 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30840bd5f0 con 0x7f309c0b55a0 2024-04-26T23:47:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3093e00640 1 -- 172.21.15.47:0/1403886010 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30840bd790 con 0x7f309c0b55a0 2024-04-26T23:47:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f3093e00640 1 -- 172.21.15.47:0/1403886010 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30840bdb40 con 0x7f309c0b55a0 2024-04-26T23:47:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c15c1a0 con 0x7f309c0b55a0 2024-04-26T23:47:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c15e510 con 0x7f309c0b55a0 2024-04-26T23:47:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.803+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309c069700 con 0x7f309c0b55a0 2024-04-26T23:47:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.807+0000 7f3093e00640 1 -- 172.21.15.47:0/1403886010 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f30840b33f0 con 0x7f309c0b55a0 2024-04-26T23:47:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.807+0000 7f3093e00640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3078068650 0x7f307806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.807+0000 7f3093e00640 1 -- 172.21.15.47:0/1403886010 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f3084121050 con 0x7f309c0b55a0 2024-04-26T23:47:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.807+0000 7f309b400640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3078068650 0x7f307806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:44.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.807+0000 7f309b400640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3078068650 0x7f307806ab10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f308c009ac0 tx=0x7f308c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:44.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.811+0000 7f3093e00640 1 -- 172.21.15.47:0/1403886010 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3084016110 con 0x7f309c0b55a0 2024-04-26T23:47:44.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f309c156bf0 con 0x7f309c0b55a0 2024-04-26T23:47:44.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f3093e00640 1 -- 172.21.15.47:0/1403886010 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) ==== 104+0+11 (secure 0 0 0) 0x7f30840f0bd0 con 0x7f309c0b55a0 2024-04-26T23:47:44.979 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:47:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3078068650 msgr2=0x7f307806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3078068650 0x7f307806ab10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f308c009ac0 tx=0x7f308c009190 comp rx=0 tx=0).stop 2024-04-26T23:47:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c0b55a0 msgr2=0x7f309c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:44.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c0b55a0 0x7f309c154da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f30840ac040 tx=0x7f308401ad30 comp rx=0 tx=0).stop 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 shutdown_connections 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3078068650 0x7f307806ab10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f309c162970 0x7f309c13da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f309c0b55a0 0x7f309c154da0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 --2- 172.21.15.47:0/1403886010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f309c06ea90 0x7f309c15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 >> 172.21.15.47:0/1403886010 conn(0x7f309c070c00 msgr2=0x7f309c0b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 shutdown_connections 2024-04-26T23:47:44.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:44.975+0000 7f30a2200640 1 -- 172.21.15.47:0/1403886010 wait complete. 2024-04-26T23:47:45.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:47:45.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.139+0000 7fead9400640 1 Processor -- start 2024-04-26T23:47:45.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.139+0000 7fead9400640 1 -- start start 2024-04-26T23:47:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead9400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fead40af810 0x7fead406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead9400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fead406cb70 0x7fead406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead9400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead40ae4a0 con 0x7fead414d140 2024-04-26T23:47:45.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead9400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fead406cfc0 con 0x7fead40af810 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead9400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fead40afc70 con 0x7fead406cb70 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7feacbe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fead40af810 0x7fead406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead2800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fead414d140 0x7fead40add90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36882/0 (socket says 172.21.15.47:36882) 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead2800640 1 -- 172.21.15.47:0/879493264 learned_addr learned my addr 172.21.15.47:0/879493264 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead3200640 1 --2- 172.21.15.47:0/879493264 >> v2:172.21.15.203:3300/0 conn(0x7fead406cb70 0x7fead406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7feacbe00640 1 -- 172.21.15.47:0/879493264 >> v2:172.21.15.203:3300/0 conn(0x7fead406cb70 msgr2=0x7fead406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7feacbe00640 1 --2- 172.21.15.47:0/879493264 >> v2:172.21.15.203:3300/0 conn(0x7fead406cb70 0x7fead406e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7feacbe00640 1 -- 172.21.15.47:0/879493264 >> v1:172.21.15.47:6789/0 conn(0x7fead414d140 legacy=0x7fead40add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7feacbe00640 1 -- 172.21.15.47:0/879493264 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead40ae770 con 0x7fead40af810 2024-04-26T23:47:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.143+0000 7fead1e00640 1 -- 172.21.15.47:0/879493264 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896791742 0 0) 0x7fead40ae4a0 con 0x7fead414d140 2024-04-26T23:47:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7feacbe00640 1 --2- 172.21.15.47:0/879493264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40af810 0x7fead406c630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fead406d370 tx=0x7feabc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d03101354622d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead1e00640 1 -- 172.21.15.47:0/879493264 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0ab430 con 0x7fead40af810 2024-04-26T23:47:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead1e00640 1 -- 172.21.15.47:0/879493264 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feabc0b0070 con 0x7fead40af810 2024-04-26T23:47:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead1e00640 1 -- 172.21.15.47:0/879493264 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0ab7f0 con 0x7fead40af810 2024-04-26T23:47:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 -- 172.21.15.47:0/879493264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40af810 msgr2=0x7fead406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 --2- 172.21.15.47:0/879493264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40af810 0x7fead406c630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fead406d370 tx=0x7feabc01c430 comp rx=0 tx=0).stop 2024-04-26T23:47:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 -- 172.21.15.47:0/879493264 shutdown_connections 2024-04-26T23:47:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 --2- 172.21.15.47:0/879493264 >> v2:172.21.15.203:3300/0 conn(0x7fead406cb70 0x7fead406e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 --2- 172.21.15.47:0/879493264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead40af810 0x7fead406c630 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 -- 172.21.15.47:0/879493264 >> 172.21.15.47:0/879493264 conn(0x7fead40b2b70 msgr2=0x7fead40b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:45.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 -- 172.21.15.47:0/879493264 shutdown_connections 2024-04-26T23:47:45.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 -- 172.21.15.47:0/879493264 wait complete. 2024-04-26T23:47:45.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 Processor -- start 2024-04-26T23:47:45.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.147+0000 7fead9400640 1 -- start start 2024-04-26T23:47:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead406cb70 0x7fead41482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead40af810 0x7fead4148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead414d140 0x7fead4142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fead40b5e80 con 0x7fead406cb70 2024-04-26T23:47:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fead40af2f0 con 0x7fead40af810 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fead40b6000 con 0x7fead414d140 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead406cb70 0x7fead41482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead406cb70 0x7fead41482e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38030/0 (socket says 172.21.15.47:38030) 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 -- 172.21.15.47:0/3820376823 learned_addr learned my addr 172.21.15.47:0/3820376823 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7feacbe00640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead40af810 0x7fead4148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead3200640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead414d140 0x7fead4142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 -- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead414d140 msgr2=0x7fead4142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead414d140 0x7fead4142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 -- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead40af810 msgr2=0x7fead4148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead40af810 0x7fead4148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 -- 172.21.15.47:0/3820376823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead4143860 con 0x7fead406cb70 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7feacbe00640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead40af810 0x7fead4148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead2800640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead406cb70 0x7fead41482e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feac400c4b0 tx=0x7feac400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7feacaa00640 1 -- 172.21.15.47:0/3820376823 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4018070 con 0x7fead406cb70 2024-04-26T23:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7feacaa00640 1 -- 172.21.15.47:0/3820376823 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac4007500 con 0x7fead406cb70 2024-04-26T23:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead4143b40 con 0x7fead406cb70 2024-04-26T23:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7feacaa00640 1 -- 172.21.15.47:0/3820376823 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4004a30 con 0x7fead406cb70 2024-04-26T23:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead4144100 con 0x7fead406cb70 2024-04-26T23:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead4069700 con 0x7fead406cb70 2024-04-26T23:47:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.151+0000 7feacaa00640 1 -- 172.21.15.47:0/3820376823 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7feac401b070 con 0x7fead406cb70 2024-04-26T23:47:45.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.155+0000 7feacaa00640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab0068650 0x7feab006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.155+0000 7feacaa00640 1 -- 172.21.15.47:0/3820376823 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7feac4085ff0 con 0x7fead406cb70 2024-04-26T23:47:45.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.155+0000 7feacbe00640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab0068650 0x7feab006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.155+0000 7feacbe00640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab0068650 0x7feab006ab10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feabc0af000 tx=0x7feabc0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:45.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.159+0000 7feacaa00640 1 -- 172.21.15.47:0/3820376823 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feac4055c80 con 0x7fead406cb70 2024-04-26T23:47:45.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fead4148f20 con 0x7fead406cb70 2024-04-26T23:47:45.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7feacaa00640 1 -- 172.21.15.47:0/3820376823 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) ==== 100+0+11 (secure 0 0 0) 0x7feac4059f80 con 0x7fead406cb70 2024-04-26T23:47:45.328 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:47:45.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab0068650 msgr2=0x7feab006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab0068650 0x7feab006ab10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feabc0af000 tx=0x7feabc0a7000 comp rx=0 tx=0).stop 2024-04-26T23:47:45.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead406cb70 msgr2=0x7fead41482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead406cb70 0x7fead41482e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7feac400c4b0 tx=0x7feac400c970 comp rx=0 tx=0).stop 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 shutdown_connections 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab0068650 0x7feab006ab10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead414d140 0x7fead4142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead40af810 0x7fead4148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 --2- 172.21.15.47:0/3820376823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead406cb70 0x7fead41482e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 >> 172.21.15.47:0/3820376823 conn(0x7fead40b2b70 msgr2=0x7fead40b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 shutdown_connections 2024-04-26T23:47:45.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.323+0000 7fead9400640 1 -- 172.21.15.47:0/3820376823 wait complete. 2024-04-26T23:47:45.350 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:47:45.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddf0800640 1 Processor -- start 2024-04-26T23:47:45.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddf0800640 1 -- start start 2024-04-26T23:47:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddf0800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdde806cd40 0x7fdde815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddf0800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde80aea30 con 0x7fdde80af7f0 2024-04-26T23:47:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddf0800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde80aed10 con 0x7fdde8159b70 2024-04-26T23:47:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddf0800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdde80af360 con 0x7fdde806cd40 2024-04-26T23:47:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddee800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdde80af7f0 0x7fdde81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36884/0 (socket says 172.21.15.47:36884) 2024-04-26T23:47:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddee800640 1 -- 172.21.15.47:0/1397988276 learned_addr learned my addr 172.21.15.47:0/1397988276 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:45.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fdded400640 1 --2- 172.21.15.47:0/1397988276 >> v2:172.21.15.203:3300/0 conn(0x7fdde806cd40 0x7fdde815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddeca00640 1 -- 172.21.15.47:0/1397988276 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380996204 0 0) 0x7fdde80aea30 con 0x7fdde80af7f0 2024-04-26T23:47:45.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddeca00640 1 -- 172.21.15.47:0/1397988276 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddd0003530 con 0x7fdde80af7f0 2024-04-26T23:47:45.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fdded400640 1 -- 172.21.15.47:0/1397988276 >> v1:172.21.15.203:6789/0 conn(0x7fdde8159b70 legacy=0x7fdde806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fdded400640 1 -- 172.21.15.47:0/1397988276 >> v1:172.21.15.47:6789/0 conn(0x7fdde80af7f0 legacy=0x7fdde81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fddeca00640 1 -- 172.21.15.47:0/1397988276 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724684186 0 0) 0x7fdde80aed10 con 0x7fdde8159b70 2024-04-26T23:47:45.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.487+0000 7fdded400640 1 -- 172.21.15.47:0/1397988276 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde80aeff0 con 0x7fdde806cd40 2024-04-26T23:47:45.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fdded400640 1 --2- 172.21.15.47:0/1397988276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 0x7fdde815fca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fddd80097c0 tx=0x7fddd801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5476bf9d3111dd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:45.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddeca00640 1 -- 172.21.15.47:0/1397988276 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80aa620 con 0x7fdde806cd40 2024-04-26T23:47:45.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddeca00640 1 -- 172.21.15.47:0/1397988276 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd80af070 con 0x7fdde806cd40 2024-04-26T23:47:45.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddeca00640 1 -- 172.21.15.47:0/1397988276 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80aa9e0 con 0x7fdde806cd40 2024-04-26T23:47:45.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddf0800640 1 -- 172.21.15.47:0/1397988276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 msgr2=0x7fdde815fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddf0800640 1 --2- 172.21.15.47:0/1397988276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 0x7fdde815fca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fddd80097c0 tx=0x7fddd801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddf0800640 1 -- 172.21.15.47:0/1397988276 shutdown_connections 2024-04-26T23:47:45.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddf0800640 1 --2- 172.21.15.47:0/1397988276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 0x7fdde815fca0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddf0800640 1 -- 172.21.15.47:0/1397988276 >> 172.21.15.47:0/1397988276 conn(0x7fdde80b2d40 msgr2=0x7fdde80b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:45.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddf0800640 1 -- 172.21.15.47:0/1397988276 shutdown_connections 2024-04-26T23:47:45.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.491+0000 7fddf0800640 1 -- 172.21.15.47:0/1397988276 wait complete. 2024-04-26T23:47:45.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 Processor -- start 2024-04-26T23:47:45.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 -- start start 2024-04-26T23:47:45.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 0x7fdde814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdde80af7f0 0x7fdde81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdde8159b70 0x7fdde8073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdde8072240 con 0x7fdde80af7f0 2024-04-26T23:47:45.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80720c0 con 0x7fdde806cd40 2024-04-26T23:47:45.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdde80723c0 con 0x7fdde8159b70 2024-04-26T23:47:45.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdde80af7f0 0x7fdde81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdde80af7f0 0x7fdde81513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38034/0 (socket says 172.21.15.47:38034) 2024-04-26T23:47:45.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 -- 172.21.15.47:0/2578372795 learned_addr learned my addr 172.21.15.47:0/2578372795 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:45.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddede00640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 0x7fdde814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddee800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdde8159b70 0x7fdde8073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 -- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdde8159b70 msgr2=0x7fdde8073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdde8159b70 0x7fdde8073010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 -- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 msgr2=0x7fdde814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 0x7fdde814b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 -- 172.21.15.47:0/2578372795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde814b9c0 con 0x7fdde80af7f0 2024-04-26T23:47:45.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddee800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdde8159b70 0x7fdde8073010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdded400640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdde80af7f0 0x7fdde81513c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fddd80ac040 tx=0x7fddd801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdde2000640 1 -- 172.21.15.47:0/2578372795 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80aac00 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdde2000640 1 -- 172.21.15.47:0/2578372795 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd80aada0 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde80b4e90 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fdde2000640 1 -- 172.21.15.47:0/2578372795 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd80be650 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.495+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde814fe50 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.499+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde80695f0 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.499+0000 7fdde2000640 1 -- 172.21.15.47:0/2578372795 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fddd80bc020 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.499+0000 7fdde2000640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fddcc068680 0x7fddcc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.499+0000 7fdde2000640 1 -- 172.21.15.47:0/2578372795 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7fddd8121290 con 0x7fdde80af7f0 2024-04-26T23:47:45.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.499+0000 7fddede00640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fddcc068680 0x7fddcc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.499+0000 7fddede00640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fddcc068680 0x7fddcc06ab40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdddc000f70 tx=0x7fdddc007dc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:45.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.503+0000 7fdde2000640 1 -- 172.21.15.47:0/2578372795 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdde814b9c0 con 0x7fdde80af7f0 2024-04-26T23:47:45.687 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdde80cd440 con 0x7fdde80af7f0 2024-04-26T23:47:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fdde2000640 1 -- 172.21.15.47:0/2578372795 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7fddd8016090 con 0x7fdde80af7f0 2024-04-26T23:47:45.688 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:47:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fddcc068680 msgr2=0x7fddcc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fddcc068680 0x7fddcc06ab40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdddc000f70 tx=0x7fdddc007dc0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdde80af7f0 msgr2=0x7fdde81513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdde80af7f0 0x7fdde81513c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fddd80ac040 tx=0x7fddd801ace0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 shutdown_connections 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fddcc068680 0x7fddcc06ab40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdde8159b70 0x7fdde8073010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdde80af7f0 0x7fdde81513c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 --2- 172.21.15.47:0/2578372795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdde806cd40 0x7fdde814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.683+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 >> 172.21.15.47:0/2578372795 conn(0x7fdde80b2d40 msgr2=0x7fdde80b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.687+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 shutdown_connections 2024-04-26T23:47:45.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.687+0000 7fddf0800640 1 -- 172.21.15.47:0/2578372795 wait complete. 2024-04-26T23:47:45.710 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-04-26T23:47:45.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:45.710 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:47:45.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:47:45.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:45.731 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:47:45.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[36576]: fuse finished with error 0 and tester_r 0 2024-04-26T23:47:45.789 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:47:45.790 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:47:45.790 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:45.800 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:47:45.800 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:45.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:47:45.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e30000640 1 Processor -- start 2024-04-26T23:47:45.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e30000640 1 -- start start 2024-04-26T23:47:45.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e30000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28160810 0x7f7e28071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e30000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7e280d1860 0x7f7e280cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e30000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e280cd830 con 0x7f7e28072150 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e30000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f7e28071080 con 0x7f7e280d1860 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e30000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7e28071360 con 0x7f7e28160810 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2e000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7e280d1860 0x7f7e280cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2e000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7e280d1860 0x7f7e280cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38040/0 (socket says 172.21.15.47:38040) 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2e000640 1 -- 172.21.15.47:0/942425509 learned_addr learned my addr 172.21.15.47:0/942425509 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2d600640 1 --2- 172.21.15.47:0/942425509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28160810 0x7f7e28071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2e000640 1 -- 172.21.15.47:0/942425509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28160810 msgr2=0x7f7e28071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2e000640 1 --2- 172.21.15.47:0/942425509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28160810 0x7f7e28071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2e000640 1 -- 172.21.15.47:0/942425509 >> v1:172.21.15.203:6789/0 conn(0x7f7e28072150 legacy=0x7f7e280d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.987+0000 7f7e2e000640 1 -- 172.21.15.47:0/942425509 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e280cdad0 con 0x7f7e280d1860 2024-04-26T23:47:45.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e2e000640 1 --2- 172.21.15.47:0/942425509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280cdff0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009e50 tx=0x7f7e2001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11321ad41c369092 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e27e00640 1 -- 172.21.15.47:0/942425509 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e200b4070 con 0x7f7e280d1860 2024-04-26T23:47:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e27e00640 1 -- 172.21.15.47:0/942425509 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e200af400 con 0x7f7e280d1860 2024-04-26T23:47:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e27e00640 1 -- 172.21.15.47:0/942425509 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e200af7d0 con 0x7f7e280d1860 2024-04-26T23:47:45.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 -- 172.21.15.47:0/942425509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 msgr2=0x7f7e280cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 --2- 172.21.15.47:0/942425509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280cdff0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009e50 tx=0x7f7e2001f210 comp rx=0 tx=0).stop 2024-04-26T23:47:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 -- 172.21.15.47:0/942425509 shutdown_connections 2024-04-26T23:47:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 --2- 172.21.15.47:0/942425509 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280cdff0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 --2- 172.21.15.47:0/942425509 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28160810 0x7f7e28071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 -- 172.21.15.47:0/942425509 >> 172.21.15.47:0/942425509 conn(0x7f7e280d2e90 msgr2=0x7f7e280d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 -- 172.21.15.47:0/942425509 shutdown_connections 2024-04-26T23:47:45.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.991+0000 7f7e30000640 1 -- 172.21.15.47:0/942425509 wait complete. 2024-04-26T23:47:45.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 Processor -- start 2024-04-26T23:47:45.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 -- start start 2024-04-26T23:47:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28072150 0x7f7e28157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e28160810 0x7f7e280c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28160bf0 con 0x7f7e280d1860 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e28071ca0 con 0x7f7e28160810 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7e28160d70 con 0x7f7e28072150 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38056/0 (socket says 172.21.15.47:38056) 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 -- 172.21.15.47:0/218575803 learned_addr learned my addr 172.21.15.47:0/218575803 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2d600640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28072150 0x7f7e28157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2e000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e28160810 0x7f7e280c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 -- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28072150 msgr2=0x7f7e28157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28072150 0x7f7e28157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 -- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e28160810 msgr2=0x7f7e280c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e28160810 0x7f7e280c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 -- 172.21.15.47:0/218575803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e281f3e20 con 0x7f7e280d1860 2024-04-26T23:47:46.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2e000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e28160810 0x7f7e280c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e2cc00640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280c8df0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c370 tx=0x7f7e1400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e25600640 1 -- 172.21.15.47:0/218575803 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e140052d0 con 0x7f7e280d1860 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e25600640 1 -- 172.21.15.47:0/218575803 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e14005470 con 0x7f7e280d1860 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e281f43e0 con 0x7f7e280d1860 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e25600640 1 -- 172.21.15.47:0/218575803 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e14007260 con 0x7f7e280d1860 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.995+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e281579a0 con 0x7f7e280d1860 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.999+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e28069700 con 0x7f7e280d1860 2024-04-26T23:47:46.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.999+0000 7f7e25600640 1 -- 172.21.15.47:0/218575803 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f7e14007400 con 0x7f7e280d1860 2024-04-26T23:47:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.999+0000 7f7e25600640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e080686a0 0x7f7e0806ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.999+0000 7f7e25600640 1 -- 172.21.15.47:0/218575803 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f7e14086140 con 0x7f7e280d1860 2024-04-26T23:47:46.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.999+0000 7f7e2d600640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e080686a0 0x7f7e0806ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:45.999+0000 7f7e2d600640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e080686a0 0x7f7e0806ab60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c007a60 tx=0x7f7e1c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.003+0000 7f7e25600640 1 -- 172.21.15.47:0/218575803 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7e14055e10 con 0x7f7e280d1860 2024-04-26T23:47:46.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.171+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e2815d900 con 0x7f7e280d1860 2024-04-26T23:47:46.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.171+0000 7f7e25600640 1 -- 172.21.15.47:0/218575803 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16722 (secure 0 0 0) 0x7f7e1405a110 con 0x7f7e280d1860 2024-04-26T23:47:46.178 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:46.178 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:47:31.889557+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e080686a0 msgr2=0x7f7e0806ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e080686a0 0x7f7e0806ab60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c007a60 tx=0x7f7e1c008040 comp rx=0 tx=0).stop 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 msgr2=0x7f7e280c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280c8df0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c370 tx=0x7f7e1400c830 comp rx=0 tx=0).stop 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 shutdown_connections 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7e080686a0 0x7f7e0806ab60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e28160810 0x7f7e280c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e280d1860 0x7f7e280c8df0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 --2- 172.21.15.47:0/218575803 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e28072150 0x7f7e28157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 >> 172.21.15.47:0/218575803 conn(0x7f7e280d2e90 msgr2=0x7f7e2815f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:46.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 shutdown_connections 2024-04-26T23:47:46.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.175+0000 7f7e30000640 1 -- 172.21.15.47:0/218575803 wait complete. 2024-04-26T23:47:46.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:46:32.386905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:46:33.526173+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:47:46.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:47:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7393c00640 1 Processor -- start 2024-04-26T23:47:46.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7393c00640 1 -- start start 2024-04-26T23:47:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7393c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c06c630 0x7f738c06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7393c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f738c160b50 0x7f738c160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7393c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f738c06cfd0 con 0x7f738c15cf50 2024-04-26T23:47:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7393c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f738c0af7a0 con 0x7f738c160b50 2024-04-26T23:47:46.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7393c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f738c0ae030 con 0x7f738c06c630 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7391200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f738c15cf50 0x7f738c0cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36900/0 (socket says 172.21.15.47:36900) 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7391200640 1 -- 172.21.15.47:0/1874420573 learned_addr learned my addr 172.21.15.47:0/1874420573 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7391c00640 1 --2- 172.21.15.47:0/1874420573 >> v2:172.21.15.47:3300/0 conn(0x7f738c160b50 0x7f738c160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7383e00640 1 --2- 172.21.15.47:0/1874420573 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c06c630 0x7f738c06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f738be00640 1 -- 172.21.15.47:0/1874420573 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567118922 0 0) 0x7f737c001120 con 0x7f738c15cf50 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f738be00640 1 -- 172.21.15.47:0/1874420573 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7370003530 con 0x7f738c15cf50 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7391c00640 1 -- 172.21.15.47:0/1874420573 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c06c630 msgr2=0x7f738c06ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7391c00640 1 --2- 172.21.15.47:0/1874420573 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c06c630 0x7f738c06ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7391c00640 1 -- 172.21.15.47:0/1874420573 >> v1:172.21.15.47:6789/0 conn(0x7f738c15cf50 legacy=0x7f738c0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7391c00640 1 -- 172.21.15.47:0/1874420573 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c0d0ae0 con 0x7f738c160b50 2024-04-26T23:47:46.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.339+0000 7f7383e00640 1 --2- 172.21.15.47:0/1874420573 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c06c630 0x7f738c06ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7391c00640 1 --2- 172.21.15.47:0/1874420573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c160b50 0x7f738c160fe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7384009d90 tx=0x7f738401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ee03a080ace53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f738be00640 1 -- 172.21.15.47:0/1874420573 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73840b2070 con 0x7f738c160b50 2024-04-26T23:47:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f738be00640 1 -- 172.21.15.47:0/1874420573 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73840a5920 con 0x7f738c160b50 2024-04-26T23:47:46.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f738be00640 1 -- 172.21.15.47:0/1874420573 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73840a5cf0 con 0x7f738c160b50 2024-04-26T23:47:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 -- 172.21.15.47:0/1874420573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c160b50 msgr2=0x7f738c160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 --2- 172.21.15.47:0/1874420573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c160b50 0x7f738c160fe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7384009d90 tx=0x7f738401c970 comp rx=0 tx=0).stop 2024-04-26T23:47:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 -- 172.21.15.47:0/1874420573 shutdown_connections 2024-04-26T23:47:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 --2- 172.21.15.47:0/1874420573 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c160b50 0x7f738c160fe0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 --2- 172.21.15.47:0/1874420573 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c06c630 0x7f738c06ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 -- 172.21.15.47:0/1874420573 >> 172.21.15.47:0/1874420573 conn(0x7f738c0b2b70 msgr2=0x7f738c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 -- 172.21.15.47:0/1874420573 shutdown_connections 2024-04-26T23:47:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.343+0000 7f7393c00640 1 -- 172.21.15.47:0/1874420573 wait complete. 2024-04-26T23:47:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 Processor -- start 2024-04-26T23:47:46.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 -- start start 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c06c630 0x7f738c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f738c15cf50 0x7f738c09cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c160b50 0x7f738c09d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f738c161930 con 0x7f738c06c630 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f738c15d330 con 0x7f738c15cf50 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f738c161ab0 con 0x7f738c160b50 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c06c630 0x7f738c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c06c630 0x7f738c14bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38070/0 (socket says 172.21.15.47:38070) 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 -- 172.21.15.47:0/3080802767 learned_addr learned my addr 172.21.15.47:0/3080802767 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391c00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c160b50 0x7f738c09d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7383e00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f738c15cf50 0x7f738c09cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 -- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c160b50 msgr2=0x7f738c09d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c160b50 0x7f738c09d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 -- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f738c15cf50 msgr2=0x7f738c09cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f738c15cf50 0x7f738c09cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 -- 172.21.15.47:0/3080802767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c09daf0 con 0x7f738c06c630 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7391200640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c06c630 0x7f738c14bfd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f737c00c760 tx=0x7f737c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7389600640 1 -- 172.21.15.47:0/3080802767 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c017070 con 0x7f738c06c630 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7389600640 1 -- 172.21.15.47:0/3080802767 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f737c005ae0 con 0x7f738c06c630 2024-04-26T23:47:46.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7389600640 1 -- 172.21.15.47:0/3080802767 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737c007e30 con 0x7f738c06c630 2024-04-26T23:47:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c09ddd0 con 0x7f738c06c630 2024-04-26T23:47:46.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c09e390 con 0x7f738c06c630 2024-04-26T23:47:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.347+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c069700 con 0x7f738c06c630 2024-04-26T23:47:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.351+0000 7f7389600640 1 -- 172.21.15.47:0/3080802767 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f737c01a070 con 0x7f738c06c630 2024-04-26T23:47:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.351+0000 7f7389600640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7368068650 0x7f736806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.351+0000 7f7389600640 1 -- 172.21.15.47:0/3080802767 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f737c086240 con 0x7f738c06c630 2024-04-26T23:47:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.351+0000 7f7383e00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7368068650 0x7f736806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.351+0000 7f7383e00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7368068650 0x7f736806ab10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f738c153190 tx=0x7f7374008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.355+0000 7f7389600640 1 -- 172.21.15.47:0/3080802767 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f738c06cfd0 con 0x7f738c06c630 2024-04-26T23:47:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.515+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f738c073d50 con 0x7f738c06c630 2024-04-26T23:47:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7389600640 1 -- 172.21.15.47:0/3080802767 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7f737c056450 con 0x7f738c06c630 2024-04-26T23:47:46.523 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:47:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7368068650 msgr2=0x7f736806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7368068650 0x7f736806ab10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f738c153190 tx=0x7f7374008040 comp rx=0 tx=0).stop 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c06c630 msgr2=0x7f738c14bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c06c630 0x7f738c14bfd0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f737c00c760 tx=0x7f737c00cc20 comp rx=0 tx=0).stop 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 shutdown_connections 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7368068650 0x7f736806ab10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f738c160b50 0x7f738c09d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f738c15cf50 0x7f738c09cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 --2- 172.21.15.47:0/3080802767 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f738c06c630 0x7f738c14bfd0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 >> 172.21.15.47:0/3080802767 conn(0x7f738c0b2b70 msgr2=0x7f738c0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 shutdown_connections 2024-04-26T23:47:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.519+0000 7f7393c00640 1 -- 172.21.15.47:0/3080802767 wait complete. 2024-04-26T23:47:46.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:47:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6aece00640 1 Processor -- start 2024-04-26T23:47:46.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6aece00640 1 -- start start 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6aece00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6ae8162970 0x7f6ae80700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6aece00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6ae80730b0 0x7f6ae80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6aece00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae806f000 con 0x7f6ae806ea90 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6aece00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae806f2e0 con 0x7f6ae80730b0 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6aece00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae806f5c0 con 0x7f6ae8162970 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae6800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6ae80730b0 0x7f6ae80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6adfe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6ae806ea90 0x7f6ae80729a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36916/0 (socket says 172.21.15.47:36916) 2024-04-26T23:47:46.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6adfe00640 1 -- 172.21.15.47:0/4063638155 learned_addr learned my addr 172.21.15.47:0/4063638155 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae5e00640 1 --2- 172.21.15.47:0/4063638155 >> v2:172.21.15.203:3300/0 conn(0x7f6ae8162970 0x7f6ae80700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae6800640 1 -- 172.21.15.47:0/4063638155 >> v2:172.21.15.203:3300/0 conn(0x7f6ae8162970 msgr2=0x7f6ae80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae6800640 1 --2- 172.21.15.47:0/4063638155 >> v2:172.21.15.203:3300/0 conn(0x7f6ae8162970 0x7f6ae80700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae6800640 1 -- 172.21.15.47:0/4063638155 >> v1:172.21.15.47:6789/0 conn(0x7f6ae806ea90 legacy=0x7f6ae80729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae5400640 1 -- 172.21.15.47:0/4063638155 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413165772 0 0) 0x7f6ae806f000 con 0x7f6ae806ea90 2024-04-26T23:47:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae6800640 1 -- 172.21.15.47:0/4063638155 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae806f8a0 con 0x7f6ae80730b0 2024-04-26T23:47:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.683+0000 7f6ae5e00640 1 --2- 172.21.15.47:0/4063638155 >> v2:172.21.15.203:3300/0 conn(0x7f6ae8162970 0x7f6ae80700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:46.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6ae6800640 1 --2- 172.21.15.47:0/4063638155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae80730b0 0x7f6ae80cb560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8071530 tx=0x7f6ae001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a23155902132060 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6ae5400640 1 -- 172.21.15.47:0/4063638155 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00b2070 con 0x7f6ae80730b0 2024-04-26T23:47:46.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6ae5400640 1 -- 172.21.15.47:0/4063638155 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae00a59e0 con 0x7f6ae80730b0 2024-04-26T23:47:46.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6ae5400640 1 -- 172.21.15.47:0/4063638155 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00a5db0 con 0x7f6ae80730b0 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 -- 172.21.15.47:0/4063638155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae80730b0 msgr2=0x7f6ae80cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 --2- 172.21.15.47:0/4063638155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae80730b0 0x7f6ae80cb560 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8071530 tx=0x7f6ae001c900 comp rx=0 tx=0).stop 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 -- 172.21.15.47:0/4063638155 shutdown_connections 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 --2- 172.21.15.47:0/4063638155 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae80730b0 0x7f6ae80cb560 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 --2- 172.21.15.47:0/4063638155 >> v2:172.21.15.203:3300/0 conn(0x7f6ae8162970 0x7f6ae80700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 -- 172.21.15.47:0/4063638155 >> 172.21.15.47:0/4063638155 conn(0x7f6ae8070c00 msgr2=0x7f6ae806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 -- 172.21.15.47:0/4063638155 shutdown_connections 2024-04-26T23:47:46.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.687+0000 7f6aece00640 1 -- 172.21.15.47:0/4063638155 wait complete. 2024-04-26T23:47:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 Processor -- start 2024-04-26T23:47:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 -- start start 2024-04-26T23:47:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ae806ea90 0x7f6ae8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ae80730b0 0x7f6ae814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae8162970 0x7f6ae813fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae80b49c0 con 0x7f6ae8162970 2024-04-26T23:47:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae80b4840 con 0x7f6ae806ea90 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae816c0b0 con 0x7f6ae80730b0 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae8162970 0x7f6ae813fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae8162970 0x7f6ae813fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38094/0 (socket says 172.21.15.47:38094) 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 -- 172.21.15.47:0/2369894489 learned_addr learned my addr 172.21.15.47:0/2369894489 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae5e00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ae806ea90 0x7f6ae8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6adfe00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ae80730b0 0x7f6ae814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 -- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ae80730b0 msgr2=0x7f6ae814ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ae80730b0 0x7f6ae814ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 -- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ae806ea90 msgr2=0x7f6ae8156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ae806ea90 0x7f6ae8156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 -- 172.21.15.47:0/2369894489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae814f310 con 0x7f6ae8162970 2024-04-26T23:47:46.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ae6800640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae8162970 0x7f6ae813fe40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0019510 tx=0x7f6ae00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ade000640 1 -- 172.21.15.47:0/2369894489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00b2050 con 0x7f6ae8162970 2024-04-26T23:47:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ade000640 1 -- 172.21.15.47:0/2369894489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae00b3040 con 0x7f6ae8162970 2024-04-26T23:47:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae8159f00 con 0x7f6ae8162970 2024-04-26T23:47:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6ade000640 1 -- 172.21.15.47:0/2369894489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae00ad850 con 0x7f6ae8162970 2024-04-26T23:47:46.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.691+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae815a4c0 con 0x7f6ae8162970 2024-04-26T23:47:46.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.695+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae8069700 con 0x7f6ae8162970 2024-04-26T23:47:46.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.695+0000 7f6ade000640 1 -- 172.21.15.47:0/2369894489 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f6ae00c0020 con 0x7f6ae8162970 2024-04-26T23:47:46.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.695+0000 7f6ade000640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6ac4068650 0x7f6ac406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:46.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.695+0000 7f6ade000640 1 -- 172.21.15.47:0/2369894489 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f6ae0121a50 con 0x7f6ae8162970 2024-04-26T23:47:46.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.695+0000 7f6ae5e00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6ac4068650 0x7f6ac406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:46.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.695+0000 7f6ae5e00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6ac4068650 0x7f6ac406ab10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006fd0 tx=0x7f6ad8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:46.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.699+0000 7f6ade000640 1 -- 172.21.15.47:0/2369894489 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6ae0016520 con 0x7f6ae8162970 2024-04-26T23:47:46.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.863+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6ae8159ad0 con 0x7f6ae8162970 2024-04-26T23:47:46.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.863+0000 7f6ade000640 1 -- 172.21.15.47:0/2369894489 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) ==== 104+0+11 (secure 0 0 0) 0x7f6ae00f1e10 con 0x7f6ae8162970 2024-04-26T23:47:46.870 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:47:46.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6ac4068650 msgr2=0x7f6ac406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6ac4068650 0x7f6ac406ab10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006fd0 tx=0x7f6ad8008040 comp rx=0 tx=0).stop 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae8162970 msgr2=0x7f6ae813fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae8162970 0x7f6ae813fe40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0019510 tx=0x7f6ae00196a0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 shutdown_connections 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6ac4068650 0x7f6ac406ab10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6ae8162970 0x7f6ae813fe40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6ae80730b0 0x7f6ae814ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 --2- 172.21.15.47:0/2369894489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ae806ea90 0x7f6ae8156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 >> 172.21.15.47:0/2369894489 conn(0x7f6ae8070c00 msgr2=0x7f6ae8155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 shutdown_connections 2024-04-26T23:47:46.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:46.867+0000 7f6aece00640 1 -- 172.21.15.47:0/2369894489 wait complete. 2024-04-26T23:47:46.892 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:47:47.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 Processor -- start 2024-04-26T23:47:47.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 -- start start 2024-04-26T23:47:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f006409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00640b56f0 0x7f006409bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f00640704d0 0x7f0064070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0064071620 con 0x7f00640b56f0 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f0064162e90 con 0x7f00640704d0 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0069000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f00640d2d40 con 0x7f0064162ab0 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00640b56f0 0x7f006409bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00640b56f0 0x7f006409bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38110/0 (socket says 172.21.15.47:38110) 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 -- 172.21.15.47:0/130320032 learned_addr learned my addr 172.21.15.47:0/130320032 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0061e00640 1 --2- 172.21.15.47:0/130320032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f006409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0062800640 1 --2- 172.21.15.47:0/130320032 >> v2:172.21.15.203:3300/0 conn(0x7f00640704d0 0x7f0064070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 -- 172.21.15.47:0/130320032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 msgr2=0x7f006409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 --2- 172.21.15.47:0/130320032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f006409ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 -- 172.21.15.47:0/130320032 >> v2:172.21.15.203:3300/0 conn(0x7f00640704d0 msgr2=0x7f0064070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 --2- 172.21.15.47:0/130320032 >> v2:172.21.15.203:3300/0 conn(0x7f00640704d0 0x7f0064070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.031+0000 7f0059400640 1 -- 172.21.15.47:0/130320032 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006406dfc0 con 0x7f00640b56f0 2024-04-26T23:47:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0059400640 1 --2- 172.21.15.47:0/130320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f006409bfa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f00640739f0 tx=0x7f004c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ccd12eaa42a99b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0061400640 1 -- 172.21.15.47:0/130320032 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b0070 con 0x7f00640b56f0 2024-04-26T23:47:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0061400640 1 -- 172.21.15.47:0/130320032 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c0ab600 con 0x7f00640b56f0 2024-04-26T23:47:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0061400640 1 -- 172.21.15.47:0/130320032 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0ab9d0 con 0x7f00640b56f0 2024-04-26T23:47:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 -- 172.21.15.47:0/130320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 msgr2=0x7f006409bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 --2- 172.21.15.47:0/130320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f006409bfa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f00640739f0 tx=0x7f004c01c490 comp rx=0 tx=0).stop 2024-04-26T23:47:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 -- 172.21.15.47:0/130320032 shutdown_connections 2024-04-26T23:47:47.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 --2- 172.21.15.47:0/130320032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f006409bfa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 --2- 172.21.15.47:0/130320032 >> v2:172.21.15.203:3300/0 conn(0x7f00640704d0 0x7f0064070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 --2- 172.21.15.47:0/130320032 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f006409ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 -- 172.21.15.47:0/130320032 >> 172.21.15.47:0/130320032 conn(0x7f00640b4c00 msgr2=0x7f00640b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:47.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 -- 172.21.15.47:0/130320032 shutdown_connections 2024-04-26T23:47:47.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 -- 172.21.15.47:0/130320032 wait complete. 2024-04-26T23:47:47.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 Processor -- start 2024-04-26T23:47:47.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.035+0000 7f0069000640 1 -- start start 2024-04-26T23:47:47.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00640704d0 0x7f0064150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f00640d0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f00640d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f00640721b0 con 0x7f00640b56f0 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f00640718e0 con 0x7f00640704d0 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0064072330 con 0x7f0064162ab0 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f00640d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f00640d0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38118/0 (socket says 172.21.15.47:38118) 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 -- 172.21.15.47:0/502930176 learned_addr learned my addr 172.21.15.47:0/502930176 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:47.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0062800640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f00640d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0061e00640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00640704d0 0x7f0064150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 -- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 msgr2=0x7f00640d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f00640d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 -- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00640704d0 msgr2=0x7f0064150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00640704d0 0x7f0064150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 -- 172.21.15.47:0/502930176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006415fc50 con 0x7f00640b56f0 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0059400640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f00640d0170 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f004c01ab40 tx=0x7f004c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f005aa00640 1 -- 172.21.15.47:0/502930176 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b0040 con 0x7f00640b56f0 2024-04-26T23:47:47.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f005aa00640 1 -- 172.21.15.47:0/502930176 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c0b4620 con 0x7f00640b56f0 2024-04-26T23:47:47.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f005aa00640 1 -- 172.21.15.47:0/502930176 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b4a10 con 0x7f00640b56f0 2024-04-26T23:47:47.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00640afe00 con 0x7f00640b56f0 2024-04-26T23:47:47.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00640b03c0 con 0x7f00640b56f0 2024-04-26T23:47:47.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.039+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0064069700 con 0x7f00640b56f0 2024-04-26T23:47:47.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.043+0000 7f005aa00640 1 -- 172.21.15.47:0/502930176 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f004c0ab4c0 con 0x7f00640b56f0 2024-04-26T23:47:47.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.043+0000 7f005aa00640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0040068680 0x7f004006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.043+0000 7f005aa00640 1 -- 172.21.15.47:0/502930176 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f004c120ad0 con 0x7f00640b56f0 2024-04-26T23:47:47.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.043+0000 7f0061e00640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0040068680 0x7f004006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.043+0000 7f0061e00640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0040068680 0x7f004006ab40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0054003fd0 tx=0x7f00540039a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:47.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.047+0000 7f005aa00640 1 -- 172.21.15.47:0/502930176 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f004c016110 con 0x7f00640b56f0 2024-04-26T23:47:47.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.215+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f00640b5cb0 con 0x7f00640b56f0 2024-04-26T23:47:47.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.215+0000 7f005aa00640 1 -- 172.21.15.47:0/502930176 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) ==== 100+0+11 (secure 0 0 0) 0x7f004c0f0c60 con 0x7f00640b56f0 2024-04-26T23:47:47.220 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.215+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0040068680 msgr2=0x7f004006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.215+0000 7f0069000640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0040068680 0x7f004006ab40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0054003fd0 tx=0x7f00540039a0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.215+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 msgr2=0x7f00640d0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.215+0000 7f0069000640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f00640d0170 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f004c01ab40 tx=0x7f004c019230 comp rx=0 tx=0).stop 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 shutdown_connections 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0040068680 0x7f004006ab40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0064162ab0 0x7f00640d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00640b56f0 0x7f00640d0170 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 --2- 172.21.15.47:0/502930176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00640704d0 0x7f0064150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 >> 172.21.15.47:0/502930176 conn(0x7f00640b4c00 msgr2=0x7f00640d1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 shutdown_connections 2024-04-26T23:47:47.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.219+0000 7f0069000640 1 -- 172.21.15.47:0/502930176 wait complete. 2024-04-26T23:47:47.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:47:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d47200640 1 Processor -- start 2024-04-26T23:47:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d47200640 1 -- start start 2024-04-26T23:47:47.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d47200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6d40159b70 0x7f6d4006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d47200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d400af7f0 0x7f6d4006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d47200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d400aea30 con 0x7f6d4015fca0 2024-04-26T23:47:47.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d47200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6d400af360 con 0x7f6d40159b70 2024-04-26T23:47:47.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d47200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d400aed10 con 0x7f6d400af7f0 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d3fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6d40159b70 0x7f6d4006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d45200640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f6d4015fca0 0x7f6d40160130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:52112/0 (socket says 172.21.15.47:52112) 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d45200640 1 -- 172.21.15.47:0/552497517 learned_addr learned my addr 172.21.15.47:0/552497517 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d3f400640 1 --2- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d400af7f0 0x7f6d4006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d3fe00640 1 -- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d400af7f0 msgr2=0x7f6d4006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d3fe00640 1 --2- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d400af7f0 0x7f6d4006cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d3fe00640 1 -- 172.21.15.47:0/552497517 >> v1:172.21.15.203:6789/0 conn(0x7f6d4015fca0 legacy=0x7f6d40160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.383+0000 7f6d3fe00640 1 -- 172.21.15.47:0/552497517 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d400aeff0 con 0x7f6d40159b70 2024-04-26T23:47:47.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d3fe00640 1 --2- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d40159b70 0x7f6d4006c630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d300097c0 tx=0x7f6d3001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe0f68e7d326e1cd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:47.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d3ea00640 1 -- 172.21.15.47:0/552497517 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300b1070 con 0x7f6d40159b70 2024-04-26T23:47:47.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d3ea00640 1 -- 172.21.15.47:0/552497517 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d300ac410 con 0x7f6d40159b70 2024-04-26T23:47:47.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d3ea00640 1 -- 172.21.15.47:0/552497517 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300ac7e0 con 0x7f6d40159b70 2024-04-26T23:47:47.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 -- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d40159b70 msgr2=0x7f6d4006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 --2- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d40159b70 0x7f6d4006c630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6d300097c0 tx=0x7f6d3001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 -- 172.21.15.47:0/552497517 shutdown_connections 2024-04-26T23:47:47.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 --2- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d400af7f0 0x7f6d4006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 --2- 172.21.15.47:0/552497517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d40159b70 0x7f6d4006c630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 -- 172.21.15.47:0/552497517 >> 172.21.15.47:0/552497517 conn(0x7f6d400b2d40 msgr2=0x7f6d400b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:47.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 -- 172.21.15.47:0/552497517 shutdown_connections 2024-04-26T23:47:47.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.387+0000 7f6d47200640 1 -- 172.21.15.47:0/552497517 wait complete. 2024-04-26T23:47:47.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 Processor -- start 2024-04-26T23:47:47.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 -- start start 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d400af7f0 0x7f6d4015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d40159b70 0x7f6d4009d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d4015fca0 0x7f6d4014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4006fae0 con 0x7f6d4015fca0 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4006f960 con 0x7f6d400af7f0 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4006fc60 con 0x7f6d40159b70 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d4015fca0 0x7f6d4014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d4015fca0 0x7f6d4014cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38134/0 (socket says 172.21.15.47:38134) 2024-04-26T23:47:47.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 -- 172.21.15.47:0/1693693780 learned_addr learned my addr 172.21.15.47:0/1693693780 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:47.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 -- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d40159b70 msgr2=0x7f6d4009d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d3f400640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d40159b70 0x7f6d4009d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d3fe00640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d400af7f0 0x7f6d4015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d40159b70 0x7f6d4009d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 -- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d400af7f0 msgr2=0x7f6d4015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d400af7f0 0x7f6d4015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 -- 172.21.15.47:0/1693693780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4009d610 con 0x7f6d4015fca0 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d3f400640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d40159b70 0x7f6d4009d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d3fe00640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d400af7f0 0x7f6d4015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d45200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d4015fca0 0x7f6d4014cf80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6d38002240 tx=0x7f6d3800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d37e00640 1 -- 172.21.15.47:0/1693693780 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38017070 con 0x7f6d4015fca0 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d37e00640 1 -- 172.21.15.47:0/1693693780 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3800abd0 con 0x7f6d4015fca0 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d37e00640 1 -- 172.21.15.47:0/1693693780 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38012400 con 0x7f6d4015fca0 2024-04-26T23:47:47.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4009e930 con 0x7f6d4015fca0 2024-04-26T23:47:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d4009db70 con 0x7f6d4015fca0 2024-04-26T23:47:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.391+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d400695f0 con 0x7f6d4015fca0 2024-04-26T23:47:47.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.395+0000 7f6d37e00640 1 -- 172.21.15.47:0/1693693780 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f6d3801a070 con 0x7f6d4015fca0 2024-04-26T23:47:47.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.395+0000 7f6d37e00640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d20068680 0x7f6d2006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.395+0000 7f6d37e00640 1 -- 172.21.15.47:0/1693693780 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f6d38086b50 con 0x7f6d4015fca0 2024-04-26T23:47:47.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.395+0000 7f6d3fe00640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d20068680 0x7f6d2006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.395+0000 7f6d3fe00640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d20068680 0x7f6d2006ab40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d300ae000 tx=0x7f6d30008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:47.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.399+0000 7f6d37e00640 1 -- 172.21.15.47:0/1693693780 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6d4009d610 con 0x7f6d4015fca0 2024-04-26T23:47:47.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.575+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d4006eca0 con 0x7f6d4015fca0 2024-04-26T23:47:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d37e00640 1 -- 172.21.15.47:0/1693693780 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7f6d38056d10 con 0x7f6d4015fca0 2024-04-26T23:47:47.583 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:47:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d20068680 msgr2=0x7f6d2006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d20068680 0x7f6d2006ab40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6d300ae000 tx=0x7f6d30008040 comp rx=0 tx=0).stop 2024-04-26T23:47:47.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d4015fca0 msgr2=0x7f6d4014cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d4015fca0 0x7f6d4014cf80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6d38002240 tx=0x7f6d3800cf00 comp rx=0 tx=0).stop 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 shutdown_connections 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6d20068680 0x7f6d2006ab40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d4015fca0 0x7f6d4014cf80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6d40159b70 0x7f6d4009d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 --2- 172.21.15.47:0/1693693780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d400af7f0 0x7f6d4015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 >> 172.21.15.47:0/1693693780 conn(0x7f6d400b2d40 msgr2=0x7f6d400720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 shutdown_connections 2024-04-26T23:47:47.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.579+0000 7f6d47200640 1 -- 172.21.15.47:0/1693693780 wait complete. 2024-04-26T23:47:47.604 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi203.front.sepia.ceph.com... 2024-04-26T23:47:47.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:47.605 DEBUG:teuthology.orchestra.run.smithi203:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T23:47:47.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33669]: fuse finished with error 0 and tester_r 0 2024-04-26T23:47:47.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:47:47.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:47:47.628 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:47:47.799 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:47:47.799 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:47.799 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:47.808 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:47:47.808 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:47:47.808 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:47:47.808 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:47.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350228k,nr_inodes=4087557,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6713 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:47:47.851 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:47:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f204b800640 1 Processor -- start 2024-04-26T23:47:47.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f204b800640 1 -- start start 2024-04-26T23:47:47.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f204b800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 0x7f20440d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f204b800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20440d2340 con 0x7f2044070390 2024-04-26T23:47:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f204b800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20440cd580 con 0x7f204406f0a0 2024-04-26T23:47:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f204b800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f20440cf350 con 0x7f204409c170 2024-04-26T23:47:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f2049800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2044070390 0x7f2044070840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36922/0 (socket says 172.21.15.47:36922) 2024-04-26T23:47:47.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f2049800640 1 -- 172.21.15.47:0/654886996 learned_addr learned my addr 172.21.15.47:0/654886996 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f2043e00640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 0x7f20440d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266798938 0 0) 0x7f20440d2340 con 0x7f2044070390 2024-04-26T23:47:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.987+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2028003530 con 0x7f2044070390 2024-04-26T23:47:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2002988542 0 0) 0x7f2028003530 con 0x7f2044070390 2024-04-26T23:47:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 msgr2=0x7f20440d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 0x7f20440d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 >> v1:172.21.15.203:6789/0 conn(0x7f204406f0a0 legacy=0x7f204409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20440cd860 con 0x7f2044070390 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f203c001680 con 0x7f2044070390 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 >> v1:172.21.15.47:6789/0 conn(0x7f2044070390 legacy=0x7f2044070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 0x7f20280039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2028003f70 0x7f2028004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028004d50 0x7f20280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f20440cf350 con 0x7f2028003f70 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f202800bab0 con 0x7f2028004d50 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f202800bcb0 con 0x7f204409c170 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043e00640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2028003f70 0x7f2028004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2048e00640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 0x7f20280039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2049800640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028004d50 0x7f20280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043e00640 1 -- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 msgr2=0x7f20280039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043e00640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f204409c170 0x7f20280039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043e00640 1 -- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028004d50 msgr2=0x7f20280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043e00640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028004d50 0x7f20280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043e00640 1 -- 172.21.15.47:0/654886996 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2028003530 con 0x7f2028003f70 2024-04-26T23:47:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.991+0000 7f2043e00640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2028003f70 0x7f2028004810 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2030009ae0 tx=0x7f203001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b1ca4c8deb5b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20300b2070 con 0x7f2028003f70 2024-04-26T23:47:47.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20300a5550 con 0x7f2028003f70 2024-04-26T23:47:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043400640 1 -- 172.21.15.47:0/654886996 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20300096b0 con 0x7f2028003f70 2024-04-26T23:47:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- 172.21.15.47:0/654886996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2028003f70 msgr2=0x7f2028004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:47.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 --2- 172.21.15.47:0/654886996 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2028003f70 0x7f2028004810 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2030009ae0 tx=0x7f203001ca70 comp rx=0 tx=0).stop 2024-04-26T23:47:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2049800640 1 -- 172.21.15.47:0/654886996 reap_dead start 2024-04-26T23:47:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- 172.21.15.47:0/654886996 shutdown_connections 2024-04-26T23:47:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- 172.21.15.47:0/654886996 >> 172.21.15.47:0/654886996 conn(0x7f20440d2e90 msgr2=0x7f20440d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- 172.21.15.47:0/654886996 shutdown_connections 2024-04-26T23:47:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- 172.21.15.47:0/654886996 wait complete. 2024-04-26T23:47:48.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 Processor -- start 2024-04-26T23:47:48.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- start start 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028003f70 0x7f20440cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2044157ad0 0x7f20440c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20440c9100 0x7f204406d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f204406f480 con 0x7f2044157ad0 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20440cde20 con 0x7f2028003f70 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f204b800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f20440d1fa0 con 0x7f20440c9100 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2044157ad0 0x7f20440c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2044157ad0 0x7f20440c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38142/0 (socket says 172.21.15.47:38142) 2024-04-26T23:47:48.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043e00640 1 -- 172.21.15.47:0/26281184 learned_addr learned my addr 172.21.15.47:0/26281184 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2049800640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20440c9100 0x7f204406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2048e00640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028003f70 0x7f20440cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043e00640 1 -- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20440c9100 msgr2=0x7f204406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.995+0000 7f2043e00640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20440c9100 0x7f204406d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2043e00640 1 -- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028003f70 msgr2=0x7f20440cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2043e00640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028003f70 0x7f20440cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2043e00640 1 -- 172.21.15.47:0/26281184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20440c7b20 con 0x7f2044157ad0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2043e00640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2044157ad0 0x7f20440c8bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2030009ae0 tx=0x7f2028005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2040c00640 1 -- 172.21.15.47:0/26281184 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20300bc030 con 0x7f2044157ad0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2040c00640 1 -- 172.21.15.47:0/26281184 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f203000f000 con 0x7f2044157ad0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2040c00640 1 -- 172.21.15.47:0/26281184 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20300b2040 con 0x7f2044157ad0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20440c7e00 con 0x7f2044157ad0 2024-04-26T23:47:48.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20440c83c0 con 0x7f2044157ad0 2024-04-26T23:47:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2044069700 con 0x7f2044157ad0 2024-04-26T23:47:48.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2040c00640 1 -- 172.21.15.47:0/26281184 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f20300bf070 con 0x7f2044157ad0 2024-04-26T23:47:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2040c00640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2024068680 0x7f202406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:47.999+0000 7f2040c00640 1 -- 172.21.15.47:0/26281184 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f2030120cf0 con 0x7f2044157ad0 2024-04-26T23:47:48.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.003+0000 7f2048e00640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2024068680 0x7f202406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.003+0000 7f2048e00640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2024068680 0x7f202406ab40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f20440b1eb0 tx=0x7f2034009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.003+0000 7f2040c00640 1 -- 172.21.15.47:0/26281184 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2030016780 con 0x7f2044157ad0 2024-04-26T23:47:48.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.203+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20440cfc40 con 0x7f2044157ad0 2024-04-26T23:47:48.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f2040c00640 1 -- 172.21.15.47:0/26281184 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f20300f09c0 con 0x7f2044157ad0 2024-04-26T23:47:48.332 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:48.333 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3134789300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3134789300},{"type":"v1","addr":"172.21.15.203:6836","nonce":3134789300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/4099074472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4099074472},{"type":"v1","addr":"172.21.15.203:6837","nonce":4099074472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5298,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/789136995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":789136995},{"type":"v1","addr":"172.21.15.47:6834","nonce":789136995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:46:34.565067+0000","modified":"2024-04-26T23:46:37.594167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/2869278725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":2869278725},{"type":"v1","addr":"172.21.15.47:6835","nonce":2869278725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":2}]} 2024-04-26T23:47:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-04-26T23:47:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2024068680 msgr2=0x7f202406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2024068680 0x7f202406ab40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f20440b1eb0 tx=0x7f2034009040 comp rx=0 tx=0).stop 2024-04-26T23:47:48.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2044157ad0 msgr2=0x7f20440c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2044157ad0 0x7f20440c8bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2030009ae0 tx=0x7f2028005840 comp rx=0 tx=0).stop 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 shutdown_connections 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2024068680 0x7f202406ab40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f20440c9100 0x7f204406d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2044157ad0 0x7f20440c8bc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 --2- 172.21.15.47:0/26281184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2028003f70 0x7f20440cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 >> 172.21.15.47:0/26281184 conn(0x7f20440d2e90 msgr2=0x7f20440b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 shutdown_connections 2024-04-26T23:47:48.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.207+0000 7f204b800640 1 -- 172.21.15.47:0/26281184 wait complete. 2024-04-26T23:47:48.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:47:48.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bbde00640 1 Processor -- start 2024-04-26T23:47:48.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bbde00640 1 -- start start 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bbde00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0bb80ce310 0x7f0bb815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bbde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb806fcd0 0x7f0bb80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bbde00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb815fc50 con 0x7f0bb815c100 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bbde00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb8160860 con 0x7f0bb80ce310 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bbde00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb815d4a0 con 0x7f0bb806fcd0 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bb6a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0bb815c100 0x7f0bb80cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:36932/0 (socket says 172.21.15.47:36932) 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bb6a00640 1 -- 172.21.15.47:0/1517752935 learned_addr learned my addr 172.21.15.47:0/1517752935 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bae000640 1 --2- 172.21.15.47:0/1517752935 >> v2:172.21.15.47:3300/0 conn(0x7f0bb80ce310 0x7f0bb815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bb7400640 1 --2- 172.21.15.47:0/1517752935 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb806fcd0 0x7f0bb80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bb6000640 1 -- 172.21.15.47:0/1517752935 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331846127 0 0) 0x7f0bb815fc50 con 0x7f0bb815c100 2024-04-26T23:47:48.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bae000640 1 -- 172.21.15.47:0/1517752935 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb806fcd0 msgr2=0x7f0bb80b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bae000640 1 --2- 172.21.15.47:0/1517752935 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb806fcd0 0x7f0bb80b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bae000640 1 -- 172.21.15.47:0/1517752935 >> v1:172.21.15.47:6789/0 conn(0x7f0bb815c100 legacy=0x7f0bb80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.471+0000 7f0bae000640 1 -- 172.21.15.47:0/1517752935 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb815ff30 con 0x7f0bb80ce310 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bae000640 1 --2- 172.21.15.47:0/1517752935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb80ce310 0x7f0bb815cf60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00097a0 tx=0x7f0ba001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb675e4c11562ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bb6000640 1 -- 172.21.15.47:0/1517752935 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00ab680 con 0x7f0bb80ce310 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bb6000640 1 -- 172.21.15.47:0/1517752935 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba00b0070 con 0x7f0bb80ce310 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bb6000640 1 -- 172.21.15.47:0/1517752935 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00aba40 con 0x7f0bb80ce310 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 -- 172.21.15.47:0/1517752935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb80ce310 msgr2=0x7f0bb815cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 --2- 172.21.15.47:0/1517752935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb80ce310 0x7f0bb815cf60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00097a0 tx=0x7f0ba001c480 comp rx=0 tx=0).stop 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 -- 172.21.15.47:0/1517752935 shutdown_connections 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 --2- 172.21.15.47:0/1517752935 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb806fcd0 0x7f0bb80b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 --2- 172.21.15.47:0/1517752935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb80ce310 0x7f0bb815cf60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 -- 172.21.15.47:0/1517752935 >> 172.21.15.47:0/1517752935 conn(0x7f0bb806c800 msgr2=0x7f0bb806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 -- 172.21.15.47:0/1517752935 shutdown_connections 2024-04-26T23:47:48.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.475+0000 7f0bbde00640 1 -- 172.21.15.47:0/1517752935 wait complete. 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 Processor -- start 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 -- start start 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb806fcd0 0x7f0bb81f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb80ce310 0x7f0bb814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bb815c100 0x7f0bb8159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80b5ef0 con 0x7f0bb806fcd0 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb80b5d70 con 0x7f0bb815c100 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb80b6070 con 0x7f0bb80ce310 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb806fcd0 0x7f0bb81f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb806fcd0 0x7f0bb81f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38156/0 (socket says 172.21.15.47:38156) 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 -- 172.21.15.47:0/123605326 learned_addr learned my addr 172.21.15.47:0/123605326 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bae000640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb80ce310 0x7f0bb814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb7400640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bb815c100 0x7f0bb8159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 -- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb80ce310 msgr2=0x7f0bb814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb80ce310 0x7f0bb814f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 -- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bb815c100 msgr2=0x7f0bb8159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bb815c100 0x7f0bb8159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 -- 172.21.15.47:0/123605326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb814fe00 con 0x7f0bb806fcd0 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bb6a00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb806fcd0 0x7f0bb81f8010 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80011f0 tx=0x7f0ba800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bafe00640 1 -- 172.21.15.47:0/123605326 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8018070 con 0x7f0bb806fcd0 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bafe00640 1 -- 172.21.15.47:0/123605326 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba80074e0 con 0x7f0bb806fcd0 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bafe00640 1 -- 172.21.15.47:0/123605326 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8004a10 con 0x7f0bb806fcd0 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb81f8550 con 0x7f0bb806fcd0 2024-04-26T23:47:48.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.479+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb81f8ab0 con 0x7f0bb806fcd0 2024-04-26T23:47:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.483+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb8069700 con 0x7f0bb806fcd0 2024-04-26T23:47:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.483+0000 7f0bafe00640 1 -- 172.21.15.47:0/123605326 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f0ba801b070 con 0x7f0bb806fcd0 2024-04-26T23:47:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.483+0000 7f0bafe00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0b94068650 0x7f0b9406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.483+0000 7f0bafe00640 1 -- 172.21.15.47:0/123605326 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f0ba8086000 con 0x7f0bb806fcd0 2024-04-26T23:47:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.483+0000 7f0bae000640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0b94068650 0x7f0b9406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.483+0000 7f0bae000640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0b94068650 0x7f0b9406ab10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00af000 tx=0x7f0ba00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.487+0000 7f0bafe00640 1 -- 172.21.15.47:0/123605326 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0bb81f8550 con 0x7f0bb806fcd0 2024-04-26T23:47:48.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.651+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bb815b360 con 0x7f0bb806fcd0 2024-04-26T23:47:48.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.651+0000 7f0bafe00640 1 -- 172.21.15.47:0/123605326 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16722 (secure 0 0 0) 0x7f0bb814fe00 con 0x7f0bb806fcd0 2024-04-26T23:47:48.658 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:48.659 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:47:31.889557+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0b94068650 msgr2=0x7f0b9406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0b94068650 0x7f0b9406ab10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00af000 tx=0x7f0ba00a7000 comp rx=0 tx=0).stop 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb806fcd0 msgr2=0x7f0bb81f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb806fcd0 0x7f0bb81f8010 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80011f0 tx=0x7f0ba800c9b0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 shutdown_connections 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0b94068650 0x7f0b9406ab10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0bb815c100 0x7f0bb8159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f0bb80ce310 0x7f0bb814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 --2- 172.21.15.47:0/123605326 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0bb806fcd0 0x7f0bb81f8010 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 >> 172.21.15.47:0/123605326 conn(0x7f0bb806c800 msgr2=0x7f0bb8166240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 shutdown_connections 2024-04-26T23:47:48.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.655+0000 7f0bbde00640 1 -- 172.21.15.47:0/123605326 wait complete. 2024-04-26T23:47:48.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:46:32.386905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:46:33.526173+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:47:48.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:47:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdefa000640 1 Processor -- start 2024-04-26T23:47:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdefa000640 1 -- start start 2024-04-26T23:47:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdefa000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdef4160670 0x7fdef409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdefa000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef40b2490 0x7fdef409bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdefa000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef4071f90 con 0x7fdef4160a50 2024-04-26T23:47:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdefa000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdef4070ee0 con 0x7fdef4160670 2024-04-26T23:47:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdefa000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdef40cebc0 con 0x7fdef40b2490 2024-04-26T23:47:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdef3400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdef4160670 0x7fdef409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef40b2490 0x7fdef409bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdeeaa00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fdef4160a50 0x7fdef40d1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:52126/0 (socket says 172.21.15.47:52126) 2024-04-26T23:47:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdeeaa00640 1 -- 172.21.15.47:0/3187995314 learned_addr learned my addr 172.21.15.47:0/3187995314 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdef3400640 1 -- 172.21.15.47:0/3187995314 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef40b2490 msgr2=0x7fdef409bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdef3400640 1 --2- 172.21.15.47:0/3187995314 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef40b2490 0x7fdef409bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdef3400640 1 -- 172.21.15.47:0/3187995314 >> v1:172.21.15.203:6789/0 conn(0x7fdef4160a50 legacy=0x7fdef40d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.819+0000 7fdef3400640 1 -- 172.21.15.47:0/3187995314 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4072230 con 0x7fdef4160670 2024-04-26T23:47:48.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdef3400640 1 --2- 172.21.15.47:0/3187995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef4160670 0x7fdef409ba60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdee40097c0 tx=0x7fdee401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa0ff73c7460be1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdef2a00640 1 -- 172.21.15.47:0/3187995314 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee40b0070 con 0x7fdef4160670 2024-04-26T23:47:48.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdef2a00640 1 -- 172.21.15.47:0/3187995314 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee40ab600 con 0x7fdef4160670 2024-04-26T23:47:48.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdef2a00640 1 -- 172.21.15.47:0/3187995314 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee40ab9d0 con 0x7fdef4160670 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 -- 172.21.15.47:0/3187995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef4160670 msgr2=0x7fdef409ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 --2- 172.21.15.47:0/3187995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef4160670 0x7fdef409ba60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdee40097c0 tx=0x7fdee401c3e0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 -- 172.21.15.47:0/3187995314 shutdown_connections 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 --2- 172.21.15.47:0/3187995314 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef40b2490 0x7fdef409bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 --2- 172.21.15.47:0/3187995314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef4160670 0x7fdef409ba60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 -- 172.21.15.47:0/3187995314 >> 172.21.15.47:0/3187995314 conn(0x7fdef40b4c00 msgr2=0x7fdef40b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 -- 172.21.15.47:0/3187995314 shutdown_connections 2024-04-26T23:47:48.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.823+0000 7fdefa000640 1 -- 172.21.15.47:0/3187995314 wait complete. 2024-04-26T23:47:48.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 Processor -- start 2024-04-26T23:47:48.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 -- start start 2024-04-26T23:47:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef40b2490 0x7fdef414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef4160670 0x7fdef40c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4160a50 0x7fdef40c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdef40b5870 con 0x7fdef4160a50 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdef40b56f0 con 0x7fdef40b2490 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdef40719a0 con 0x7fdef4160670 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4160a50 0x7fdef40c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4160a50 0x7fdef40c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38166/0 (socket says 172.21.15.47:38166) 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 -- 172.21.15.47:0/3675198961 learned_addr learned my addr 172.21.15.47:0/3675198961 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3400640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef40b2490 0x7fdef414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdeeaa00640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef4160670 0x7fdef40c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 -- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef4160670 msgr2=0x7fdef40c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef4160670 0x7fdef40c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 -- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef40b2490 msgr2=0x7fdef414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef40b2490 0x7fdef414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:48.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 -- 172.21.15.47:0/3675198961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef40cb320 con 0x7fdef4160a50 2024-04-26T23:47:48.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdeeaa00640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef4160670 0x7fdef40c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:48.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdef3e00640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4160a50 0x7fdef40c73f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00e7f0 tx=0x7fdeec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdeebe00640 1 -- 172.21.15.47:0/3675198961 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec017070 con 0x7fdef4160a50 2024-04-26T23:47:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdeebe00640 1 -- 172.21.15.47:0/3675198961 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec00c940 con 0x7fdef4160a50 2024-04-26T23:47:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdeebe00640 1 -- 172.21.15.47:0/3675198961 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00eea0 con 0x7fdef4160a50 2024-04-26T23:47:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef40cb600 con 0x7fdef4160a50 2024-04-26T23:47:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.827+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef40cbbc0 con 0x7fdef4160a50 2024-04-26T23:47:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.831+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef4069700 con 0x7fdef4160a50 2024-04-26T23:47:48.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.831+0000 7fdeebe00640 1 -- 172.21.15.47:0/3675198961 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fdeec01a070 con 0x7fdef4160a50 2024-04-26T23:47:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.831+0000 7fdeebe00640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fded0068680 0x7fded006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.831+0000 7fdeebe00640 1 -- 172.21.15.47:0/3675198961 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7fdeec087030 con 0x7fdef4160a50 2024-04-26T23:47:48.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.831+0000 7fdef3400640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fded0068680 0x7fded006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:48.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.831+0000 7fdef3400640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fded0068680 0x7fded006ab40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdee40ad000 tx=0x7fdee40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:48.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:48.835+0000 7fdeebe00640 1 -- 172.21.15.47:0/3675198961 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdeec056b60 con 0x7fdef4160a50 2024-04-26T23:47:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.003+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdef40cbd90 con 0x7fdef4160a50 2024-04-26T23:47:49.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.003+0000 7fdeebe00640 1 -- 172.21.15.47:0/3675198961 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7fdeec05ae60 con 0x7fdef4160a50 2024-04-26T23:47:49.009 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:47:49.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.003+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fded0068680 msgr2=0x7fded006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.003+0000 7fdefa000640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fded0068680 0x7fded006ab40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdee40ad000 tx=0x7fdee40a6000 comp rx=0 tx=0).stop 2024-04-26T23:47:49.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.003+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4160a50 msgr2=0x7fdef40c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.003+0000 7fdefa000640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4160a50 0x7fdef40c73f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00e7f0 tx=0x7fdeec00ecb0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 shutdown_connections 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fded0068680 0x7fded006ab40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdef4160a50 0x7fdef40c73f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdef4160670 0x7fdef40c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 --2- 172.21.15.47:0/3675198961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdef40b2490 0x7fdef414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 >> 172.21.15.47:0/3675198961 conn(0x7fdef40b4c00 msgr2=0x7fdef40d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 shutdown_connections 2024-04-26T23:47:49.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.007+0000 7fdefa000640 1 -- 172.21.15.47:0/3675198961 wait complete. 2024-04-26T23:47:49.030 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:47:49.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c6400640 1 Processor -- start 2024-04-26T23:47:49.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c6400640 1 -- start start 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c6400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c006d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c6400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49c015f280 0x7f49c01600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c6400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c006daf0 con 0x7f49c00d2ed0 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c6400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f49c00d0dc0 con 0x7f49c015f280 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c6400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f49c006ddd0 con 0x7f49c00d2af0 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49b7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49c015f280 0x7f49c01600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49b7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f49c015f280 0x7f49c01600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40308/0 (socket says 172.21.15.47:40308) 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49b7e00640 1 -- 172.21.15.47:0/2339856288 learned_addr learned my addr 172.21.15.47:0/2339856288 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:49.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49c5000640 1 --2- 172.21.15.47:0/2339856288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c006d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49b7e00640 1 -- 172.21.15.47:0/2339856288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 msgr2=0x7f49c006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:49.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49b7e00640 1 --2- 172.21.15.47:0/2339856288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c006d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49b7e00640 1 -- 172.21.15.47:0/2339856288 >> v1:172.21.15.203:6789/0 conn(0x7f49c00d2ed0 legacy=0x7f49c00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.171+0000 7f49b7e00640 1 -- 172.21.15.47:0/2339856288 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c006e0b0 con 0x7f49c015f280 2024-04-26T23:47:49.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49b7e00640 1 --2- 172.21.15.47:0/2339856288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c01600d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009870 tx=0x7f49a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e6e78c493cdeb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49bfe00640 1 -- 172.21.15.47:0/2339856288 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a80b2070 con 0x7f49c015f280 2024-04-26T23:47:49.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49bfe00640 1 -- 172.21.15.47:0/2339856288 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a80ad640 con 0x7f49c015f280 2024-04-26T23:47:49.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49bfe00640 1 -- 172.21.15.47:0/2339856288 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a80ada10 con 0x7f49c015f280 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 -- 172.21.15.47:0/2339856288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 msgr2=0x7f49c01600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 --2- 172.21.15.47:0/2339856288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c01600d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009870 tx=0x7f49a801c560 comp rx=0 tx=0).stop 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 -- 172.21.15.47:0/2339856288 shutdown_connections 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 --2- 172.21.15.47:0/2339856288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c01600d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 --2- 172.21.15.47:0/2339856288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c006d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 -- 172.21.15.47:0/2339856288 >> 172.21.15.47:0/2339856288 conn(0x7f49c009ba60 msgr2=0x7f49c009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 -- 172.21.15.47:0/2339856288 shutdown_connections 2024-04-26T23:47:49.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.175+0000 7f49c6400640 1 -- 172.21.15.47:0/2339856288 wait complete. 2024-04-26T23:47:49.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 Processor -- start 2024-04-26T23:47:49.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 -- start start 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49c00d2ed0 0x7f49c01590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c0157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f49c016bc50 con 0x7f49c015f280 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f49c016bdd0 con 0x7f49c00d2ed0 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f49c016bf50 con 0x7f49c00d2af0 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c0157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c0157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40314/0 (socket says 172.21.15.47:40314) 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 -- 172.21.15.47:0/1778677465 learned_addr learned my addr 172.21.15.47:0/1778677465 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49b7e00640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49c00d2ed0 0x7f49c01590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5000640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 -- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 msgr2=0x7f49c00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 -- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49c00d2ed0 msgr2=0x7f49c01590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49c00d2ed0 0x7f49c01590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 -- 172.21.15.47:0/1778677465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c0159930 con 0x7f49c015f280 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49b7e00640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49c00d2ed0 0x7f49c01590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5000640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c5a00640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c0157e90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c760 tx=0x7f49b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49bd600640 1 -- 172.21.15.47:0/1778677465 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8003b80 con 0x7f49c015f280 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49bd600640 1 -- 172.21.15.47:0/1778677465 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b8003d20 con 0x7f49c015f280 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c00c8140 con 0x7f49c015f280 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49bd600640 1 -- 172.21.15.47:0/1778677465 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b800aa30 con 0x7f49c015f280 2024-04-26T23:47:49.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c00c8700 con 0x7f49c015f280 2024-04-26T23:47:49.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.179+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c0069470 con 0x7f49c015f280 2024-04-26T23:47:49.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.183+0000 7f49bd600640 1 -- 172.21.15.47:0/1778677465 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f49b800abd0 con 0x7f49c015f280 2024-04-26T23:47:49.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.183+0000 7f49bd600640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f499c068680 0x7f499c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.183+0000 7f49bd600640 1 -- 172.21.15.47:0/1778677465 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f49b8086ce0 con 0x7f49c015f280 2024-04-26T23:47:49.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.183+0000 7f49c5000640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f499c068680 0x7f499c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.183+0000 7f49c5000640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f499c068680 0x7f499c06ab40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b9f0 tx=0x7f49b0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.187+0000 7f49bd600640 1 -- 172.21.15.47:0/1778677465 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f49b8056ef0 con 0x7f49c015f280 2024-04-26T23:47:49.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.351+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f49c0162550 con 0x7f49c015f280 2024-04-26T23:47:49.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.351+0000 7f49bd600640 1 -- 172.21.15.47:0/1778677465 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) ==== 104+0+11 (secure 0 0 0) 0x7f49b80567f0 con 0x7f49c015f280 2024-04-26T23:47:49.358 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f499c068680 msgr2=0x7f499c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f499c068680 0x7f499c06ab40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b9f0 tx=0x7f49b0008040 comp rx=0 tx=0).stop 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 msgr2=0x7f49c0157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c0157e90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f49b800c760 tx=0x7f49b800cc20 comp rx=0 tx=0).stop 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 shutdown_connections 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f499c068680 0x7f499c06ab40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f49c015f280 0x7f49c0157e90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49c00d2ed0 0x7f49c01590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 --2- 172.21.15.47:0/1778677465 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f49c00d2af0 0x7f49c00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 >> 172.21.15.47:0/1778677465 conn(0x7f49c009ba60 msgr2=0x7f49c0161c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 shutdown_connections 2024-04-26T23:47:49.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.355+0000 7f49c6400640 1 -- 172.21.15.47:0/1778677465 wait complete. 2024-04-26T23:47:49.379 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:47:49.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.515+0000 7fe2aee00640 1 Processor -- start 2024-04-26T23:47:49.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.515+0000 7fe2aee00640 1 -- start start 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2aee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 0x7fe2a80700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2aee00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe2a806ea90 0x7fe2a80729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2aee00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2a80b55a0 0x7fe2a8072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2aee00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a806f000 con 0x7fe2a80b55a0 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2aee00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a806f2e0 con 0x7fe2a806ea90 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2aee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a806f5c0 con 0x7fe2a8162970 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2a80b55a0 0x7fe2a8072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe2a80b55a0 0x7fe2a8072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40318/0 (socket says 172.21.15.47:40318) 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 -- 172.21.15.47:0/2941304559 learned_addr learned my addr 172.21.15.47:0/2941304559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2a7400640 1 --2- 172.21.15.47:0/2941304559 >> v2:172.21.15.203:3300/0 conn(0x7fe2a806ea90 0x7fe2a80729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2a7e00640 1 --2- 172.21.15.47:0/2941304559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 0x7fe2a80700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 -- 172.21.15.47:0/2941304559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 msgr2=0x7fe2a80700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:49.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 --2- 172.21.15.47:0/2941304559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 0x7fe2a80700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 -- 172.21.15.47:0/2941304559 >> v2:172.21.15.203:3300/0 conn(0x7fe2a806ea90 msgr2=0x7fe2a80729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:49.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 --2- 172.21.15.47:0/2941304559 >> v2:172.21.15.203:3300/0 conn(0x7fe2a806ea90 0x7fe2a80729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.519+0000 7fe2ace00640 1 -- 172.21.15.47:0/2941304559 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a806f8a0 con 0x7fe2a80b55a0 2024-04-26T23:47:49.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2ace00640 1 --2- 172.21.15.47:0/2941304559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a80b55a0 0x7fe2a8072ee0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8071440 tx=0x7fe2a001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478dcb22bdf0af77 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2a6a00640 1 -- 172.21.15.47:0/2941304559 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00a5860 con 0x7fe2a80b55a0 2024-04-26T23:47:49.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2a6a00640 1 -- 172.21.15.47:0/2941304559 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a00a5a00 con 0x7fe2a80b55a0 2024-04-26T23:47:49.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2a6a00640 1 -- 172.21.15.47:0/2941304559 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00a5dd0 con 0x7fe2a80b55a0 2024-04-26T23:47:49.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 -- 172.21.15.47:0/2941304559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a80b55a0 msgr2=0x7fe2a8072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 --2- 172.21.15.47:0/2941304559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a80b55a0 0x7fe2a8072ee0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8071440 tx=0x7fe2a001c9c0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 -- 172.21.15.47:0/2941304559 shutdown_connections 2024-04-26T23:47:49.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 --2- 172.21.15.47:0/2941304559 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a80b55a0 0x7fe2a8072ee0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 --2- 172.21.15.47:0/2941304559 >> v2:172.21.15.203:3300/0 conn(0x7fe2a806ea90 0x7fe2a80729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 --2- 172.21.15.47:0/2941304559 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 0x7fe2a80700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 -- 172.21.15.47:0/2941304559 >> 172.21.15.47:0/2941304559 conn(0x7fe2a8070c00 msgr2=0x7fe2a806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 -- 172.21.15.47:0/2941304559 shutdown_connections 2024-04-26T23:47:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 -- 172.21.15.47:0/2941304559 wait complete. 2024-04-26T23:47:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 Processor -- start 2024-04-26T23:47:49.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.523+0000 7fe2aee00640 1 -- start start 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a806ea90 0x7fe2a8158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a80b55a0 0x7fe2a80d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 0x7fe2a81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80b49c0 con 0x7fe2a806ea90 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80b4840 con 0x7fe2a80b55a0 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80cbd70 con 0x7fe2a8162970 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a806ea90 0x7fe2a8158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a806ea90 0x7fe2a8158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40324/0 (socket says 172.21.15.47:40324) 2024-04-26T23:47:49.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 -- 172.21.15.47:0/3147576400 learned_addr learned my addr 172.21.15.47:0/3147576400 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:49.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7400640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a80b55a0 0x7fe2a80d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 -- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 msgr2=0x7fe2a81536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 0x7fe2a81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 -- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a80b55a0 msgr2=0x7fe2a80d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a80b55a0 0x7fe2a80d0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 -- 172.21.15.47:0/3147576400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a815d900 con 0x7fe2a806ea90 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7400640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a80b55a0 0x7fe2a80d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2a7e00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a806ea90 0x7fe2a8158690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe29800e870 tx=0x7fe29800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe29fe00640 1 -- 172.21.15.47:0/3147576400 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298017070 con 0x7fe2a806ea90 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe29fe00640 1 -- 172.21.15.47:0/3147576400 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29800c940 con 0x7fe2a806ea90 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe29fe00640 1 -- 172.21.15.47:0/3147576400 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29800ccf0 con 0x7fe2a806ea90 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a815dc40 con 0x7fe2a806ea90 2024-04-26T23:47:49.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a815e480 con 0x7fe2a806ea90 2024-04-26T23:47:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a806d390 con 0x7fe2a806ea90 2024-04-26T23:47:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.527+0000 7fe29fe00640 1 -- 172.21.15.47:0/3147576400 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe29801a070 con 0x7fe2a806ea90 2024-04-26T23:47:49.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.531+0000 7fe29fe00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe288068650 0x7fe28806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.531+0000 7fe29fe00640 1 -- 172.21.15.47:0/3147576400 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7fe298086ef0 con 0x7fe2a806ea90 2024-04-26T23:47:49.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.531+0000 7fe2a7400640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe288068650 0x7fe28806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.531+0000 7fe2a7400640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe288068650 0x7fe28806ab10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8158ee0 tx=0x7fe294008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.535+0000 7fe29fe00640 1 -- 172.21.15.47:0/3147576400 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe2a815dc40 con 0x7fe2a806ea90 2024-04-26T23:47:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.698+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe2a8069700 con 0x7fe2a806ea90 2024-04-26T23:47:49.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.698+0000 7fe29fe00640 1 -- 172.21.15.47:0/3147576400 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) ==== 100+0+11 (secure 0 0 0) 0x7fe298056f90 con 0x7fe2a806ea90 2024-04-26T23:47:49.705 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.698+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe288068650 msgr2=0x7fe28806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.698+0000 7fe2aee00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe288068650 0x7fe28806ab10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8158ee0 tx=0x7fe294008040 comp rx=0 tx=0).stop 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.698+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a806ea90 msgr2=0x7fe2a8158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.698+0000 7fe2aee00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a806ea90 0x7fe2a8158690 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe29800e870 tx=0x7fe29800ec70 comp rx=0 tx=0).stop 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 shutdown_connections 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe288068650 0x7fe28806ab10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2a8162970 0x7fe2a81536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe2a80b55a0 0x7fe2a80d0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 --2- 172.21.15.47:0/3147576400 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2a806ea90 0x7fe2a8158690 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 >> 172.21.15.47:0/3147576400 conn(0x7fe2a8070c00 msgr2=0x7fe2a8155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 shutdown_connections 2024-04-26T23:47:49.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.702+0000 7fe2aee00640 1 -- 172.21.15.47:0/3147576400 wait complete. 2024-04-26T23:47:49.726 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:47:49.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.858+0000 7f4e93800640 1 Processor -- start 2024-04-26T23:47:49.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.858+0000 7f4e93800640 1 -- start start 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e93800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e93800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f4e8c15d5b0 0x7f4e8c15da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e93800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e8c15e050 con 0x7f4e8c0cdc00 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e93800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f4e8c15e330 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e93800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c0ceda0 con 0x7f4e8c0b4360 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e91800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4e8c0cdc00 0x7f4e8c15e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44642/0 (socket says 172.21.15.47:44642) 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e91800640 1 -- 172.21.15.47:0/3764769800 learned_addr learned my addr 172.21.15.47:0/3764769800 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e90e00640 1 --2- 172.21.15.47:0/3764769800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e8be00640 1 --2- 172.21.15.47:0/3764769800 >> v2:172.21.15.203:3300/0 conn(0x7f4e8c15d5b0 0x7f4e8c15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e8b400640 1 -- 172.21.15.47:0/3764769800 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507344205 0 0) 0x7f4e8c15e050 con 0x7f4e8c0cdc00 2024-04-26T23:47:49.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e90e00640 1 -- 172.21.15.47:0/3764769800 >> v2:172.21.15.203:3300/0 conn(0x7f4e8c15d5b0 msgr2=0x7f4e8c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:49.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e90e00640 1 --2- 172.21.15.47:0/3764769800 >> v2:172.21.15.203:3300/0 conn(0x7f4e8c15d5b0 0x7f4e8c15da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e90e00640 1 -- 172.21.15.47:0/3764769800 >> v1:172.21.15.47:6789/0 conn(0x7f4e8c0cdc00 legacy=0x7f4e8c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.862+0000 7f4e90e00640 1 -- 172.21.15.47:0/3764769800 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c0cf080 con 0x7f4e8c0b4360 2024-04-26T23:47:49.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e90e00640 1 --2- 172.21.15.47:0/3764769800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c0cf5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097c0 tx=0x7f4e8001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe4183a105669c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e8b400640 1 -- 172.21.15.47:0/3764769800 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e800b0070 con 0x7f4e8c0b4360 2024-04-26T23:47:49.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e8b400640 1 -- 172.21.15.47:0/3764769800 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e800ab600 con 0x7f4e8c0b4360 2024-04-26T23:47:49.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e8b400640 1 -- 172.21.15.47:0/3764769800 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e800ab9d0 con 0x7f4e8c0b4360 2024-04-26T23:47:49.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 -- 172.21.15.47:0/3764769800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 msgr2=0x7f4e8c0cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 --2- 172.21.15.47:0/3764769800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c0cf5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e800097c0 tx=0x7f4e8001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 -- 172.21.15.47:0/3764769800 shutdown_connections 2024-04-26T23:47:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 --2- 172.21.15.47:0/3764769800 >> v2:172.21.15.203:3300/0 conn(0x7f4e8c15d5b0 0x7f4e8c15da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 --2- 172.21.15.47:0/3764769800 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c0cf5a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 -- 172.21.15.47:0/3764769800 >> 172.21.15.47:0/3764769800 conn(0x7f4e8c06c800 msgr2=0x7f4e8c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 -- 172.21.15.47:0/3764769800 shutdown_connections 2024-04-26T23:47:49.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 -- 172.21.15.47:0/3764769800 wait complete. 2024-04-26T23:47:49.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 Processor -- start 2024-04-26T23:47:49.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.866+0000 7f4e93800640 1 -- start start 2024-04-26T23:47:49.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e8c0cdc00 0x7f4e8c14ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e8c15d5b0 0x7f4e8c157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0ce590 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8c0ce410 con 0x7f4e8c0cdc00 2024-04-26T23:47:49.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4e8c16a750 con 0x7f4e8c0b4360 2024-04-26T23:47:49.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e8c15d5b0 0x7f4e8c157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e8c15d5b0 0x7f4e8c157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40336/0 (socket says 172.21.15.47:40336) 2024-04-26T23:47:49.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 -- 172.21.15.47:0/1399873599 learned_addr learned my addr 172.21.15.47:0/1399873599 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:49.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e90e00640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e8be00640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e8c0cdc00 0x7f4e8c14ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 -- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 msgr2=0x7f4e8c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 -- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e8c0cdc00 msgr2=0x7f4e8c14ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e8c0cdc00 0x7f4e8c14ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:49.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 -- 172.21.15.47:0/1399873599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8c1586f0 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e91800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e8c15d5b0 0x7f4e8c157d80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400c700 tx=0x7f4e8400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e88c00640 1 -- 172.21.15.47:0/1399873599 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e84018070 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e88c00640 1 -- 172.21.15.47:0/1399873599 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8400ce10 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e88c00640 1 -- 172.21.15.47:0/1399873599 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400a860 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8c1589d0 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e8c158f90 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e8c069700 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.870+0000 7f4e88c00640 1 -- 172.21.15.47:0/1399873599 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f4e8400aa00 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.874+0000 7f4e88c00640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4e6c068680 0x7f4e6c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:49.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.874+0000 7f4e88c00640 1 -- 172.21.15.47:0/1399873599 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f4e840863b0 con 0x7f4e8c15d5b0 2024-04-26T23:47:49.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.874+0000 7f4e90e00640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4e6c068680 0x7f4e6c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:49.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.874+0000 7f4e90e00640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4e6c068680 0x7f4e6c06ab40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4e800ad000 tx=0x7f4e800a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:49.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:49.878+0000 7f4e88c00640 1 -- 172.21.15.47:0/1399873599 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4e84055e60 con 0x7f4e8c15d5b0 2024-04-26T23:47:50.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.078+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e8c0cfdd0 con 0x7f4e8c15d5b0 2024-04-26T23:47:50.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.078+0000 7f4e88c00640 1 -- 172.21.15.47:0/1399873599 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f4e8405a160 con 0x7f4e8c15d5b0 2024-04-26T23:47:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:50.084 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3134789300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3134789300},{"type":"v1","addr":"172.21.15.203:6836","nonce":3134789300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/4099074472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4099074472},{"type":"v1","addr":"172.21.15.203:6837","nonce":4099074472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5298,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/789136995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":789136995},{"type":"v1","addr":"172.21.15.47:6834","nonce":789136995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:46:34.565067+0000","modified":"2024-04-26T23:46:37.594167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/2869278725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":2869278725},{"type":"v1","addr":"172.21.15.47:6835","nonce":2869278725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":2}]} 2024-04-26T23:47:50.084 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-04-26T23:47:50.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4e6c068680 msgr2=0x7f4e6c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4e6c068680 0x7f4e6c06ab40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4e800ad000 tx=0x7f4e800a6000 comp rx=0 tx=0).stop 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e8c15d5b0 msgr2=0x7f4e8c157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e8c15d5b0 0x7f4e8c157d80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4e8400c700 tx=0x7f4e8400cbc0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 shutdown_connections 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4e6c068680 0x7f4e6c06ab40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4e8c15d5b0 0x7f4e8c157d80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e8c0cdc00 0x7f4e8c14ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 --2- 172.21.15.47:0/1399873599 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4e8c0b4360 0x7f4e8c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 >> 172.21.15.47:0/1399873599 conn(0x7f4e8c06c800 msgr2=0x7f4e8c0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 shutdown_connections 2024-04-26T23:47:50.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.082+0000 7f4e93800640 1 -- 172.21.15.47:0/1399873599 wait complete. 2024-04-26T23:47:50.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:47:50.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3940400640 1 Processor -- start 2024-04-26T23:47:50.256 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3940400640 1 -- start start 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3940400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f39380d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3940400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39380713a0 0x7f393809bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3940400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39380d2340 con 0x7f393809ba60 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3940400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f39380cd580 con 0x7f39380713a0 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3940400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39380cd860 con 0x7f393806f0a0 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393e400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f39380713a0 0x7f393809bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393d000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f393809ba60 0x7f39380ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44646/0 (socket says 172.21.15.47:44646) 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393d000640 1 -- 172.21.15.47:0/1676121173 learned_addr learned my addr 172.21.15.47:0/1676121173 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:50.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393da00640 1 --2- 172.21.15.47:0/1676121173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f39380d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393e400640 1 -- 172.21.15.47:0/1676121173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 msgr2=0x7f39380d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:50.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393e400640 1 --2- 172.21.15.47:0/1676121173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f39380d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393e400640 1 -- 172.21.15.47:0/1676121173 >> v1:172.21.15.47:6789/0 conn(0x7f393809ba60 legacy=0x7f39380ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f393e400640 1 -- 172.21.15.47:0/1676121173 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39380cdb40 con 0x7f39380713a0 2024-04-26T23:47:50.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.250+0000 7f3937e00640 1 -- 172.21.15.47:0/1676121173 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796070266 0 0) 0x7f39380d2340 con 0x7f393809ba60 2024-04-26T23:47:50.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.254+0000 7f393e400640 1 --2- 172.21.15.47:0/1676121173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393809bee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3930009dc0 tx=0x7f393001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333cf30cfffea09d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3937e00640 1 -- 172.21.15.47:0/1676121173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300b2070 con 0x7f39380713a0 2024-04-26T23:47:50.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3937e00640 1 -- 172.21.15.47:0/1676121173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39300a5810 con 0x7f39380713a0 2024-04-26T23:47:50.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3937e00640 1 -- 172.21.15.47:0/1676121173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300a5be0 con 0x7f39380713a0 2024-04-26T23:47:50.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- 172.21.15.47:0/1676121173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 msgr2=0x7f393809bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 --2- 172.21.15.47:0/1676121173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393809bee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3930009dc0 tx=0x7f393001c950 comp rx=0 tx=0).stop 2024-04-26T23:47:50.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- 172.21.15.47:0/1676121173 shutdown_connections 2024-04-26T23:47:50.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 --2- 172.21.15.47:0/1676121173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393809bee0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.263 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 --2- 172.21.15.47:0/1676121173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f39380d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- 172.21.15.47:0/1676121173 >> 172.21.15.47:0/1676121173 conn(0x7f39380d2e90 msgr2=0x7f39380d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:50.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- 172.21.15.47:0/1676121173 shutdown_connections 2024-04-26T23:47:50.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- 172.21.15.47:0/1676121173 wait complete. 2024-04-26T23:47:50.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 Processor -- start 2024-04-26T23:47:50.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- start start 2024-04-26T23:47:50.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f393815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393814a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f393809ba60 0x7f39380c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f393806d510 con 0x7f39380713a0 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f393816c140 con 0x7f393809ba60 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f3940400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39380c98a0 con 0x7f393806f0a0 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f393d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393814a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f393d000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393814a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40354/0 (socket says 172.21.15.47:40354) 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f393d000640 1 -- 172.21.15.47:0/1526111704 learned_addr learned my addr 172.21.15.47:0/1526111704 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f393da00640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f393815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.258+0000 7f393e400640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f393809ba60 0x7f39380c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f393d000640 1 -- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 msgr2=0x7f393815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f393d000640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f393815e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f393d000640 1 -- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f393809ba60 msgr2=0x7f39380c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f393d000640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f393809ba60 0x7f39380c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f393d000640 1 -- 172.21.15.47:0/1526111704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39380c92e0 con 0x7f39380713a0 2024-04-26T23:47:50.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f393d000640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393814a220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f39240011f0 tx=0x7f392400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f3935600640 1 -- 172.21.15.47:0/1526111704 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924018070 con 0x7f39380713a0 2024-04-26T23:47:50.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f3935600640 1 -- 172.21.15.47:0/1526111704 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39240074e0 con 0x7f39380713a0 2024-04-26T23:47:50.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39380c95c0 con 0x7f39380713a0 2024-04-26T23:47:50.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f3935600640 1 -- 172.21.15.47:0/1526111704 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924004a10 con 0x7f39380713a0 2024-04-26T23:47:50.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393815eab0 con 0x7f39380713a0 2024-04-26T23:47:50.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3938069700 con 0x7f39380713a0 2024-04-26T23:47:50.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.262+0000 7f3935600640 1 -- 172.21.15.47:0/1526111704 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f392401b070 con 0x7f39380713a0 2024-04-26T23:47:50.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.266+0000 7f3935600640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3918068680 0x7f391806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.266+0000 7f3935600640 1 -- 172.21.15.47:0/1526111704 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f39240860d0 con 0x7f39380713a0 2024-04-26T23:47:50.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.266+0000 7f393da00640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3918068680 0x7f391806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.266+0000 7f393da00640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3918068680 0x7f391806ab40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39380b5d40 tx=0x7f392c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.270+0000 7f3935600640 1 -- 172.21.15.47:0/1526111704 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3924055c90 con 0x7f39380713a0 2024-04-26T23:47:50.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.438+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f393815db60 con 0x7f39380713a0 2024-04-26T23:47:50.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.438+0000 7f3935600640 1 -- 172.21.15.47:0/1526111704 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16722 (secure 0 0 0) 0x7f3924059f90 con 0x7f39380713a0 2024-04-26T23:47:50.446 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:50.446 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:47:31.889557+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3918068680 msgr2=0x7f391806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3918068680 0x7f391806ab40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39380b5d40 tx=0x7f392c009190 comp rx=0 tx=0).stop 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 msgr2=0x7f393814a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393814a220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f39240011f0 tx=0x7f392400c9b0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 shutdown_connections 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3918068680 0x7f391806ab40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f393809ba60 0x7f39380c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39380713a0 0x7f393814a220 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 --2- 172.21.15.47:0/1526111704 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f393806f0a0 0x7f393815e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 >> 172.21.15.47:0/1526111704 conn(0x7f39380d2e90 msgr2=0x7f39380b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:50.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 shutdown_connections 2024-04-26T23:47:50.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.442+0000 7f3940400640 1 -- 172.21.15.47:0/1526111704 wait complete. 2024-04-26T23:47:50.468 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:47:50.468 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:47:50.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9269c00640 1 Processor -- start 2024-04-26T23:47:50.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9269c00640 1 -- start start 2024-04-26T23:47:50.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9269c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f92640ce310 0x7f926415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9269c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926415fc50 con 0x7f926406fcd0 2024-04-26T23:47:50.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9269c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926415ff30 con 0x7f926415c100 2024-04-26T23:47:50.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9269c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9264160860 con 0x7f92640ce310 2024-04-26T23:47:50.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f925a000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f92640ce310 0x7f926415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9263400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f926406fcd0 0x7f92640b4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44652/0 (socket says 172.21.15.47:44652) 2024-04-26T23:47:50.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.602+0000 7f9263400640 1 -- 172.21.15.47:0/102440040 learned_addr learned my addr 172.21.15.47:0/102440040 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f925a000640 1 -- 172.21.15.47:0/102440040 >> v1:172.21.15.203:6789/0 conn(0x7f926415c100 legacy=0x7f92640cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f925a000640 1 -- 172.21.15.47:0/102440040 >> v1:172.21.15.47:6789/0 conn(0x7f926406fcd0 legacy=0x7f92640b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f925a000640 1 -- 172.21.15.47:0/102440040 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264160210 con 0x7f92640ce310 2024-04-26T23:47:50.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f9262000640 1 -- 172.21.15.47:0/102440040 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100816577 0 0) 0x7f926415fc50 con 0x7f926406fcd0 2024-04-26T23:47:50.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f925a000640 1 --2- 172.21.15.47:0/102440040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640ce310 0x7f926415cf60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097a0 tx=0x7f924c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0c07bb2d71abbf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f9262000640 1 -- 172.21.15.47:0/102440040 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0b1070 con 0x7f92640ce310 2024-04-26T23:47:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f9262000640 1 -- 172.21.15.47:0/102440040 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924c0ac5f0 con 0x7f92640ce310 2024-04-26T23:47:50.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f9262000640 1 -- 172.21.15.47:0/102440040 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0ac9c0 con 0x7f92640ce310 2024-04-26T23:47:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f9269c00640 1 -- 172.21.15.47:0/102440040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640ce310 msgr2=0x7f926415cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f9269c00640 1 --2- 172.21.15.47:0/102440040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640ce310 0x7f926415cf60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f924c0097a0 tx=0x7f924c01c480 comp rx=0 tx=0).stop 2024-04-26T23:47:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.606+0000 7f9269c00640 1 -- 172.21.15.47:0/102440040 shutdown_connections 2024-04-26T23:47:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 --2- 172.21.15.47:0/102440040 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640ce310 0x7f926415cf60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 -- 172.21.15.47:0/102440040 >> 172.21.15.47:0/102440040 conn(0x7f926406c800 msgr2=0x7f926406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 -- 172.21.15.47:0/102440040 shutdown_connections 2024-04-26T23:47:50.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 -- 172.21.15.47:0/102440040 wait complete. 2024-04-26T23:47:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 Processor -- start 2024-04-26T23:47:50.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 -- start start 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f926406fcd0 0x7f926414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640ce310 0x7f92640723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f926415c100 0x7f926415e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9264169e60 con 0x7f926406fcd0 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92640b6000 con 0x7f926415c100 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9269c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9264169fe0 con 0x7f92640ce310 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f926406fcd0 0x7f926414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f926406fcd0 0x7f926414fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40376/0 (socket says 172.21.15.47:40376) 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 -- 172.21.15.47:0/3975846036 learned_addr learned my addr 172.21.15.47:0/3975846036 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:50.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9263400640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f926415c100 0x7f926415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f925a000640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640ce310 0x7f92640723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 -- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640ce310 msgr2=0x7f92640723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640ce310 0x7f92640723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 -- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f926415c100 msgr2=0x7f926415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f926415c100 0x7f926415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 -- 172.21.15.47:0/3975846036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264150530 con 0x7f926406fcd0 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f925a000640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640ce310 0x7f92640723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9263400640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f926415c100 0x7f926415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:50.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f9262a00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f926406fcd0 0x7f926414fc30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f925400c3c0 tx=0x7f925400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.610+0000 7f925b400640 1 -- 172.21.15.47:0/3975846036 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254017070 con 0x7f926406fcd0 2024-04-26T23:47:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f925b400640 1 -- 172.21.15.47:0/3975846036 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92540052d0 con 0x7f926406fcd0 2024-04-26T23:47:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9264150810 con 0x7f926406fcd0 2024-04-26T23:47:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f925b400640 1 -- 172.21.15.47:0/3975846036 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254003840 con 0x7f926406fcd0 2024-04-26T23:47:50.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9264150dd0 con 0x7f926406fcd0 2024-04-26T23:47:50.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9264069700 con 0x7f926406fcd0 2024-04-26T23:47:50.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f925b400640 1 -- 172.21.15.47:0/3975846036 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f925401a070 con 0x7f926406fcd0 2024-04-26T23:47:50.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f925b400640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9240068650 0x7f924006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f925b400640 1 -- 172.21.15.47:0/3975846036 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f9254086220 con 0x7f926406fcd0 2024-04-26T23:47:50.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f925a000640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9240068650 0x7f924006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.614+0000 7f925a000640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9240068650 0x7f924006ab10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f924c0ae000 tx=0x7f924c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.618+0000 7f925b400640 1 -- 172.21.15.47:0/3975846036 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9254005480 con 0x7f926406fcd0 2024-04-26T23:47:50.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.818+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92640d08b0 con 0x7f926406fcd0 2024-04-26T23:47:50.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.818+0000 7f925b400640 1 -- 172.21.15.47:0/3975846036 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7f92540563e0 con 0x7f926406fcd0 2024-04-26T23:47:50.826 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:50.826 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3134789300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3134789300},{"type":"v1","addr":"172.21.15.203:6836","nonce":3134789300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/4099074472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4099074472},{"type":"v1","addr":"172.21.15.203:6837","nonce":4099074472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5298,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/789136995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":789136995},{"type":"v1","addr":"172.21.15.47:6834","nonce":789136995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:46:34.565067+0000","modified":"2024-04-26T23:46:37.594167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/2869278725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":2869278725},{"type":"v1","addr":"172.21.15.47:6835","nonce":2869278725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":2}]} 2024-04-26T23:47:50.827 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-04-26T23:47:50.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9240068650 msgr2=0x7f924006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9240068650 0x7f924006ab10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f924c0ae000 tx=0x7f924c008040 comp rx=0 tx=0).stop 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f926406fcd0 msgr2=0x7f926414fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f926406fcd0 0x7f926414fc30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f925400c3c0 tx=0x7f925400c880 comp rx=0 tx=0).stop 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 shutdown_connections 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9240068650 0x7f924006ab10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f926415c100 0x7f926415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640ce310 0x7f92640723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 --2- 172.21.15.47:0/3975846036 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f926406fcd0 0x7f926414fc30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 >> 172.21.15.47:0/3975846036 conn(0x7f926406c800 msgr2=0x7f926415b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 shutdown_connections 2024-04-26T23:47:50.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.822+0000 7f9269c00640 1 -- 172.21.15.47:0/3975846036 wait complete. 2024-04-26T23:47:50.847 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:47:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff598600640 1 Processor -- start 2024-04-26T23:47:50.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff598600640 1 -- start start 2024-04-26T23:47:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff598600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff59006f0a0 0x7ff5900d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff598600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5900713a0 0x7ff59009bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff598600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5900d2340 con 0x7ff59009ba60 2024-04-26T23:47:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff598600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff5900cd580 con 0x7ff59006f0a0 2024-04-26T23:47:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff598600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff5900cd860 con 0x7ff5900713a0 2024-04-26T23:47:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff595200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff59009ba60 0x7ff5900ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44666/0 (socket says 172.21.15.47:44666) 2024-04-26T23:47:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff595200640 1 -- 172.21.15.47:0/1424213568 learned_addr learned my addr 172.21.15.47:0/1424213568 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff596600640 1 --2- 172.21.15.47:0/1424213568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5900713a0 0x7ff59009bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff595c00640 1 --2- 172.21.15.47:0/1424213568 >> v2:172.21.15.203:3300/0 conn(0x7ff59006f0a0 0x7ff5900d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff58fe00640 1 -- 172.21.15.47:0/1424213568 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736663863 0 0) 0x7ff5900d2340 con 0x7ff59009ba60 2024-04-26T23:47:50.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff58fe00640 1 -- 172.21.15.47:0/1424213568 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff578003530 con 0x7ff59009ba60 2024-04-26T23:47:50.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff596600640 1 -- 172.21.15.47:0/1424213568 >> v2:172.21.15.203:3300/0 conn(0x7ff59006f0a0 msgr2=0x7ff5900d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:50.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff596600640 1 --2- 172.21.15.47:0/1424213568 >> v2:172.21.15.203:3300/0 conn(0x7ff59006f0a0 0x7ff5900d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff596600640 1 -- 172.21.15.47:0/1424213568 >> v1:172.21.15.47:6789/0 conn(0x7ff59009ba60 legacy=0x7ff5900ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.982+0000 7ff596600640 1 -- 172.21.15.47:0/1424213568 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5900cdb40 con 0x7ff5900713a0 2024-04-26T23:47:50.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff596600640 1 --2- 172.21.15.47:0/1424213568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5900713a0 0x7ff59009bee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff588009d90 tx=0x7ff58801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea54332cd28a52dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff58fe00640 1 -- 172.21.15.47:0/1424213568 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5880b2070 con 0x7ff5900713a0 2024-04-26T23:47:50.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff58fe00640 1 -- 172.21.15.47:0/1424213568 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5880a5830 con 0x7ff5900713a0 2024-04-26T23:47:50.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff58fe00640 1 -- 172.21.15.47:0/1424213568 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5880a5c00 con 0x7ff5900713a0 2024-04-26T23:47:50.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 -- 172.21.15.47:0/1424213568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5900713a0 msgr2=0x7ff59009bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 --2- 172.21.15.47:0/1424213568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5900713a0 0x7ff59009bee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff588009d90 tx=0x7ff58801c970 comp rx=0 tx=0).stop 2024-04-26T23:47:50.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 -- 172.21.15.47:0/1424213568 shutdown_connections 2024-04-26T23:47:50.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 --2- 172.21.15.47:0/1424213568 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5900713a0 0x7ff59009bee0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 --2- 172.21.15.47:0/1424213568 >> v2:172.21.15.203:3300/0 conn(0x7ff59006f0a0 0x7ff5900d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 -- 172.21.15.47:0/1424213568 >> 172.21.15.47:0/1424213568 conn(0x7ff5900d2e90 msgr2=0x7ff5900d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:50.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 -- 172.21.15.47:0/1424213568 shutdown_connections 2024-04-26T23:47:50.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.986+0000 7ff598600640 1 -- 172.21.15.47:0/1424213568 wait complete. 2024-04-26T23:47:50.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 Processor -- start 2024-04-26T23:47:50.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 -- start start 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff59006f0a0 0x7ff59015f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5900713a0 0x7ff5900afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff59009ba60 0x7ff59014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff59006d510 con 0x7ff5900713a0 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff59016c140 con 0x7ff59009ba60 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff590150680 con 0x7ff59006f0a0 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5900713a0 0x7ff5900afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5900713a0 0x7ff5900afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40380/0 (socket says 172.21.15.47:40380) 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 -- 172.21.15.47:0/788394173 learned_addr learned my addr 172.21.15.47:0/788394173 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595c00640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff59006f0a0 0x7ff59015f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff596600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff59009ba60 0x7ff59014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 -- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff59006f0a0 msgr2=0x7ff59015f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff59006f0a0 0x7ff59015f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 -- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff59009ba60 msgr2=0x7ff59014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff59009ba60 0x7ff59014fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 -- 172.21.15.47:0/788394173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5901503a0 con 0x7ff5900713a0 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff595200640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5900713a0 0x7ff5900afd40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c4b0 tx=0x7ff57c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff58d600640 1 -- 172.21.15.47:0/788394173 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c017070 con 0x7ff5900713a0 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff58d600640 1 -- 172.21.15.47:0/788394173 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff57c005cf0 con 0x7ff5900713a0 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff58d600640 1 -- 172.21.15.47:0/788394173 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff57c007290 con 0x7ff5900713a0 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff590150e70 con 0x7ff5900713a0 2024-04-26T23:47:50.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.990+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff590151430 con 0x7ff5900713a0 2024-04-26T23:47:51.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.994+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff590069700 con 0x7ff5900713a0 2024-04-26T23:47:51.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.994+0000 7ff58d600640 1 -- 172.21.15.47:0/788394173 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff57c01a070 con 0x7ff5900713a0 2024-04-26T23:47:51.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.994+0000 7ff58d600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff570068650 0x7ff57006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.994+0000 7ff58d600640 1 -- 172.21.15.47:0/788394173 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7ff57c0861b0 con 0x7ff5900713a0 2024-04-26T23:47:51.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.994+0000 7ff595c00640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff570068650 0x7ff57006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.998+0000 7ff595c00640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff570068650 0x7ff57006ab10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff584009a50 tx=0x7ff584008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:51.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:50.998+0000 7ff58d600640 1 -- 172.21.15.47:0/788394173 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff57c056450 con 0x7ff5900713a0 2024-04-26T23:47:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.202+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5900b3890 con 0x7ff5900713a0 2024-04-26T23:47:51.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.202+0000 7ff58d600640 1 -- 172.21.15.47:0/788394173 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5184 (secure 0 0 0) 0x7ff57c055d50 con 0x7ff5900713a0 2024-04-26T23:47:51.209 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:51.209 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3134789300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3134789300},{"type":"v1","addr":"172.21.15.203:6836","nonce":3134789300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/4099074472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4099074472},{"type":"v1","addr":"172.21.15.203:6837","nonce":4099074472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5298,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/789136995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":789136995},{"type":"v1","addr":"172.21.15.47:6834","nonce":789136995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:46:34.565067+0000","modified":"2024-04-26T23:46:37.594167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5301},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5301":{"gid":5301,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/2869278725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":2869278725},{"type":"v1","addr":"172.21.15.47:6835","nonce":2869278725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5301,"qdb_cluster":[5301]},"id":2}]} 2024-04-26T23:47:51.209 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 18 2024-04-26T23:47:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff570068650 msgr2=0x7ff57006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff570068650 0x7ff57006ab10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff584009a50 tx=0x7ff584008040 comp rx=0 tx=0).stop 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5900713a0 msgr2=0x7ff5900afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5900713a0 0x7ff5900afd40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c4b0 tx=0x7ff57c00c970 comp rx=0 tx=0).stop 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 shutdown_connections 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff570068650 0x7ff57006ab10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff59009ba60 0x7ff59014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5900713a0 0x7ff5900afd40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 --2- 172.21.15.47:0/788394173 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff59006f0a0 0x7ff59015f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 >> 172.21.15.47:0/788394173 conn(0x7ff5900d2e90 msgr2=0x7ff59006e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 shutdown_connections 2024-04-26T23:47:51.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.206+0000 7ff598600640 1 -- 172.21.15.47:0/788394173 wait complete. 2024-04-26T23:47:51.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:47:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5fd000640 1 Processor -- start 2024-04-26T23:47:51.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5fd000640 1 -- start start 2024-04-26T23:47:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5fd000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f815c100 0x7fb5f815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5fd000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f815fc50 con 0x7fb5f806fcd0 2024-04-26T23:47:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5fd000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f815ff30 con 0x7fb5f80ce310 2024-04-26T23:47:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5fd000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f8160860 con 0x7fb5f815c100 2024-04-26T23:47:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5efe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb5f806fcd0 0x7fb5f80cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44672/0 (socket says 172.21.15.47:44672) 2024-04-26T23:47:51.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5efe00640 1 -- 172.21.15.47:0/996485877 learned_addr learned my addr 172.21.15.47:0/996485877 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5f5e00640 1 --2- 172.21.15.47:0/996485877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f815c100 0x7fb5f815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5f5400640 1 -- 172.21.15.47:0/996485877 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373489416 0 0) 0x7fb5f815fc50 con 0x7fb5f806fcd0 2024-04-26T23:47:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5f5400640 1 -- 172.21.15.47:0/996485877 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5dc003530 con 0x7fb5f806fcd0 2024-04-26T23:47:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5f5400640 1 -- 172.21.15.47:0/996485877 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3726384825 0 0) 0x7fb5f815ff30 con 0x7fb5f80ce310 2024-04-26T23:47:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5f5e00640 1 -- 172.21.15.47:0/996485877 >> v1:172.21.15.203:6789/0 conn(0x7fb5f80ce310 legacy=0x7fb5f80b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5f5e00640 1 -- 172.21.15.47:0/996485877 >> v1:172.21.15.47:6789/0 conn(0x7fb5f806fcd0 legacy=0x7fb5f80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.366+0000 7fb5f5e00640 1 -- 172.21.15.47:0/996485877 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f8160210 con 0x7fb5f815c100 2024-04-26T23:47:51.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5f5e00640 1 --2- 172.21.15.47:0/996485877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f815c100 0x7fb5f815cf60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80097f0 tx=0x7fb5e801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eaec9678f983a41 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:51.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5f5400640 1 -- 172.21.15.47:0/996485877 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80ab5f0 con 0x7fb5f815c100 2024-04-26T23:47:51.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5f5400640 1 -- 172.21.15.47:0/996485877 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e80b0070 con 0x7fb5f815c100 2024-04-26T23:47:51.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5f5400640 1 -- 172.21.15.47:0/996485877 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80ab9b0 con 0x7fb5f815c100 2024-04-26T23:47:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5fd000640 1 -- 172.21.15.47:0/996485877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f815c100 msgr2=0x7fb5f815cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5fd000640 1 --2- 172.21.15.47:0/996485877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f815c100 0x7fb5f815cf60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80097f0 tx=0x7fb5e801c4e0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5fd000640 1 -- 172.21.15.47:0/996485877 shutdown_connections 2024-04-26T23:47:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5fd000640 1 --2- 172.21.15.47:0/996485877 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f815c100 0x7fb5f815cf60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5fd000640 1 -- 172.21.15.47:0/996485877 >> 172.21.15.47:0/996485877 conn(0x7fb5f806c800 msgr2=0x7fb5f806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5fd000640 1 -- 172.21.15.47:0/996485877 shutdown_connections 2024-04-26T23:47:51.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.370+0000 7fb5fd000640 1 -- 172.21.15.47:0/996485877 wait complete. 2024-04-26T23:47:51.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 Processor -- start 2024-04-26T23:47:51.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 -- start start 2024-04-26T23:47:51.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5f806fcd0 0x7fb5f81578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f80ce310 0x7fb5f81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5f815c100 0x7fb5f80aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f80b60c0 con 0x7fb5f815c100 2024-04-26T23:47:51.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f80b5f40 con 0x7fb5f806fcd0 2024-04-26T23:47:51.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f80cec00 con 0x7fb5f80ce310 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5f815c100 0x7fb5f80aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5f815c100 0x7fb5f80aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40382/0 (socket says 172.21.15.47:40382) 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 -- 172.21.15.47:0/1759444995 learned_addr learned my addr 172.21.15.47:0/1759444995 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f5e00640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5f806fcd0 0x7fb5f81578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5efe00640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f80ce310 0x7fb5f81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 -- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f80ce310 msgr2=0x7fb5f81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f80ce310 0x7fb5f81554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 -- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5f806fcd0 msgr2=0x7fb5f81578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5f806fcd0 0x7fb5f81578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 -- 172.21.15.47:0/1759444995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f81580f0 con 0x7fb5f815c100 2024-04-26T23:47:51.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5f6800640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5f815c100 0x7fb5f80aeec0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c710 tx=0x7fb5f000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:51.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5ee000640 1 -- 172.21.15.47:0/1759444995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0003db0 con 0x7fb5f815c100 2024-04-26T23:47:51.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5ee000640 1 -- 172.21.15.47:0/1759444995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f000ce20 con 0x7fb5f815c100 2024-04-26T23:47:51.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f81faeb0 con 0x7fb5f815c100 2024-04-26T23:47:51.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5ee000640 1 -- 172.21.15.47:0/1759444995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00052b0 con 0x7fb5f815c100 2024-04-26T23:47:51.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f8157de0 con 0x7fb5f815c100 2024-04-26T23:47:51.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.374+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f8069700 con 0x7fb5f815c100 2024-04-26T23:47:51.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.378+0000 7fb5ee000640 1 -- 172.21.15.47:0/1759444995 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fb5f0005450 con 0x7fb5f815c100 2024-04-26T23:47:51.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.378+0000 7fb5ee000640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb5d4068650 0x7fb5d406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.378+0000 7fb5ee000640 1 -- 172.21.15.47:0/1759444995 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7fb5f0086bc0 con 0x7fb5f815c100 2024-04-26T23:47:51.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.378+0000 7fb5f5e00640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb5d4068650 0x7fb5d406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.378+0000 7fb5f5e00640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb5d4068650 0x7fb5d406ab10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80af000 tx=0x7fb5e80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:51.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.382+0000 7fb5ee000640 1 -- 172.21.15.47:0/1759444995 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb5f0056810 con 0x7fb5f815c100 2024-04-26T23:47:51.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5f81fac60 con 0x7fb5f815c100 2024-04-26T23:47:51.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5ee000640 1 -- 172.21.15.47:0/1759444995 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16722 (secure 0 0 0) 0x7fb5f005ab10 con 0x7fb5f815c100 2024-04-26T23:47:51.556 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:51.556 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":38,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:47:31.889557+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:46:32.386905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-26T23:46:33.526173+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:47:51.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb5d4068650 msgr2=0x7fb5d406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb5d4068650 0x7fb5d406ab10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80af000 tx=0x7fb5e80a7000 comp rx=0 tx=0).stop 2024-04-26T23:47:51.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5f815c100 msgr2=0x7fb5f80aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5f815c100 0x7fb5f80aeec0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000c710 tx=0x7fb5f000cbd0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 shutdown_connections 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb5d4068650 0x7fb5d406ab10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb5f815c100 0x7fb5f80aeec0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb5f80ce310 0x7fb5f81554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 --2- 172.21.15.47:0/1759444995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5f806fcd0 0x7fb5f81578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 >> 172.21.15.47:0/1759444995 conn(0x7fb5f806c800 msgr2=0x7fb5f815ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 shutdown_connections 2024-04-26T23:47:51.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.550+0000 7fb5fd000640 1 -- 172.21.15.47:0/1759444995 wait complete. 2024-04-26T23:47:51.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:47:51.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 Processor -- start 2024-04-26T23:47:51.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 -- start start 2024-04-26T23:47:51.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9090159b70 0x7f909006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f90900af7f0 0x7f909006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f909015fca0 0x7f9090160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f90900af360 con 0x7f909015fca0 2024-04-26T23:47:51.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f90900aea30 con 0x7f90900af7f0 2024-04-26T23:47:51.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f9094c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f90900aed10 con 0x7f9090159b70 2024-04-26T23:47:51.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f909015fca0 0x7f9090160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f909015fca0 0x7f9090160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40386/0 (socket says 172.21.15.47:40386) 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 -- 172.21.15.47:0/4045295859 learned_addr learned my addr 172.21.15.47:0/4045295859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908d400640 1 --2- 172.21.15.47:0/4045295859 >> v2:172.21.15.203:3300/0 conn(0x7f90900af7f0 0x7f909006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908de00640 1 --2- 172.21.15.47:0/4045295859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9090159b70 0x7f909006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 -- 172.21.15.47:0/4045295859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9090159b70 msgr2=0x7f909006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 --2- 172.21.15.47:0/4045295859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9090159b70 0x7f909006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 -- 172.21.15.47:0/4045295859 >> v2:172.21.15.203:3300/0 conn(0x7f90900af7f0 msgr2=0x7f909006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 --2- 172.21.15.47:0/4045295859 >> v2:172.21.15.203:3300/0 conn(0x7f90900af7f0 0x7f909006cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908e800640 1 -- 172.21.15.47:0/4045295859 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90900aeff0 con 0x7f909015fca0 2024-04-26T23:47:51.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.714+0000 7f908d400640 1 --2- 172.21.15.47:0/4045295859 >> v2:172.21.15.203:3300/0 conn(0x7f90900af7f0 0x7f909006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:51.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f908e800640 1 --2- 172.21.15.47:0/4045295859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090160130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f90900742a0 tx=0x7f908801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7593c22699476db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:51.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f908ca00640 1 -- 172.21.15.47:0/4045295859 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880a5890 con 0x7f909015fca0 2024-04-26T23:47:51.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f908ca00640 1 -- 172.21.15.47:0/4045295859 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90880a5a30 con 0x7f909015fca0 2024-04-26T23:47:51.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f908ca00640 1 -- 172.21.15.47:0/4045295859 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880a5e00 con 0x7f909015fca0 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 -- 172.21.15.47:0/4045295859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 msgr2=0x7f9090160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 --2- 172.21.15.47:0/4045295859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090160130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f90900742a0 tx=0x7f908801c9f0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 -- 172.21.15.47:0/4045295859 shutdown_connections 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 --2- 172.21.15.47:0/4045295859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090160130 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 --2- 172.21.15.47:0/4045295859 >> v2:172.21.15.203:3300/0 conn(0x7f90900af7f0 0x7f909006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 --2- 172.21.15.47:0/4045295859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9090159b70 0x7f909006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 -- 172.21.15.47:0/4045295859 >> 172.21.15.47:0/4045295859 conn(0x7f90900b2d40 msgr2=0x7f90900b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:51.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 -- 172.21.15.47:0/4045295859 shutdown_connections 2024-04-26T23:47:51.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.718+0000 7f9094c00640 1 -- 172.21.15.47:0/4045295859 wait complete. 2024-04-26T23:47:51.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 Processor -- start 2024-04-26T23:47:51.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 -- start start 2024-04-26T23:47:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90900af7f0 0x7f909014f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9090159b70 0x7f9090151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9090073db0 con 0x7f909015fca0 2024-04-26T23:47:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9090073c30 con 0x7f9090159b70 2024-04-26T23:47:51.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9090073f30 con 0x7f90900af7f0 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40388/0 (socket says 172.21.15.47:40388) 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 -- 172.21.15.47:0/1293365335 learned_addr learned my addr 172.21.15.47:0/1293365335 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908d400640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9090159b70 0x7f9090151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908de00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90900af7f0 0x7f909014f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 -- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90900af7f0 msgr2=0x7f909014f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90900af7f0 0x7f909014f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 -- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9090159b70 msgr2=0x7f9090151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9090159b70 0x7f9090151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 -- 172.21.15.47:0/1293365335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9090155070 con 0x7f909015fca0 2024-04-26T23:47:51.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f908e800640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090150090 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f90880af040 tx=0x7f9088019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9086000640 1 -- 172.21.15.47:0/1293365335 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088009250 con 0x7f909015fca0 2024-04-26T23:47:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9086000640 1 -- 172.21.15.47:0/1293365335 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90880b8650 con 0x7f909015fca0 2024-04-26T23:47:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9086000640 1 -- 172.21.15.47:0/1293365335 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880b8a40 con 0x7f909015fca0 2024-04-26T23:47:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9090155350 con 0x7f909015fca0 2024-04-26T23:47:51.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90900cf600 con 0x7f909015fca0 2024-04-26T23:47:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.722+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90900695f0 con 0x7f909015fca0 2024-04-26T23:47:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.726+0000 7f9086000640 1 -- 172.21.15.47:0/1293365335 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f90880c1020 con 0x7f909015fca0 2024-04-26T23:47:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.726+0000 7f9086000640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9070068650 0x7f907006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:51.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.726+0000 7f9086000640 1 -- 172.21.15.47:0/1293365335 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5737+0+0 (secure 0 0 0) 0x7f9088121390 con 0x7f909015fca0 2024-04-26T23:47:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.726+0000 7f908de00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9070068650 0x7f907006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:51.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.726+0000 7f908de00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9070068650 0x7f907006ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9080007a60 tx=0x7f9080008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:51.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.730+0000 7f9086000640 1 -- 172.21.15.47:0/1293365335 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f90880c8020 con 0x7f909015fca0 2024-04-26T23:47:51.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.926+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f90900b0a30 con 0x7f909015fca0 2024-04-26T23:47:51.934 INFO:tasks.ceph.mon.a.smithi047.stderr:2024-04-26T23:47:51.930+0000 7efc1ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:47:51.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.930+0000 7f9086000640 1 -- 172.21.15.47:0/1293365335 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f90880165e0 con 0x7f909015fca0 2024-04-26T23:47:51.937 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9070068650 msgr2=0x7f907006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9070068650 0x7f907006ab10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9080007a60 tx=0x7f9080008040 comp rx=0 tx=0).stop 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 msgr2=0x7f9090150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090150090 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f90880af040 tx=0x7f9088019790 comp rx=0 tx=0).stop 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 shutdown_connections 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9070068650 0x7f907006ab10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f909015fca0 0x7f9090150090 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9090159b70 0x7f9090151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 --2- 172.21.15.47:0/1293365335 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f90900af7f0 0x7f909014f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 >> 172.21.15.47:0/1293365335 conn(0x7f90900b2d40 msgr2=0x7f90900b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 shutdown_connections 2024-04-26T23:47:51.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:51.934+0000 7f9094c00640 1 -- 172.21.15.47:0/1293365335 wait complete. 2024-04-26T23:47:51.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:47:52.007 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-26T23:47:52.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.098+0000 7f1108000640 1 Processor -- start 2024-04-26T23:47:52.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.098+0000 7f1108000640 1 -- start start 2024-04-26T23:47:52.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1108000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11000d0390 0x7f11000af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:52.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1108000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f11001603e0 0x7f110006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:52.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1108000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11000ae6a0 con 0x7f110006c630 2024-04-26T23:47:52.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1108000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f11000ae920 con 0x7f11000d0390 2024-04-26T23:47:52.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1108000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f11000aec00 con 0x7f11001603e0 2024-04-26T23:47:52.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1105600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11000d0390 0x7f11000af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:52.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1105600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11000d0390 0x7f11000af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40418/0 (socket says 172.21.15.47:40418) 2024-04-26T23:47:52.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1105600640 1 -- 172.21.15.47:0/4164906548 learned_addr learned my addr 172.21.15.47:0/4164906548 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:52.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1106000640 1 --2- 172.21.15.47:0/4164906548 >> v2:172.21.15.203:3300/0 conn(0x7f11001603e0 0x7f110006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1105600640 1 -- 172.21.15.47:0/4164906548 >> v2:172.21.15.203:3300/0 conn(0x7f11001603e0 msgr2=0x7f110006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1105600640 1 --2- 172.21.15.47:0/4164906548 >> v2:172.21.15.203:3300/0 conn(0x7f11001603e0 0x7f110006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1105600640 1 -- 172.21.15.47:0/4164906548 >> v1:172.21.15.203:6789/0 conn(0x7f110006c630 legacy=0x7f110015fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1105600640 1 -- 172.21.15.47:0/4164906548 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11000aeee0 con 0x7f11000d0390 2024-04-26T23:47:52.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.102+0000 7f1106000640 1 --2- 172.21.15.47:0/4164906548 >> v2:172.21.15.203:3300/0 conn(0x7f11001603e0 0x7f110006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:52.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1105600640 1 --2- 172.21.15.47:0/4164906548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11000af6e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1100159f90 tx=0x7f10f401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6ac53e8dccb27a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:52.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f10ffe00640 1 -- 172.21.15.47:0/4164906548 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f40b4070 con 0x7f11000d0390 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f10ffe00640 1 -- 172.21.15.47:0/4164906548 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f40a7a30 con 0x7f11000d0390 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f10ffe00640 1 -- 172.21.15.47:0/4164906548 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f40a7e00 con 0x7f11000d0390 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- 172.21.15.47:0/4164906548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 msgr2=0x7f11000af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 --2- 172.21.15.47:0/4164906548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11000af6e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1100159f90 tx=0x7f10f401eb60 comp rx=0 tx=0).stop 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- 172.21.15.47:0/4164906548 shutdown_connections 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 --2- 172.21.15.47:0/4164906548 >> v2:172.21.15.203:3300/0 conn(0x7f11001603e0 0x7f110006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 --2- 172.21.15.47:0/4164906548 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11000af6e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- 172.21.15.47:0/4164906548 >> 172.21.15.47:0/4164906548 conn(0x7f11000b2b70 msgr2=0x7f11000b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- 172.21.15.47:0/4164906548 shutdown_connections 2024-04-26T23:47:52.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- 172.21.15.47:0/4164906548 wait complete. 2024-04-26T23:47:52.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 Processor -- start 2024-04-26T23:47:52.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- start start 2024-04-26T23:47:52.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f110006c630 0x7f11001fbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11001665f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11001603e0 0x7f1100154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f110006faf0 con 0x7f11000d0390 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f110006f970 con 0x7f110006c630 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.106+0000 7f1108000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f110006fc70 con 0x7f11001603e0 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11001665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11001665f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40424/0 (socket says 172.21.15.47:40424) 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 -- 172.21.15.47:0/3821798897 learned_addr learned my addr 172.21.15.47:0/3821798897 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1105600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f110006c630 0x7f11001fbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1106000640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11001603e0 0x7f1100154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 -- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11001603e0 msgr2=0x7f1100154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11001603e0 0x7f1100154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 -- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f110006c630 msgr2=0x7f11001fbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f110006c630 0x7f11001fbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 -- 172.21.15.47:0/3821798897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1100166b30 con 0x7f11000d0390 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1104c00640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11001665f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c370 tx=0x7f10ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f10fd600640 1 -- 172.21.15.47:0/3821798897 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0052d0 con 0x7f11000d0390 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f10fd600640 1 -- 172.21.15.47:0/3821798897 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ec005470 con 0x7f11000d0390 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11000b05f0 con 0x7f11000d0390 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f10fd600640 1 -- 172.21.15.47:0/3821798897 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec007260 con 0x7f11000d0390 2024-04-26T23:47:52.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11000b0bb0 con 0x7f11000d0390 2024-04-26T23:47:52.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11000b0380 con 0x7f11000d0390 2024-04-26T23:47:52.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f10fd600640 1 -- 172.21.15.47:0/3821798897 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f10ec007400 con 0x7f11000d0390 2024-04-26T23:47:52.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.110+0000 7f10fd600640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10e0068650 0x7f10e006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:52.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.114+0000 7f10fd600640 1 -- 172.21.15.47:0/3821798897 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5795+0+0 (secure 0 0 0) 0x7f10ec0862a0 con 0x7f11000d0390 2024-04-26T23:47:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.114+0000 7f1105600640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10e0068650 0x7f10e006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:52.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.114+0000 7f1105600640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10e0068650 0x7f10e006ab10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10f40b1000 tx=0x7f10f40a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:52.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.118+0000 7f10fd600640 1 -- 172.21.15.47:0/3821798897 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f11000ae6a0 con 0x7f11000d0390 2024-04-26T23:47:52.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.322+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1100069700 con 0x7f11000d0390 2024-04-26T23:47:52.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f10fd600640 1 -- 172.21.15.47:0/3821798897 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7f10ec0860c0 con 0x7f11000d0390 2024-04-26T23:47:52.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10e0068650 msgr2=0x7f10e006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:52.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10e0068650 0x7f10e006ab10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10f40b1000 tx=0x7f10f40a9070 comp rx=0 tx=0).stop 2024-04-26T23:47:52.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 msgr2=0x7f11001665f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:52.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11001665f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00c370 tx=0x7f10ec00c830 comp rx=0 tx=0).stop 2024-04-26T23:47:52.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 shutdown_connections 2024-04-26T23:47:52.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f10e0068650 0x7f10e006ab10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11001603e0 0x7f1100154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11000d0390 0x7f11001665f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 --2- 172.21.15.47:0/3821798897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f110006c630 0x7f11001fbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:52.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 >> 172.21.15.47:0/3821798897 conn(0x7f11000b2b70 msgr2=0x7f110015e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:52.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 shutdown_connections 2024-04-26T23:47:52.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:52.934+0000 7f1108000640 1 -- 172.21.15.47:0/3821798897 wait complete. 2024-04-26T23:47:52.967 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:47:53.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 Processor -- start 2024-04-26T23:47:53.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 -- start start 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fee5c072960 0x7fee5c160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fee5c072d40 0x7fee5c162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c163330 0x7fee5c1637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fee5c0b62e0 con 0x7fee5c072d40 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fee5c073960 con 0x7fee5c072960 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee64400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c1607c0 con 0x7fee5c163330 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fee5c072d40 0x7fee5c162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fee5c072d40 0x7fee5c162df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40440/0 (socket says 172.21.15.47:40440) 2024-04-26T23:47:53.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 -- 172.21.15.47:0/3275241822 learned_addr learned my addr 172.21.15.47:0/3275241822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee62400640 1 --2- 172.21.15.47:0/3275241822 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c163330 0x7fee5c1637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61a00640 1 --2- 172.21.15.47:0/3275241822 >> v2:172.21.15.203:3300/0 conn(0x7fee5c072960 0x7fee5c160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 -- 172.21.15.47:0/3275241822 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c163330 msgr2=0x7fee5c1637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 --2- 172.21.15.47:0/3275241822 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c163330 0x7fee5c1637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 -- 172.21.15.47:0/3275241822 >> v2:172.21.15.203:3300/0 conn(0x7fee5c072960 msgr2=0x7fee5c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 --2- 172.21.15.47:0/3275241822 >> v2:172.21.15.203:3300/0 conn(0x7fee5c072960 0x7fee5c160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61000640 1 -- 172.21.15.47:0/3275241822 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c0b56d0 con 0x7fee5c072d40 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee62400640 1 --2- 172.21.15.47:0/3275241822 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c163330 0x7fee5c1637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:53.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.154+0000 7fee61a00640 1 --2- 172.21.15.47:0/3275241822 >> v2:172.21.15.203:3300/0 conn(0x7fee5c072960 0x7fee5c160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:53.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee61000640 1 --2- 172.21.15.47:0/3275241822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072d40 0x7fee5c162df0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fee5c075ae0 tx=0x7fee4801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394971eda48876dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:53.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee5be00640 1 -- 172.21.15.47:0/3275241822 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480ab620 con 0x7fee5c072d40 2024-04-26T23:47:53.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee5be00640 1 -- 172.21.15.47:0/3275241822 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee480b0070 con 0x7fee5c072d40 2024-04-26T23:47:53.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee5be00640 1 -- 172.21.15.47:0/3275241822 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee480ab9e0 con 0x7fee5c072d40 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 -- 172.21.15.47:0/3275241822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072d40 msgr2=0x7fee5c162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 --2- 172.21.15.47:0/3275241822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072d40 0x7fee5c162df0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fee5c075ae0 tx=0x7fee4801c460 comp rx=0 tx=0).stop 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 -- 172.21.15.47:0/3275241822 shutdown_connections 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 --2- 172.21.15.47:0/3275241822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072d40 0x7fee5c162df0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 --2- 172.21.15.47:0/3275241822 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c163330 0x7fee5c1637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 --2- 172.21.15.47:0/3275241822 >> v2:172.21.15.203:3300/0 conn(0x7fee5c072960 0x7fee5c160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 -- 172.21.15.47:0/3275241822 >> 172.21.15.47:0/3275241822 conn(0x7fee5c070bc0 msgr2=0x7fee5c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 -- 172.21.15.47:0/3275241822 shutdown_connections 2024-04-26T23:47:53.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 -- 172.21.15.47:0/3275241822 wait complete. 2024-04-26T23:47:53.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.158+0000 7fee64400640 1 Processor -- start 2024-04-26T23:47:53.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 -- start start 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072960 0x7fee5c0d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c072d40 0x7fee5c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee5c163330 0x7fee5c15a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c15d0b0 con 0x7fee5c072960 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee5c0731d0 con 0x7fee5c163330 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee5c15d230 con 0x7fee5c072d40 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072960 0x7fee5c0d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:53.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072960 0x7fee5c0d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40446/0 (socket says 172.21.15.47:40446) 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 -- 172.21.15.47:0/2670087943 learned_addr learned my addr 172.21.15.47:0/2670087943 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61000640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c072d40 0x7fee5c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee62400640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee5c163330 0x7fee5c15a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 -- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c072d40 msgr2=0x7fee5c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c072d40 0x7fee5c15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 -- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee5c163330 msgr2=0x7fee5c15a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee5c163330 0x7fee5c15a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 -- 172.21.15.47:0/2670087943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5c06c400 con 0x7fee5c072960 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee61a00640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072960 0x7fee5c0d0af0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fee5000d800 tx=0x7fee5000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee59600640 1 -- 172.21.15.47:0/2670087943 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50018070 con 0x7fee5c072960 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee59600640 1 -- 172.21.15.47:0/2670087943 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee50004030 con 0x7fee5c072960 2024-04-26T23:47:53.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee59600640 1 -- 172.21.15.47:0/2670087943 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee50004400 con 0x7fee5c072960 2024-04-26T23:47:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5c14b580 con 0x7fee5c072960 2024-04-26T23:47:53.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5c14b820 con 0x7fee5c072960 2024-04-26T23:47:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.162+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5c0695f0 con 0x7fee5c072960 2024-04-26T23:47:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.166+0000 7fee59600640 1 -- 172.21.15.47:0/2670087943 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fee500096a0 con 0x7fee5c072960 2024-04-26T23:47:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.166+0000 7fee59600640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee3c0686a0 0x7fee3c06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.166+0000 7fee59600640 1 -- 172.21.15.47:0/2670087943 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5795+0+0 (secure 0 0 0) 0x7fee500870d0 con 0x7fee5c072960 2024-04-26T23:47:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.166+0000 7fee61000640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee3c0686a0 0x7fee3c06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:53.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.166+0000 7fee61000640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee3c0686a0 0x7fee3c06ab60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fee480af000 tx=0x7fee480a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:53.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.170+0000 7fee59600640 1 -- 172.21.15.47:0/2670087943 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fee500573b0 con 0x7fee5c072960 2024-04-26T23:47:53.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:53.334+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee5c0cdc30 con 0x7fee5c072960 2024-04-26T23:47:54.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.138+0000 7fee59600640 1 -- 172.21.15.47:0/2670087943 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) ==== 181+0+0 (secure 0 0 0) 0x7fee50056cb0 con 0x7fee5c072960 2024-04-26T23:47:54.143 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:47:54.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.138+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee3c0686a0 msgr2=0x7fee3c06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:54.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.138+0000 7fee64400640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee3c0686a0 0x7fee3c06ab60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fee480af000 tx=0x7fee480a7000 comp rx=0 tx=0).stop 2024-04-26T23:47:54.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.138+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072960 msgr2=0x7fee5c0d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:54.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.138+0000 7fee64400640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072960 0x7fee5c0d0af0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fee5000d800 tx=0x7fee5000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 shutdown_connections 2024-04-26T23:47:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fee3c0686a0 0x7fee3c06ab60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee5c163330 0x7fee5c15a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee5c072d40 0x7fee5c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 --2- 172.21.15.47:0/2670087943 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee5c072960 0x7fee5c0d0af0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 >> 172.21.15.47:0/2670087943 conn(0x7fee5c070bc0 msgr2=0x7fee5c1609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:54.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 shutdown_connections 2024-04-26T23:47:54.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.142+0000 7fee64400640 1 -- 172.21.15.47:0/2670087943 wait complete. 2024-04-26T23:47:54.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:47:54.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aaca00640 1 Processor -- start 2024-04-26T23:47:54.324 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aaca00640 1 -- start start 2024-04-26T23:47:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aaca00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1aa8072d40 0x7f1aa806ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aaca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f1aa806f140 0x7f1aa806f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aaca00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa8073960 con 0x7f1aa8072960 2024-04-26T23:47:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aaca00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa80b62e0 con 0x7f1aa8072d40 2024-04-26T23:47:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aaca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa80b56d0 con 0x7f1aa806f140 2024-04-26T23:47:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1a9d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1aa8072d40 0x7f1aa806ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:54.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1a9d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1aa8072d40 0x7f1aa806ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40458/0 (socket says 172.21.15.47:40458) 2024-04-26T23:47:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1a9d400640 1 -- 172.21.15.47:0/3477116025 learned_addr learned my addr 172.21.15.47:0/3477116025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1a9d400640 1 -- 172.21.15.47:0/3477116025 >> v2:172.21.15.203:3300/0 conn(0x7f1aa806f140 msgr2=0x7f1aa806f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aa6800640 1 --2- 172.21.15.47:0/3477116025 >> v2:172.21.15.203:3300/0 conn(0x7f1aa806f140 0x7f1aa806f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1a9d400640 1 --2- 172.21.15.47:0/3477116025 >> v2:172.21.15.203:3300/0 conn(0x7f1aa806f140 0x7f1aa806f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1a9d400640 1 -- 172.21.15.47:0/3477116025 >> v1:172.21.15.203:6789/0 conn(0x7f1aa8072960 legacy=0x7f1aa8160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1a9d400640 1 -- 172.21.15.47:0/3477116025 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa80b59b0 con 0x7f1aa8072d40 2024-04-26T23:47:54.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.318+0000 7f1aa6800640 1 --2- 172.21.15.47:0/3477116025 >> v2:172.21.15.203:3300/0 conn(0x7f1aa806f140 0x7f1aa806f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:47:54.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1a9d400640 1 --2- 172.21.15.47:0/3477116025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa806ec00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8075390 tx=0x7f1a9001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c802ec134fca273 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:54.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aa5400640 1 -- 172.21.15.47:0/3477116025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900b0070 con 0x7f1aa8072d40 2024-04-26T23:47:54.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aa5400640 1 -- 172.21.15.47:0/3477116025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a900ab600 con 0x7f1aa8072d40 2024-04-26T23:47:54.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aa5400640 1 -- 172.21.15.47:0/3477116025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900ab9d0 con 0x7f1aa8072d40 2024-04-26T23:47:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 -- 172.21.15.47:0/3477116025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 msgr2=0x7f1aa806ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 --2- 172.21.15.47:0/3477116025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa806ec00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8075390 tx=0x7f1a9001c420 comp rx=0 tx=0).stop 2024-04-26T23:47:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 -- 172.21.15.47:0/3477116025 shutdown_connections 2024-04-26T23:47:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 --2- 172.21.15.47:0/3477116025 >> v2:172.21.15.203:3300/0 conn(0x7f1aa806f140 0x7f1aa806f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 --2- 172.21.15.47:0/3477116025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa806ec00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 -- 172.21.15.47:0/3477116025 >> 172.21.15.47:0/3477116025 conn(0x7f1aa8070bc0 msgr2=0x7f1aa806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:54.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 -- 172.21.15.47:0/3477116025 shutdown_connections 2024-04-26T23:47:54.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.322+0000 7f1aaca00640 1 -- 172.21.15.47:0/3477116025 wait complete. 2024-04-26T23:47:54.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 Processor -- start 2024-04-26T23:47:54.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 -- start start 2024-04-26T23:47:54.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1aa806f140 0x7f1aa80cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:54.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1aa8072960 0x7f1aa81609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:54.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa80cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:54.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa815d230 con 0x7f1aa8072d40 2024-04-26T23:47:54.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa815d0b0 con 0x7f1aa8072960 2024-04-26T23:47:54.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa80b5280 con 0x7f1aa806f140 2024-04-26T23:47:54.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa80cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa80cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40466/0 (socket says 172.21.15.47:40466) 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 -- 172.21.15.47:0/145985230 learned_addr learned my addr 172.21.15.47:0/145985230 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa5e00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1aa806f140 0x7f1aa80cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1a9d400640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1aa8072960 0x7f1aa81609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 -- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1aa806f140 msgr2=0x7f1aa80cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1aa806f140 0x7f1aa80cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 -- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1aa8072960 msgr2=0x7f1aa81609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1aa8072960 0x7f1aa81609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:54.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 -- 172.21.15.47:0/145985230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa81555e0 con 0x7f1aa8072d40 2024-04-26T23:47:54.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aa6800640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa80cc730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000cd80 tx=0x7f1aa000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:54.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1a9ea00640 1 -- 172.21.15.47:0/145985230 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000f680 con 0x7f1aa8072d40 2024-04-26T23:47:54.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1a9ea00640 1 -- 172.21.15.47:0/145985230 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa000f840 con 0x7f1aa8072d40 2024-04-26T23:47:54.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1a9ea00640 1 -- 172.21.15.47:0/145985230 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000fc30 con 0x7f1aa8072d40 2024-04-26T23:47:54.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa81586b0 con 0x7f1aa8072d40 2024-04-26T23:47:54.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.326+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa8154ff0 con 0x7f1aa8072d40 2024-04-26T23:47:54.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.330+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa80695f0 con 0x7f1aa8072d40 2024-04-26T23:47:54.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.330+0000 7f1a9ea00640 1 -- 172.21.15.47:0/145985230 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f1aa00213f0 con 0x7f1aa8072d40 2024-04-26T23:47:54.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.330+0000 7f1a9ea00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1a84068680 0x7f1a8406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:54.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.330+0000 7f1a9ea00640 1 -- 172.21.15.47:0/145985230 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5357+0+0 (secure 0 0 0) 0x7f1aa00879a0 con 0x7f1aa8072d40 2024-04-26T23:47:54.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.330+0000 7f1aa5e00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1a84068680 0x7f1a8406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:54.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.334+0000 7f1aa5e00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1a84068680 0x7f1a8406ab40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80d1160 tx=0x7f1a98009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:54.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.334+0000 7f1a9ea00640 1 -- 172.21.15.47:0/145985230 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1aa81555e0 con 0x7f1aa8072d40 2024-04-26T23:47:54.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:54.498+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1aa80d0eb0 con 0x7f1aa8072d40 2024-04-26T23:47:55.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.142+0000 7f1a9ea00640 1 -- 172.21.15.47:0/145985230 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) ==== 169+0+0 (secure 0 0 0) 0x7f1aa0014030 con 0x7f1aa8072d40 2024-04-26T23:47:55.149 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-04-26T23:47:55.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1a84068680 msgr2=0x7f1a8406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1a84068680 0x7f1a8406ab40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80d1160 tx=0x7f1a98009060 comp rx=0 tx=0).stop 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 msgr2=0x7f1aa80cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa80cc730 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000cd80 tx=0x7f1aa000a650 comp rx=0 tx=0).stop 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 shutdown_connections 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1a84068680 0x7f1a8406ab40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1aa8072d40 0x7f1aa80cc730 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1aa8072960 0x7f1aa81609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 --2- 172.21.15.47:0/145985230 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1aa806f140 0x7f1aa80cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 >> 172.21.15.47:0/145985230 conn(0x7f1aa8070bc0 msgr2=0x7f1aa80cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:55.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 shutdown_connections 2024-04-26T23:47:55.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.146+0000 7f1aaca00640 1 -- 172.21.15.47:0/145985230 wait complete. 2024-04-26T23:47:55.181 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/volumes/snapshot_clone_delay 2024-04-26T23:47:55.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.318+0000 7ff851e00640 1 Processor -- start 2024-04-26T23:47:55.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.318+0000 7ff851e00640 1 -- start start 2024-04-26T23:47:55.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff851e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c0d0390 0x7ff84c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff851e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff84c1603e0 0x7ff84c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff851e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff84c0ae6a0 con 0x7ff84c06c630 2024-04-26T23:47:55.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff851e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff84c0ae920 con 0x7ff84c1603e0 2024-04-26T23:47:55.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff851e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c0aec00 con 0x7ff84c0d0390 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c0d0390 0x7ff84c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c0d0390 0x7ff84c0af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:58192/0 (socket says 172.21.15.47:58192) 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84aa00640 1 -- 172.21.15.47:0/2119203683 learned_addr learned my addr 172.21.15.47:0/2119203683 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84b400640 1 --2- 172.21.15.47:0/2119203683 >> v2:172.21.15.203:3300/0 conn(0x7ff84c1603e0 0x7ff84c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84a000640 1 -- 172.21.15.47:0/2119203683 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682122816 0 0) 0x7ff834001120 con 0x7ff84c06c630 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84a000640 1 -- 172.21.15.47:0/2119203683 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff830005740 con 0x7ff84c06c630 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84aa00640 1 -- 172.21.15.47:0/2119203683 >> v2:172.21.15.203:3300/0 conn(0x7ff84c1603e0 msgr2=0x7ff84c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:55.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84aa00640 1 --2- 172.21.15.47:0/2119203683 >> v2:172.21.15.203:3300/0 conn(0x7ff84c1603e0 0x7ff84c06cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84aa00640 1 -- 172.21.15.47:0/2119203683 >> v1:172.21.15.203:6789/0 conn(0x7ff84c06c630 legacy=0x7ff84c15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.322+0000 7ff84aa00640 1 -- 172.21.15.47:0/2119203683 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c0aeee0 con 0x7ff84c0d0390 2024-04-26T23:47:55.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff84aa00640 1 --2- 172.21.15.47:0/2119203683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c0d0390 0x7ff84c0af6e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009870 tx=0x7ff83c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8147bf5a15aaae2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:55.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff84a000640 1 -- 172.21.15.47:0/2119203683 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0b0070 con 0x7ff84c0d0390 2024-04-26T23:47:55.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff84a000640 1 -- 172.21.15.47:0/2119203683 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff83c0ab600 con 0x7ff84c0d0390 2024-04-26T23:47:55.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff84a000640 1 -- 172.21.15.47:0/2119203683 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0ab9d0 con 0x7ff84c0d0390 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 -- 172.21.15.47:0/2119203683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c0d0390 msgr2=0x7ff84c0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 --2- 172.21.15.47:0/2119203683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c0d0390 0x7ff84c0af6e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009870 tx=0x7ff83c01c4d0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 -- 172.21.15.47:0/2119203683 shutdown_connections 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 --2- 172.21.15.47:0/2119203683 >> v2:172.21.15.203:3300/0 conn(0x7ff84c1603e0 0x7ff84c06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 --2- 172.21.15.47:0/2119203683 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c0d0390 0x7ff84c0af6e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 -- 172.21.15.47:0/2119203683 >> 172.21.15.47:0/2119203683 conn(0x7ff84c0b2b70 msgr2=0x7ff84c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 -- 172.21.15.47:0/2119203683 shutdown_connections 2024-04-26T23:47:55.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.326+0000 7ff851e00640 1 -- 172.21.15.47:0/2119203683 wait complete. 2024-04-26T23:47:55.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 Processor -- start 2024-04-26T23:47:55.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 -- start start 2024-04-26T23:47:55.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff84c06c630 0x7ff84c15b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff84c0d0390 0x7ff84c0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c1603e0 0x7ff84c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c06fa70 con 0x7ff84c0d0390 2024-04-26T23:47:55.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c06f8f0 con 0x7ff84c06c630 2024-04-26T23:47:55.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff851e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c06fbf0 con 0x7ff84c1603e0 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff843e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff84c0d0390 0x7ff84c0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff843e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff84c0d0390 0x7ff84c0afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40474/0 (socket says 172.21.15.47:40474) 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff843e00640 1 -- 172.21.15.47:0/2912065628 learned_addr learned my addr 172.21.15.47:0/2912065628 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84aa00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff84c06c630 0x7ff84c15b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84b400640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c1603e0 0x7ff84c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84b400640 1 -- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff84c06c630 msgr2=0x7ff84c15b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84b400640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff84c06c630 0x7ff84c15b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84b400640 1 -- 172.21.15.47:0/2912065628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff84c0d0390 msgr2=0x7ff84c0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84b400640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff84c0d0390 0x7ff84c0afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84b400640 1 -- 172.21.15.47:0/2912065628 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c1583e0 con 0x7ff84c1603e0 2024-04-26T23:47:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff84b400640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c1603e0 0x7ff84c147690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff84400eba0 tx=0x7ff84400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.330+0000 7ff843400640 1 -- 172.21.15.47:0/2912065628 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844018020 con 0x7ff84c1603e0 2024-04-26T23:47:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff843400640 1 -- 172.21.15.47:0/2912065628 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84400cd20 con 0x7ff84c1603e0 2024-04-26T23:47:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84c1586c0 con 0x7ff84c1603e0 2024-04-26T23:47:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff843400640 1 -- 172.21.15.47:0/2912065628 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8440146c0 con 0x7ff84c1603e0 2024-04-26T23:47:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c158f60 con 0x7ff84c1603e0 2024-04-26T23:47:55.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff84c158890 con 0x7ff84c1603e0 2024-04-26T23:47:55.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff843400640 1 -- 172.21.15.47:0/2912065628 <== mon.2 v2:172.21.15.203:3301/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff84401b020 con 0x7ff84c1603e0 2024-04-26T23:47:55.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff843400640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff828068680 0x7ff82806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff843400640 1 -- 172.21.15.47:0/2912065628 <== mon.2 v2:172.21.15.203:3301/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7ff8440877f0 con 0x7ff84c1603e0 2024-04-26T23:47:55.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.334+0000 7ff84aa00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff828068680 0x7ff82806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.338+0000 7ff84aa00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff828068680 0x7ff82806ab40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0ad000 tx=0x7ff83c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:55.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.342+0000 7ff843400640 1 -- 172.21.15.47:0/2912065628 <== mon.2 v2:172.21.15.203:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff844022030 con 0x7ff84c1603e0 2024-04-26T23:47:55.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.514+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"} v 0) -- 0x7ff84c069700 con 0x7ff84c1603e0 2024-04-26T23:47:55.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.518+0000 7ff843400640 1 -- 172.21.15.47:0/2912065628 <== mon.2 v2:172.21.15.203:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/volumes/snapshot_clone_delay"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7ff844010040 con 0x7ff84c1603e0 2024-04-26T23:47:55.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff828068680 msgr2=0x7ff82806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff828068680 0x7ff82806ab40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff83c0ad000 tx=0x7ff83c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c1603e0 msgr2=0x7ff84c147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c1603e0 0x7ff84c147690 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff84400eba0 tx=0x7ff84400c490 comp rx=0 tx=0).stop 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 shutdown_connections 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff828068680 0x7ff82806ab40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff84c1603e0 0x7ff84c147690 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff84c0d0390 0x7ff84c0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 --2- 172.21.15.47:0/2912065628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff84c06c630 0x7ff84c15b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 >> 172.21.15.47:0/2912065628 conn(0x7ff84c0b2b70 msgr2=0x7ff84c166420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 shutdown_connections 2024-04-26T23:47:55.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.522+0000 7ff851e00640 1 -- 172.21.15.47:0/2912065628 wait complete. 2024-04-26T23:47:55.547 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:47:55.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.682+0000 7f7574800640 1 Processor -- start 2024-04-26T23:47:55.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.682+0000 7f7574800640 1 -- start start 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7574800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f756c0af6e0 0x7f756c1603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7574800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756c0ae6a0 con 0x7f756c06cd40 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7574800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756c0ae920 con 0x7f756c0d0390 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7574800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f756c0aec00 con 0x7f756c0af6e0 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7571400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f756c06cd40 0x7f756c15fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44696/0 (socket says 172.21.15.47:44696) 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7571400640 1 -- 172.21.15.47:0/3303268700 learned_addr learned my addr 172.21.15.47:0/3303268700 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7572800640 1 --2- 172.21.15.47:0/3303268700 >> v2:172.21.15.203:3300/0 conn(0x7f756c0af6e0 0x7f756c1603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7570a00640 1 -- 172.21.15.47:0/3303268700 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 366576258 0 0) 0x7f755c001120 con 0x7f756c06cd40 2024-04-26T23:47:55.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7570a00640 1 -- 172.21.15.47:0/3303268700 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7554005740 con 0x7f756c06cd40 2024-04-26T23:47:55.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7570a00640 1 -- 172.21.15.47:0/3303268700 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082543006 0 0) 0x7f756c0ae920 con 0x7f756c0d0390 2024-04-26T23:47:55.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7570a00640 1 -- 172.21.15.47:0/3303268700 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f755c001120 con 0x7f756c0d0390 2024-04-26T23:47:55.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7572800640 1 -- 172.21.15.47:0/3303268700 >> v1:172.21.15.203:6789/0 conn(0x7f756c0d0390 legacy=0x7f756c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7572800640 1 -- 172.21.15.47:0/3303268700 >> v1:172.21.15.47:6789/0 conn(0x7f756c06cd40 legacy=0x7f756c15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.686+0000 7f7572800640 1 -- 172.21.15.47:0/3303268700 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c0aeee0 con 0x7f756c0af6e0 2024-04-26T23:47:55.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7572800640 1 --2- 172.21.15.47:0/3303268700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c1603e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7568009d90 tx=0x7f756801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a451b36f4e75f7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:55.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7570a00640 1 -- 172.21.15.47:0/3303268700 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680b2070 con 0x7f756c0af6e0 2024-04-26T23:47:55.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7570a00640 1 -- 172.21.15.47:0/3303268700 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75680a5900 con 0x7f756c0af6e0 2024-04-26T23:47:55.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7570a00640 1 -- 172.21.15.47:0/3303268700 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680a5cb0 con 0x7f756c0af6e0 2024-04-26T23:47:55.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- 172.21.15.47:0/3303268700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 msgr2=0x7f756c1603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 --2- 172.21.15.47:0/3303268700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c1603e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7568009d90 tx=0x7f756801c8b0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- 172.21.15.47:0/3303268700 shutdown_connections 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 --2- 172.21.15.47:0/3303268700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c1603e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- 172.21.15.47:0/3303268700 >> 172.21.15.47:0/3303268700 conn(0x7f756c0b2b70 msgr2=0x7f756c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- 172.21.15.47:0/3303268700 shutdown_connections 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- 172.21.15.47:0/3303268700 wait complete. 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 Processor -- start 2024-04-26T23:47:55.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- start start 2024-04-26T23:47:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f756c06cd40 0x7f756c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c14b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756c0d0390 0x7f756c14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f756c06faf0 con 0x7f756c0d0390 2024-04-26T23:47:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f756c06f970 con 0x7f756c0af6e0 2024-04-26T23:47:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.690+0000 7f7574800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f756c06fc70 con 0x7f756c06cd40 2024-04-26T23:47:55.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756c0d0390 0x7f756c14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7571e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f756c06cd40 0x7f756c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756c0d0390 0x7f756c14c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40482/0 (socket says 172.21.15.47:40482) 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 -- 172.21.15.47:0/2873005128 learned_addr learned my addr 172.21.15.47:0/2873005128 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7571400640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c14b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 -- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f756c06cd40 msgr2=0x7f756c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f756c06cd40 0x7f756c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 -- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 msgr2=0x7f756c14b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c14b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 -- 172.21.15.47:0/2873005128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c150840 con 0x7f756c0d0390 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7571400640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c14b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7572800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756c0d0390 0x7f756c14c900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7568009d90 tx=0x7f7568019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:55.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7566000640 1 -- 172.21.15.47:0/2873005128 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680b2050 con 0x7f756c0d0390 2024-04-26T23:47:55.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7566000640 1 -- 172.21.15.47:0/2873005128 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75680be070 con 0x7f756c0d0390 2024-04-26T23:47:55.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7566000640 1 -- 172.21.15.47:0/2873005128 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75680ada70 con 0x7f756c0d0390 2024-04-26T23:47:55.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c150b20 con 0x7f756c0d0390 2024-04-26T23:47:55.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c14c3e0 con 0x7f756c0d0390 2024-04-26T23:47:55.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756c069700 con 0x7f756c0d0390 2024-04-26T23:47:55.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.694+0000 7f7566000640 1 -- 172.21.15.47:0/2873005128 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f75680a5780 con 0x7f756c0d0390 2024-04-26T23:47:55.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.698+0000 7f7566000640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7550068650 0x7f755006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:55.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.698+0000 7f7566000640 1 -- 172.21.15.47:0/2873005128 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f7568121b50 con 0x7f756c0d0390 2024-04-26T23:47:55.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.698+0000 7f7571e00640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7550068650 0x7f755006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:55.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.698+0000 7f7571e00640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7550068650 0x7f755006ab10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f756c151a00 tx=0x7f7560009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:55.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.702+0000 7f7566000640 1 -- 172.21.15.47:0/2873005128 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7568016560 con 0x7f756c0d0390 2024-04-26T23:47:55.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.866+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f756c06ecb0 con 0x7f756c0d0390 2024-04-26T23:47:55.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7566000640 1 -- 172.21.15.47:0/2873005128 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f75680f22a0 con 0x7f756c0d0390 2024-04-26T23:47:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7550068650 msgr2=0x7f755006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7550068650 0x7f755006ab10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f756c151a00 tx=0x7f7560009040 comp rx=0 tx=0).stop 2024-04-26T23:47:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756c0d0390 msgr2=0x7f756c14c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:55.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756c0d0390 0x7f756c14c900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7568009d90 tx=0x7f7568019650 comp rx=0 tx=0).stop 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 shutdown_connections 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7550068650 0x7f755006ab10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f756c0d0390 0x7f756c14c900 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f756c0af6e0 0x7f756c14b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 --2- 172.21.15.47:0/2873005128 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f756c06cd40 0x7f756c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 >> 172.21.15.47:0/2873005128 conn(0x7f756c0b2b70 msgr2=0x7f756c0b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 shutdown_connections 2024-04-26T23:47:55.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:55.870+0000 7f7574800640 1 -- 172.21.15.47:0/2873005128 wait complete. 2024-04-26T23:47:55.898 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed' 2024-04-26T23:47:56.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3772200640 1 Processor -- start 2024-04-26T23:47:56.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3772200640 1 -- start start 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3772200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f376c15cde0 0x7f376c0d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3772200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f376c15d1c0 0x7f376c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3772200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f376c071770 con 0x7f376c0711f0 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3772200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f376c0afa50 con 0x7f376c15d1c0 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3772200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f376c071a50 con 0x7f376c15cde0 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3763e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f376c15d1c0 0x7f376c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3763e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f376c15d1c0 0x7f376c0d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40490/0 (socket says 172.21.15.47:40490) 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3763e00640 1 -- 172.21.15.47:0/6179038 learned_addr learned my addr 172.21.15.47:0/6179038 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3770e00640 1 --2- 172.21.15.47:0/6179038 >> v2:172.21.15.203:3300/0 conn(0x7f376c15cde0 0x7f376c0d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3763e00640 1 -- 172.21.15.47:0/6179038 >> v2:172.21.15.203:3300/0 conn(0x7f376c15cde0 msgr2=0x7f376c0d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:56.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3763e00640 1 --2- 172.21.15.47:0/6179038 >> v2:172.21.15.203:3300/0 conn(0x7f376c15cde0 0x7f376c0d3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:56.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3763e00640 1 -- 172.21.15.47:0/6179038 >> v1:172.21.15.203:6789/0 conn(0x7f376c0711f0 legacy=0x7f376c160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:56.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.034+0000 7f3763e00640 1 -- 172.21.15.47:0/6179038 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c071d30 con 0x7f376c15d1c0 2024-04-26T23:47:56.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3763e00640 1 --2- 172.21.15.47:0/6179038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c15d1c0 0x7f376c0d1150 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f376c0d3be0 tx=0x7f375401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ddfcf2f89dd762 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f376be00640 1 -- 172.21.15.47:0/6179038 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37540ab650 con 0x7f376c15d1c0 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f376be00640 1 -- 172.21.15.47:0/6179038 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37540b0070 con 0x7f376c15d1c0 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f376be00640 1 -- 172.21.15.47:0/6179038 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37540aba10 con 0x7f376c15d1c0 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 -- 172.21.15.47:0/6179038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c15d1c0 msgr2=0x7f376c0d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 --2- 172.21.15.47:0/6179038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c15d1c0 0x7f376c0d1150 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f376c0d3be0 tx=0x7f375401c4f0 comp rx=0 tx=0).stop 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 -- 172.21.15.47:0/6179038 shutdown_connections 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 --2- 172.21.15.47:0/6179038 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c15d1c0 0x7f376c0d1150 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 --2- 172.21.15.47:0/6179038 >> v2:172.21.15.203:3300/0 conn(0x7f376c15cde0 0x7f376c0d3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 -- 172.21.15.47:0/6179038 >> 172.21.15.47:0/6179038 conn(0x7f376c09ba60 msgr2=0x7f376c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 -- 172.21.15.47:0/6179038 shutdown_connections 2024-04-26T23:47:56.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.038+0000 7f3772200640 1 -- 172.21.15.47:0/6179038 wait complete. 2024-04-26T23:47:56.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 Processor -- start 2024-04-26T23:47:56.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 -- start start 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c0711f0 0x7f376c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f376c15cde0 0x7f376c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f376c15d1c0 0x7f376c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f376c169fa0 con 0x7f376c0711f0 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f376c169e20 con 0x7f376c15d1c0 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f376c16a120 con 0x7f376c15cde0 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c0711f0 0x7f376c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c0711f0 0x7f376c152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40496/0 (socket says 172.21.15.47:40496) 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 -- 172.21.15.47:0/522353999 learned_addr learned my addr 172.21.15.47:0/522353999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3771800640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f376c15d1c0 0x7f376c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3763e00640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f376c15cde0 0x7f376c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 -- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f376c15cde0 msgr2=0x7f376c158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:56.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f376c15cde0 0x7f376c158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 -- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f376c15d1c0 msgr2=0x7f376c15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f376c15d1c0 0x7f376c15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 -- 172.21.15.47:0/522353999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f376c15f0c0 con 0x7f376c0711f0 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3770e00640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c0711f0 0x7f376c152ed0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d800 tx=0x7f375c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3769600640 1 -- 172.21.15.47:0/522353999 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c00b6c0 con 0x7f376c0711f0 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3769600640 1 -- 172.21.15.47:0/522353999 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f375c019070 con 0x7f376c0711f0 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3769600640 1 -- 172.21.15.47:0/522353999 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f375c00ba60 con 0x7f376c0711f0 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f376c15f3a0 con 0x7f376c0711f0 2024-04-26T23:47:56.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f376c15f960 con 0x7f376c0711f0 2024-04-26T23:47:56.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.042+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f376c069470 con 0x7f376c0711f0 2024-04-26T23:47:56.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.046+0000 7f3769600640 1 -- 172.21.15.47:0/522353999 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f375c00bc00 con 0x7f376c0711f0 2024-04-26T23:47:56.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.046+0000 7f3769600640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3748068650 0x7f374806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:56.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.046+0000 7f3769600640 1 -- 172.21.15.47:0/522353999 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f375c086f60 con 0x7f376c0711f0 2024-04-26T23:47:56.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.046+0000 7f3763e00640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3748068650 0x7f374806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:56.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.046+0000 7f3763e00640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3748068650 0x7f374806ab10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f37540af000 tx=0x7f37540a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:56.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.050+0000 7f3769600640 1 -- 172.21.15.47:0/522353999 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f375c057520 con 0x7f376c0711f0 2024-04-26T23:47:56.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:56.278+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]} v 0) -- 0x7f376c070a30 con 0x7f376c0711f0 2024-04-26T23:47:57.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.154+0000 7f3769600640 1 -- 172.21.15.47:0/522353999 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_failed"]}]=0 v141) ==== 165+0+0 (secure 0 0 0) 0x7f375c056e20 con 0x7f376c0711f0 2024-04-26T23:47:57.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3748068650 msgr2=0x7f374806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3748068650 0x7f374806ab10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f37540af000 tx=0x7f37540a7000 comp rx=0 tx=0).stop 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c0711f0 msgr2=0x7f376c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c0711f0 0x7f376c152ed0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f375c00d800 tx=0x7f375c00dcc0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 shutdown_connections 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3748068650 0x7f374806ab10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f376c15d1c0 0x7f376c15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f376c15cde0 0x7f376c158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 --2- 172.21.15.47:0/522353999 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f376c0711f0 0x7f376c152ed0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 >> 172.21.15.47:0/522353999 conn(0x7f376c09ba60 msgr2=0x7f376c0d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 shutdown_connections 2024-04-26T23:47:57.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.158+0000 7f3772200640 1 -- 172.21.15.47:0/522353999 wait complete. 2024-04-26T23:47:57.188 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is in failed state and validate the reason ... ok 2024-04-26T23:47:57.188 INFO:tasks.cephfs_test_runner:Starting test: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) ensure failure status is shown when clone is cancelled during in-progress state and validate the reason 2024-04-26T23:47:57.188 INFO:tasks.cephfs_test_runner:test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-26T23:47:57.189 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:47:57.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ac1a00640 1 Processor -- start 2024-04-26T23:47:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ac1a00640 1 -- start start 2024-04-26T23:47:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ac1a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9abc160810 0x7f9abc071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ac1a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9abc0d1860 0x7f9abc0cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ac1a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc0cd830 con 0x7f9abc072150 2024-04-26T23:47:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ac1a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9abc071080 con 0x7f9abc160810 2024-04-26T23:47:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ac1a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9abc071360 con 0x7f9abc0d1860 2024-04-26T23:47:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9abaa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9abc160810 0x7f9abc071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ab3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9abc072150 0x7f9abc0d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44712/0 (socket says 172.21.15.47:44712) 2024-04-26T23:47:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9ab3e00640 1 -- 172.21.15.47:0/3230313887 learned_addr learned my addr 172.21.15.47:0/3230313887 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9abb400640 1 --2- 172.21.15.47:0/3230313887 >> v2:172.21.15.203:3300/0 conn(0x7f9abc0d1860 0x7f9abc0cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9abaa00640 1 -- 172.21.15.47:0/3230313887 >> v2:172.21.15.203:3300/0 conn(0x7f9abc0d1860 msgr2=0x7f9abc0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9abaa00640 1 --2- 172.21.15.47:0/3230313887 >> v2:172.21.15.203:3300/0 conn(0x7f9abc0d1860 0x7f9abc0cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9abaa00640 1 -- 172.21.15.47:0/3230313887 >> v1:172.21.15.47:6789/0 conn(0x7f9abc072150 legacy=0x7f9abc0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.330+0000 7f9abaa00640 1 -- 172.21.15.47:0/3230313887 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc0cdad0 con 0x7f9abc160810 2024-04-26T23:47:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9abaa00640 1 --2- 172.21.15.47:0/3230313887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc160810 0x7f9abc071760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9abc073fa0 tx=0x7f9aac01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd5c06de14446d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:57.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9aba000640 1 -- 172.21.15.47:0/3230313887 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0b5070 con 0x7f9abc160810 2024-04-26T23:47:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9aba000640 1 -- 172.21.15.47:0/3230313887 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac0a8970 con 0x7f9abc160810 2024-04-26T23:47:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9aba000640 1 -- 172.21.15.47:0/3230313887 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0a8d40 con 0x7f9abc160810 2024-04-26T23:47:57.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 -- 172.21.15.47:0/3230313887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc160810 msgr2=0x7f9abc071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/3230313887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc160810 0x7f9abc071760 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9abc073fa0 tx=0x7f9aac01ec70 comp rx=0 tx=0).stop 2024-04-26T23:47:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 -- 172.21.15.47:0/3230313887 shutdown_connections 2024-04-26T23:47:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/3230313887 >> v2:172.21.15.203:3300/0 conn(0x7f9abc0d1860 0x7f9abc0cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/3230313887 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc160810 0x7f9abc071760 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 -- 172.21.15.47:0/3230313887 >> 172.21.15.47:0/3230313887 conn(0x7f9abc0d2e90 msgr2=0x7f9abc0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 -- 172.21.15.47:0/3230313887 shutdown_connections 2024-04-26T23:47:57.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.334+0000 7f9ac1a00640 1 -- 172.21.15.47:0/3230313887 wait complete. 2024-04-26T23:47:57.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 Processor -- start 2024-04-26T23:47:57.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 -- start start 2024-04-26T23:47:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc072150 0x7f9abc1f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc0d1860 0x7f9abc06eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc160810 0x7f9abc15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc160bf0 con 0x7f9abc072150 2024-04-26T23:47:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9abc071ca0 con 0x7f9abc160810 2024-04-26T23:47:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9abc160d70 con 0x7f9abc0d1860 2024-04-26T23:47:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc072150 0x7f9abc1f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc072150 0x7f9abc1f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40518/0 (socket says 172.21.15.47:40518) 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 -- 172.21.15.47:0/1812676396 learned_addr learned my addr 172.21.15.47:0/1812676396 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abb400640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc160810 0x7f9abc15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ab3e00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc0d1860 0x7f9abc06eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 -- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc0d1860 msgr2=0x7f9abc06eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc0d1860 0x7f9abc06eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 -- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc160810 msgr2=0x7f9abc15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc160810 0x7f9abc15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 -- 172.21.15.47:0/1812676396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc06f1e0 con 0x7f9abc072150 2024-04-26T23:47:57.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abb400640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc160810 0x7f9abc15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:47:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9abaa00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc072150 0x7f9abc1f4f10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0b3040 tx=0x7f9aac01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ab2a00640 1 -- 172.21.15.47:0/1812676396 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0bf070 con 0x7f9abc072150 2024-04-26T23:47:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ab2a00640 1 -- 172.21.15.47:0/1812676396 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aac0b07e0 con 0x7f9abc072150 2024-04-26T23:47:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ab2a00640 1 -- 172.21.15.47:0/1812676396 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0b5040 con 0x7f9abc072150 2024-04-26T23:47:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc1f5560 con 0x7f9abc072150 2024-04-26T23:47:57.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9abc1f5b20 con 0x7f9abc072150 2024-04-26T23:47:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.338+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9abc069700 con 0x7f9abc072150 2024-04-26T23:47:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.342+0000 7f9ab2a00640 1 -- 172.21.15.47:0/1812676396 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f9aac0b0bd0 con 0x7f9abc072150 2024-04-26T23:47:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.342+0000 7f9ab2a00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068680 0x7f9a9806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.342+0000 7f9ab2a00640 1 -- 172.21.15.47:0/1812676396 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f9aac1234a0 con 0x7f9abc072150 2024-04-26T23:47:57.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.342+0000 7f9ab3e00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068680 0x7f9a9806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.342+0000 7f9ab3e00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068680 0x7f9a9806ab40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9abc15dc30 tx=0x7f9aa4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:57.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.346+0000 7f9ab2a00640 1 -- 172.21.15.47:0/1812676396 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9aac0187d0 con 0x7f9abc072150 2024-04-26T23:47:57.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.510+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9abc0b19b0 con 0x7f9abc072150 2024-04-26T23:47:57.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.510+0000 7f9ab2a00640 1 -- 172.21.15.47:0/1812676396 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+13008 (secure 0 0 0) 0x7f9aac0f39d0 con 0x7f9abc072150 2024-04-26T23:47:57.518 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:47:57.518 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":41,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:47:55.141083+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6835/2869278725":"2024-04-27T23:47:51.932030+0000","172.21.15.47:6833/2869278725":"2024-04-27T23:47:51.932030+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068680 msgr2=0x7f9a9806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068680 0x7f9a9806ab40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9abc15dc30 tx=0x7f9aa4009040 comp rx=0 tx=0).stop 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc072150 msgr2=0x7f9abc1f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc072150 0x7f9abc1f4f10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0b3040 tx=0x7f9aac01ba10 comp rx=0 tx=0).stop 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 shutdown_connections 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9a98068680 0x7f9a9806ab40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9abc160810 0x7f9abc15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9abc0d1860 0x7f9abc06eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 --2- 172.21.15.47:0/1812676396 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9abc072150 0x7f9abc1f4f10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 >> 172.21.15.47:0/1812676396 conn(0x7f9abc0d2e90 msgr2=0x7f9abc0afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:57.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 shutdown_connections 2024-04-26T23:47:57.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.514+0000 7f9ac1a00640 1 -- 172.21.15.47:0/1812676396 wait complete. 2024-04-26T23:47:57.540 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:47:57.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:47:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f61a0c00640 1 Processor -- start 2024-04-26T23:47:57.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f61a0c00640 1 -- start start 2024-04-26T23:47:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f61a0c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f619c162970 0x7f619c0700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f61a0c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619c06f000 con 0x7f619c0730b0 2024-04-26T23:47:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f61a0c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619c06f2e0 con 0x7f619c06ea90 2024-04-26T23:47:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f61a0c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f619c06f5c0 con 0x7f619c162970 2024-04-26T23:47:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f6199e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f619c162970 0x7f619c0700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f619a800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f619c0730b0 0x7f619c0cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:44724/0 (socket says 172.21.15.47:44724) 2024-04-26T23:47:57.684 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f619a800640 1 -- 172.21.15.47:0/1687918519 learned_addr learned my addr 172.21.15.47:0/1687918519 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f6199e00640 1 -- 172.21.15.47:0/1687918519 >> v1:172.21.15.203:6789/0 conn(0x7f619c06ea90 legacy=0x7f619c0729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f6199e00640 1 -- 172.21.15.47:0/1687918519 >> v1:172.21.15.47:6789/0 conn(0x7f619c0730b0 legacy=0x7f619c0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f6199e00640 1 -- 172.21.15.47:0/1687918519 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c06f8a0 con 0x7f619c162970 2024-04-26T23:47:57.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.678+0000 7f6199400640 1 -- 172.21.15.47:0/1687918519 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 51835887 0 0) 0x7f619c06f000 con 0x7f619c0730b0 2024-04-26T23:47:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f6199e00640 1 --2- 172.21.15.47:0/1687918519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c0700a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f618c0097c0 tx=0x7f618c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed57c20083c9f4e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f6199400640 1 -- 172.21.15.47:0/1687918519 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c0ab650 con 0x7f619c162970 2024-04-26T23:47:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f6199400640 1 -- 172.21.15.47:0/1687918519 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618c0b0070 con 0x7f619c162970 2024-04-26T23:47:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f6199400640 1 -- 172.21.15.47:0/1687918519 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c0aba10 con 0x7f619c162970 2024-04-26T23:47:57.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 -- 172.21.15.47:0/1687918519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 msgr2=0x7f619c0700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 --2- 172.21.15.47:0/1687918519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c0700a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f618c0097c0 tx=0x7f618c01c430 comp rx=0 tx=0).stop 2024-04-26T23:47:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 -- 172.21.15.47:0/1687918519 shutdown_connections 2024-04-26T23:47:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 --2- 172.21.15.47:0/1687918519 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c0700a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 -- 172.21.15.47:0/1687918519 >> 172.21.15.47:0/1687918519 conn(0x7f619c070c00 msgr2=0x7f619c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 -- 172.21.15.47:0/1687918519 shutdown_connections 2024-04-26T23:47:57.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 -- 172.21.15.47:0/1687918519 wait complete. 2024-04-26T23:47:57.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 Processor -- start 2024-04-26T23:47:57.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.682+0000 7f61a0c00640 1 -- start start 2024-04-26T23:47:57.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f619c06ea90 0x7f619c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f619c0730b0 0x7f619c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0cc080 con 0x7f619c162970 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f619c0b4840 con 0x7f619c06ea90 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f619c150600 con 0x7f619c0730b0 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40536/0 (socket says 172.21.15.47:40536) 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 -- 172.21.15.47:0/3885836892 learned_addr learned my addr 172.21.15.47:0/3885836892 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f6191400640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f619c0730b0 0x7f619c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f6199e00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f619c06ea90 0x7f619c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 -- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f619c0730b0 msgr2=0x7f619c14fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f619c0730b0 0x7f619c14fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 -- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f619c06ea90 msgr2=0x7f619c1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f619c06ea90 0x7f619c1556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 -- 172.21.15.47:0/3885836892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619c14f3d0 con 0x7f619c162970 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f619a800640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c14bf60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f619400c7b0 tx=0x7f619400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f6192a00640 1 -- 172.21.15.47:0/3885836892 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194018070 con 0x7f619c162970 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f6192a00640 1 -- 172.21.15.47:0/3885836892 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619400a640 con 0x7f619c162970 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f6192a00640 1 -- 172.21.15.47:0/3885836892 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619400aa70 con 0x7f619c162970 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619c150850 con 0x7f619c162970 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619c150e10 con 0x7f619c162970 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.686+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f619c06d370 con 0x7f619c162970 2024-04-26T23:47:57.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.690+0000 7f6192a00640 1 -- 172.21.15.47:0/3885836892 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f619401b070 con 0x7f619c162970 2024-04-26T23:47:57.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.690+0000 7f6192a00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6178068650 0x7f617806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:57.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.690+0000 7f6192a00640 1 -- 172.21.15.47:0/3885836892 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f6194085fb0 con 0x7f619c162970 2024-04-26T23:47:57.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.690+0000 7f6199e00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6178068650 0x7f617806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:57.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.690+0000 7f6199e00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6178068650 0x7f617806ab10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f618c0af000 tx=0x7f618c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:57.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.694+0000 7f6192a00640 1 -- 172.21.15.47:0/3885836892 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6194055f20 con 0x7f619c162970 2024-04-26T23:47:57.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f619c15a6c0 con 0x7f619c162970 2024-04-26T23:47:57.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f6192a00640 1 -- 172.21.15.47:0/3885836892 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) ==== 93+0+10 (secure 0 0 0) 0x7f619405a220 con 0x7f619c162970 2024-04-26T23:47:57.864 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:47:57.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6178068650 msgr2=0x7f617806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6178068650 0x7f617806ab10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f618c0af000 tx=0x7f618c0a7000 comp rx=0 tx=0).stop 2024-04-26T23:47:57.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 msgr2=0x7f619c14bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:57.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c14bf60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f619400c7b0 tx=0x7f619400cc70 comp rx=0 tx=0).stop 2024-04-26T23:47:57.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 shutdown_connections 2024-04-26T23:47:57.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6178068650 0x7f617806ab10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f619c162970 0x7f619c14bf60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f619c0730b0 0x7f619c14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 --2- 172.21.15.47:0/3885836892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f619c06ea90 0x7f619c1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:57.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 >> 172.21.15.47:0/3885836892 conn(0x7f619c070c00 msgr2=0x7f619c0b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:57.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 shutdown_connections 2024-04-26T23:47:57.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:57.858+0000 7f61a0c00640 1 -- 172.21.15.47:0/3885836892 wait complete. 2024-04-26T23:47:57.886 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2024-04-26T23:47:58.027 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb277800640 1 Processor -- start 2024-04-26T23:47:58.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb277800640 1 -- start start 2024-04-26T23:47:58.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb277800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb270162c60 0x7fb2700d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:58.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb277800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb2700d1f30 0x7fb2700d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:58.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb277800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2700d5960 con 0x7fb2700b3f80 2024-04-26T23:47:58.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb277800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb2700d5f20 con 0x7fb270162c60 2024-04-26T23:47:58.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb277800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb2700d5c40 con 0x7fb2700d1f30 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb275800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb2700d1f30 0x7fb2700d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb274e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb270162c60 0x7fb2700d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb275800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb2700d1f30 0x7fb2700d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:58238/0 (socket says 172.21.15.47:58238) 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb275800640 1 -- 172.21.15.47:0/4118116522 learned_addr learned my addr 172.21.15.47:0/4118116522 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb267e00640 1 --1- 172.21.15.47:0/4118116522 >> v1:172.21.15.203:6789/0 conn(0x7fb2700b3f80 0x7fb2700b52e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:41330/0 (socket says 172.21.15.47:41330) 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb274e00640 1 -- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb2700d1f30 msgr2=0x7fb2700d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb274e00640 1 --2- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb2700d1f30 0x7fb2700d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb274e00640 1 -- 172.21.15.47:0/4118116522 >> v1:172.21.15.203:6789/0 conn(0x7fb2700b3f80 legacy=0x7fb2700b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb274e00640 1 -- 172.21.15.47:0/4118116522 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2700b4ae0 con 0x7fb270162c60 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb26fe00640 1 -- 172.21.15.47:0/4118116522 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614914680 0 0) 0x7fb2700d5960 con 0x7fb2700b3f80 2024-04-26T23:47:58.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.022+0000 7fb275800640 1 --2- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb2700d1f30 0x7fb2700d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:47:58.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb274e00640 1 --2- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb270162c60 0x7fb2700d19f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2600097c0 tx=0x7fb26001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a4a3210b13d313 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:58.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb26fe00640 1 -- 172.21.15.47:0/4118116522 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2600b0070 con 0x7fb270162c60 2024-04-26T23:47:58.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb26fe00640 1 -- 172.21.15.47:0/4118116522 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2600ab600 con 0x7fb270162c60 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb26fe00640 1 -- 172.21.15.47:0/4118116522 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2600ab9d0 con 0x7fb270162c60 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 -- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb270162c60 msgr2=0x7fb2700d19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 --2- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb270162c60 0x7fb2700d19f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2600097c0 tx=0x7fb26001c410 comp rx=0 tx=0).stop 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 -- 172.21.15.47:0/4118116522 shutdown_connections 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 --2- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb2700d1f30 0x7fb2700d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 --2- 172.21.15.47:0/4118116522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb270162c60 0x7fb2700d19f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 -- 172.21.15.47:0/4118116522 >> 172.21.15.47:0/4118116522 conn(0x7fb27009e3e0 msgr2=0x7fb2700d50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 -- 172.21.15.47:0/4118116522 shutdown_connections 2024-04-26T23:47:58.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.026+0000 7fb277800640 1 -- 172.21.15.47:0/4118116522 wait complete. 2024-04-26T23:47:58.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 Processor -- start 2024-04-26T23:47:58.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 -- start start 2024-04-26T23:47:58.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2700b3f80 0x7fb27014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2700d1f30 0x7fb2700b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb270162c60 0x7fb27014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700b6610 con 0x7fb2700d1f30 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb2700b6490 con 0x7fb2700b3f80 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb27016c180 con 0x7fb270162c60 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2700d1f30 0x7fb2700b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2700d1f30 0x7fb2700b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40546/0 (socket says 172.21.15.47:40546) 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 -- 172.21.15.47:0/2380313411 learned_addr learned my addr 172.21.15.47:0/2380313411 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb274e00640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2700b3f80 0x7fb27014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:58.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb275800640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb270162c60 0x7fb27014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:58.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 -- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb270162c60 msgr2=0x7fb27014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb270162c60 0x7fb27014d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 -- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2700b3f80 msgr2=0x7fb27014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2700b3f80 0x7fb27014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 -- 172.21.15.47:0/2380313411 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27014e4f0 con 0x7fb2700d1f30 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb274e00640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2700b3f80 0x7fb27014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb267e00640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2700d1f30 0x7fb2700b30e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb25800c480 tx=0x7fb25800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb26d600640 1 -- 172.21.15.47:0/2380313411 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258018070 con 0x7fb2700d1f30 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb26d600640 1 -- 172.21.15.47:0/2380313411 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2580074e0 con 0x7fb2700d1f30 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb26d600640 1 -- 172.21.15.47:0/2380313411 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2580049f0 con 0x7fb2700d1f30 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27014e7d0 con 0x7fb2700d1f30 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.030+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27014ed90 con 0x7fb2700d1f30 2024-04-26T23:47:58.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.034+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb270069700 con 0x7fb2700d1f30 2024-04-26T23:47:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.034+0000 7fb26d600640 1 -- 172.21.15.47:0/2380313411 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fb258004b90 con 0x7fb2700d1f30 2024-04-26T23:47:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.034+0000 7fb26d600640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb24c068680 0x7fb24c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:58.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.034+0000 7fb26d600640 1 -- 172.21.15.47:0/2380313411 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fb258085da0 con 0x7fb2700d1f30 2024-04-26T23:47:58.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.034+0000 7fb274e00640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb24c068680 0x7fb24c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:58.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.034+0000 7fb274e00640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb24c068680 0x7fb24c06ab40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2600ad000 tx=0x7fb2600a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:58.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.038+0000 7fb26d600640 1 -- 172.21.15.47:0/2380313411 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb258055d10 con 0x7fb2700d1f30 2024-04-26T23:47:58.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:58.262+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) -- 0x7fb270068eb0 con 0x7fb2700d1f30 2024-04-26T23:47:59.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.166+0000 7fb26d600640 1 -- 172.21.15.47:0/2380313411 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v143) ==== 183+0+0 (secure 0 0 0) 0x7fb25805a010 con 0x7fb2700d1f30 2024-04-26T23:47:59.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb24c068680 msgr2=0x7fb24c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb24c068680 0x7fb24c06ab40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb2600ad000 tx=0x7fb2600a6000 comp rx=0 tx=0).stop 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2700d1f30 msgr2=0x7fb2700b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2700d1f30 0x7fb2700b30e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb25800c480 tx=0x7fb25800c940 comp rx=0 tx=0).stop 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 shutdown_connections 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb24c068680 0x7fb24c06ab40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb270162c60 0x7fb27014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb2700d1f30 0x7fb2700b30e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 --2- 172.21.15.47:0/2380313411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2700b3f80 0x7fb27014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 >> 172.21.15.47:0/2380313411 conn(0x7fb27009e3e0 msgr2=0x7fb27006e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:59.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 shutdown_connections 2024-04-26T23:47:59.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.170+0000 7fb277800640 1 -- 172.21.15.47:0/2380313411 wait complete. 2024-04-26T23:47:59.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:47:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b81a00640 1 Processor -- start 2024-04-26T23:47:59.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b81a00640 1 -- start start 2024-04-26T23:47:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b81a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c0d0390 0x7f6b7c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b81a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6b7c1603e0 0x7f6b7c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b81a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b7c0ae6a0 con 0x7f6b7c06c630 2024-04-26T23:47:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b81a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7c0ae920 con 0x7f6b7c1603e0 2024-04-26T23:47:59.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b81a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7c0aec00 con 0x7f6b7c0d0390 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.342+0000 7f6b7aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c0d0390 0x7f6b7c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7b400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6b7c1603e0 0x7f6b7c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b73e00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f6b7c06c630 0x7f6b7c15fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:42830/0 (socket says 172.21.15.47:42830) 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b73e00640 1 -- 172.21.15.47:0/1606730884 learned_addr learned my addr 172.21.15.47:0/1606730884 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7b400640 1 -- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c0d0390 msgr2=0x7f6b7c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7b400640 1 --2- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c0d0390 0x7f6b7c0af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7b400640 1 -- 172.21.15.47:0/1606730884 >> v1:172.21.15.203:6789/0 conn(0x7f6b7c06c630 legacy=0x7f6b7c15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7b400640 1 -- 172.21.15.47:0/1606730884 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c0aeee0 con 0x7f6b7c1603e0 2024-04-26T23:47:59.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7a000640 1 -- 172.21.15.47:0/1606730884 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313371286 0 0) 0x7f6b64001120 con 0x7f6b7c06c630 2024-04-26T23:47:59.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7aa00640 1 --2- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c0d0390 0x7f6b7c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:47:59.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7b400640 1 --2- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c1603e0 0x7f6b7c06cab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009d90 tx=0x7f6b7401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8637896d3793d0a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7a000640 1 -- 172.21.15.47:0/1606730884 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740b2070 con 0x7f6b7c1603e0 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7a000640 1 -- 172.21.15.47:0/1606730884 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b740a5820 con 0x7f6b7c1603e0 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.346+0000 7f6b7a000640 1 -- 172.21.15.47:0/1606730884 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740a5bf0 con 0x7f6b7c1603e0 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c1603e0 msgr2=0x7f6b7c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 --2- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c1603e0 0x7f6b7c06cab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009d90 tx=0x7f6b7401c8e0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- 172.21.15.47:0/1606730884 shutdown_connections 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 --2- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c1603e0 0x7f6b7c06cab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 --2- 172.21.15.47:0/1606730884 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c0d0390 0x7f6b7c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- 172.21.15.47:0/1606730884 >> 172.21.15.47:0/1606730884 conn(0x7f6b7c0b2b70 msgr2=0x7f6b7c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- 172.21.15.47:0/1606730884 shutdown_connections 2024-04-26T23:47:59.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- 172.21.15.47:0/1606730884 wait complete. 2024-04-26T23:47:59.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 Processor -- start 2024-04-26T23:47:59.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- start start 2024-04-26T23:47:59.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c06c630 0x7f6b7c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c0d0390 0x7f6b7c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c1603e0 0x7f6b7c165a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c06fa70 con 0x7f6b7c06c630 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c06f8f0 con 0x7f6b7c0d0390 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b81a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6b7c06fbf0 con 0x7f6b7c1603e0 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c06c630 0x7f6b7c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c06c630 0x7f6b7c1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45618/0 (socket says 172.21.15.47:45618) 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 -- 172.21.15.47:0/3762173662 learned_addr learned my addr 172.21.15.47:0/3762173662 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7b400640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c1603e0 0x7f6b7c165a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b73e00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c0d0390 0x7f6b7c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 -- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c1603e0 msgr2=0x7f6b7c165a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c1603e0 0x7f6b7c165a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 -- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c0d0390 msgr2=0x7f6b7c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c0d0390 0x7f6b7c0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 -- 172.21.15.47:0/3762173662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c15d6a0 con 0x7f6b7c06c630 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.350+0000 7f6b7aa00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c06c630 0x7f6b7c1590f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e980 tx=0x7f6b6c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b72a00640 1 -- 172.21.15.47:0/3762173662 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c017070 con 0x7f6b7c06c630 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b72a00640 1 -- 172.21.15.47:0/3762173662 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6c00ca00 con 0x7f6b7c06c630 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b72a00640 1 -- 172.21.15.47:0/3762173662 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00cdd0 con 0x7f6b7c06c630 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c15d980 con 0x7f6b7c06c630 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c15df40 con 0x7f6b7c06c630 2024-04-26T23:47:59.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b7c0b1e20 con 0x7f6b7c06c630 2024-04-26T23:47:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b72a00640 1 -- 172.21.15.47:0/3762173662 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f6b6c01a070 con 0x7f6b7c06c630 2024-04-26T23:47:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b72a00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b58068650 0x7f6b5806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b72a00640 1 -- 172.21.15.47:0/3762173662 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7f6b6c086d00 con 0x7f6b7c06c630 2024-04-26T23:47:59.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.354+0000 7f6b73e00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b58068650 0x7f6b5806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.358+0000 7f6b73e00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b58068650 0x7f6b5806ab10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c156290 tx=0x7f6b64007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:59.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.358+0000 7f6b72a00640 1 -- 172.21.15.47:0/3762173662 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6b6c0572c0 con 0x7f6b7c06c630 2024-04-26T23:47:59.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.526+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f6b7c069700 con 0x7f6b7c06c630 2024-04-26T23:47:59.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b72a00640 1 -- 172.21.15.47:0/3762173662 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f6b6c056bc0 con 0x7f6b7c06c630 2024-04-26T23:47:59.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b58068650 msgr2=0x7f6b5806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b58068650 0x7f6b5806ab10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c156290 tx=0x7f6b64007c10 comp rx=0 tx=0).stop 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c06c630 msgr2=0x7f6b7c1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c06c630 0x7f6b7c1590f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00e980 tx=0x7f6b6c00ee40 comp rx=0 tx=0).stop 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 shutdown_connections 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6b58068650 0x7f6b5806ab10 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6b7c1603e0 0x7f6b7c165a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b7c0d0390 0x7f6b7c0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 --2- 172.21.15.47:0/3762173662 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b7c06c630 0x7f6b7c1590f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.530+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 >> 172.21.15.47:0/3762173662 conn(0x7f6b7c0b2b70 msgr2=0x7f6b7c156eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.534+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 shutdown_connections 2024-04-26T23:47:59.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.534+0000 7f6b81a00640 1 -- 172.21.15.47:0/3762173662 wait complete. 2024-04-26T23:47:59.560 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:47:59.560 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:47:59.657 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:47:59.750 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:47:59.750 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:59.750 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:59.760 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:47:59.760 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:47:59.760 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:59.770 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350228k,nr_inodes=4087557,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6713 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:47:59.770 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:47:59.770 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:59.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:47:59.811 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:47:59.811 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:47:59.823 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350228k,nr_inodes=4087557,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6713 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:47:59.823 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-26T23:47:59.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:47:59.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.986+0000 7fae07a00640 1 Processor -- start 2024-04-26T23:47:59.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.986+0000 7fae07a00640 1 -- start start 2024-04-26T23:47:59.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae07a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fae00160810 0x7fae00071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae07a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fae000d1860 0x7fae000cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae07a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae000cd830 con 0x7fae00072150 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae07a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fae00071080 con 0x7fae000d1860 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae07a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fae00071360 con 0x7fae00160810 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae05a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fae000d1860 0x7fae000cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fadf7e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fae00072150 0x7fae000d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58094/0 (socket says 172.21.15.47:58094) 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fadf7e00640 1 -- 172.21.15.47:0/3589667148 learned_addr learned my addr 172.21.15.47:0/3589667148 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae05000640 1 --2- 172.21.15.47:0/3589667148 >> v2:172.21.15.203:3300/0 conn(0x7fae00160810 0x7fae00071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae05a00640 1 -- 172.21.15.47:0/3589667148 >> v2:172.21.15.203:3300/0 conn(0x7fae00160810 msgr2=0x7fae00071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae05a00640 1 --2- 172.21.15.47:0/3589667148 >> v2:172.21.15.203:3300/0 conn(0x7fae00160810 0x7fae00071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae05a00640 1 -- 172.21.15.47:0/3589667148 >> v1:172.21.15.47:6789/0 conn(0x7fae00072150 legacy=0x7fae000d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:47:59.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.990+0000 7fae05a00640 1 -- 172.21.15.47:0/3589667148 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae000cdad0 con 0x7fae000d1860 2024-04-26T23:47:59.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae05a00640 1 --2- 172.21.15.47:0/3589667148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae000d1860 0x7fae000cdff0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fae000767e0 tx=0x7fadf801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488aff5998d9ed61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:47:59.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fadffe00640 1 -- 172.21.15.47:0/3589667148 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80b5070 con 0x7fae000d1860 2024-04-26T23:47:59.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fadffe00640 1 -- 172.21.15.47:0/3589667148 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf80a8970 con 0x7fae000d1860 2024-04-26T23:47:59.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fadffe00640 1 -- 172.21.15.47:0/3589667148 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80a8d40 con 0x7fae000d1860 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- 172.21.15.47:0/3589667148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae000d1860 msgr2=0x7fae000cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 --2- 172.21.15.47:0/3589667148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae000d1860 0x7fae000cdff0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fae000767e0 tx=0x7fadf801ec70 comp rx=0 tx=0).stop 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- 172.21.15.47:0/3589667148 shutdown_connections 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 --2- 172.21.15.47:0/3589667148 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae000d1860 0x7fae000cdff0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 --2- 172.21.15.47:0/3589667148 >> v2:172.21.15.203:3300/0 conn(0x7fae00160810 0x7fae00071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- 172.21.15.47:0/3589667148 >> 172.21.15.47:0/3589667148 conn(0x7fae000d2e90 msgr2=0x7fae000d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- 172.21.15.47:0/3589667148 shutdown_connections 2024-04-26T23:48:00.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- 172.21.15.47:0/3589667148 wait complete. 2024-04-26T23:48:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 Processor -- start 2024-04-26T23:48:00.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- start start 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae00072150 0x7fae000c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae000d1860 0x7fae000ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae00160810 0x7fae000cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fae00160bf0 con 0x7fae00160810 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae00071ca0 con 0x7fae00072150 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.994+0000 7fae07a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fae00160d70 con 0x7fae000d1860 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae00160810 0x7fae000cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae00160810 0x7fae000cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45640/0 (socket says 172.21.15.47:45640) 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 -- 172.21.15.47:0/1820595564 learned_addr learned my addr 172.21.15.47:0/1820595564 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05000640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae00072150 0x7fae000c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fadf7e00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae000d1860 0x7fae000ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 -- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae000d1860 msgr2=0x7fae000ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae000d1860 0x7fae000ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 -- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae00072150 msgr2=0x7fae000c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae00072150 0x7fae000c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 -- 172.21.15.47:0/1820595564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0015b760 con 0x7fae00160810 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fadf7e00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae000d1860 0x7fae000ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae05a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae00160810 0x7fae000cab00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fadf80b3040 tx=0x7fadf801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fadfd600640 1 -- 172.21.15.47:0/1820595564 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80bf070 con 0x7fae00160810 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fadfd600640 1 -- 172.21.15.47:0/1820595564 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf80b07a0 con 0x7fae00160810 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fadfd600640 1 -- 172.21.15.47:0/1820595564 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf80b5040 con 0x7fae00160810 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0015ba40 con 0x7fae00160810 2024-04-26T23:48:00.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae000b63b0 con 0x7fae00160810 2024-04-26T23:48:00.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae00069700 con 0x7fae00160810 2024-04-26T23:48:00.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fadfd600640 1 -- 172.21.15.47:0/1820595564 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fadf80b0b90 con 0x7fae00160810 2024-04-26T23:48:00.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:47:59.998+0000 7fadfd600640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faddc068650 0x7faddc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.002+0000 7fadfd600640 1 -- 172.21.15.47:0/1820595564 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fadf8123370 con 0x7fae00160810 2024-04-26T23:48:00.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.002+0000 7fae05000640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faddc068650 0x7faddc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.002+0000 7fae05000640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faddc068650 0x7faddc06ab10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fadf0003fd0 tx=0x7fadf00039a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:00.011 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.006+0000 7fadfd600640 1 -- 172.21.15.47:0/1820595564 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fadf80187d0 con 0x7fae00160810 2024-04-26T23:48:00.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae000d1510 con 0x7fae00160810 2024-04-26T23:48:00.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fadfd600640 1 -- 172.21.15.47:0/1820595564 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3869 (secure 0 0 0) 0x7fadf80f38f0 con 0x7fae00160810 2024-04-26T23:48:00.216 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:00.216 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5104,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/3134789300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":3134789300},{"type":"v1","addr":"172.21.15.203:6836","nonce":3134789300}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/4099074472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":4099074472},{"type":"v1","addr":"172.21.15.203:6837","nonce":4099074472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5298,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/789136995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":789136995},{"type":"v1","addr":"172.21.15.47:6834","nonce":789136995}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/439929006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":439929006},{"type":"v1","addr":"172.21.15.47:6835","nonce":439929006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-04-26T23:48:00.216 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 20 2024-04-26T23:48:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faddc068650 msgr2=0x7faddc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faddc068650 0x7faddc06ab10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fadf0003fd0 tx=0x7fadf00039a0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae00160810 msgr2=0x7fae000cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae00160810 0x7fae000cab00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fadf80b3040 tx=0x7fadf801ba10 comp rx=0 tx=0).stop 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 shutdown_connections 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7faddc068650 0x7faddc06ab10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fae00160810 0x7fae000cab00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fae000d1860 0x7fae000ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 --2- 172.21.15.47:0/1820595564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae00072150 0x7fae000c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 >> 172.21.15.47:0/1820595564 conn(0x7fae000d2e90 msgr2=0x7fae000d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 shutdown_connections 2024-04-26T23:48:00.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.210+0000 7fae07a00640 1 -- 172.21.15.47:0/1820595564 wait complete. 2024-04-26T23:48:00.239 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T23:48:00.239 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-26T23:48:00.239 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:48:00.239 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:48:00.239 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T23:48:00.239 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-26T23:48:00.240 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:48:00.240 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:48:00.240 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T23:48:00.240 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-26T23:48:00.240 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:48:00.240 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:48:00.240 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T23:48:00.241 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-26T23:48:00.241 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:48:00.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:48:00.252 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:48:00.252 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T23:48:00.253 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:48:00.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T23:48:00.255 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:48:00.255 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T23:48:00.256 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:48:00.256 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T23:48:00.297 INFO:tasks.ceph.mds.c:Started 2024-04-26T23:48:00.298 DEBUG:teuthology.parallel:result is None 2024-04-26T23:48:00.298 INFO:tasks.ceph.mds.a:Started 2024-04-26T23:48:00.299 DEBUG:teuthology.parallel:result is None 2024-04-26T23:48:00.306 INFO:tasks.ceph.mds.b:Started 2024-04-26T23:48:00.306 DEBUG:teuthology.parallel:result is None 2024-04-26T23:48:00.307 INFO:tasks.ceph.mds.d:Started 2024-04-26T23:48:00.308 DEBUG:teuthology.parallel:result is None 2024-04-26T23:48:00.308 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-26T23:48:00.384 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-04-26T23:48:00.384 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-26T23:48:00.397 INFO:tasks.ceph.mds.b.smithi203.stdout:starting mds.b at 2024-04-26T23:48:00.397 INFO:tasks.ceph.mds.d.smithi203.stdout:starting mds.d at 2024-04-26T23:48:00.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.446+0000 7fcec2600640 1 Processor -- start 2024-04-26T23:48:00.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.446+0000 7fcec2600640 1 -- start start 2024-04-26T23:48:00.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcec2600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcec2600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcebc06c630 0x7fcebc06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcec2600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcebc0b5a50 con 0x7fcebc15d080 2024-04-26T23:48:00.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcec2600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcebc15d460 con 0x7fcebc06c630 2024-04-26T23:48:00.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcec2600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc0b5d30 con 0x7fcebc0ade00 2024-04-26T23:48:00.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebb400640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7fcebc15d080 0x7fcebc0b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:42854/0 (socket says 172.21.15.47:42854) 2024-04-26T23:48:00.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebb400640 1 -- 172.21.15.47:0/2405052122 learned_addr learned my addr 172.21.15.47:0/2405052122 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:00.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebbe00640 1 --2- 172.21.15.47:0/2405052122 >> v2:172.21.15.203:3300/0 conn(0x7fcebc06c630 0x7fcebc06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebbe00640 1 -- 172.21.15.47:0/2405052122 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 msgr2=0x7fcebc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:00.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebbe00640 1 --2- 172.21.15.47:0/2405052122 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebbe00640 1 -- 172.21.15.47:0/2405052122 >> v1:172.21.15.203:6789/0 conn(0x7fcebc15d080 legacy=0x7fcebc0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebbe00640 1 -- 172.21.15.47:0/2405052122 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc0b6010 con 0x7fcebc06c630 2024-04-26T23:48:00.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.450+0000 7fcebbe00640 1 --2- 172.21.15.47:0/2405052122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc06c630 0x7fcebc06cac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009d90 tx=0x7fceb401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb161c7284f63167 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:00.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcebaa00640 1 -- 172.21.15.47:0/2405052122 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb40b2070 con 0x7fcebc06c630 2024-04-26T23:48:00.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcebaa00640 1 -- 172.21.15.47:0/2405052122 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb40a58b0 con 0x7fcebc06c630 2024-04-26T23:48:00.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcebaa00640 1 -- 172.21.15.47:0/2405052122 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb40a5c80 con 0x7fcebc06c630 2024-04-26T23:48:00.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- 172.21.15.47:0/2405052122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc06c630 msgr2=0x7fcebc06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 --2- 172.21.15.47:0/2405052122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc06c630 0x7fcebc06cac0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fceb4009d90 tx=0x7fceb401c8e0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- 172.21.15.47:0/2405052122 shutdown_connections 2024-04-26T23:48:00.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 --2- 172.21.15.47:0/2405052122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc06c630 0x7fcebc06cac0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 --2- 172.21.15.47:0/2405052122 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- 172.21.15.47:0/2405052122 >> 172.21.15.47:0/2405052122 conn(0x7fcebc0b2d40 msgr2=0x7fcebc0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:00.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- 172.21.15.47:0/2405052122 shutdown_connections 2024-04-26T23:48:00.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- 172.21.15.47:0/2405052122 wait complete. 2024-04-26T23:48:00.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 Processor -- start 2024-04-26T23:48:00.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- start start 2024-04-26T23:48:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcebc06c630 0x7fcebc0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15d080 0x7fcebc14e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0b45d0 con 0x7fcebc06c630 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0b4450 con 0x7fcebc15d080 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcec2600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc0b4750 con 0x7fcebc0ade00 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcebb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcebc06c630 0x7fcebc0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcebb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcebc06c630 0x7fcebc0b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45686/0 (socket says 172.21.15.47:45686) 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcebb400640 1 -- 172.21.15.47:0/12941665 learned_addr learned my addr 172.21.15.47:0/12941665 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fcebbe00640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15d080 0x7fcebc14e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.454+0000 7fceb3e00640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcebb400640 1 -- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 msgr2=0x7fcebc0b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcebb400640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcebb400640 1 -- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15d080 msgr2=0x7fcebc14e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcebb400640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15d080 0x7fcebc14e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcebb400640 1 -- 172.21.15.47:0/12941665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc06fb60 con 0x7fcebc06c630 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcebb400640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcebc06c630 0x7fcebc0b1110 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c420 tx=0x7fceac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fceb3400640 1 -- 172.21.15.47:0/12941665 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac017070 con 0x7fcebc06c630 2024-04-26T23:48:00.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fceb3400640 1 -- 172.21.15.47:0/12941665 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac005cf0 con 0x7fcebc06c630 2024-04-26T23:48:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcebc06fe40 con 0x7fcebc06c630 2024-04-26T23:48:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fceb3400640 1 -- 172.21.15.47:0/12941665 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0072f0 con 0x7fcebc06c630 2024-04-26T23:48:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcebc0b1fc0 con 0x7fcebc06c630 2024-04-26T23:48:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcebc0695f0 con 0x7fcebc06c630 2024-04-26T23:48:00.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fceb3400640 1 -- 172.21.15.47:0/12941665 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fceac01a070 con 0x7fcebc06c630 2024-04-26T23:48:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fceb3400640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce98068650 0x7fce9806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.458+0000 7fceb3400640 1 -- 172.21.15.47:0/12941665 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4943+0+0 (secure 0 0 0) 0x7fceac085dc0 con 0x7fcebc06c630 2024-04-26T23:48:00.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.462+0000 7fceb3e00640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce98068650 0x7fce9806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:00.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.462+0000 7fceb3e00640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce98068650 0x7fce9806ab10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcebc151e30 tx=0x7fcea4009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:00.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.462+0000 7fceb3400640 1 -- 172.21.15.47:0/12941665 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fceac055d30 con 0x7fcebc06c630 2024-04-26T23:48:00.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:00.638+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcebc0b5590 con 0x7fcebc06c630 2024-04-26T23:48:01.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.182+0000 7fceb3400640 1 -- 172.21.15.47:0/12941665 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) ==== 97+0+0 (secure 0 0 0) 0x7fceac05a030 con 0x7fcebc06c630 2024-04-26T23:48:01.190 INFO:teuthology.orchestra.run.smithi047.stderr: removed all blocklist entries 2024-04-26T23:48:01.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce98068650 msgr2=0x7fce9806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce98068650 0x7fce9806ab10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcebc151e30 tx=0x7fcea4009190 comp rx=0 tx=0).stop 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcebc06c630 msgr2=0x7fcebc0b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcebc06c630 0x7fcebc0b1110 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c420 tx=0x7fceac00c8e0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 shutdown_connections 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fce98068650 0x7fce9806ab10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcebc15d080 0x7fcebc14e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcebc0ade00 0x7fcebc0b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 --2- 172.21.15.47:0/12941665 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcebc06c630 0x7fcebc0b1110 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 >> 172.21.15.47:0/12941665 conn(0x7fcebc0b2d40 msgr2=0x7fcebc0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 shutdown_connections 2024-04-26T23:48:01.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.186+0000 7fcec2600640 1 -- 172.21.15.47:0/12941665 wait complete. 2024-04-26T23:48:01.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-26T23:48:01.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.350+0000 7f6c56200640 1 Processor -- start 2024-04-26T23:48:01.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.350+0000 7f6c56200640 1 -- start start 2024-04-26T23:48:01.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c56200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6c500b4360 0x7f6c500cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c56200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c5015d5b0 0x7f6c5015da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c56200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5015e050 con 0x7f6c500cdc00 2024-04-26T23:48:01.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c56200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6c5015e330 con 0x7f6c500b4360 2024-04-26T23:48:01.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c56200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6c500ceda0 con 0x7f6c5015d5b0 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4f400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6c500b4360 0x7f6c500cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c47e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c5015d5b0 0x7f6c5015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4fe00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f6c500cdc00 0x7f6c5015e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:42864/0 (socket says 172.21.15.47:42864) 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4f400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6c500b4360 0x7f6c500cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:39858/0 (socket says 172.21.15.47:39858) 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c47e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c5015d5b0 0x7f6c5015da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:57494/0 (socket says 172.21.15.47:57494) 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4fe00640 1 -- 172.21.15.47:0/686833810 learned_addr learned my addr 172.21.15.47:0/686833810 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4f400640 1 -- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c5015d5b0 msgr2=0x7f6c5015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4f400640 1 --2- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c5015d5b0 0x7f6c5015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4f400640 1 -- 172.21.15.47:0/686833810 >> v1:172.21.15.203:6789/0 conn(0x7f6c500cdc00 legacy=0x7f6c5015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4f400640 1 -- 172.21.15.47:0/686833810 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c500cf080 con 0x7f6c500b4360 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c47e00640 1 --2- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c5015d5b0 0x7f6c5015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:48:01.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.354+0000 7f6c4ea00640 1 -- 172.21.15.47:0/686833810 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209569269 0 0) 0x7f6c5015e050 con 0x7f6c500cdc00 2024-04-26T23:48:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c4f400640 1 --2- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c500b4360 0x7f6c500cf5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c400097c0 tx=0x7f6c4001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82fd36e6f04c2408 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c4ea00640 1 -- 172.21.15.47:0/686833810 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400b0070 con 0x7f6c500b4360 2024-04-26T23:48:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c4ea00640 1 -- 172.21.15.47:0/686833810 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c400ab600 con 0x7f6c500b4360 2024-04-26T23:48:01.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c4ea00640 1 -- 172.21.15.47:0/686833810 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c400ab9d0 con 0x7f6c500b4360 2024-04-26T23:48:01.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 -- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c500b4360 msgr2=0x7f6c500cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 --2- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c500b4360 0x7f6c500cf5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c400097c0 tx=0x7f6c4001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 -- 172.21.15.47:0/686833810 shutdown_connections 2024-04-26T23:48:01.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 --2- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c5015d5b0 0x7f6c5015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 --2- 172.21.15.47:0/686833810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c500b4360 0x7f6c500cf5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 -- 172.21.15.47:0/686833810 >> 172.21.15.47:0/686833810 conn(0x7f6c5006c800 msgr2=0x7f6c5006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 -- 172.21.15.47:0/686833810 shutdown_connections 2024-04-26T23:48:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.358+0000 7f6c56200640 1 -- 172.21.15.47:0/686833810 wait complete. 2024-04-26T23:48:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 Processor -- start 2024-04-26T23:48:01.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 -- start start 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c500b4360 0x7f6c50150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c500cdc00 0x7f6c50141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5015d5b0 0x7f6c501555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b60f0 con 0x7f6c500cdc00 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c500b5f70 con 0x7f6c5015d5b0 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5016a750 con 0x7f6c500b4360 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c500cdc00 0x7f6c50141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c4f400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c500b4360 0x7f6c50150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c500cdc00 0x7f6c50141660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45690/0 (socket says 172.21.15.47:45690) 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 -- 172.21.15.47:0/2268243962 learned_addr learned my addr 172.21.15.47:0/2268243962 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c4fe00640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5015d5b0 0x7f6c501555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 -- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c500b4360 msgr2=0x7f6c50150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c500b4360 0x7f6c50150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 -- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5015d5b0 msgr2=0x7f6c501555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5015d5b0 0x7f6c501555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 -- 172.21.15.47:0/2268243962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c50069ee0 con 0x7f6c500cdc00 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47e00640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c500cdc00 0x7f6c50141660 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800ebe0 tx=0x7f6c3800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47400640 1 -- 172.21.15.47:0/2268243962 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800cc30 con 0x7f6c500cdc00 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47400640 1 -- 172.21.15.47:0/2268243962 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3800cdd0 con 0x7f6c500cdc00 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c47400640 1 -- 172.21.15.47:0/2268243962 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38005ba0 con 0x7f6c500cdc00 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c500739c0 con 0x7f6c500cdc00 2024-04-26T23:48:01.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c50073f80 con 0x7f6c500cdc00 2024-04-26T23:48:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.362+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c50069700 con 0x7f6c500cdc00 2024-04-26T23:48:01.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.366+0000 7f6c47400640 1 -- 172.21.15.47:0/2268243962 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f6c38006030 con 0x7f6c500cdc00 2024-04-26T23:48:01.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.366+0000 7f6c47400640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c2c068680 0x7f6c2c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.366+0000 7f6c47400640 1 -- 172.21.15.47:0/2268243962 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7f6c38086e40 con 0x7f6c500cdc00 2024-04-26T23:48:01.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.366+0000 7f6c4f400640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c2c068680 0x7f6c2c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.366+0000 7f6c4f400640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c2c068680 0x7f6c2c06ab40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6c400ad000 tx=0x7f6c400a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:01.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.370+0000 7f6c47400640 1 -- 172.21.15.47:0/2268243962 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6c38017020 con 0x7f6c500cdc00 2024-04-26T23:48:01.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.594+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6c500b1b30 con 0x7f6c500cdc00 2024-04-26T23:48:01.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.594+0000 7f6c47400640 1 -- 172.21.15.47:0/2268243962 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f6c38056e00 con 0x7f6c500cdc00 2024-04-26T23:48:01.601 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:01.601 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:48:01.601 INFO:teuthology.orchestra.run.smithi047.stdout: "auth_dump": [ 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.a", 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmPvgWGxAAiYQ2zUX0ozNfqhRyoqklbA==", 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.602 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.b", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxm0ms+JxAA/yzvj5fwb8ubsCaa8RPulA==", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.c", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmJQ08IhAA+Pq7378EpZhTk027ykb25Q==", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.603 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mds.d", 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmqVSULhAA4u/dlOjp5dvwF7dCSEzBjQ==", 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.604 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.0", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBkPCxmlALuFBAALtrCma5B3PGPr4wwo9MHsQ==", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.1", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBnPCxms/UlHhAAqYSWMKwMrWVB4fAaks2ouw==", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.2", 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBqPCxmL2dpKBAAoLK+/xVyjawGaNzqnJKfsA==", 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.3", 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBtPCxmvmoNMRAAZIRxIBrJHZ4Zf8L6w3C7dg==", 2024-04-26T23:48:01.606 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.4", 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBzPCxmuAseJRAAFY67ni0LWB3q0kgi5MdGMA==", 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.607 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.5", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQB2PCxmLy55LxAAQ1LcwQkn4tgpBOBAAVGPmw==", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.6", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQB5PCxmk2xtORAAUD/E0hWuBjAzQzLWViuGwQ==", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "osd.7", 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQB9PCxmHWQvBhAAqMiM2MHF9YUbdt0wrrJKZw==", 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow profile osd", 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile osd", 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.0", 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmSs+fMhAAi6eSRSyhcIwg3ckGbNdS9Q==", 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.609 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow r", 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.1", 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBjPCxmwgTIABAAoqIgP1MTeUjPZz0fFI/QZA==", 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.2", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmnAndOBAARbPEFhWyxpORFk++YkeIZw==", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.3", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBjPCxmnBTmBhAAzw4PpzWsqCroEIeyjApSPg==", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow", 2024-04-26T23:48:01.611 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow r", 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow rw", 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow rwx" 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "client.admin", 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBhPCxmosOzOhAAEZcOKcH6whmSmdPyES3Txg==", 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "mgr": "allow *", 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow *", 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.612 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.x", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmzWLtFhAAQralpGU4KTBxBggcgaIHZA==", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "entity": "mgr.y", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "key": "AQBiPCxmOXIBExAAAvRWdTqgQoTBjJINIP8Axw==", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "caps": { 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "mds": "allow *", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "mon": "allow profile mgr", 2024-04-26T23:48:01.613 INFO:teuthology.orchestra.run.smithi047.stdout: "osd": "allow *" 2024-04-26T23:48:01.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:01.614 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-04-26T23:48:01.614 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c2c068680 msgr2=0x7f6c2c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c2c068680 0x7f6c2c06ab40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6c400ad000 tx=0x7f6c400a6000 comp rx=0 tx=0).stop 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c500cdc00 msgr2=0x7f6c50141660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c500cdc00 0x7f6c50141660 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800ebe0 tx=0x7f6c3800c520 comp rx=0 tx=0).stop 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 shutdown_connections 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6c2c068680 0x7f6c2c06ab40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c5015d5b0 0x7f6c501555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c500cdc00 0x7f6c50141660 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 --2- 172.21.15.47:0/2268243962 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6c500b4360 0x7f6c50150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 >> 172.21.15.47:0/2268243962 conn(0x7f6c5006c800 msgr2=0x7f6c500b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 shutdown_connections 2024-04-26T23:48:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.598+0000 7f6c56200640 1 -- 172.21.15.47:0/2268243962 wait complete. 2024-04-26T23:48:01.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:48:01.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.754+0000 7fde3aa00640 1 Processor -- start 2024-04-26T23:48:01.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde3aa00640 1 -- start start 2024-04-26T23:48:01.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde3aa00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fde3415c100 0x7fde3415cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde3aa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fde3406fcd0 0x7fde340cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde3aa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde3415fc50 con 0x7fde340ce140 2024-04-26T23:48:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde3aa00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fde340ce5b0 con 0x7fde3406fcd0 2024-04-26T23:48:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde3aa00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fde34160860 con 0x7fde3415c100 2024-04-26T23:48:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde38a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fde340ce140 0x7fde3406ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58124/0 (socket says 172.21.15.47:58124) 2024-04-26T23:48:01.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde2b400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fde3406fcd0 0x7fde340cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde38a00640 1 -- 172.21.15.47:0/1804537964 learned_addr learned my addr 172.21.15.47:0/1804537964 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde33400640 1 -- 172.21.15.47:0/1804537964 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745679016 0 0) 0x7fde3415fc50 con 0x7fde340ce140 2024-04-26T23:48:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde2b400640 1 -- 172.21.15.47:0/1804537964 >> v2:172.21.15.203:3300/0 conn(0x7fde3415c100 msgr2=0x7fde3415cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde2b400640 1 --2- 172.21.15.47:0/1804537964 >> v2:172.21.15.203:3300/0 conn(0x7fde3415c100 0x7fde3415cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde2b400640 1 -- 172.21.15.47:0/1804537964 >> v1:172.21.15.47:6789/0 conn(0x7fde340ce140 legacy=0x7fde3406ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.758+0000 7fde2b400640 1 -- 172.21.15.47:0/1804537964 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3415ff30 con 0x7fde3406fcd0 2024-04-26T23:48:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde2b400640 1 --2- 172.21.15.47:0/1804537964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde340cdc00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fde340703a0 tx=0x7fde1c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8ba5eb8246cba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:01.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde33400640 1 -- 172.21.15.47:0/1804537964 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b0070 con 0x7fde3406fcd0 2024-04-26T23:48:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde33400640 1 -- 172.21.15.47:0/1804537964 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0ab600 con 0x7fde3406fcd0 2024-04-26T23:48:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde33400640 1 -- 172.21.15.47:0/1804537964 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0ab9d0 con 0x7fde3406fcd0 2024-04-26T23:48:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 -- 172.21.15.47:0/1804537964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 msgr2=0x7fde340cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 --2- 172.21.15.47:0/1804537964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde340cdc00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fde340703a0 tx=0x7fde1c01c460 comp rx=0 tx=0).stop 2024-04-26T23:48:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 -- 172.21.15.47:0/1804537964 shutdown_connections 2024-04-26T23:48:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 --2- 172.21.15.47:0/1804537964 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde340cdc00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 --2- 172.21.15.47:0/1804537964 >> v2:172.21.15.203:3300/0 conn(0x7fde3415c100 0x7fde3415cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 -- 172.21.15.47:0/1804537964 >> 172.21.15.47:0/1804537964 conn(0x7fde3406c800 msgr2=0x7fde3406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 -- 172.21.15.47:0/1804537964 shutdown_connections 2024-04-26T23:48:01.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 -- 172.21.15.47:0/1804537964 wait complete. 2024-04-26T23:48:01.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 Processor -- start 2024-04-26T23:48:01.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.762+0000 7fde3aa00640 1 -- start start 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde3409ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde340ce140 0x7fde34159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3415c100 0x7fde340af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fde341691e0 con 0x7fde3406fcd0 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde34169060 con 0x7fde340ce140 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fde34169360 con 0x7fde3415c100 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde3409ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde3409ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45718/0 (socket says 172.21.15.47:45718) 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 -- 172.21.15.47:0/263957446 learned_addr learned my addr 172.21.15.47:0/263957446 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde2b400640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde340ce140 0x7fde34159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde38a00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3415c100 0x7fde340af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 -- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3415c100 msgr2=0x7fde340af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3415c100 0x7fde340af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 -- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde340ce140 msgr2=0x7fde34159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde340ce140 0x7fde34159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 -- 172.21.15.47:0/263957446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3415a310 con 0x7fde3406fcd0 2024-04-26T23:48:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde38a00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3415c100 0x7fde340af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:01.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde33e00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde3409ce40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fde2400b440 tx=0x7fde2400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde30c00640 1 -- 172.21.15.47:0/263957446 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24015020 con 0x7fde3406fcd0 2024-04-26T23:48:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde30c00640 1 -- 172.21.15.47:0/263957446 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde240118b0 con 0x7fde3406fcd0 2024-04-26T23:48:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde30c00640 1 -- 172.21.15.47:0/263957446 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24011ca0 con 0x7fde3406fcd0 2024-04-26T23:48:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3409d7c0 con 0x7fde3406fcd0 2024-04-26T23:48:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3409dd80 con 0x7fde3406fcd0 2024-04-26T23:48:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde34069700 con 0x7fde3406fcd0 2024-04-26T23:48:01.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.766+0000 7fde30c00640 1 -- 172.21.15.47:0/263957446 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fde24018020 con 0x7fde3406fcd0 2024-04-26T23:48:01.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.770+0000 7fde30c00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde10068650 0x7fde1006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:01.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.770+0000 7fde30c00640 1 -- 172.21.15.47:0/263957446 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7fde24086b50 con 0x7fde3406fcd0 2024-04-26T23:48:01.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.770+0000 7fde2b400640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde10068650 0x7fde1006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:01.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.770+0000 7fde2b400640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde10068650 0x7fde1006ab10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0ad000 tx=0x7fde1c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:01.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.774+0000 7fde30c00640 1 -- 172.21.15.47:0/263957446 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fde2401f020 con 0x7fde3406fcd0 2024-04-26T23:48:01.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.942+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde3409d4e0 con 0x7fde3406fcd0 2024-04-26T23:48:01.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.942+0000 7fde30c00640 1 -- 172.21.15.47:0/263957446 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+12879 (secure 0 0 0) 0x7fde3415a310 con 0x7fde3406fcd0 2024-04-26T23:48:01.950 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:01.950 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":45,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:01.196260+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:48:01.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde10068650 msgr2=0x7fde1006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde10068650 0x7fde1006ab10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0ad000 tx=0x7fde1c0a6000 comp rx=0 tx=0).stop 2024-04-26T23:48:01.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 msgr2=0x7fde3409ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:01.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde3409ce40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fde2400b440 tx=0x7fde2400b900 comp rx=0 tx=0).stop 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 shutdown_connections 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fde10068650 0x7fde1006ab10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fde3415c100 0x7fde340af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde340ce140 0x7fde34159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 --2- 172.21.15.47:0/263957446 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fde3406fcd0 0x7fde3409ce40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 >> 172.21.15.47:0/263957446 conn(0x7fde3406c800 msgr2=0x7fde3406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 shutdown_connections 2024-04-26T23:48:01.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:01.946+0000 7fde3aa00640 1 -- 172.21.15.47:0/263957446 wait complete. 2024-04-26T23:48:01.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:48:01.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:48:02.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec8200640 1 Processor -- start 2024-04-26T23:48:02.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec8200640 1 -- start start 2024-04-26T23:48:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec8200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbec00d0390 0x7fbec00af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec8200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbec006c630 0x7fbec006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec8200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec00ae6a0 con 0x7fbec015fcd0 2024-04-26T23:48:02.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec8200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbec00ae920 con 0x7fbec00d0390 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec8200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbec00aec00 con 0x7fbec006c630 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec5800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbec00d0390 0x7fbec00af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec5800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbec00d0390 0x7fbec00af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45726/0 (socket says 172.21.15.47:45726) 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec5800640 1 -- 172.21.15.47:0/2127053547 learned_addr learned my addr 172.21.15.47:0/2127053547 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec4e00640 1 --2- 172.21.15.47:0/2127053547 >> v2:172.21.15.203:3300/0 conn(0x7fbec006c630 0x7fbec006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec5800640 1 -- 172.21.15.47:0/2127053547 >> v2:172.21.15.203:3300/0 conn(0x7fbec006c630 msgr2=0x7fbec006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec5800640 1 --2- 172.21.15.47:0/2127053547 >> v2:172.21.15.203:3300/0 conn(0x7fbec006c630 0x7fbec006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec5800640 1 -- 172.21.15.47:0/2127053547 >> v1:172.21.15.203:6789/0 conn(0x7fbec015fcd0 legacy=0x7fbec0160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.110+0000 7fbec5800640 1 -- 172.21.15.47:0/2127053547 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec00aeee0 con 0x7fbec00d0390 2024-04-26T23:48:02.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec5800640 1 --2- 172.21.15.47:0/2127053547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec00d0390 0x7fbec00af6e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbec006e9e0 tx=0x7fbeb401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c37ce6c96c485a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbebfe00640 1 -- 172.21.15.47:0/2127053547 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40b0070 con 0x7fbec00d0390 2024-04-26T23:48:02.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbebfe00640 1 -- 172.21.15.47:0/2127053547 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb40ab600 con 0x7fbec00d0390 2024-04-26T23:48:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbebfe00640 1 -- 172.21.15.47:0/2127053547 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb40ab9d0 con 0x7fbec00d0390 2024-04-26T23:48:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 -- 172.21.15.47:0/2127053547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec00d0390 msgr2=0x7fbec00af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 --2- 172.21.15.47:0/2127053547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec00d0390 0x7fbec00af6e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbec006e9e0 tx=0x7fbeb401c490 comp rx=0 tx=0).stop 2024-04-26T23:48:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 -- 172.21.15.47:0/2127053547 shutdown_connections 2024-04-26T23:48:02.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 --2- 172.21.15.47:0/2127053547 >> v2:172.21.15.203:3300/0 conn(0x7fbec006c630 0x7fbec006cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 --2- 172.21.15.47:0/2127053547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec00d0390 0x7fbec00af6e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 -- 172.21.15.47:0/2127053547 >> 172.21.15.47:0/2127053547 conn(0x7fbec00b2b70 msgr2=0x7fbec00b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 -- 172.21.15.47:0/2127053547 shutdown_connections 2024-04-26T23:48:02.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.114+0000 7fbec8200640 1 -- 172.21.15.47:0/2127053547 wait complete. 2024-04-26T23:48:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 Processor -- start 2024-04-26T23:48:02.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 -- start start 2024-04-26T23:48:02.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec006c630 0x7fbec009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbec00d0390 0x7fbec0147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec015fcd0 0x7fbec0154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbec006faf0 con 0x7fbec015fcd0 2024-04-26T23:48:02.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbec006f970 con 0x7fbec006c630 2024-04-26T23:48:02.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbec006fc70 con 0x7fbec00d0390 2024-04-26T23:48:02.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec015fcd0 0x7fbec0154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec015fcd0 0x7fbec0154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45736/0 (socket says 172.21.15.47:45736) 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 -- 172.21.15.47:0/2567988025 learned_addr learned my addr 172.21.15.47:0/2567988025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec4e00640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbec00d0390 0x7fbec0147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec5800640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec006c630 0x7fbec009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 -- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbec00d0390 msgr2=0x7fbec0147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbec00d0390 0x7fbec0147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 -- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec006c630 msgr2=0x7fbec009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec006c630 0x7fbec009ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 -- 172.21.15.47:0/2567988025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec00afac0 con 0x7fbec015fcd0 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec6200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec015fcd0 0x7fbec0154b50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c760 tx=0x7fbeb800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbebd600640 1 -- 172.21.15.47:0/2567988025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8003b80 con 0x7fbec015fcd0 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbebd600640 1 -- 172.21.15.47:0/2567988025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb8003d20 con 0x7fbec015fcd0 2024-04-26T23:48:02.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbebd600640 1 -- 172.21.15.47:0/2567988025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800aa30 con 0x7fbec015fcd0 2024-04-26T23:48:02.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec00afda0 con 0x7fbec015fcd0 2024-04-26T23:48:02.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec00b0360 con 0x7fbec015fcd0 2024-04-26T23:48:02.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.118+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec0069700 con 0x7fbec015fcd0 2024-04-26T23:48:02.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.122+0000 7fbebd600640 1 -- 172.21.15.47:0/2567988025 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fbeb800abd0 con 0x7fbec015fcd0 2024-04-26T23:48:02.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.122+0000 7fbebd600640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbea0068680 0x7fbea006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.122+0000 7fbebd600640 1 -- 172.21.15.47:0/2567988025 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7fbeb80867e0 con 0x7fbec015fcd0 2024-04-26T23:48:02.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.122+0000 7fbec5800640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbea0068680 0x7fbea006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.122+0000 7fbec5800640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbea0068680 0x7fbea006ab40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40ad000 tx=0x7fbeb40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.126+0000 7fbebd600640 1 -- 172.21.15.47:0/2567988025 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbec00ae6a0 con 0x7fbec015fcd0 2024-04-26T23:48:02.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.294+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbec006ecb0 con 0x7fbec015fcd0 2024-04-26T23:48:02.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.294+0000 7fbebd600640 1 -- 172.21.15.47:0/2567988025 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7fbeb8056750 con 0x7fbec015fcd0 2024-04-26T23:48:02.302 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbea0068680 msgr2=0x7fbea006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbea0068680 0x7fbea006ab40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40ad000 tx=0x7fbeb40a6000 comp rx=0 tx=0).stop 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec015fcd0 msgr2=0x7fbec0154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec015fcd0 0x7fbec0154b50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c760 tx=0x7fbeb800cc20 comp rx=0 tx=0).stop 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 shutdown_connections 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbea0068680 0x7fbea006ab40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbec015fcd0 0x7fbec0154b50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbec00d0390 0x7fbec0147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 --2- 172.21.15.47:0/2567988025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbec006c630 0x7fbec009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 >> 172.21.15.47:0/2567988025 conn(0x7fbec00b2b70 msgr2=0x7fbec00b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:02.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 shutdown_connections 2024-04-26T23:48:02.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.298+0000 7fbec8200640 1 -- 172.21.15.47:0/2567988025 wait complete. 2024-04-26T23:48:02.322 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T23:48:02.443 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:02.447 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:02.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.454+0000 7f7de2200640 1 Processor -- start 2024-04-26T23:48:02.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7de2200640 1 -- start start 2024-04-26T23:48:02.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7de2200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7ddc15c100 0x7f7ddc15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7de2200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc15fc50 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7de2200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc15ff30 con 0x7f7ddc0ce310 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7de2200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7ddc160860 con 0x7f7ddc15c100 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7dd3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7ddc06fcd0 0x7f7ddc0cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58128/0 (socket says 172.21.15.47:58128) 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7dd3e00640 1 -- 172.21.15.47:0/515186203 learned_addr learned my addr 172.21.15.47:0/515186203 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddb400640 1 --2- 172.21.15.47:0/515186203 >> v2:172.21.15.203:3300/0 conn(0x7f7ddc15c100 0x7f7ddc15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866174753 0 0) 0x7f7ddc15fc50 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc0005740 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426499941 0 0) 0x7f7ddc15ff30 con 0x7f7ddc0ce310 2024-04-26T23:48:02.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ddc15fc50 con 0x7f7ddc0ce310 2024-04-26T23:48:02.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddb400640 1 -- 172.21.15.47:0/515186203 >> v1:172.21.15.203:6789/0 conn(0x7f7ddc0ce310 legacy=0x7f7ddc0b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddb400640 1 -- 172.21.15.47:0/515186203 >> v1:172.21.15.47:6789/0 conn(0x7f7ddc06fcd0 legacy=0x7f7ddc0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2985020552 0 0) 0x7f7dc0005740 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.458+0000 7f7ddb400640 1 -- 172.21.15.47:0/515186203 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc160210 con 0x7f7ddc15c100 2024-04-26T23:48:02.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7ddb400640 1 --2- 172.21.15.47:0/515186203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc15cf60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc1609e0 tx=0x7f7dcc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55cb32d847c2daaf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0b0070 con 0x7f7ddc15c100 2024-04-26T23:48:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0ab400 con 0x7f7ddc15c100 2024-04-26T23:48:02.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7ddaa00640 1 -- 172.21.15.47:0/515186203 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4001800 con 0x7f7ddc15c100 2024-04-26T23:48:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7de2200640 1 -- 172.21.15.47:0/515186203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 msgr2=0x7f7ddc15cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7de2200640 1 --2- 172.21.15.47:0/515186203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc15cf60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc1609e0 tx=0x7f7dcc01c3c0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7de2200640 1 -- 172.21.15.47:0/515186203 shutdown_connections 2024-04-26T23:48:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7de2200640 1 --2- 172.21.15.47:0/515186203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc15cf60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7de2200640 1 -- 172.21.15.47:0/515186203 >> 172.21.15.47:0/515186203 conn(0x7f7ddc06c800 msgr2=0x7f7ddc06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7de2200640 1 -- 172.21.15.47:0/515186203 shutdown_connections 2024-04-26T23:48:02.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.462+0000 7f7de2200640 1 -- 172.21.15.47:0/515186203 wait complete. 2024-04-26T23:48:02.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 Processor -- start 2024-04-26T23:48:02.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 -- start start 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ddc06fcd0 0x7f7ddc145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0ce310 0x7f7ddc0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc1615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc0cec00 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc0b6000 con 0x7f7ddc15c100 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7ddc0ced80 con 0x7f7ddc0ce310 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ddc06fcd0 0x7f7ddc145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ddc06fcd0 0x7f7ddc145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45742/0 (socket says 172.21.15.47:45742) 2024-04-26T23:48:02.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 -- 172.21.15.47:0/183355614 learned_addr learned my addr 172.21.15.47:0/183355614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddbe00640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc1615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7dd3e00640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0ce310 0x7f7ddc0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 -- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0ce310 msgr2=0x7f7ddc0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0ce310 0x7f7ddc0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 -- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 msgr2=0x7f7ddc1615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc1615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 -- 172.21.15.47:0/183355614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc146490 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddbe00640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7ddb400640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ddc06fcd0 0x7f7ddc145f50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc018fd0 tx=0x7f7dcc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7dd3400640 1 -- 172.21.15.47:0/183355614 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0b9070 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7dd3400640 1 -- 172.21.15.47:0/183355614 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0b5680 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc162040 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7dd3400640 1 -- 172.21.15.47:0/183355614 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0b0040 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.466+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc0b1e40 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.470+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc069700 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.470+0000 7f7dd3400640 1 -- 172.21.15.47:0/183355614 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f7dcc0bc070 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.470+0000 7f7dd3400640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7db8068650 0x7f7db806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.470+0000 7f7dd3400640 1 -- 172.21.15.47:0/183355614 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7f7dcc120cf0 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.470+0000 7f7dd3e00640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7db8068650 0x7f7db806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.470+0000 7f7dd3e00640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7db8068650 0x7f7db806ab10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc156560 tx=0x7f7dc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.474+0000 7f7dd3400640 1 -- 172.21.15.47:0/183355614 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7dcc0c3030 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7ddc0b45b0 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7dd3400640 1 -- 172.21.15.47:0/183355614 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) ==== 84+0+65 (secure 0 0 0) 0x7f7dcc015fb0 con 0x7f7ddc06fcd0 2024-04-26T23:48:02.648 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:02.649 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-26T23:48:02.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:02.649 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-04-26T23:48:02.649 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-04-26T23:48:02.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:02.649 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7db8068650 msgr2=0x7f7db806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7db8068650 0x7f7db806ab10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc156560 tx=0x7f7dc4009040 comp rx=0 tx=0).stop 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ddc06fcd0 msgr2=0x7f7ddc145f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ddc06fcd0 0x7f7ddc145f50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc018fd0 tx=0x7f7dcc019160 comp rx=0 tx=0).stop 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 shutdown_connections 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7db8068650 0x7f7db806ab10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ddc15c100 0x7f7ddc1615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7ddc0ce310 0x7f7ddc0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 --2- 172.21.15.47:0/183355614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7ddc06fcd0 0x7f7ddc145f50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 >> 172.21.15.47:0/183355614 conn(0x7f7ddc06c800 msgr2=0x7f7ddc0b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 shutdown_connections 2024-04-26T23:48:02.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.642+0000 7f7de2200640 1 -- 172.21.15.47:0/183355614 wait complete. 2024-04-26T23:48:02.669 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T23:48:02.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T23:48:02.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.806+0000 7f43e2e00640 1 Processor -- start 2024-04-26T23:48:02.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.806+0000 7f43e2e00640 1 -- start start 2024-04-26T23:48:02.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43e2e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f43dc06fca0 0x7f43dc0d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43e2e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43dc072140 con 0x7f43dc0d03b0 2024-04-26T23:48:02.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43e2e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43dc072420 con 0x7f43dc15c1d0 2024-04-26T23:48:02.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43e2e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f43dc072700 con 0x7f43dc06fca0 2024-04-26T23:48:02.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43db400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f43dc06fca0 0x7f43dc0d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43e0e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f43dc0d03b0 0x7f43dc072f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58138/0 (socket says 172.21.15.47:58138) 2024-04-26T23:48:02.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43e0e00640 1 -- 172.21.15.47:0/1336318694 learned_addr learned my addr 172.21.15.47:0/1336318694 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:02.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43db400640 1 -- 172.21.15.47:0/1336318694 >> v1:172.21.15.203:6789/0 conn(0x7f43dc15c1d0 legacy=0x7f43dc0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43db400640 1 -- 172.21.15.47:0/1336318694 >> v1:172.21.15.47:6789/0 conn(0x7f43dc0d03b0 legacy=0x7f43dc072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.810+0000 7f43db400640 1 -- 172.21.15.47:0/1336318694 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc0729e0 con 0x7f43dc06fca0 2024-04-26T23:48:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43db400640 1 --2- 172.21.15.47:0/1336318694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc06fca0 0x7f43dc0d17b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097c0 tx=0x7f43c801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c1939ae48075ea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43daa00640 1 -- 172.21.15.47:0/1336318694 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c80ab430 con 0x7f43dc06fca0 2024-04-26T23:48:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43daa00640 1 -- 172.21.15.47:0/1336318694 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c80b0070 con 0x7f43dc06fca0 2024-04-26T23:48:02.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43daa00640 1 -- 172.21.15.47:0/1336318694 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c80ab7f0 con 0x7f43dc06fca0 2024-04-26T23:48:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- 172.21.15.47:0/1336318694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc06fca0 msgr2=0x7f43dc0d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 --2- 172.21.15.47:0/1336318694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc06fca0 0x7f43dc0d17b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f43c80097c0 tx=0x7f43c801c410 comp rx=0 tx=0).stop 2024-04-26T23:48:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- 172.21.15.47:0/1336318694 shutdown_connections 2024-04-26T23:48:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 --2- 172.21.15.47:0/1336318694 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc06fca0 0x7f43dc0d17b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- 172.21.15.47:0/1336318694 >> 172.21.15.47:0/1336318694 conn(0x7f43dc0d0c90 msgr2=0x7f43dc0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- 172.21.15.47:0/1336318694 shutdown_connections 2024-04-26T23:48:02.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- 172.21.15.47:0/1336318694 wait complete. 2024-04-26T23:48:02.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 Processor -- start 2024-04-26T23:48:02.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- start start 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43dc06fca0 0x7f43dc1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc0d03b0 0x7f43dc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43dc15c1d0 0x7f43dc151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc169da0 con 0x7f43dc0d03b0 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc169c20 con 0x7f43dc15c1d0 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.814+0000 7f43e2e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f43dc169f20 con 0x7f43dc06fca0 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc0d03b0 0x7f43dc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc0d03b0 0x7f43dc09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45754/0 (socket says 172.21.15.47:45754) 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 -- 172.21.15.47:0/2225187 learned_addr learned my addr 172.21.15.47:0/2225187 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:02.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43dbe00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43dc06fca0 0x7f43dc1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43e0e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43dc15c1d0 0x7f43dc151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 -- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43dc06fca0 msgr2=0x7f43dc1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43dc06fca0 0x7f43dc1589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 -- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43dc15c1d0 msgr2=0x7f43dc151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43dc15c1d0 0x7f43dc151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 -- 172.21.15.47:0/2225187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc09d360 con 0x7f43dc0d03b0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43e0e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43dc15c1d0 0x7f43dc151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43db400640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc0d03b0 0x7f43dc09c9c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f43c8019020 tx=0x7f43c801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43d3e00640 1 -- 172.21.15.47:0/2225187 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c80bf610 con 0x7f43dc0d03b0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43d3e00640 1 -- 172.21.15.47:0/2225187 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c80abe50 con 0x7f43dc0d03b0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43d3e00640 1 -- 172.21.15.47:0/2225187 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c80bfa10 con 0x7f43dc0d03b0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc09d640 con 0x7f43dc0d03b0 2024-04-26T23:48:02.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc09dc00 con 0x7f43dc0d03b0 2024-04-26T23:48:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc0695f0 con 0x7f43dc0d03b0 2024-04-26T23:48:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.818+0000 7f43d3e00640 1 -- 172.21.15.47:0/2225187 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f43c80bd020 con 0x7f43dc0d03b0 2024-04-26T23:48:02.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.822+0000 7f43d3e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f43bc068650 0x7f43bc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:02.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.822+0000 7f43d3e00640 1 -- 172.21.15.47:0/2225187 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4857+0+0 (secure 0 0 0) 0x7f43c80a8020 con 0x7f43dc0d03b0 2024-04-26T23:48:02.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.822+0000 7f43dbe00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f43bc068650 0x7f43bc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:02.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.822+0000 7f43dbe00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f43bc068650 0x7f43bc06ab10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f43cc007fd0 tx=0x7f43cc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:02.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.826+0000 7f43d3e00640 1 -- 172.21.15.47:0/2225187 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f43c8125070 con 0x7f43dc0d03b0 2024-04-26T23:48:02.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:02.990+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f43dc0b24e0 con 0x7f43dc0d03b0 2024-04-26T23:48:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43d3e00640 1 -- 172.21.15.47:0/2225187 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) ==== 138+0+0 (secure 0 0 0) 0x7f43c8016090 con 0x7f43dc0d03b0 2024-04-26T23:48:03.196 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f43bc068650 msgr2=0x7f43bc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f43bc068650 0x7f43bc06ab10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f43cc007fd0 tx=0x7f43cc009040 comp rx=0 tx=0).stop 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc0d03b0 msgr2=0x7f43dc09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc0d03b0 0x7f43dc09c9c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f43c8019020 tx=0x7f43c801ac50 comp rx=0 tx=0).stop 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 shutdown_connections 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f43bc068650 0x7f43bc06ab10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43dc15c1d0 0x7f43dc151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f43dc0d03b0 0x7f43dc09c9c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 --2- 172.21.15.47:0/2225187 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f43dc06fca0 0x7f43dc1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.190+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 >> 172.21.15.47:0/2225187 conn(0x7f43dc0d0c90 msgr2=0x7f43dc0d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.194+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 shutdown_connections 2024-04-26T23:48:03.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.194+0000 7f43e2e00640 1 -- 172.21.15.47:0/2225187 wait complete. 2024-04-26T23:48:03.224 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T23:48:03.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a3c00640 1 Processor -- start 2024-04-26T23:48:03.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a3c00640 1 -- start start 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a3c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f769c0cf260 0x7f769c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a3c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f769c070ce0 con 0x7f769c161620 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a3c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f769c0722c0 con 0x7f769c0cf260 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a3c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f769c070fc0 con 0x7f769c0cfd50 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f769be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f769c161620 0x7f769c0cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58146/0 (socket says 172.21.15.47:58146) 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f769be00640 1 -- 172.21.15.47:0/2126120660 learned_addr learned my addr 172.21.15.47:0/2126120660 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a1200640 1 --2- 172.21.15.47:0/2126120660 >> v2:172.21.15.203:3300/0 conn(0x7f769c0cf260 0x7f769c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a1c00640 1 --2- 172.21.15.47:0/2126120660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f769b400640 1 -- 172.21.15.47:0/2126120660 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047292027 0 0) 0x7f769c070ce0 con 0x7f769c161620 2024-04-26T23:48:03.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f769b400640 1 -- 172.21.15.47:0/2126120660 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7684003530 con 0x7f769c161620 2024-04-26T23:48:03.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a1c00640 1 -- 172.21.15.47:0/2126120660 >> v2:172.21.15.203:3300/0 conn(0x7f769c0cf260 msgr2=0x7f769c071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:03.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a1c00640 1 --2- 172.21.15.47:0/2126120660 >> v2:172.21.15.203:3300/0 conn(0x7f769c0cf260 0x7f769c071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a1c00640 1 -- 172.21.15.47:0/2126120660 >> v1:172.21.15.47:6789/0 conn(0x7f769c161620 legacy=0x7f769c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:03.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a1c00640 1 -- 172.21.15.47:0/2126120660 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c0712a0 con 0x7f769c0cfd50 2024-04-26T23:48:03.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.366+0000 7f76a1200640 1 --2- 172.21.15.47:0/2126120660 >> v2:172.21.15.203:3300/0 conn(0x7f769c0cf260 0x7f769c071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:48:03.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a1c00640 1 --2- 172.21.15.47:0/2126120660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c0cd7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7694009d90 tx=0x7f769401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70fcbcbdfda58510 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:03.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f769b400640 1 -- 172.21.15.47:0/2126120660 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940b2070 con 0x7f769c0cfd50 2024-04-26T23:48:03.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f769b400640 1 -- 172.21.15.47:0/2126120660 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76940a5920 con 0x7f769c0cfd50 2024-04-26T23:48:03.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f769b400640 1 -- 172.21.15.47:0/2126120660 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76940a5cf0 con 0x7f769c0cfd50 2024-04-26T23:48:03.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 -- 172.21.15.47:0/2126120660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 msgr2=0x7f769c0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:03.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 --2- 172.21.15.47:0/2126120660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c0cd7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7694009d90 tx=0x7f769401c970 comp rx=0 tx=0).stop 2024-04-26T23:48:03.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 -- 172.21.15.47:0/2126120660 shutdown_connections 2024-04-26T23:48:03.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 --2- 172.21.15.47:0/2126120660 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c0cd7e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 --2- 172.21.15.47:0/2126120660 >> v2:172.21.15.203:3300/0 conn(0x7f769c0cf260 0x7f769c071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 -- 172.21.15.47:0/2126120660 >> 172.21.15.47:0/2126120660 conn(0x7f769c0d2fb0 msgr2=0x7f769c0d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:03.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 -- 172.21.15.47:0/2126120660 shutdown_connections 2024-04-26T23:48:03.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.370+0000 7f76a3c00640 1 -- 172.21.15.47:0/2126120660 wait complete. 2024-04-26T23:48:03.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 Processor -- start 2024-04-26T23:48:03.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 -- start start 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f769c0cf260 0x7f769c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c15df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f769c161620 0x7f769c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f769c070a80 con 0x7f769c0cf260 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f769c070900 con 0x7f769c161620 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f769c161a20 con 0x7f769c0cfd50 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f769c0cf260 0x7f769c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:03.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f769c0cf260 0x7f769c1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45756/0 (socket says 172.21.15.47:45756) 2024-04-26T23:48:03.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 -- 172.21.15.47:0/124555623 learned_addr learned my addr 172.21.15.47:0/124555623 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:03.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f769c161620 0x7f769c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:03.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f769be00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c15df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:03.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 -- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 msgr2=0x7f769c15df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:03.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c15df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 -- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f769c161620 msgr2=0x7f769c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:03.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f769c161620 0x7f769c15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:03.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 -- 172.21.15.47:0/124555623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c160230 con 0x7f769c0cf260 2024-04-26T23:48:03.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a1200640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f769c0cf260 0x7f769c1585f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f769000e980 tx=0x7f769000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:03.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f7698c00640 1 -- 172.21.15.47:0/124555623 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7690017070 con 0x7f769c0cf260 2024-04-26T23:48:03.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f7698c00640 1 -- 172.21.15.47:0/124555623 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769000ca00 con 0x7f769c0cf260 2024-04-26T23:48:03.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c160510 con 0x7f769c0cf260 2024-04-26T23:48:03.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f7698c00640 1 -- 172.21.15.47:0/124555623 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769000cdd0 con 0x7f769c0cf260 2024-04-26T23:48:03.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.374+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c160ad0 con 0x7f769c0cf260 2024-04-26T23:48:03.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.378+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769c069700 con 0x7f769c0cf260 2024-04-26T23:48:03.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.378+0000 7f7698c00640 1 -- 172.21.15.47:0/124555623 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f769001a070 con 0x7f769c0cf260 2024-04-26T23:48:03.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.378+0000 7f7698c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f767c068650 0x7f767c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:03.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.378+0000 7f7698c00640 1 -- 172.21.15.47:0/124555623 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5227+0+0 (secure 0 0 0) 0x7f76900870c0 con 0x7f769c0cf260 2024-04-26T23:48:03.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.378+0000 7f769be00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f767c068650 0x7f767c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:03.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.382+0000 7f769be00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f767c068650 0x7f767c06ab10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7688007fd0 tx=0x7f7688009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:03.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.382+0000 7f7698c00640 1 -- 172.21.15.47:0/124555623 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7690057050 con 0x7f769c0cf260 2024-04-26T23:48:03.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:03.546+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f769c0682e0 con 0x7f769c0cf260 2024-04-26T23:48:04.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.194+0000 7f7698c00640 1 -- 172.21.15.47:0/124555623 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) ==== 170+0+0 (secure 0 0 0) 0x7f769005b350 con 0x7f769c0cf260 2024-04-26T23:48:04.203 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-04-26T23:48:04.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f767c068650 msgr2=0x7f767c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f767c068650 0x7f767c06ab10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7688007fd0 tx=0x7f7688009040 comp rx=0 tx=0).stop 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f769c0cf260 msgr2=0x7f769c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f769c0cf260 0x7f769c1585f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f769000e980 tx=0x7f769000ee40 comp rx=0 tx=0).stop 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 shutdown_connections 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f767c068650 0x7f767c06ab10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f769c161620 0x7f769c15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f769c0cfd50 0x7f769c15df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 --2- 172.21.15.47:0/124555623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f769c0cf260 0x7f769c1585f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 >> 172.21.15.47:0/124555623 conn(0x7f769c0d2fb0 msgr2=0x7f769c159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 shutdown_connections 2024-04-26T23:48:04.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.198+0000 7f76a3c00640 1 -- 172.21.15.47:0/124555623 wait complete. 2024-04-26T23:48:04.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T23:48:04.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1922400640 1 Processor -- start 2024-04-26T23:48:04.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1922400640 1 -- start start 2024-04-26T23:48:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1922400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f191c06cd40 0x7f191c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1922400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191c0ae6a0 con 0x7f191c15fcd0 2024-04-26T23:48:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1922400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f191c0ae920 con 0x7f191c0d0390 2024-04-26T23:48:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1922400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f191c0aec00 con 0x7f191c06cd40 2024-04-26T23:48:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f191be00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f191c15fcd0 0x7f191c160160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58162/0 (socket says 172.21.15.47:58162) 2024-04-26T23:48:04.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f191be00640 1 -- 172.21.15.47:0/3508041991 learned_addr learned my addr 172.21.15.47:0/3508041991 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1912a00640 1 --2- 172.21.15.47:0/3508041991 >> v2:172.21.15.203:3300/0 conn(0x7f191c06cd40 0x7f191c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f191aa00640 1 -- 172.21.15.47:0/3508041991 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659119113 0 0) 0x7f19140014a0 con 0x7f191c15fcd0 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f191aa00640 1 -- 172.21.15.47:0/3508041991 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1900003530 con 0x7f191c15fcd0 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f191aa00640 1 -- 172.21.15.47:0/3508041991 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612779470 0 0) 0x7f191c0ae920 con 0x7f191c0d0390 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f191aa00640 1 -- 172.21.15.47:0/3508041991 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19140014a0 con 0x7f191c0d0390 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1912a00640 1 -- 172.21.15.47:0/3508041991 >> v1:172.21.15.203:6789/0 conn(0x7f191c0d0390 legacy=0x7f191c06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1912a00640 1 -- 172.21.15.47:0/3508041991 >> v1:172.21.15.47:6789/0 conn(0x7f191c15fcd0 legacy=0x7f191c160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:04.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.382+0000 7f1912a00640 1 -- 172.21.15.47:0/3508041991 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c0aeee0 con 0x7f191c06cd40 2024-04-26T23:48:04.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1912a00640 1 --2- 172.21.15.47:0/3508041991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c06cd40 0x7f191c0af6e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f19040097c0 tx=0x7f190401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46afbf405daf6b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f191aa00640 1 -- 172.21.15.47:0/3508041991 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040b0070 con 0x7f191c06cd40 2024-04-26T23:48:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f191aa00640 1 -- 172.21.15.47:0/3508041991 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19040ab600 con 0x7f191c06cd40 2024-04-26T23:48:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f191aa00640 1 -- 172.21.15.47:0/3508041991 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040ab9d0 con 0x7f191c06cd40 2024-04-26T23:48:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1922400640 1 -- 172.21.15.47:0/3508041991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c06cd40 msgr2=0x7f191c0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:04.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1922400640 1 --2- 172.21.15.47:0/3508041991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c06cd40 0x7f191c0af6e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f19040097c0 tx=0x7f190401c3e0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1922400640 1 -- 172.21.15.47:0/3508041991 shutdown_connections 2024-04-26T23:48:04.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1922400640 1 --2- 172.21.15.47:0/3508041991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c06cd40 0x7f191c0af6e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1922400640 1 -- 172.21.15.47:0/3508041991 >> 172.21.15.47:0/3508041991 conn(0x7f191c0b2b70 msgr2=0x7f191c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:04.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1922400640 1 -- 172.21.15.47:0/3508041991 shutdown_connections 2024-04-26T23:48:04.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.386+0000 7f1922400640 1 -- 172.21.15.47:0/3508041991 wait complete. 2024-04-26T23:48:04.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 Processor -- start 2024-04-26T23:48:04.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 -- start start 2024-04-26T23:48:04.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c06cd40 0x7f191c14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:04.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f191c0d0390 0x7f191c14b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:04.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c15fcd0 0x7f191c14d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:04.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f191c06faf0 con 0x7f191c06cd40 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f191c06f970 con 0x7f191c15fcd0 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f191c06fc70 con 0x7f191c0d0390 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c06cd40 0x7f191c14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c06cd40 0x7f191c14e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45766/0 (socket says 172.21.15.47:45766) 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 -- 172.21.15.47:0/798971739 learned_addr learned my addr 172.21.15.47:0/798971739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1912a00640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f191c0d0390 0x7f191c14b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191be00640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c15fcd0 0x7f191c14d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:04.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 -- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f191c0d0390 msgr2=0x7f191c14b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:04.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f191c0d0390 0x7f191c14b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 -- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c15fcd0 msgr2=0x7f191c14d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:04.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c15fcd0 0x7f191c14d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:04.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 -- 172.21.15.47:0/798971739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c14ff00 con 0x7f191c06cd40 2024-04-26T23:48:04.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f191b400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c06cd40 0x7f191c14e400 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c490 tx=0x7f190c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:04.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1913e00640 1 -- 172.21.15.47:0/798971739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c0052d0 con 0x7f191c06cd40 2024-04-26T23:48:04.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1913e00640 1 -- 172.21.15.47:0/798971739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c005470 con 0x7f191c06cd40 2024-04-26T23:48:04.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c1501a0 con 0x7f191c06cd40 2024-04-26T23:48:04.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1913e00640 1 -- 172.21.15.47:0/798971739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c012870 con 0x7f191c06cd40 2024-04-26T23:48:04.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.390+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c15bf70 con 0x7f191c06cd40 2024-04-26T23:48:04.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.394+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c069700 con 0x7f191c06cd40 2024-04-26T23:48:04.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.394+0000 7f1913e00640 1 -- 172.21.15.47:0/798971739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f190c012a10 con 0x7f191c06cd40 2024-04-26T23:48:04.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.394+0000 7f1913e00640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18f8068650 0x7f18f806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:04.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.394+0000 7f1913e00640 1 -- 172.21.15.47:0/798971739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5609+0+0 (secure 0 0 0) 0x7f190c087340 con 0x7f191c06cd40 2024-04-26T23:48:04.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.394+0000 7f1912a00640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18f8068650 0x7f18f806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:04.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.398+0000 7f1912a00640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18f8068650 0x7f18f806ab10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f19040ad000 tx=0x7f1904008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:04.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.398+0000 7f1913e00640 1 -- 172.21.15.47:0/798971739 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f190c0570c0 con 0x7f191c06cd40 2024-04-26T23:48:04.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:04.598+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f191c06ec90 con 0x7f191c06cd40 2024-04-26T23:48:05.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.198+0000 7f1913e00640 1 -- 172.21.15.47:0/798971739 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v23) ==== 172+0+0 (secure 0 0 0) 0x7f190c05b3c0 con 0x7f191c06cd40 2024-04-26T23:48:05.205 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 6 and data pool 7 2024-04-26T23:48:05.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18f8068650 msgr2=0x7f18f806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18f8068650 0x7f18f806ab10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f19040ad000 tx=0x7f1904008040 comp rx=0 tx=0).stop 2024-04-26T23:48:05.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c06cd40 msgr2=0x7f191c14e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c06cd40 0x7f191c14e400 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c490 tx=0x7f190c00c950 comp rx=0 tx=0).stop 2024-04-26T23:48:05.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 shutdown_connections 2024-04-26T23:48:05.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f18f8068650 0x7f18f806ab10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f191c15fcd0 0x7f191c14d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f191c0d0390 0x7f191c14b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 --2- 172.21.15.47:0/798971739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f191c06cd40 0x7f191c14e400 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.202+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 >> 172.21.15.47:0/798971739 conn(0x7f191c0b2b70 msgr2=0x7f191c0b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:05.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.210+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 shutdown_connections 2024-04-26T23:48:05.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.210+0000 7f1922400640 1 -- 172.21.15.47:0/798971739 wait complete. 2024-04-26T23:48:05.263 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:48:05.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.398+0000 7f3c0de00640 1 Processor -- start 2024-04-26T23:48:05.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.398+0000 7f3c0de00640 1 -- start start 2024-04-26T23:48:05.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c0de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0815f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c0de00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3c080ce310 0x7f3c0806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c0de00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0815fe60 con 0x7f3c0806fa80 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c0de00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0806df90 con 0x7f3c080ce310 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c0de00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3c08160140 con 0x7f3c081599e0 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3bffe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3c0806fa80 0x7f3c080cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58176/0 (socket says 172.21.15.47:58176) 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3bffe00640 1 -- 172.21.15.47:0/2789905767 learned_addr learned my addr 172.21.15.47:0/2789905767 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c07400640 1 --2- 172.21.15.47:0/2789905767 >> v2:172.21.15.203:3300/0 conn(0x7f3c080ce310 0x7f3c0806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c06a00640 1 --2- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c06000640 1 -- 172.21.15.47:0/2789905767 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015430734 0 0) 0x7f3c0815fe60 con 0x7f3c0806fa80 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c06000640 1 -- 172.21.15.47:0/2789905767 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bec003530 con 0x7f3c0806fa80 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c07400640 1 -- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 msgr2=0x7f3c0815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c07400640 1 --2- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0815f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c07400640 1 -- 172.21.15.47:0/2789905767 >> v1:172.21.15.47:6789/0 conn(0x7f3c0806fa80 legacy=0x7f3c080cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c07400640 1 -- 172.21.15.47:0/2789905767 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c08160420 con 0x7f3c080ce310 2024-04-26T23:48:05.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c06a00640 1 --2- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:48:05.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.402+0000 7f3c07400640 1 --2- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c080ce310 0x7f3c0806e420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009d90 tx=0x7f3c0001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e9f6b6a4e0faf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:05.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c06000640 1 -- 172.21.15.47:0/2789905767 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c000b2070 con 0x7f3c080ce310 2024-04-26T23:48:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c06000640 1 -- 172.21.15.47:0/2789905767 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c000a5940 con 0x7f3c080ce310 2024-04-26T23:48:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c06000640 1 -- 172.21.15.47:0/2789905767 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c000a5d10 con 0x7f3c080ce310 2024-04-26T23:48:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c080ce310 msgr2=0x7f3c0806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 --2- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c080ce310 0x7f3c0806e420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009d90 tx=0x7f3c0001c970 comp rx=0 tx=0).stop 2024-04-26T23:48:05.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- 172.21.15.47:0/2789905767 shutdown_connections 2024-04-26T23:48:05.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 --2- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c080ce310 0x7f3c0806e420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 --2- 172.21.15.47:0/2789905767 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- 172.21.15.47:0/2789905767 >> 172.21.15.47:0/2789905767 conn(0x7f3c0806c800 msgr2=0x7f3c0806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:05.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- 172.21.15.47:0/2789905767 shutdown_connections 2024-04-26T23:48:05.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- 172.21.15.47:0/2789905767 wait complete. 2024-04-26T23:48:05.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 Processor -- start 2024-04-26T23:48:05.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- start start 2024-04-26T23:48:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0806fa80 0x7f3c0814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c080ce310 0x7f3c0815df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0816be50 con 0x7f3c080ce310 2024-04-26T23:48:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08070090 con 0x7f3c0806fa80 2024-04-26T23:48:05.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c0de00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0816bfd0 con 0x7f3c081599e0 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c080ce310 0x7f3c0815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3bffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c080ce310 0x7f3c0815df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45772/0 (socket says 172.21.15.47:45772) 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3bffe00640 1 -- 172.21.15.47:0/1457237401 learned_addr learned my addr 172.21.15.47:0/1457237401 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c07400640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.406+0000 7f3c06a00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0806fa80 0x7f3c0814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bffe00640 1 -- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 msgr2=0x7f3c0814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bffe00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bffe00640 1 -- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0806fa80 msgr2=0x7f3c0814d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bffe00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0806fa80 0x7f3c0814d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bffe00640 1 -- 172.21.15.47:0/1457237401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c080ca310 con 0x7f3c080ce310 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bffe00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c080ce310 0x7f3c0815df40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c400 tx=0x7f3bf000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bff400640 1 -- 172.21.15.47:0/1457237401 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0017070 con 0x7f3c080ce310 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bff400640 1 -- 172.21.15.47:0/1457237401 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0007500 con 0x7f3c080ce310 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bff400640 1 -- 172.21.15.47:0/1457237401 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf00059f0 con 0x7f3c080ce310 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c080b4a30 con 0x7f3c080ce310 2024-04-26T23:48:05.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c080b4ff0 con 0x7f3c080ce310 2024-04-26T23:48:05.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c08069700 con 0x7f3c080ce310 2024-04-26T23:48:05.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bff400640 1 -- 172.21.15.47:0/1457237401 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f3bf001a070 con 0x7f3c080ce310 2024-04-26T23:48:05.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bff400640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3be4068650 0x7f3be406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.410+0000 7f3bff400640 1 -- 172.21.15.47:0/1457237401 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f3bf00861e0 con 0x7f3c080ce310 2024-04-26T23:48:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.414+0000 7f3c06a00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3be4068650 0x7f3be406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.414+0000 7f3c06a00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3be4068650 0x7f3be406ab10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009580 tx=0x7f3bf8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:05.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.414+0000 7f3bff400640 1 -- 172.21.15.47:0/1457237401 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3bf0055dc0 con 0x7f3c080ce310 2024-04-26T23:48:05.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.578+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c080b0d30 con 0x7f3c080ce310 2024-04-26T23:48:05.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3bff400640 1 -- 172.21.15.47:0/1457237401 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16614 (secure 0 0 0) 0x7f3bf005a0c0 con 0x7f3c080ce310 2024-04-26T23:48:05.587 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:05.587 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":48,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:04.603683+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3be4068650 msgr2=0x7f3be406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3be4068650 0x7f3be406ab10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009580 tx=0x7f3bf8009190 comp rx=0 tx=0).stop 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c080ce310 msgr2=0x7f3c0815df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c080ce310 0x7f3c0815df40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c400 tx=0x7f3bf000c8c0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 shutdown_connections 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3be4068650 0x7f3be406ab10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3c081599e0 0x7f3c0814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3c080ce310 0x7f3c0815df40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 --2- 172.21.15.47:0/1457237401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c0806fa80 0x7f3c0814d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 >> 172.21.15.47:0/1457237401 conn(0x7f3c0806c800 msgr2=0x7f3c0806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:05.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 shutdown_connections 2024-04-26T23:48:05.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.582+0000 7f3c0de00640 1 -- 172.21.15.47:0/1457237401 wait complete. 2024-04-26T23:48:05.609 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:48:05.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.742+0000 7f4b28c00640 1 Processor -- start 2024-04-26T23:48:05.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.742+0000 7f4b28c00640 1 -- start start 2024-04-26T23:48:05.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.742+0000 7f4b28c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4b24072150 0x7f4b240d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.742+0000 7f4b28c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b240d1690 0x7f4b240cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.742+0000 7f4b28c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b240cd830 con 0x7f4b24160810 2024-04-26T23:48:05.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.742+0000 7f4b28c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f4b24071080 con 0x7f4b24072150 2024-04-26T23:48:05.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.742+0000 7f4b28c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4b24071360 con 0x7f4b240d1690 2024-04-26T23:48:05.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b1be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4b24072150 0x7f4b240d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b21e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4b24160810 0x7f4b24071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58180/0 (socket says 172.21.15.47:58180) 2024-04-26T23:48:05.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b21e00640 1 -- 172.21.15.47:0/4187181648 learned_addr learned my addr 172.21.15.47:0/4187181648 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:05.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b22800640 1 --2- 172.21.15.47:0/4187181648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b240d1690 0x7f4b240cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b1be00640 1 -- 172.21.15.47:0/4187181648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b240d1690 msgr2=0x7f4b240cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:05.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b1be00640 1 --2- 172.21.15.47:0/4187181648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b240d1690 0x7f4b240cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b1be00640 1 -- 172.21.15.47:0/4187181648 >> v1:172.21.15.47:6789/0 conn(0x7f4b24160810 legacy=0x7f4b24071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b1be00640 1 -- 172.21.15.47:0/4187181648 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b240cdad0 con 0x7f4b24072150 2024-04-26T23:48:05.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b21400640 1 -- 172.21.15.47:0/4187181648 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257298452 0 0) 0x7f4b240cd830 con 0x7f4b24160810 2024-04-26T23:48:05.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b22800640 1 --2- 172.21.15.47:0/4187181648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b240d1690 0x7f4b240cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:05.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b1be00640 1 --2- 172.21.15.47:0/4187181648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b24072150 0x7f4b240d1150 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097c0 tx=0x7f4b0c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a80a2903c5fae94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:05.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b21400640 1 -- 172.21.15.47:0/4187181648 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0b5070 con 0x7f4b24072150 2024-04-26T23:48:05.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b21400640 1 -- 172.21.15.47:0/4187181648 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0a8990 con 0x7f4b24072150 2024-04-26T23:48:05.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.746+0000 7f4b21400640 1 -- 172.21.15.47:0/4187181648 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0a8d60 con 0x7f4b24072150 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- 172.21.15.47:0/4187181648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b24072150 msgr2=0x7f4b240d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 --2- 172.21.15.47:0/4187181648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b24072150 0x7f4b240d1150 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0097c0 tx=0x7f4b0c01ec90 comp rx=0 tx=0).stop 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- 172.21.15.47:0/4187181648 shutdown_connections 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 --2- 172.21.15.47:0/4187181648 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b240d1690 0x7f4b240cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 --2- 172.21.15.47:0/4187181648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b24072150 0x7f4b240d1150 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- 172.21.15.47:0/4187181648 >> 172.21.15.47:0/4187181648 conn(0x7f4b240d2e90 msgr2=0x7f4b240d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- 172.21.15.47:0/4187181648 shutdown_connections 2024-04-26T23:48:05.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- 172.21.15.47:0/4187181648 wait complete. 2024-04-26T23:48:05.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 Processor -- start 2024-04-26T23:48:05.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- start start 2024-04-26T23:48:05.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b24072150 0x7f4b240c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b240d1690 0x7f4b240ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b24160810 0x7f4b2414ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f4b24160d70 con 0x7f4b240d1690 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4b24160bf0 con 0x7f4b24072150 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b28c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4b240ce530 con 0x7f4b24160810 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b240d1690 0x7f4b240ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b240d1690 0x7f4b240ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45792/0 (socket says 172.21.15.47:45792) 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 -- 172.21.15.47:0/437547473 learned_addr learned my addr 172.21.15.47:0/437547473 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b21e00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b24072150 0x7f4b240c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b22800640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b24160810 0x7f4b2414ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 -- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b24160810 msgr2=0x7f4b2414ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b24160810 0x7f4b2414ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 -- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b24072150 msgr2=0x7f4b240c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b24072150 0x7f4b240c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b1be00640 1 -- 172.21.15.47:0/437547473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b240cf870 con 0x7f4b240d1690 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.750+0000 7f4b21e00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b24072150 0x7f4b240c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b1be00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b240d1690 0x7f4b240ca120 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0b3040 tx=0x7f4b0c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b1a000640 1 -- 172.21.15.47:0/437547473 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0bf070 con 0x7f4b240d1690 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b1a000640 1 -- 172.21.15.47:0/437547473 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0b0800 con 0x7f4b240d1690 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b1a000640 1 -- 172.21.15.47:0/437547473 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0b5040 con 0x7f4b240d1690 2024-04-26T23:48:05.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b240cfb50 con 0x7f4b240d1690 2024-04-26T23:48:05.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b240d0110 con 0x7f4b240d1690 2024-04-26T23:48:05.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b24069700 con 0x7f4b240d1690 2024-04-26T23:48:05.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b1a000640 1 -- 172.21.15.47:0/437547473 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f4b0c0b0bf0 con 0x7f4b240d1690 2024-04-26T23:48:05.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b1a000640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b00068680 0x7f4b0006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:05.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b1a000640 1 -- 172.21.15.47:0/437547473 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f4b0c1237c0 con 0x7f4b240d1690 2024-04-26T23:48:05.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.754+0000 7f4b21e00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b00068680 0x7f4b0006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:05.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.758+0000 7f4b21e00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b00068680 0x7f4b0006ab40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000f70 tx=0x7f4b14007cb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:05.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.758+0000 7f4b1a000640 1 -- 172.21.15.47:0/437547473 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f4b0c0187f0 con 0x7f4b240d1690 2024-04-26T23:48:05.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.926+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b240b0df0 con 0x7f4b240d1690 2024-04-26T23:48:05.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b1a000640 1 -- 172.21.15.47:0/437547473 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16614 (secure 0 0 0) 0x7f4b0c0f3a40 con 0x7f4b240d1690 2024-04-26T23:48:05.935 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:05.935 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":48,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:04.603683+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:48:05.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b00068680 msgr2=0x7f4b0006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b00068680 0x7f4b0006ab40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000f70 tx=0x7f4b14007cb0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b240d1690 msgr2=0x7f4b240ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b240d1690 0x7f4b240ca120 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0b3040 tx=0x7f4b0c01ba30 comp rx=0 tx=0).stop 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 shutdown_connections 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4b00068680 0x7f4b0006ab40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f4b24160810 0x7f4b2414ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4b240d1690 0x7f4b240ca120 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 --2- 172.21.15.47:0/437547473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4b24072150 0x7f4b240c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 >> 172.21.15.47:0/437547473 conn(0x7f4b240d2e90 msgr2=0x7f4b240afd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 shutdown_connections 2024-04-26T23:48:05.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:05.930+0000 7f4b28c00640 1 -- 172.21.15.47:0/437547473 wait complete. 2024-04-26T23:48:05.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T23:48:06.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe7e800640 1 Processor -- start 2024-04-26T23:48:06.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe7e800640 1 -- start start 2024-04-26T23:48:06.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe7e800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe780730b0 0x7efe78160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:06.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe7e800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe780c7910 con 0x7efe7815d2f0 2024-04-26T23:48:06.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe7e800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe780c7b80 con 0x7efe7815cf10 2024-04-26T23:48:06.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe7e800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efe7815d7e0 con 0x7efe780730b0 2024-04-26T23:48:06.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe77e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe780730b0 0x7efe78160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:06.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe6ea00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efe7815d2f0 0x7efe780729a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58190/0 (socket says 172.21.15.47:58190) 2024-04-26T23:48:06.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe6ea00640 1 -- 172.21.15.47:0/2847423989 learned_addr learned my addr 172.21.15.47:0/2847423989 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:06.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe76a00640 1 -- 172.21.15.47:0/2847423989 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161949121 0 0) 0x7efe780c7910 con 0x7efe7815d2f0 2024-04-26T23:48:06.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe76a00640 1 -- 172.21.15.47:0/2847423989 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe5c003530 con 0x7efe7815d2f0 2024-04-26T23:48:06.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe77e00640 1 -- 172.21.15.47:0/2847423989 >> v1:172.21.15.203:6789/0 conn(0x7efe7815cf10 legacy=0x7efe780c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:06.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe77e00640 1 -- 172.21.15.47:0/2847423989 >> v1:172.21.15.47:6789/0 conn(0x7efe7815d2f0 legacy=0x7efe780729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:06.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.094+0000 7efe77e00640 1 -- 172.21.15.47:0/2847423989 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7815dac0 con 0x7efe780730b0 2024-04-26T23:48:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe77e00640 1 --2- 172.21.15.47:0/2847423989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe780730b0 0x7efe78160ca0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efe70009d90 tx=0x7efe7001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dae732639705a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe76a00640 1 -- 172.21.15.47:0/2847423989 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe700b2070 con 0x7efe780730b0 2024-04-26T23:48:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe76a00640 1 -- 172.21.15.47:0/2847423989 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe700a57a0 con 0x7efe780730b0 2024-04-26T23:48:06.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe76a00640 1 -- 172.21.15.47:0/2847423989 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe700a5b70 con 0x7efe780730b0 2024-04-26T23:48:06.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe7e800640 1 -- 172.21.15.47:0/2847423989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe780730b0 msgr2=0x7efe78160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:06.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe7e800640 1 --2- 172.21.15.47:0/2847423989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe780730b0 0x7efe78160ca0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efe70009d90 tx=0x7efe7001c8e0 comp rx=0 tx=0).stop 2024-04-26T23:48:06.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe7e800640 1 -- 172.21.15.47:0/2847423989 shutdown_connections 2024-04-26T23:48:06.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe7e800640 1 --2- 172.21.15.47:0/2847423989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe780730b0 0x7efe78160ca0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:06.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe7e800640 1 -- 172.21.15.47:0/2847423989 >> 172.21.15.47:0/2847423989 conn(0x7efe78070c00 msgr2=0x7efe7806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:06.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe7e800640 1 -- 172.21.15.47:0/2847423989 shutdown_connections 2024-04-26T23:48:06.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.098+0000 7efe7e800640 1 -- 172.21.15.47:0/2847423989 wait complete. 2024-04-26T23:48:06.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 Processor -- start 2024-04-26T23:48:06.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 -- start start 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe780730b0 0x7efe7814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe7815cf10 0x7efe781f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe7815d2f0 0x7efe7815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe7816b260 con 0x7efe7815cf10 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe780706f0 con 0x7efe780730b0 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe7816b3e0 con 0x7efe7815d2f0 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe7815cf10 0x7efe781f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe7815cf10 0x7efe781f84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45806/0 (socket says 172.21.15.47:45806) 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 -- 172.21.15.47:0/3582726285 learned_addr learned my addr 172.21.15.47:0/3582726285 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe77400640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe780730b0 0x7efe7814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:06.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe77e00640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe7815d2f0 0x7efe7815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:06.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 -- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe7815d2f0 msgr2=0x7efe7815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:06.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe7815d2f0 0x7efe7815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 -- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe780730b0 msgr2=0x7efe7814e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe780730b0 0x7efe7814e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 -- 172.21.15.47:0/3582726285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe781f89e0 con 0x7efe7815cf10 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6ea00640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe7815cf10 0x7efe781f84a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c420 tx=0x7efe6000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6fe00640 1 -- 172.21.15.47:0/3582726285 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60017070 con 0x7efe7815cf10 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6fe00640 1 -- 172.21.15.47:0/3582726285 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60005cf0 con 0x7efe7815cf10 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7814ea50 con 0x7efe7815cf10 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe6fe00640 1 -- 172.21.15.47:0/3582726285 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe600072d0 con 0x7efe7815cf10 2024-04-26T23:48:06.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe780b4f30 con 0x7efe7815cf10 2024-04-26T23:48:06.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.102+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe78069700 con 0x7efe7815cf10 2024-04-26T23:48:06.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.106+0000 7efe6fe00640 1 -- 172.21.15.47:0/3582726285 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7efe6001a070 con 0x7efe7815cf10 2024-04-26T23:48:06.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.106+0000 7efe6fe00640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe54068650 0x7efe5406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:06.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.106+0000 7efe6fe00640 1 -- 172.21.15.47:0/3582726285 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7efe60086100 con 0x7efe7815cf10 2024-04-26T23:48:06.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.106+0000 7efe77400640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe54068650 0x7efe5406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:06.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.106+0000 7efe77400640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe54068650 0x7efe5406ab10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe68001810 tx=0x7efe68009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:06.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.110+0000 7efe6fe00640 1 -- 172.21.15.47:0/3582726285 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efe60055ce0 con 0x7efe7815cf10 2024-04-26T23:48:06.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:06.314+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efe7806d040 con 0x7efe7815cf10 2024-04-26T23:48:07.196 INFO:tasks.ceph.mds.a.smithi047.stderr:2024-04-26T23:48:07.190+0000 7f99f5a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:48:07.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe6fe00640 1 -- 172.21.15.47:0/3582726285 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7efe60059fe0 con 0x7efe7815cf10 2024-04-26T23:48:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe54068650 msgr2=0x7efe5406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe54068650 0x7efe5406ab10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efe68001810 tx=0x7efe68009040 comp rx=0 tx=0).stop 2024-04-26T23:48:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe7815cf10 msgr2=0x7efe781f84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe7815cf10 0x7efe781f84a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efe6000c420 tx=0x7efe6000c8e0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 shutdown_connections 2024-04-26T23:48:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe54068650 0x7efe5406ab10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe7815d2f0 0x7efe7815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe7815cf10 0x7efe781f84a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 --2- 172.21.15.47:0/3582726285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe780730b0 0x7efe7814e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 >> 172.21.15.47:0/3582726285 conn(0x7efe78070c00 msgr2=0x7efe7806f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 shutdown_connections 2024-04-26T23:48:07.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.234+0000 7efe7e800640 1 -- 172.21.15.47:0/3582726285 wait complete. 2024-04-26T23:48:07.265 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T23:48:07.266 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T23:48:07.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.406+0000 7f40b7a00640 1 Processor -- start 2024-04-26T23:48:07.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.406+0000 7f40b7a00640 1 -- start start 2024-04-26T23:48:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b7a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f40b015cf50 0x7f40b00cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:07.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b7a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f40b006cd40 0x7f40b0160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b7a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40b00ae030 con 0x7f40b00d04b0 2024-04-26T23:48:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b7a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f40b00af7a0 con 0x7f40b015cf50 2024-04-26T23:48:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b7a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f40b00d0ae0 con 0x7f40b006cd40 2024-04-26T23:48:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b5000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f40b015cf50 0x7f40b00cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40a7e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f40b00d04b0 0x7f40b006c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58196/0 (socket says 172.21.15.47:58196) 2024-04-26T23:48:07.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40a7e00640 1 -- 172.21.15.47:0/3141691170 learned_addr learned my addr 172.21.15.47:0/3141691170 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b5a00640 1 --2- 172.21.15.47:0/3141691170 >> v2:172.21.15.203:3300/0 conn(0x7f40b006cd40 0x7f40b0160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b5000640 1 -- 172.21.15.47:0/3141691170 >> v2:172.21.15.203:3300/0 conn(0x7f40b006cd40 msgr2=0x7f40b0160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b5000640 1 --2- 172.21.15.47:0/3141691170 >> v2:172.21.15.203:3300/0 conn(0x7f40b006cd40 0x7f40b0160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b5000640 1 -- 172.21.15.47:0/3141691170 >> v1:172.21.15.47:6789/0 conn(0x7f40b00d04b0 legacy=0x7f40b006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40b5000640 1 -- 172.21.15.47:0/3141691170 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b00af9d0 con 0x7f40b015cf50 2024-04-26T23:48:07.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.410+0000 7f40afe00640 1 -- 172.21.15.47:0/3141691170 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187218515 0 0) 0x7f40b00ae030 con 0x7f40b00d04b0 2024-04-26T23:48:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b5000640 1 --2- 172.21.15.47:0/3141691170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b00cff70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f40b0074510 tx=0x7f40a001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cab02daec08b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40afe00640 1 -- 172.21.15.47:0/3141691170 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a00b2070 con 0x7f40b015cf50 2024-04-26T23:48:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40afe00640 1 -- 172.21.15.47:0/3141691170 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a00a9070 con 0x7f40b015cf50 2024-04-26T23:48:07.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40afe00640 1 -- 172.21.15.47:0/3141691170 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a00ad880 con 0x7f40b015cf50 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 -- 172.21.15.47:0/3141691170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 msgr2=0x7f40b00cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3141691170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b00cff70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f40b0074510 tx=0x7f40a001c450 comp rx=0 tx=0).stop 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 -- 172.21.15.47:0/3141691170 shutdown_connections 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3141691170 >> v2:172.21.15.203:3300/0 conn(0x7f40b006cd40 0x7f40b0160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3141691170 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b00cff70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 -- 172.21.15.47:0/3141691170 >> 172.21.15.47:0/3141691170 conn(0x7f40b00b2b70 msgr2=0x7f40b00b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 -- 172.21.15.47:0/3141691170 shutdown_connections 2024-04-26T23:48:07.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 -- 172.21.15.47:0/3141691170 wait complete. 2024-04-26T23:48:07.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 Processor -- start 2024-04-26T23:48:07.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.414+0000 7f40b7a00640 1 -- start start 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40b006cd40 0x7f40b01426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40b00d04b0 0x7f40b015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b015f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f40b00b3c40 con 0x7f40b015cf50 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40b015d330 con 0x7f40b006cd40 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f40b00b3dc0 con 0x7f40b00d04b0 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b015f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b015f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45818/0 (socket says 172.21.15.47:45818) 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 -- 172.21.15.47:0/3078379941 learned_addr learned my addr 172.21.15.47:0/3078379941 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5000640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40b006cd40 0x7f40b01426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:07.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40a7e00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40b00d04b0 0x7f40b015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 -- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40b00d04b0 msgr2=0x7f40b015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40b00d04b0 0x7f40b015ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 -- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40b006cd40 msgr2=0x7f40b01426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40b006cd40 0x7f40b01426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 -- 172.21.15.47:0/3078379941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b009cf80 con 0x7f40b015cf50 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b5a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b015f3c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f40a8007e40 tx=0x7f40a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40ad600640 1 -- 172.21.15.47:0/3078379941 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8014620 con 0x7f40b015cf50 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40ad600640 1 -- 172.21.15.47:0/3078379941 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40a8019070 con 0x7f40b015cf50 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b015d5d0 con 0x7f40b015cf50 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40ad600640 1 -- 172.21.15.47:0/3078379941 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8014a20 con 0x7f40b015cf50 2024-04-26T23:48:07.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b015db90 con 0x7f40b015cf50 2024-04-26T23:48:07.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b0069700 con 0x7f40b015cf50 2024-04-26T23:48:07.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.418+0000 7f40ad600640 1 -- 172.21.15.47:0/3078379941 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f40a8014bc0 con 0x7f40b015cf50 2024-04-26T23:48:07.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.422+0000 7f40ad600640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f408c068650 0x7f408c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:07.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.422+0000 7f40ad600640 1 -- 172.21.15.47:0/3078379941 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f40a8087660 con 0x7f40b015cf50 2024-04-26T23:48:07.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.422+0000 7f40b5000640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f408c068650 0x7f408c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:07.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.422+0000 7f40b5000640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f408c068650 0x7f408c06ab10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f40a00af000 tx=0x7f40a00a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:07.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.426+0000 7f40ad600640 1 -- 172.21.15.47:0/3078379941 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f40a8057890 con 0x7f40b015cf50 2024-04-26T23:48:07.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:07.626+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f40b00b47d0 con 0x7f40b015cf50 2024-04-26T23:48:08.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.238+0000 7f40ad600640 1 -- 172.21.15.47:0/3078379941 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7f40a8057190 con 0x7f40b015cf50 2024-04-26T23:48:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f408c068650 msgr2=0x7f408c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f408c068650 0x7f408c06ab10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f40a00af000 tx=0x7f40a00a7000 comp rx=0 tx=0).stop 2024-04-26T23:48:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 msgr2=0x7f40b015f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b015f3c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f40a8007e40 tx=0x7f40a800e4b0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 shutdown_connections 2024-04-26T23:48:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f408c068650 0x7f408c06ab10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f40b015cf50 0x7f40b015f3c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f40b00d04b0 0x7f40b015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 --2- 172.21.15.47:0/3078379941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40b006cd40 0x7f40b01426b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 >> 172.21.15.47:0/3078379941 conn(0x7f40b00b2b70 msgr2=0x7f40b00720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 shutdown_connections 2024-04-26T23:48:08.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.242+0000 7f40b7a00640 1 -- 172.21.15.47:0/3078379941 wait complete. 2024-04-26T23:48:08.269 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T23:48:08.270 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:48:08.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.406+0000 7fbe2fe00640 1 Processor -- start 2024-04-26T23:48:08.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.406+0000 7fbe2fe00640 1 -- start start 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe3015cff0 0x7fbe30161570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe300b2b30 0x7fbe300b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2fe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fbe300d1040 0x7fbe300d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2fe00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fbe300d3040 con 0x7fbe3015cff0 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2fe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fbe30161ab0 con 0x7fbe300d1040 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe300d19d0 con 0x7fbe300b2b30 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe3015cff0 0x7fbe30161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbe3015cff0 0x7fbe30161570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45832/0 (socket says 172.21.15.47:45832) 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 -- 172.21.15.47:0/4040304675 learned_addr learned my addr 172.21.15.47:0/4040304675 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe26000640 1 --2- 172.21.15.47:0/4040304675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe300b2b30 0x7fbe300b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.416 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2f400640 1 --2- 172.21.15.47:0/4040304675 >> v2:172.21.15.203:3300/0 conn(0x7fbe300d1040 0x7fbe300d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 -- 172.21.15.47:0/4040304675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe300b2b30 msgr2=0x7fbe300b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:08.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 --2- 172.21.15.47:0/4040304675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe300b2b30 0x7fbe300b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 -- 172.21.15.47:0/4040304675 >> v2:172.21.15.203:3300/0 conn(0x7fbe300d1040 msgr2=0x7fbe300d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:08.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 --2- 172.21.15.47:0/4040304675 >> v2:172.21.15.203:3300/0 conn(0x7fbe300d1040 0x7fbe300d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2ea00640 1 -- 172.21.15.47:0/4040304675 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe300b4680 con 0x7fbe3015cff0 2024-04-26T23:48:08.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.410+0000 7fbe2f400640 1 --2- 172.21.15.47:0/4040304675 >> v2:172.21.15.203:3300/0 conn(0x7fbe300d1040 0x7fbe300d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:08.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2ea00640 1 --2- 172.21.15.47:0/4040304675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe3015cff0 0x7fbe30161570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbe3009c680 tx=0x7fbe2001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3070f29acccc26cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:08.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2e000640 1 -- 172.21.15.47:0/4040304675 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe200b0070 con 0x7fbe3015cff0 2024-04-26T23:48:08.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2e000640 1 -- 172.21.15.47:0/4040304675 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200ab600 con 0x7fbe3015cff0 2024-04-26T23:48:08.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2e000640 1 -- 172.21.15.47:0/4040304675 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe200ab9d0 con 0x7fbe3015cff0 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- 172.21.15.47:0/4040304675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe3015cff0 msgr2=0x7fbe30161570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/4040304675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe3015cff0 0x7fbe30161570 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fbe3009c680 tx=0x7fbe2001c490 comp rx=0 tx=0).stop 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- 172.21.15.47:0/4040304675 shutdown_connections 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/4040304675 >> v2:172.21.15.203:3300/0 conn(0x7fbe300d1040 0x7fbe300d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/4040304675 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe300b2b30 0x7fbe300b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/4040304675 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe3015cff0 0x7fbe30161570 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- 172.21.15.47:0/4040304675 >> 172.21.15.47:0/4040304675 conn(0x7fbe3009ba60 msgr2=0x7fbe3009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- 172.21.15.47:0/4040304675 shutdown_connections 2024-04-26T23:48:08.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- 172.21.15.47:0/4040304675 wait complete. 2024-04-26T23:48:08.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 Processor -- start 2024-04-26T23:48:08.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- start start 2024-04-26T23:48:08.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe300b2b30 0x7fbe30160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe300d1040 0x7fbe3015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe3015cff0 0x7fbe3015df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3015d3d0 con 0x7fbe300d1040 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe300b3940 con 0x7fbe300b2b30 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.414+0000 7fbe2fe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fbe300cdf70 con 0x7fbe3015cff0 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe300d1040 0x7fbe3015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe300d1040 0x7fbe3015c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45840/0 (socket says 172.21.15.47:45840) 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 -- 172.21.15.47:0/972075754 learned_addr learned my addr 172.21.15.47:0/972075754 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe2ea00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe300b2b30 0x7fbe30160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe2f400640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe3015cff0 0x7fbe3015df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 -- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe3015cff0 msgr2=0x7fbe3015df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe3015cff0 0x7fbe3015df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 -- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe300b2b30 msgr2=0x7fbe30160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe300b2b30 0x7fbe30160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 -- 172.21.15.47:0/972075754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3015e6d0 con 0x7fbe300d1040 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe26000640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe300d1040 0x7fbe3015c3a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800d800 tx=0x7fbe1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe27400640 1 -- 172.21.15.47:0/972075754 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18018020 con 0x7fbe300d1040 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe27400640 1 -- 172.21.15.47:0/972075754 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe180096a0 con 0x7fbe300d1040 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe27400640 1 -- 172.21.15.47:0/972075754 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18009a50 con 0x7fbe300d1040 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3015e9b0 con 0x7fbe300d1040 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3015ef70 con 0x7fbe300d1040 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe30069470 con 0x7fbe300d1040 2024-04-26T23:48:08.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe27400640 1 -- 172.21.15.47:0/972075754 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fbe1801b020 con 0x7fbe300d1040 2024-04-26T23:48:08.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.418+0000 7fbe27400640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe0c068680 0x7fbe0c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.422+0000 7fbe27400640 1 -- 172.21.15.47:0/972075754 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fbe18087200 con 0x7fbe300d1040 2024-04-26T23:48:08.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.422+0000 7fbe2ea00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe0c068680 0x7fbe0c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.422+0000 7fbe2ea00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe0c068680 0x7fbe0c06ab40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe30076ad0 tx=0x7fbe20009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:08.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.426+0000 7fbe27400640 1 -- 172.21.15.47:0/972075754 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fbe18022020 con 0x7fbe300d1040 2024-04-26T23:48:08.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.626+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe300cd220 con 0x7fbe300d1040 2024-04-26T23:48:08.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.626+0000 7fbe27400640 1 -- 172.21.15.47:0/972075754 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5181 (secure 0 0 0) 0x7fbe18056de0 con 0x7fbe300d1040 2024-04-26T23:48:08.633 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:08.634 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2875189318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2875189318},{"type":"v1","addr":"172.21.15.203:6836","nonce":2875189318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/629228023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":629228023},{"type":"v1","addr":"172.21.15.203:6837","nonce":629228023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5910,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/868771075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":868771075},{"type":"v1","addr":"172.21.15.47:6834","nonce":868771075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:48:04.603648+0000","modified":"2024-04-26T23:48:07.629516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5913},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5913":{"gid":5913,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/3889822755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3889822755},{"type":"v1","addr":"172.21.15.47:6835","nonce":3889822755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5913,"qdb_cluster":[5913]},"id":3}]} 2024-04-26T23:48:08.634 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe0c068680 msgr2=0x7fbe0c06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe0c068680 0x7fbe0c06ab40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe30076ad0 tx=0x7fbe20009040 comp rx=0 tx=0).stop 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe300d1040 msgr2=0x7fbe3015c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe300d1040 0x7fbe3015c3a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800d800 tx=0x7fbe1800dcc0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 shutdown_connections 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fbe0c068680 0x7fbe0c06ab40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fbe3015cff0 0x7fbe3015df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbe300d1040 0x7fbe3015c3a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 --2- 172.21.15.47:0/972075754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe300b2b30 0x7fbe30160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 >> 172.21.15.47:0/972075754 conn(0x7fbe3009ba60 msgr2=0x7fbe300b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 shutdown_connections 2024-04-26T23:48:08.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.630+0000 7fbe2fe00640 1 -- 172.21.15.47:0/972075754 wait complete. 2024-04-26T23:48:08.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:48:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fee400640 1 Processor -- start 2024-04-26T23:48:08.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fee400640 1 -- start start 2024-04-26T23:48:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fee400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2fe8160810 0x7f2fe8071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fee400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe80cd830 con 0x7f2fe8072150 2024-04-26T23:48:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fee400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8071080 con 0x7f2fe80d1860 2024-04-26T23:48:08.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fee400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe8071360 con 0x7f2fe8160810 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2fe8072150 0x7f2fe80d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:58200/0 (socket says 172.21.15.47:58200) 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2964091841 learned_addr learned my addr 172.21.15.47:0/2964091841 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7400640 1 --2- 172.21.15.47:0/2964091841 >> v2:172.21.15.203:3300/0 conn(0x7f2fe8160810 0x7f2fe8071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221861835 0 0) 0x7f2fe80cd830 con 0x7f2fe8072150 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fcc003530 con 0x7f2fe8072150 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614742877 0 0) 0x7f2fe8071080 con 0x7f2fe80d1860 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe80cd830 con 0x7f2fe80d1860 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2868866042 0 0) 0x7f2fcc003530 con 0x7f2fe8072150 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 >> v2:172.21.15.203:3300/0 conn(0x7f2fe8160810 msgr2=0x7f2fe8071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:08.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 --2- 172.21.15.47:0/2964091841 >> v2:172.21.15.203:3300/0 conn(0x7f2fe8160810 0x7f2fe8071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 >> v1:172.21.15.203:6789/0 conn(0x7f2fe80d1860 legacy=0x7f2fe80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe80cdad0 con 0x7f2fe8072150 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f2fd4001680 con 0x7f2fe8072150 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 >> v1:172.21.15.47:6789/0 conn(0x7f2fe8072150 legacy=0x7f2fe80d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fcc003ba0 0x7f2fcc003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc004810 0x7f2fcc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8071360 con 0x7f2fcc0051d0 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fcc00bff0 con 0x7f2fcc004810 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2fcc00c1f0 con 0x7f2fcc003ba0 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe6a00640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc004810 0x7f2fcc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7400640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fcc003ba0 0x7f2fcc003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fcc003ba0 msgr2=0x7f2fcc003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:08.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fcc003ba0 0x7f2fcc003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc004810 msgr2=0x7f2fcc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:08.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc004810 0x7f2fcc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.790+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2964091841 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fcc003530 con 0x7f2fcc0051d0 2024-04-26T23:48:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2964091841 reap_dead start 2024-04-26T23:48:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8073ea0 tx=0x7f2fe001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1dde7c157e8ff1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0001c20 con 0x7f2fcc0051d0 2024-04-26T23:48:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0003b80 con 0x7f2fcc0051d0 2024-04-26T23:48:08.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fe6000640 1 -- 172.21.15.47:0/2964091841 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00050d0 con 0x7f2fcc0051d0 2024-04-26T23:48:08.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fee400640 1 -- 172.21.15.47:0/2964091841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc0051d0 msgr2=0x7f2fcc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fee400640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8073ea0 tx=0x7f2fe001c8e0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fee400640 1 -- 172.21.15.47:0/2964091841 shutdown_connections 2024-04-26T23:48:08.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fee400640 1 --2- 172.21.15.47:0/2964091841 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fcc0051d0 0x7f2fcc00b9d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fee400640 1 -- 172.21.15.47:0/2964091841 >> 172.21.15.47:0/2964091841 conn(0x7f2fe80d2e90 msgr2=0x7f2fe80d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:08.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fee400640 1 -- 172.21.15.47:0/2964091841 shutdown_connections 2024-04-26T23:48:08.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.794+0000 7f2fee400640 1 -- 172.21.15.47:0/2964091841 wait complete. 2024-04-26T23:48:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 Processor -- start 2024-04-26T23:48:08.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 -- start start 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc0051d0 0x7f2fe80b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fe80cca50 0x7f2fe80b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe806e730 0x7f2fe81f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8160d70 con 0x7f2fe806e730 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe8160bf0 con 0x7f2fcc0051d0 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe80d1150 con 0x7f2fe80cca50 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe806e730 0x7f2fe81f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe806e730 0x7f2fe81f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45860/0 (socket says 172.21.15.47:45860) 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2236056501 learned_addr learned my addr 172.21.15.47:0/2236056501 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:08.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc0051d0 0x7f2fe80b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe6a00640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fe80cca50 0x7f2fe80b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fe80cca50 msgr2=0x7f2fe80b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fe80cca50 0x7f2fe80b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc0051d0 msgr2=0x7f2fe80b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc0051d0 0x7f2fe80b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 -- 172.21.15.47:0/2236056501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe80b72b0 con 0x7f2fe806e730 2024-04-26T23:48:08.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe806e730 0x7f2fe81f4370 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2fe001d180 tx=0x7f2fcc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fdf400640 1 -- 172.21.15.47:0/2236056501 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00bb070 con 0x7f2fe806e730 2024-04-26T23:48:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fdf400640 1 -- 172.21.15.47:0/2236056501 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0003980 con 0x7f2fe806e730 2024-04-26T23:48:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe80b7590 con 0x7f2fe806e730 2024-04-26T23:48:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fdf400640 1 -- 172.21.15.47:0/2236056501 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0005500 con 0x7f2fe806e730 2024-04-26T23:48:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.798+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe80b5de0 con 0x7f2fe806e730 2024-04-26T23:48:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.802+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe8069700 con 0x7f2fe806e730 2024-04-26T23:48:08.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.802+0000 7f2fdf400640 1 -- 172.21.15.47:0/2236056501 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f2fe00be070 con 0x7f2fe806e730 2024-04-26T23:48:08.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.802+0000 7f2fdf400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fc8068650 0x7f2fc806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:08.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.802+0000 7f2fdf400640 1 -- 172.21.15.47:0/2236056501 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f2fe0120490 con 0x7f2fe806e730 2024-04-26T23:48:08.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.802+0000 7f2fe7400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fc8068650 0x7f2fc806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:08.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.802+0000 7f2fe7400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fc8068650 0x7f2fc806ab10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009aa0 tx=0x7f2fd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:08.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.806+0000 7f2fdf400640 1 -- 172.21.15.47:0/2236056501 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2fe00165f0 con 0x7f2fe806e730 2024-04-26T23:48:08.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.970+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fe80b1d60 con 0x7f2fe806e730 2024-04-26T23:48:08.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fdf400640 1 -- 172.21.15.47:0/2236056501 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+16601 (secure 0 0 0) 0x7f2fe0001cc0 con 0x7f2fe806e730 2024-04-26T23:48:08.979 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:08.979 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":49,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:06.220557+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:48:08.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fc8068650 msgr2=0x7f2fc806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fc8068650 0x7f2fc806ab10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009aa0 tx=0x7f2fd8008040 comp rx=0 tx=0).stop 2024-04-26T23:48:08.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe806e730 msgr2=0x7f2fe81f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe806e730 0x7f2fe81f4370 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2fe001d180 tx=0x7f2fcc005840 comp rx=0 tx=0).stop 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 shutdown_connections 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fc8068650 0x7f2fc806ab10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe806e730 0x7f2fe81f4370 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2fe80cca50 0x7f2fe80b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 --2- 172.21.15.47:0/2236056501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fcc0051d0 0x7f2fe80b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 >> 172.21.15.47:0/2236056501 conn(0x7f2fe80d2e90 msgr2=0x7f2fe80b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 shutdown_connections 2024-04-26T23:48:08.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:08.974+0000 7f2fee400640 1 -- 172.21.15.47:0/2236056501 wait complete. 2024-04-26T23:48:09.001 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T23:48:09.002 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.138+0000 7f11a2800640 1 Processor -- start 2024-04-26T23:48:09.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.138+0000 7f11a2800640 1 -- start start 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.138+0000 7f11a2800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f119c15d5b0 0x7f119c15da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.138+0000 7f11a2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 0x7f119c0ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.138+0000 7f11a2800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119c15e050 con 0x7f119c0b4360 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.138+0000 7f11a2800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f119c15e330 con 0x7f119c15d5b0 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.138+0000 7f11a2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f119c0ceda0 con 0x7f119c0cdc00 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119b400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f119c0b4360 0x7f119c0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37292/0 (socket says 172.21.15.47:37292) 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119b400640 1 -- 172.21.15.47:0/2634641850 learned_addr learned my addr 172.21.15.47:0/2634641850 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f1193e00640 1 --2- 172.21.15.47:0/2634641850 >> v2:172.21.15.203:3300/0 conn(0x7f119c15d5b0 0x7f119c15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 0x7f119c0ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250904523 0 0) 0x7f119c15e050 con 0x7f119c0b4360 2024-04-26T23:48:09.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1180003530 con 0x7f119c0b4360 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 166481551 0 0) 0x7f1180003530 con 0x7f119c0b4360 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 msgr2=0x7f119c0ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 0x7f119c0ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 >> v2:172.21.15.203:3300/0 conn(0x7f119c15d5b0 msgr2=0x7f119c15da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 --2- 172.21.15.47:0/2634641850 >> v2:172.21.15.203:3300/0 conn(0x7f119c15d5b0 0x7f119c15da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c0cf080 con 0x7f119c0b4360 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f118c0016a0 con 0x7f119c0b4360 2024-04-26T23:48:09.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f1193e00640 1 --2- 172.21.15.47:0/2634641850 >> v2:172.21.15.203:3300/0 conn(0x7f119c15d5b0 0x7f119c15da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 0x7f119c0ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 >> v1:172.21.15.47:6789/0 conn(0x7f119c0b4360 legacy=0x7f119c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 0x7f11800039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1180003f00 0x7f1180004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1180004d50 0x7f11800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f119c15e330 con 0x7f1180004d50 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0ceda0 con 0x7f1180003f00 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f118000b9d0 con 0x7f119c0cdc00 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1180004d50 0x7f11800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f1193e00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1180003f00 0x7f1180004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119b400640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 0x7f11800039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 -- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 msgr2=0x7f11800039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f119c0cdc00 0x7f11800039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 -- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1180003f00 msgr2=0x7f1180004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1180003f00 0x7f1180004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.142+0000 7f119be00640 1 -- 172.21.15.47:0/2634641850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1180003530 con 0x7f1180004d50 2024-04-26T23:48:09.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f119be00640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1180004d50 0x7f11800051d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f119400e350 tx=0x7f119401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764a73f0cadb983f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11940b2070 con 0x7f1180004d50 2024-04-26T23:48:09.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11940a5e10 con 0x7f1180004d50 2024-04-26T23:48:09.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f119aa00640 1 -- 172.21.15.47:0/2634641850 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1194009de0 con 0x7f1180004d50 2024-04-26T23:48:09.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 -- 172.21.15.47:0/2634641850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1180004d50 msgr2=0x7f11800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 --2- 172.21.15.47:0/2634641850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1180004d50 0x7f11800051d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f119400e350 tx=0x7f119401ce00 comp rx=0 tx=0).stop 2024-04-26T23:48:09.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f119be00640 1 -- 172.21.15.47:0/2634641850 reap_dead start 2024-04-26T23:48:09.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 -- 172.21.15.47:0/2634641850 shutdown_connections 2024-04-26T23:48:09.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 -- 172.21.15.47:0/2634641850 >> 172.21.15.47:0/2634641850 conn(0x7f119c06c800 msgr2=0x7f119c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:09.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 -- 172.21.15.47:0/2634641850 shutdown_connections 2024-04-26T23:48:09.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 -- 172.21.15.47:0/2634641850 wait complete. 2024-04-26T23:48:09.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 Processor -- start 2024-04-26T23:48:09.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.146+0000 7f11a2800640 1 -- start start 2024-04-26T23:48:09.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1180004d50 0x7f119c1f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c144ae0 0x7f119c0b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f119c1e80f0 0x7f119c1e8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0b60f0 con 0x7f119c144ae0 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0b5f70 con 0x7f119c1e80f0 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f119c0ce090 con 0x7f1180004d50 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c144ae0 0x7f119c0b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c144ae0 0x7f119c0b0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43960/0 (socket says 172.21.15.47:43960) 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 -- 172.21.15.47:0/3015360110 learned_addr learned my addr 172.21.15.47:0/3015360110 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f119be00640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f119c1e80f0 0x7f119c1e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f119b400640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1180004d50 0x7f119c1f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 -- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1180004d50 msgr2=0x7f119c1f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1180004d50 0x7f119c1f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 -- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f119c1e80f0 msgr2=0x7f119c1e8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f119c1e80f0 0x7f119c1e8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 -- 172.21.15.47:0/3015360110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c0b19a0 con 0x7f119c144ae0 2024-04-26T23:48:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f119be00640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f119c1e80f0 0x7f119c1e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193e00640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c144ae0 0x7f119c0b0920 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1184011cd0 tx=0x7f118400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193400640 1 -- 172.21.15.47:0/3015360110 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118400fd20 con 0x7f119c144ae0 2024-04-26T23:48:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193400640 1 -- 172.21.15.47:0/3015360110 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1184014440 con 0x7f119c144ae0 2024-04-26T23:48:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193400640 1 -- 172.21.15.47:0/3015360110 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840147f0 con 0x7f119c144ae0 2024-04-26T23:48:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c0b0e60 con 0x7f119c144ae0 2024-04-26T23:48:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c0b13e0 con 0x7f119c144ae0 2024-04-26T23:48:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c069700 con 0x7f119c144ae0 2024-04-26T23:48:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.150+0000 7f1193400640 1 -- 172.21.15.47:0/3015360110 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f1184012040 con 0x7f119c144ae0 2024-04-26T23:48:09.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.154+0000 7f1193400640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1178068680 0x7f117806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.154+0000 7f1193400640 1 -- 172.21.15.47:0/3015360110 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f11840874e0 con 0x7f119c144ae0 2024-04-26T23:48:09.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.154+0000 7f119b400640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1178068680 0x7f117806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.154+0000 7f119b400640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1178068680 0x7f117806ab40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f119c09f0e0 tx=0x7f118c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.158+0000 7f1193400640 1 -- 172.21.15.47:0/3015360110 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1184019030 con 0x7f119c144ae0 2024-04-26T23:48:09.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.326+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f119c0d06a0 con 0x7f1178068680 2024-04-26T23:48:09.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.334+0000 7f1193400640 1 -- 172.21.15.47:0/3015360110 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245317 (secure 0 0 0) 0x7f119c0d06a0 con 0x7f1178068680 2024-04-26T23:48:09.343 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:09.345 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1178068680 msgr2=0x7f117806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1178068680 0x7f117806ab40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f119c09f0e0 tx=0x7f118c009040 comp rx=0 tx=0).stop 2024-04-26T23:48:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c144ae0 msgr2=0x7f119c0b0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c144ae0 0x7f119c0b0920 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1184011cd0 tx=0x7f118400f610 comp rx=0 tx=0).stop 2024-04-26T23:48:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 shutdown_connections 2024-04-26T23:48:09.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1178068680 0x7f117806ab40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f119c1e80f0 0x7f119c1e8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f119c144ae0 0x7f119c0b0920 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 --2- 172.21.15.47:0/3015360110 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1180004d50 0x7f119c1f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 >> 172.21.15.47:0/3015360110 conn(0x7f119c06c800 msgr2=0x7f119c073e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:09.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 shutdown_connections 2024-04-26T23:48:09.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.338+0000 7f11a2800640 1 -- 172.21.15.47:0/3015360110 wait complete. 2024-04-26T23:48:09.364 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-04-26T23:48:08.190536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238152,"kb_used_data":5320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736568,"statfs":{"total":773094113280,"available":772850245632,"internally_reserved":0,"allocated":5447680,"data_stored":2885170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.994676"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208885+0000","last_change":"2024-04-26T23:48:04.208885+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208885+0000","last_undegraded":"2024-04-26T23:48:04.208885+0000","last_fullsized":"2024-04-26T23:48:04.208885+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206516+0000","last_change":"2024-04-26T23:48:04.206516+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206516+0000","last_undegraded":"2024-04-26T23:48:04.206516+0000","last_fullsized":"2024-04-26T23:48:04.206516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214093+0000","last_change":"2024-04-26T23:48:04.214093+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214093+0000","last_undegraded":"2024-04-26T23:48:04.214093+0000","last_fullsized":"2024-04-26T23:48:04.214093+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.205963+0000","last_change":"2024-04-26T23:48:04.205963+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.205963+0000","last_undegraded":"2024-04-26T23:48:04.205963+0000","last_fullsized":"2024-04-26T23:48:04.205963+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.220383+0000","last_change":"2024-04-26T23:48:04.220383+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.220383+0000","last_undegraded":"2024-04-26T23:48:04.220383+0000","last_fullsized":"2024-04-26T23:48:04.220383+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.210811+0000","last_change":"2024-04-26T23:48:04.210811+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.210811+0000","last_undegraded":"2024-04-26T23:48:04.210811+0000","last_fullsized":"2024-04-26T23:48:04.210811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208962+0000","last_change":"2024-04-26T23:48:04.208962+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208962+0000","last_undegraded":"2024-04-26T23:48:04.208962+0000","last_fullsized":"2024-04-26T23:48:04.208962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213458+0000","last_change":"2024-04-26T23:48:04.213458+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213458+0000","last_undegraded":"2024-04-26T23:48:04.213458+0000","last_fullsized":"2024-04-26T23:48:04.213458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.217268+0000","last_change":"2024-04-26T23:48:04.217268+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.217268+0000","last_undegraded":"2024-04-26T23:48:04.217268+0000","last_fullsized":"2024-04-26T23:48:04.217268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212650+0000","last_change":"2024-04-26T23:48:04.212650+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212650+0000","last_undegraded":"2024-04-26T23:48:04.212650+0000","last_fullsized":"2024-04-26T23:48:04.212650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212950+0000","last_change":"2024-04-26T23:48:04.212950+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212950+0000","last_undegraded":"2024-04-26T23:48:04.212950+0000","last_fullsized":"2024-04-26T23:48:04.212950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212086+0000","last_change":"2024-04-26T23:48:04.212086+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212086+0000","last_undegraded":"2024-04-26T23:48:04.212086+0000","last_fullsized":"2024-04-26T23:48:04.212086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.217238+0000","last_change":"2024-04-26T23:48:04.217238+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.217238+0000","last_undegraded":"2024-04-26T23:48:04.217238+0000","last_fullsized":"2024-04-26T23:48:04.217238+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212849+0000","last_change":"2024-04-26T23:48:04.212849+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212849+0000","last_undegraded":"2024-04-26T23:48:04.212849+0000","last_fullsized":"2024-04-26T23:48:04.212849+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216765+0000","last_change":"2024-04-26T23:48:04.216765+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216765+0000","last_undegraded":"2024-04-26T23:48:04.216765+0000","last_fullsized":"2024-04-26T23:48:04.216765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213398+0000","last_change":"2024-04-26T23:48:04.213398+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213398+0000","last_undegraded":"2024-04-26T23:48:04.213398+0000","last_fullsized":"2024-04-26T23:48:04.213398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212086+0000","last_change":"2024-04-26T23:48:04.212086+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212086+0000","last_undegraded":"2024-04-26T23:48:04.212086+0000","last_fullsized":"2024-04-26T23:48:04.212086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215835+0000","last_change":"2024-04-26T23:48:04.215835+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215835+0000","last_undegraded":"2024-04-26T23:48:04.215835+0000","last_fullsized":"2024-04-26T23:48:04.215835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212952+0000","last_change":"2024-04-26T23:48:04.212952+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212952+0000","last_undegraded":"2024-04-26T23:48:04.212952+0000","last_fullsized":"2024-04-26T23:48:04.212952+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211188+0000","last_change":"2024-04-26T23:48:04.211188+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211188+0000","last_undegraded":"2024-04-26T23:48:04.211188+0000","last_fullsized":"2024-04-26T23:48:04.211188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208520+0000","last_change":"2024-04-26T23:48:04.208520+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208520+0000","last_undegraded":"2024-04-26T23:48:04.208520+0000","last_fullsized":"2024-04-26T23:48:04.208520+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216777+0000","last_change":"2024-04-26T23:48:04.216777+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216777+0000","last_undegraded":"2024-04-26T23:48:04.216777+0000","last_fullsized":"2024-04-26T23:48:04.216777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212192+0000","last_change":"2024-04-26T23:48:04.212192+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212192+0000","last_undegraded":"2024-04-26T23:48:04.212192+0000","last_fullsized":"2024-04-26T23:48:04.212192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216871+0000","last_change":"2024-04-26T23:48:04.216871+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216871+0000","last_undegraded":"2024-04-26T23:48:04.216871+0000","last_fullsized":"2024-04-26T23:48:04.216871+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.209503+0000","last_change":"2024-04-26T23:48:04.209503+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.209503+0000","last_undegraded":"2024-04-26T23:48:04.209503+0000","last_fullsized":"2024-04-26T23:48:04.209503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206026+0000","last_change":"2024-04-26T23:48:04.206026+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206026+0000","last_undegraded":"2024-04-26T23:48:04.206026+0000","last_fullsized":"2024-04-26T23:48:04.206026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.219508+0000","last_change":"2024-04-26T23:48:04.219508+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.219508+0000","last_undegraded":"2024-04-26T23:48:04.219508+0000","last_fullsized":"2024-04-26T23:48:04.219508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215450+0000","last_change":"2024-04-26T23:48:04.215450+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215450+0000","last_undegraded":"2024-04-26T23:48:04.215450+0000","last_fullsized":"2024-04-26T23:48:04.215450+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.224657+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:04.224657+0000","last_peered":"2024-04-26T23:48:04.224657+0000","last_clean":"2024-04-26T23:48:04.224657+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:04.224657+0000","last_undegraded":"2024-04-26T23:48:04.224657+0000","last_fullsized":"2024-04-26T23:48:04.224657+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:47.598619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206523+0000","last_change":"2024-04-26T23:48:04.206523+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206523+0000","last_undegraded":"2024-04-26T23:48:04.206523+0000","last_fullsized":"2024-04-26T23:48:04.206523+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.217211+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:04.217211+0000","last_peered":"2024-04-26T23:48:04.217211+0000","last_clean":"2024-04-26T23:48:04.217211+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:04.217211+0000","last_undegraded":"2024-04-26T23:48:04.217211+0000","last_fullsized":"2024-04-26T23:48:04.217211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:54.975375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206026+0000","last_change":"2024-04-26T23:48:04.206026+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206026+0000","last_undegraded":"2024-04-26T23:48:04.206026+0000","last_fullsized":"2024-04-26T23:48:04.206026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226422+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:04.226422+0000","last_peered":"2024-04-26T23:48:04.226422+0000","last_clean":"2024-04-26T23:48:04.226422+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:04.226422+0000","last_undegraded":"2024-04-26T23:48:04.226422+0000","last_fullsized":"2024-04-26T23:48:04.226422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:53.056415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211797+0000","last_change":"2024-04-26T23:48:04.211797+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211797+0000","last_undegraded":"2024-04-26T23:48:04.211797+0000","last_fullsized":"2024-04-26T23:48:04.211797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.215958+0000","last_change":"2024-04-26T23:48:04.215958+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215958+0000","last_undegraded":"2024-04-26T23:48:04.215958+0000","last_fullsized":"2024-04-26T23:48:04.215958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227809+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:04.227809+0000","last_peered":"2024-04-26T23:48:04.227809+0000","last_clean":"2024-04-26T23:48:04.227809+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:04.227809+0000","last_undegraded":"2024-04-26T23:48:04.227809+0000","last_fullsized":"2024-04-26T23:48:04.227809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:00.809941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223130+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:04.223130+0000","last_peered":"2024-04-26T23:48:04.223130+0000","last_clean":"2024-04-26T23:48:04.223130+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:04.223130+0000","last_undegraded":"2024-04-26T23:48:04.223130+0000","last_fullsized":"2024-04-26T23:48:04.223130+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:52.827965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214782+0000","last_change":"2024-04-26T23:48:04.214782+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214782+0000","last_undegraded":"2024-04-26T23:48:04.214782+0000","last_fullsized":"2024-04-26T23:48:04.214782+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.205185+0000","last_change":"2024-04-26T23:48:03.205185+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.205185+0000","last_undegraded":"2024-04-26T23:48:03.205185+0000","last_fullsized":"2024-04-26T23:48:03.205185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211624+0000","last_change":"2024-04-26T23:48:04.211624+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211624+0000","last_undegraded":"2024-04-26T23:48:04.211624+0000","last_fullsized":"2024-04-26T23:48:04.211624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227603+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:04.227603+0000","last_peered":"2024-04-26T23:48:04.227603+0000","last_clean":"2024-04-26T23:48:04.227603+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:04.227603+0000","last_undegraded":"2024-04-26T23:48:04.227603+0000","last_fullsized":"2024-04-26T23:48:04.227603+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:54.975375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208433+0000","last_change":"2024-04-26T23:48:04.208433+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208433+0000","last_undegraded":"2024-04-26T23:48:04.208433+0000","last_fullsized":"2024-04-26T23:48:04.208433+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203558+0000","last_change":"2024-04-26T23:48:03.203558+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203558+0000","last_undegraded":"2024-04-26T23:48:03.203558+0000","last_fullsized":"2024-04-26T23:48:03.203558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218103+0000","last_change":"2024-04-26T23:48:04.218103+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218103+0000","last_undegraded":"2024-04-26T23:48:04.218103+0000","last_fullsized":"2024-04-26T23:48:04.218103+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231363+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:04.231363+0000","last_peered":"2024-04-26T23:48:04.231363+0000","last_clean":"2024-04-26T23:48:04.231363+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:04.231363+0000","last_undegraded":"2024-04-26T23:48:04.231363+0000","last_fullsized":"2024-04-26T23:48:04.231363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208245+0000","last_change":"2024-04-26T23:48:04.208245+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208245+0000","last_undegraded":"2024-04-26T23:48:04.208245+0000","last_fullsized":"2024-04-26T23:48:04.208245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.225356+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:04.225356+0000","last_peered":"2024-04-26T23:48:04.225356+0000","last_clean":"2024-04-26T23:48:04.225356+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:04.225356+0000","last_undegraded":"2024-04-26T23:48:04.225356+0000","last_fullsized":"2024-04-26T23:48:04.225356+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:20:57.087193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213193+0000","last_change":"2024-04-26T23:48:04.213193+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213193+0000","last_undegraded":"2024-04-26T23:48:04.213193+0000","last_fullsized":"2024-04-26T23:48:04.213193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.229217+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:04.229217+0000","last_peered":"2024-04-26T23:48:04.229217+0000","last_clean":"2024-04-26T23:48:04.229217+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:04.229217+0000","last_undegraded":"2024-04-26T23:48:04.229217+0000","last_fullsized":"2024-04-26T23:48:04.229217+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226477+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:04.226477+0000","last_peered":"2024-04-26T23:48:04.226477+0000","last_clean":"2024-04-26T23:48:04.226477+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:04.226477+0000","last_undegraded":"2024-04-26T23:48:04.226477+0000","last_fullsized":"2024-04-26T23:48:04.226477+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:36.484543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215675+0000","last_change":"2024-04-26T23:48:04.215675+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215675+0000","last_undegraded":"2024-04-26T23:48:04.215675+0000","last_fullsized":"2024-04-26T23:48:04.215675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228608+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:04.228608+0000","last_peered":"2024-04-26T23:48:04.228608+0000","last_clean":"2024-04-26T23:48:04.228608+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:04.228608+0000","last_undegraded":"2024-04-26T23:48:04.228608+0000","last_fullsized":"2024-04-26T23:48:04.228608+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.209586+0000","last_change":"2024-04-26T23:48:04.209586+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.209586+0000","last_undegraded":"2024-04-26T23:48:04.209586+0000","last_fullsized":"2024-04-26T23:48:04.209586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.204831+0000","last_change":"2024-04-26T23:48:03.204831+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.204831+0000","last_undegraded":"2024-04-26T23:48:03.204831+0000","last_fullsized":"2024-04-26T23:48:03.204831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212518+0000","last_change":"2024-04-26T23:48:04.212518+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212518+0000","last_undegraded":"2024-04-26T23:48:04.212518+0000","last_fullsized":"2024-04-26T23:48:04.212518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226958+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:04.226958+0000","last_peered":"2024-04-26T23:48:04.226958+0000","last_clean":"2024-04-26T23:48:04.226958+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:04.226958+0000","last_undegraded":"2024-04-26T23:48:04.226958+0000","last_fullsized":"2024-04-26T23:48:04.226958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:22.423787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223587+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:04.223587+0000","last_peered":"2024-04-26T23:48:04.223587+0000","last_clean":"2024-04-26T23:48:04.223587+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:04.223587+0000","last_undegraded":"2024-04-26T23:48:04.223587+0000","last_fullsized":"2024-04-26T23:48:04.223587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:12.070544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213725+0000","last_change":"2024-04-26T23:48:04.213725+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213725+0000","last_undegraded":"2024-04-26T23:48:04.213725+0000","last_fullsized":"2024-04-26T23:48:04.213725+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.221652+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:04.221652+0000","last_peered":"2024-04-26T23:48:04.221652+0000","last_clean":"2024-04-26T23:48:04.221652+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:04.221652+0000","last_undegraded":"2024-04-26T23:48:04.221652+0000","last_fullsized":"2024-04-26T23:48:04.221652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:33.820112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218891+0000","last_change":"2024-04-26T23:48:04.218891+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218891+0000","last_undegraded":"2024-04-26T23:48:04.218891+0000","last_fullsized":"2024-04-26T23:48:04.218891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227952+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:04.227952+0000","last_peered":"2024-04-26T23:48:04.227952+0000","last_clean":"2024-04-26T23:48:04.227952+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:04.227952+0000","last_undegraded":"2024-04-26T23:48:04.227952+0000","last_fullsized":"2024-04-26T23:48:04.227952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.219913+0000","last_change":"2024-04-26T23:48:04.219913+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.219913+0000","last_undegraded":"2024-04-26T23:48:04.219913+0000","last_fullsized":"2024-04-26T23:48:04.219913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.215235+0000","last_change":"2024-04-26T23:48:04.215235+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215235+0000","last_undegraded":"2024-04-26T23:48:04.215235+0000","last_fullsized":"2024-04-26T23:48:04.215235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206161+0000","last_change":"2024-04-26T23:48:04.206161+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206161+0000","last_undegraded":"2024-04-26T23:48:04.206161+0000","last_fullsized":"2024-04-26T23:48:04.206161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228908+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:04.228908+0000","last_peered":"2024-04-26T23:48:04.228908+0000","last_clean":"2024-04-26T23:48:04.228908+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:04.228908+0000","last_undegraded":"2024-04-26T23:48:04.228908+0000","last_fullsized":"2024-04-26T23:48:04.228908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:36.484543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208969+0000","last_change":"2024-04-26T23:48:04.208969+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208969+0000","last_undegraded":"2024-04-26T23:48:04.208969+0000","last_fullsized":"2024-04-26T23:48:04.208969+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203562+0000","last_change":"2024-04-26T23:48:03.203562+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203562+0000","last_undegraded":"2024-04-26T23:48:03.203562+0000","last_fullsized":"2024-04-26T23:48:03.203562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.224343+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:04.224343+0000","last_peered":"2024-04-26T23:48:04.224343+0000","last_clean":"2024-04-26T23:48:04.224343+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:04.224343+0000","last_undegraded":"2024-04-26T23:48:04.224343+0000","last_fullsized":"2024-04-26T23:48:04.224343+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:52.827965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214738+0000","last_change":"2024-04-26T23:48:04.214738+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214738+0000","last_undegraded":"2024-04-26T23:48:04.214738+0000","last_fullsized":"2024-04-26T23:48:04.214738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228704+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:04.228704+0000","last_peered":"2024-04-26T23:48:04.228704+0000","last_clean":"2024-04-26T23:48:04.228704+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:04.228704+0000","last_undegraded":"2024-04-26T23:48:04.228704+0000","last_fullsized":"2024-04-26T23:48:04.228704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226180+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:04.226180+0000","last_peered":"2024-04-26T23:48:04.226180+0000","last_clean":"2024-04-26T23:48:04.226180+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:04.226180+0000","last_undegraded":"2024-04-26T23:48:04.226180+0000","last_fullsized":"2024-04-26T23:48:04.226180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.207675+0000","last_change":"2024-04-26T23:48:04.207675+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.207675+0000","last_undegraded":"2024-04-26T23:48:04.207675+0000","last_fullsized":"2024-04-26T23:48:04.207675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.215039+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:04.215039+0000","last_peered":"2024-04-26T23:48:04.215039+0000","last_clean":"2024-04-26T23:48:04.215039+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:04.215039+0000","last_undegraded":"2024-04-26T23:48:04.215039+0000","last_fullsized":"2024-04-26T23:48:04.215039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:47.598619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218406+0000","last_change":"2024-04-26T23:48:04.218406+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218406+0000","last_undegraded":"2024-04-26T23:48:04.218406+0000","last_fullsized":"2024-04-26T23:48:04.218406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231097+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:04.231097+0000","last_peered":"2024-04-26T23:48:04.231097+0000","last_clean":"2024-04-26T23:48:04.231097+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:04.231097+0000","last_undegraded":"2024-04-26T23:48:04.231097+0000","last_fullsized":"2024-04-26T23:48:04.231097+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:38.642110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216326+0000","last_change":"2024-04-26T23:48:04.216326+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216326+0000","last_undegraded":"2024-04-26T23:48:04.216326+0000","last_fullsized":"2024-04-26T23:48:04.216326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231032+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:04.231032+0000","last_peered":"2024-04-26T23:48:04.231032+0000","last_clean":"2024-04-26T23:48:04.231032+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:04.231032+0000","last_undegraded":"2024-04-26T23:48:04.231032+0000","last_fullsized":"2024-04-26T23:48:04.231032+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.205879+0000","last_change":"2024-04-26T23:48:04.205879+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.205879+0000","last_undegraded":"2024-04-26T23:48:04.205879+0000","last_fullsized":"2024-04-26T23:48:04.205879+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223933+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:04.223933+0000","last_peered":"2024-04-26T23:48:04.223933+0000","last_clean":"2024-04-26T23:48:04.223933+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:04.223933+0000","last_undegraded":"2024-04-26T23:48:04.223933+0000","last_fullsized":"2024-04-26T23:48:04.223933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:00.809941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211076+0000","last_change":"2024-04-26T23:48:04.211076+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211076+0000","last_undegraded":"2024-04-26T23:48:04.211076+0000","last_fullsized":"2024-04-26T23:48:04.211076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203473+0000","last_change":"2024-04-26T23:48:03.203473+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203473+0000","last_undegraded":"2024-04-26T23:48:03.203473+0000","last_fullsized":"2024-04-26T23:48:03.203473+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226769+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:04.226769+0000","last_peered":"2024-04-26T23:48:04.226769+0000","last_clean":"2024-04-26T23:48:04.226769+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:04.226769+0000","last_undegraded":"2024-04-26T23:48:04.226769+0000","last_fullsized":"2024-04-26T23:48:04.226769+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:53.056415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":213,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.207344+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:04.207344+0000","last_peered":"2024-04-26T23:48:04.207344+0000","last_clean":"2024-04-26T23:48:04.207344+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:04.207344+0000","last_undegraded":"2024-04-26T23:48:04.207344+0000","last_fullsized":"2024-04-26T23:48:04.207344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":803366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":544768,"data_stored":219265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1114112,"data_stored":797549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:09.369 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:09.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d6ba00640 1 Processor -- start 2024-04-26T23:48:09.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d6ba00640 1 -- start start 2024-04-26T23:48:09.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d6ba00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2d640738f0 0x7f2d640b6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d6ba00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d640b4db0 con 0x7f2d6415f080 2024-04-26T23:48:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d6ba00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d640b5090 con 0x7f2d640b47d0 2024-04-26T23:48:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d6ba00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2d640ce210 con 0x7f2d640738f0 2024-04-26T23:48:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2d6415f080 0x7f2d640cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37294/0 (socket says 172.21.15.47:37294) 2024-04-26T23:48:09.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 -- 172.21.15.47:0/561235713 learned_addr learned my addr 172.21.15.47:0/561235713 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:09.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69a00640 1 --2- 172.21.15.47:0/561235713 >> v2:172.21.15.203:3300/0 conn(0x7f2d640738f0 0x7f2d640b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137456451 0 0) 0x7f2d640b4db0 con 0x7f2d6415f080 2024-04-26T23:48:09.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d4c003530 con 0x7f2d6415f080 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428090510 0 0) 0x7f2d640b5090 con 0x7f2d640b47d0 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d640b4db0 con 0x7f2d640b47d0 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 801925365 0 0) 0x7f2d4c003530 con 0x7f2d6415f080 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 >> v2:172.21.15.203:3300/0 conn(0x7f2d640738f0 msgr2=0x7f2d640b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 --2- 172.21.15.47:0/561235713 >> v2:172.21.15.203:3300/0 conn(0x7f2d640738f0 0x7f2d640b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 >> v1:172.21.15.203:6789/0 conn(0x7f2d640b47d0 legacy=0x7f2d640731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d640ce4f0 con 0x7f2d6415f080 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f2d58001680 con 0x7f2d6415f080 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 >> v1:172.21.15.47:6789/0 conn(0x7f2d6415f080 legacy=0x7f2d640cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d4c003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d4c004810 0x7f2d4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d4c005220 0x7f2d4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d640ce210 con 0x7f2d4c003ba0 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4c00c150 con 0x7f2d4c005220 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4c00c350 con 0x7f2d4c004810 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d4c003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69a00640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d4c005220 0x7f2d4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d63e00640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d4c004810 0x7f2d4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 -- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d4c004810 msgr2=0x7f2d4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d4c004810 0x7f2d4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 -- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d4c005220 msgr2=0x7f2d4c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d4c005220 0x7f2d4c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69000640 1 -- 172.21.15.47:0/561235713 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d4c003530 con 0x7f2d4c003ba0 2024-04-26T23:48:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69a00640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d4c005220 0x7f2d4c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:09.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.546+0000 7f2d69a00640 1 -- 172.21.15.47:0/561235713 reap_dead start 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d69000640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d4c003fa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800c110 tx=0x7f2d5801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bde557eb431a06 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58007c10 con 0x7f2d4c003ba0 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d580a9070 con 0x7f2d4c003ba0 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d63400640 1 -- 172.21.15.47:0/561235713 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58005d20 con 0x7f2d4c003ba0 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d6ba00640 1 -- 172.21.15.47:0/561235713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 msgr2=0x7f2d4c003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d4c003fa0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800c110 tx=0x7f2d5801cb60 comp rx=0 tx=0).stop 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d6ba00640 1 -- 172.21.15.47:0/561235713 shutdown_connections 2024-04-26T23:48:09.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/561235713 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d4c003fa0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d6ba00640 1 -- 172.21.15.47:0/561235713 >> 172.21.15.47:0/561235713 conn(0x7f2d64075c20 msgr2=0x7f2d64076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d6ba00640 1 -- 172.21.15.47:0/561235713 shutdown_connections 2024-04-26T23:48:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.550+0000 7f2d6ba00640 1 -- 172.21.15.47:0/561235713 wait complete. 2024-04-26T23:48:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 Processor -- start 2024-04-26T23:48:09.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 -- start start 2024-04-26T23:48:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d641511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d64158160 0x7f2d640cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d64151ce0 0x7f2d640ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6415f5e0 con 0x7f2d4c003ba0 2024-04-26T23:48:09.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6415f460 con 0x7f2d64151ce0 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6406f120 con 0x7f2d64158160 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d641511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d641511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43980/0 (socket says 172.21.15.47:43980) 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 -- 172.21.15.47:0/2762790538 learned_addr learned my addr 172.21.15.47:0/2762790538 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 -- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d64158160 msgr2=0x7f2d640cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d64158160 0x7f2d640cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 -- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d64151ce0 msgr2=0x7f2d640ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d64151ce0 0x7f2d640ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 -- 172.21.15.47:0/2762790538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d64155300 con 0x7f2d4c003ba0 2024-04-26T23:48:09.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d69000640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d641511f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c10 tx=0x7f2d4c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d60c00640 1 -- 172.21.15.47:0/2762790538 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58007c10 con 0x7f2d4c003ba0 2024-04-26T23:48:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d60c00640 1 -- 172.21.15.47:0/2762790538 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d58005d70 con 0x7f2d4c003ba0 2024-04-26T23:48:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d60c00640 1 -- 172.21.15.47:0/2762790538 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58001680 con 0x7f2d4c003ba0 2024-04-26T23:48:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d64152a40 con 0x7f2d4c003ba0 2024-04-26T23:48:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.554+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d64155850 con 0x7f2d4c003ba0 2024-04-26T23:48:09.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.558+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d64069700 con 0x7f2d4c003ba0 2024-04-26T23:48:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.558+0000 7f2d60c00640 1 -- 172.21.15.47:0/2762790538 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f2d580b7030 con 0x7f2d4c003ba0 2024-04-26T23:48:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.558+0000 7f2d60c00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2d44068680 0x7f2d4406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.558+0000 7f2d60c00640 1 -- 172.21.15.47:0/2762790538 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f2d5811fd50 con 0x7f2d4c003ba0 2024-04-26T23:48:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.558+0000 7f2d63e00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2d44068680 0x7f2d4406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.558+0000 7f2d63e00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2d44068680 0x7f2d4406ab40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d50007b40 tx=0x7f2d50009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.562+0000 7f2d60c00640 1 -- 172.21.15.47:0/2762790538 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2d58016870 con 0x7f2d4c003ba0 2024-04-26T23:48:09.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.726+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d6415c420 con 0x7f2d44068680 2024-04-26T23:48:09.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.734+0000 7f2d60c00640 1 -- 172.21.15.47:0/2762790538 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245317 (secure 0 0 0) 0x7f2d6415c420 con 0x7f2d44068680 2024-04-26T23:48:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:09.744 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:09.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2d44068680 msgr2=0x7f2d4406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2d44068680 0x7f2d4406ab40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d50007b40 tx=0x7f2d50009040 comp rx=0 tx=0).stop 2024-04-26T23:48:09.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 msgr2=0x7f2d641511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d641511f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2d58000c10 tx=0x7f2d4c005840 comp rx=0 tx=0).stop 2024-04-26T23:48:09.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 shutdown_connections 2024-04-26T23:48:09.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2d44068680 0x7f2d4406ab40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d64151ce0 0x7f2d640ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d64158160 0x7f2d640cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 --2- 172.21.15.47:0/2762790538 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d4c003ba0 0x7f2d641511f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 >> 172.21.15.47:0/2762790538 conn(0x7f2d64075c20 msgr2=0x7f2d6415b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:09.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 shutdown_connections 2024-04-26T23:48:09.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.738+0000 7f2d6ba00640 1 -- 172.21.15.47:0/2762790538 wait complete. 2024-04-26T23:48:09.764 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-04-26T23:48:08.190536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238152,"kb_used_data":5320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736568,"statfs":{"total":773094113280,"available":772850245632,"internally_reserved":0,"allocated":5447680,"data_stored":2885170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.994676"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208885+0000","last_change":"2024-04-26T23:48:04.208885+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208885+0000","last_undegraded":"2024-04-26T23:48:04.208885+0000","last_fullsized":"2024-04-26T23:48:04.208885+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206516+0000","last_change":"2024-04-26T23:48:04.206516+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206516+0000","last_undegraded":"2024-04-26T23:48:04.206516+0000","last_fullsized":"2024-04-26T23:48:04.206516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214093+0000","last_change":"2024-04-26T23:48:04.214093+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214093+0000","last_undegraded":"2024-04-26T23:48:04.214093+0000","last_fullsized":"2024-04-26T23:48:04.214093+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.205963+0000","last_change":"2024-04-26T23:48:04.205963+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.205963+0000","last_undegraded":"2024-04-26T23:48:04.205963+0000","last_fullsized":"2024-04-26T23:48:04.205963+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.220383+0000","last_change":"2024-04-26T23:48:04.220383+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.220383+0000","last_undegraded":"2024-04-26T23:48:04.220383+0000","last_fullsized":"2024-04-26T23:48:04.220383+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.210811+0000","last_change":"2024-04-26T23:48:04.210811+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.210811+0000","last_undegraded":"2024-04-26T23:48:04.210811+0000","last_fullsized":"2024-04-26T23:48:04.210811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208962+0000","last_change":"2024-04-26T23:48:04.208962+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208962+0000","last_undegraded":"2024-04-26T23:48:04.208962+0000","last_fullsized":"2024-04-26T23:48:04.208962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213458+0000","last_change":"2024-04-26T23:48:04.213458+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213458+0000","last_undegraded":"2024-04-26T23:48:04.213458+0000","last_fullsized":"2024-04-26T23:48:04.213458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.217268+0000","last_change":"2024-04-26T23:48:04.217268+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.217268+0000","last_undegraded":"2024-04-26T23:48:04.217268+0000","last_fullsized":"2024-04-26T23:48:04.217268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212650+0000","last_change":"2024-04-26T23:48:04.212650+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212650+0000","last_undegraded":"2024-04-26T23:48:04.212650+0000","last_fullsized":"2024-04-26T23:48:04.212650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212950+0000","last_change":"2024-04-26T23:48:04.212950+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212950+0000","last_undegraded":"2024-04-26T23:48:04.212950+0000","last_fullsized":"2024-04-26T23:48:04.212950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212086+0000","last_change":"2024-04-26T23:48:04.212086+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212086+0000","last_undegraded":"2024-04-26T23:48:04.212086+0000","last_fullsized":"2024-04-26T23:48:04.212086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.217238+0000","last_change":"2024-04-26T23:48:04.217238+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.217238+0000","last_undegraded":"2024-04-26T23:48:04.217238+0000","last_fullsized":"2024-04-26T23:48:04.217238+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212849+0000","last_change":"2024-04-26T23:48:04.212849+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212849+0000","last_undegraded":"2024-04-26T23:48:04.212849+0000","last_fullsized":"2024-04-26T23:48:04.212849+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216765+0000","last_change":"2024-04-26T23:48:04.216765+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216765+0000","last_undegraded":"2024-04-26T23:48:04.216765+0000","last_fullsized":"2024-04-26T23:48:04.216765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213398+0000","last_change":"2024-04-26T23:48:04.213398+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213398+0000","last_undegraded":"2024-04-26T23:48:04.213398+0000","last_fullsized":"2024-04-26T23:48:04.213398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212086+0000","last_change":"2024-04-26T23:48:04.212086+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212086+0000","last_undegraded":"2024-04-26T23:48:04.212086+0000","last_fullsized":"2024-04-26T23:48:04.212086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215835+0000","last_change":"2024-04-26T23:48:04.215835+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215835+0000","last_undegraded":"2024-04-26T23:48:04.215835+0000","last_fullsized":"2024-04-26T23:48:04.215835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212952+0000","last_change":"2024-04-26T23:48:04.212952+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212952+0000","last_undegraded":"2024-04-26T23:48:04.212952+0000","last_fullsized":"2024-04-26T23:48:04.212952+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211188+0000","last_change":"2024-04-26T23:48:04.211188+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211188+0000","last_undegraded":"2024-04-26T23:48:04.211188+0000","last_fullsized":"2024-04-26T23:48:04.211188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208520+0000","last_change":"2024-04-26T23:48:04.208520+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208520+0000","last_undegraded":"2024-04-26T23:48:04.208520+0000","last_fullsized":"2024-04-26T23:48:04.208520+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216777+0000","last_change":"2024-04-26T23:48:04.216777+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216777+0000","last_undegraded":"2024-04-26T23:48:04.216777+0000","last_fullsized":"2024-04-26T23:48:04.216777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212192+0000","last_change":"2024-04-26T23:48:04.212192+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212192+0000","last_undegraded":"2024-04-26T23:48:04.212192+0000","last_fullsized":"2024-04-26T23:48:04.212192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216871+0000","last_change":"2024-04-26T23:48:04.216871+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216871+0000","last_undegraded":"2024-04-26T23:48:04.216871+0000","last_fullsized":"2024-04-26T23:48:04.216871+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.209503+0000","last_change":"2024-04-26T23:48:04.209503+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.209503+0000","last_undegraded":"2024-04-26T23:48:04.209503+0000","last_fullsized":"2024-04-26T23:48:04.209503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206026+0000","last_change":"2024-04-26T23:48:04.206026+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206026+0000","last_undegraded":"2024-04-26T23:48:04.206026+0000","last_fullsized":"2024-04-26T23:48:04.206026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.219508+0000","last_change":"2024-04-26T23:48:04.219508+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.219508+0000","last_undegraded":"2024-04-26T23:48:04.219508+0000","last_fullsized":"2024-04-26T23:48:04.219508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215450+0000","last_change":"2024-04-26T23:48:04.215450+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215450+0000","last_undegraded":"2024-04-26T23:48:04.215450+0000","last_fullsized":"2024-04-26T23:48:04.215450+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.224657+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:04.224657+0000","last_peered":"2024-04-26T23:48:04.224657+0000","last_clean":"2024-04-26T23:48:04.224657+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:04.224657+0000","last_undegraded":"2024-04-26T23:48:04.224657+0000","last_fullsized":"2024-04-26T23:48:04.224657+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:47.598619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206523+0000","last_change":"2024-04-26T23:48:04.206523+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206523+0000","last_undegraded":"2024-04-26T23:48:04.206523+0000","last_fullsized":"2024-04-26T23:48:04.206523+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.217211+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:04.217211+0000","last_peered":"2024-04-26T23:48:04.217211+0000","last_clean":"2024-04-26T23:48:04.217211+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:04.217211+0000","last_undegraded":"2024-04-26T23:48:04.217211+0000","last_fullsized":"2024-04-26T23:48:04.217211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:54.975375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206026+0000","last_change":"2024-04-26T23:48:04.206026+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206026+0000","last_undegraded":"2024-04-26T23:48:04.206026+0000","last_fullsized":"2024-04-26T23:48:04.206026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226422+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:04.226422+0000","last_peered":"2024-04-26T23:48:04.226422+0000","last_clean":"2024-04-26T23:48:04.226422+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:04.226422+0000","last_undegraded":"2024-04-26T23:48:04.226422+0000","last_fullsized":"2024-04-26T23:48:04.226422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:53.056415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211797+0000","last_change":"2024-04-26T23:48:04.211797+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211797+0000","last_undegraded":"2024-04-26T23:48:04.211797+0000","last_fullsized":"2024-04-26T23:48:04.211797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.215958+0000","last_change":"2024-04-26T23:48:04.215958+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215958+0000","last_undegraded":"2024-04-26T23:48:04.215958+0000","last_fullsized":"2024-04-26T23:48:04.215958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227809+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:04.227809+0000","last_peered":"2024-04-26T23:48:04.227809+0000","last_clean":"2024-04-26T23:48:04.227809+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:04.227809+0000","last_undegraded":"2024-04-26T23:48:04.227809+0000","last_fullsized":"2024-04-26T23:48:04.227809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:00.809941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223130+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:04.223130+0000","last_peered":"2024-04-26T23:48:04.223130+0000","last_clean":"2024-04-26T23:48:04.223130+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:04.223130+0000","last_undegraded":"2024-04-26T23:48:04.223130+0000","last_fullsized":"2024-04-26T23:48:04.223130+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:52.827965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214782+0000","last_change":"2024-04-26T23:48:04.214782+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214782+0000","last_undegraded":"2024-04-26T23:48:04.214782+0000","last_fullsized":"2024-04-26T23:48:04.214782+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.205185+0000","last_change":"2024-04-26T23:48:03.205185+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.205185+0000","last_undegraded":"2024-04-26T23:48:03.205185+0000","last_fullsized":"2024-04-26T23:48:03.205185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211624+0000","last_change":"2024-04-26T23:48:04.211624+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211624+0000","last_undegraded":"2024-04-26T23:48:04.211624+0000","last_fullsized":"2024-04-26T23:48:04.211624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227603+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:04.227603+0000","last_peered":"2024-04-26T23:48:04.227603+0000","last_clean":"2024-04-26T23:48:04.227603+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:04.227603+0000","last_undegraded":"2024-04-26T23:48:04.227603+0000","last_fullsized":"2024-04-26T23:48:04.227603+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:54.975375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208433+0000","last_change":"2024-04-26T23:48:04.208433+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208433+0000","last_undegraded":"2024-04-26T23:48:04.208433+0000","last_fullsized":"2024-04-26T23:48:04.208433+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203558+0000","last_change":"2024-04-26T23:48:03.203558+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203558+0000","last_undegraded":"2024-04-26T23:48:03.203558+0000","last_fullsized":"2024-04-26T23:48:03.203558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218103+0000","last_change":"2024-04-26T23:48:04.218103+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218103+0000","last_undegraded":"2024-04-26T23:48:04.218103+0000","last_fullsized":"2024-04-26T23:48:04.218103+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231363+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:04.231363+0000","last_peered":"2024-04-26T23:48:04.231363+0000","last_clean":"2024-04-26T23:48:04.231363+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:04.231363+0000","last_undegraded":"2024-04-26T23:48:04.231363+0000","last_fullsized":"2024-04-26T23:48:04.231363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208245+0000","last_change":"2024-04-26T23:48:04.208245+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208245+0000","last_undegraded":"2024-04-26T23:48:04.208245+0000","last_fullsized":"2024-04-26T23:48:04.208245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.225356+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:04.225356+0000","last_peered":"2024-04-26T23:48:04.225356+0000","last_clean":"2024-04-26T23:48:04.225356+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:04.225356+0000","last_undegraded":"2024-04-26T23:48:04.225356+0000","last_fullsized":"2024-04-26T23:48:04.225356+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:20:57.087193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213193+0000","last_change":"2024-04-26T23:48:04.213193+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213193+0000","last_undegraded":"2024-04-26T23:48:04.213193+0000","last_fullsized":"2024-04-26T23:48:04.213193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.229217+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:04.229217+0000","last_peered":"2024-04-26T23:48:04.229217+0000","last_clean":"2024-04-26T23:48:04.229217+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:04.229217+0000","last_undegraded":"2024-04-26T23:48:04.229217+0000","last_fullsized":"2024-04-26T23:48:04.229217+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226477+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:04.226477+0000","last_peered":"2024-04-26T23:48:04.226477+0000","last_clean":"2024-04-26T23:48:04.226477+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:04.226477+0000","last_undegraded":"2024-04-26T23:48:04.226477+0000","last_fullsized":"2024-04-26T23:48:04.226477+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:36.484543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215675+0000","last_change":"2024-04-26T23:48:04.215675+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215675+0000","last_undegraded":"2024-04-26T23:48:04.215675+0000","last_fullsized":"2024-04-26T23:48:04.215675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228608+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:04.228608+0000","last_peered":"2024-04-26T23:48:04.228608+0000","last_clean":"2024-04-26T23:48:04.228608+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:04.228608+0000","last_undegraded":"2024-04-26T23:48:04.228608+0000","last_fullsized":"2024-04-26T23:48:04.228608+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.209586+0000","last_change":"2024-04-26T23:48:04.209586+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.209586+0000","last_undegraded":"2024-04-26T23:48:04.209586+0000","last_fullsized":"2024-04-26T23:48:04.209586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.204831+0000","last_change":"2024-04-26T23:48:03.204831+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.204831+0000","last_undegraded":"2024-04-26T23:48:03.204831+0000","last_fullsized":"2024-04-26T23:48:03.204831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212518+0000","last_change":"2024-04-26T23:48:04.212518+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212518+0000","last_undegraded":"2024-04-26T23:48:04.212518+0000","last_fullsized":"2024-04-26T23:48:04.212518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226958+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:04.226958+0000","last_peered":"2024-04-26T23:48:04.226958+0000","last_clean":"2024-04-26T23:48:04.226958+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:04.226958+0000","last_undegraded":"2024-04-26T23:48:04.226958+0000","last_fullsized":"2024-04-26T23:48:04.226958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:22.423787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223587+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:04.223587+0000","last_peered":"2024-04-26T23:48:04.223587+0000","last_clean":"2024-04-26T23:48:04.223587+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:04.223587+0000","last_undegraded":"2024-04-26T23:48:04.223587+0000","last_fullsized":"2024-04-26T23:48:04.223587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:12.070544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213725+0000","last_change":"2024-04-26T23:48:04.213725+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213725+0000","last_undegraded":"2024-04-26T23:48:04.213725+0000","last_fullsized":"2024-04-26T23:48:04.213725+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.221652+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:04.221652+0000","last_peered":"2024-04-26T23:48:04.221652+0000","last_clean":"2024-04-26T23:48:04.221652+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:04.221652+0000","last_undegraded":"2024-04-26T23:48:04.221652+0000","last_fullsized":"2024-04-26T23:48:04.221652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:33.820112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218891+0000","last_change":"2024-04-26T23:48:04.218891+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218891+0000","last_undegraded":"2024-04-26T23:48:04.218891+0000","last_fullsized":"2024-04-26T23:48:04.218891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227952+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:04.227952+0000","last_peered":"2024-04-26T23:48:04.227952+0000","last_clean":"2024-04-26T23:48:04.227952+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:04.227952+0000","last_undegraded":"2024-04-26T23:48:04.227952+0000","last_fullsized":"2024-04-26T23:48:04.227952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.219913+0000","last_change":"2024-04-26T23:48:04.219913+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.219913+0000","last_undegraded":"2024-04-26T23:48:04.219913+0000","last_fullsized":"2024-04-26T23:48:04.219913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.215235+0000","last_change":"2024-04-26T23:48:04.215235+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215235+0000","last_undegraded":"2024-04-26T23:48:04.215235+0000","last_fullsized":"2024-04-26T23:48:04.215235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206161+0000","last_change":"2024-04-26T23:48:04.206161+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206161+0000","last_undegraded":"2024-04-26T23:48:04.206161+0000","last_fullsized":"2024-04-26T23:48:04.206161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228908+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:04.228908+0000","last_peered":"2024-04-26T23:48:04.228908+0000","last_clean":"2024-04-26T23:48:04.228908+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:04.228908+0000","last_undegraded":"2024-04-26T23:48:04.228908+0000","last_fullsized":"2024-04-26T23:48:04.228908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:36.484543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208969+0000","last_change":"2024-04-26T23:48:04.208969+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208969+0000","last_undegraded":"2024-04-26T23:48:04.208969+0000","last_fullsized":"2024-04-26T23:48:04.208969+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203562+0000","last_change":"2024-04-26T23:48:03.203562+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203562+0000","last_undegraded":"2024-04-26T23:48:03.203562+0000","last_fullsized":"2024-04-26T23:48:03.203562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.224343+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:04.224343+0000","last_peered":"2024-04-26T23:48:04.224343+0000","last_clean":"2024-04-26T23:48:04.224343+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:04.224343+0000","last_undegraded":"2024-04-26T23:48:04.224343+0000","last_fullsized":"2024-04-26T23:48:04.224343+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:52.827965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214738+0000","last_change":"2024-04-26T23:48:04.214738+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214738+0000","last_undegraded":"2024-04-26T23:48:04.214738+0000","last_fullsized":"2024-04-26T23:48:04.214738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228704+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:04.228704+0000","last_peered":"2024-04-26T23:48:04.228704+0000","last_clean":"2024-04-26T23:48:04.228704+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:04.228704+0000","last_undegraded":"2024-04-26T23:48:04.228704+0000","last_fullsized":"2024-04-26T23:48:04.228704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226180+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:04.226180+0000","last_peered":"2024-04-26T23:48:04.226180+0000","last_clean":"2024-04-26T23:48:04.226180+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:04.226180+0000","last_undegraded":"2024-04-26T23:48:04.226180+0000","last_fullsized":"2024-04-26T23:48:04.226180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.207675+0000","last_change":"2024-04-26T23:48:04.207675+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.207675+0000","last_undegraded":"2024-04-26T23:48:04.207675+0000","last_fullsized":"2024-04-26T23:48:04.207675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.215039+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:04.215039+0000","last_peered":"2024-04-26T23:48:04.215039+0000","last_clean":"2024-04-26T23:48:04.215039+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:04.215039+0000","last_undegraded":"2024-04-26T23:48:04.215039+0000","last_fullsized":"2024-04-26T23:48:04.215039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:47.598619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218406+0000","last_change":"2024-04-26T23:48:04.218406+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218406+0000","last_undegraded":"2024-04-26T23:48:04.218406+0000","last_fullsized":"2024-04-26T23:48:04.218406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231097+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:04.231097+0000","last_peered":"2024-04-26T23:48:04.231097+0000","last_clean":"2024-04-26T23:48:04.231097+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:04.231097+0000","last_undegraded":"2024-04-26T23:48:04.231097+0000","last_fullsized":"2024-04-26T23:48:04.231097+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:38.642110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216326+0000","last_change":"2024-04-26T23:48:04.216326+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216326+0000","last_undegraded":"2024-04-26T23:48:04.216326+0000","last_fullsized":"2024-04-26T23:48:04.216326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231032+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:04.231032+0000","last_peered":"2024-04-26T23:48:04.231032+0000","last_clean":"2024-04-26T23:48:04.231032+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:04.231032+0000","last_undegraded":"2024-04-26T23:48:04.231032+0000","last_fullsized":"2024-04-26T23:48:04.231032+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.205879+0000","last_change":"2024-04-26T23:48:04.205879+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.205879+0000","last_undegraded":"2024-04-26T23:48:04.205879+0000","last_fullsized":"2024-04-26T23:48:04.205879+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223933+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:04.223933+0000","last_peered":"2024-04-26T23:48:04.223933+0000","last_clean":"2024-04-26T23:48:04.223933+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:04.223933+0000","last_undegraded":"2024-04-26T23:48:04.223933+0000","last_fullsized":"2024-04-26T23:48:04.223933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:00.809941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211076+0000","last_change":"2024-04-26T23:48:04.211076+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211076+0000","last_undegraded":"2024-04-26T23:48:04.211076+0000","last_fullsized":"2024-04-26T23:48:04.211076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203473+0000","last_change":"2024-04-26T23:48:03.203473+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203473+0000","last_undegraded":"2024-04-26T23:48:03.203473+0000","last_fullsized":"2024-04-26T23:48:03.203473+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226769+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:04.226769+0000","last_peered":"2024-04-26T23:48:04.226769+0000","last_clean":"2024-04-26T23:48:04.226769+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:04.226769+0000","last_undegraded":"2024-04-26T23:48:04.226769+0000","last_fullsized":"2024-04-26T23:48:04.226769+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:53.056415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":213,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.207344+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:04.207344+0000","last_peered":"2024-04-26T23:48:04.207344+0000","last_clean":"2024-04-26T23:48:04.207344+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:04.207344+0000","last_undegraded":"2024-04-26T23:48:04.207344+0000","last_fullsized":"2024-04-26T23:48:04.207344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":803366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":544768,"data_stored":219265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1114112,"data_stored":797549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:09.771 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:09.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50fa00640 1 Processor -- start 2024-04-26T23:48:09.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50fa00640 1 -- start start 2024-04-26T23:48:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50fa00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff5080d1860 0x7ff508167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50fa00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5080cd830 con 0x7ff508160810 2024-04-26T23:48:09.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50fa00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff508071080 con 0x7ff508072150 2024-04-26T23:48:09.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50fa00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff508071360 con 0x7ff5080d1860 2024-04-26T23:48:09.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50d000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff508160810 0x7ff508071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37304/0 (socket says 172.21.15.47:37304) 2024-04-26T23:48:09.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50d000640 1 -- 172.21.15.47:0/2696214225 learned_addr learned my addr 172.21.15.47:0/2696214225 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff50da00640 1 --2- 172.21.15.47:0/2696214225 >> v2:172.21.15.203:3300/0 conn(0x7ff5080d1860 0x7ff508167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215332851 0 0) 0x7ff5080cd830 con 0x7ff508160810 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4ec003530 con 0x7ff508160810 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.942+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2367699967 0 0) 0x7ff4ec003530 con 0x7ff508160810 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 >> v2:172.21.15.203:3300/0 conn(0x7ff5080d1860 msgr2=0x7ff508167fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 --2- 172.21.15.47:0/2696214225 >> v2:172.21.15.203:3300/0 conn(0x7ff5080d1860 0x7ff508167fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 >> v1:172.21.15.203:6789/0 conn(0x7ff508072150 legacy=0x7ff5080d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080cdad0 con 0x7ff508160810 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7ff4f8001680 con 0x7ff508160810 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 >> v1:172.21.15.47:6789/0 conn(0x7ff508160810 legacy=0x7ff508071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec0039c0 0x7ff4ec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec0043c0 0x7ff4ec004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec005090 0x7ff4ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff508071360 con 0x7ff4ec005090 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff4ec00bf40 con 0x7ff4ec0043c0 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec00c140 con 0x7ff4ec0039c0 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec005090 0x7ff4ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50d000640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec0039c0 0x7ff4ec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff4ffe00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec0043c0 0x7ff4ec004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 -- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec0039c0 msgr2=0x7ff4ec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec0039c0 0x7ff4ec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 -- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec0043c0 msgr2=0x7ff4ec004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec0043c0 0x7ff4ec004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 -- 172.21.15.47:0/2696214225 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec003530 con 0x7ff4ec005090 2024-04-26T23:48:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 -- 172.21.15.47:0/2696214225 reap_dead start 2024-04-26T23:48:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.946+0000 7ff50da00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec005090 0x7ff4ec00b9d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff500009f90 tx=0x7ff50001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402be4c302c131ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.954 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500009c10 con 0x7ff4ec005090 2024-04-26T23:48:09.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5000a5c90 con 0x7ff4ec005090 2024-04-26T23:48:09.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff507e00640 1 -- 172.21.15.47:0/2696214225 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500003be0 con 0x7ff4ec005090 2024-04-26T23:48:09.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- 172.21.15.47:0/2696214225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec005090 msgr2=0x7ff4ec00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.955 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec005090 0x7ff4ec00b9d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff500009f90 tx=0x7ff50001cc80 comp rx=0 tx=0).stop 2024-04-26T23:48:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- 172.21.15.47:0/2696214225 shutdown_connections 2024-04-26T23:48:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 --2- 172.21.15.47:0/2696214225 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec005090 0x7ff4ec00b9d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- 172.21.15.47:0/2696214225 >> 172.21.15.47:0/2696214225 conn(0x7ff5080d2e90 msgr2=0x7ff5080d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- 172.21.15.47:0/2696214225 shutdown_connections 2024-04-26T23:48:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- 172.21.15.47:0/2696214225 wait complete. 2024-04-26T23:48:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 Processor -- start 2024-04-26T23:48:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- start start 2024-04-26T23:48:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec005090 0x7ff5081f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5080cf9e0 0x7ff508151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff508151640 0x7ff508151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff508160d70 con 0x7ff5080cf9e0 2024-04-26T23:48:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff508160bf0 con 0x7ff508151640 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff50fa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff5080d1150 con 0x7ff4ec005090 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff4ffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5080cf9e0 0x7ff508151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff4ffe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5080cf9e0 0x7ff508151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:43998/0 (socket says 172.21.15.47:43998) 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.950+0000 7ff4ffe00640 1 -- 172.21.15.47:0/1929985561 learned_addr learned my addr 172.21.15.47:0/1929985561 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff50d000640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec005090 0x7ff5081f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff50da00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff508151640 0x7ff508151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff4ffe00640 1 -- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec005090 msgr2=0x7ff5081f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff4ffe00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec005090 0x7ff5081f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff4ffe00640 1 -- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff508151640 msgr2=0x7ff508151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff4ffe00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff508151640 0x7ff508151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff4ffe00640 1 -- 172.21.15.47:0/1929985561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080cff10 con 0x7ff5080cf9e0 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff4ffe00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5080cf9e0 0x7ff508151100 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000f7f0 tx=0x7ff4f000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff505600640 1 -- 172.21.15.47:0/1929985561 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000fea0 con 0x7ff5080cf9e0 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff505600640 1 -- 172.21.15.47:0/1929985561 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f0018070 con 0x7ff5080cf9e0 2024-04-26T23:48:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff505600640 1 -- 172.21.15.47:0/1929985561 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f000d730 con 0x7ff5080cf9e0 2024-04-26T23:48:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5080d01f0 con 0x7ff5080cf9e0 2024-04-26T23:48:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5080d07b0 con 0x7ff5080cf9e0 2024-04-26T23:48:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff508069700 con 0x7ff5080cf9e0 2024-04-26T23:48:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff505600640 1 -- 172.21.15.47:0/1929985561 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff4f000d8d0 con 0x7ff5080cf9e0 2024-04-26T23:48:09.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff505600640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068650 0x7ff4e406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:09.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.954+0000 7ff505600640 1 -- 172.21.15.47:0/1929985561 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7ff4f0086c60 con 0x7ff5080cf9e0 2024-04-26T23:48:09.962 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.958+0000 7ff50d000640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068650 0x7ff4e406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:09.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.958+0000 7ff50d000640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068650 0x7ff4e406ab10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c10 tx=0x7ff4f8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:09.966 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:09.958+0000 7ff505600640 1 -- 172.21.15.47:0/1929985561 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff4f0056f20 con 0x7ff5080cf9e0 2024-04-26T23:48:10.127 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.122+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5080d0f90 con 0x7ff4e4068650 2024-04-26T23:48:10.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.126+0000 7ff505600640 1 -- 172.21.15.47:0/1929985561 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245317 (secure 0 0 0) 0x7ff4f8007030 con 0x7ff4e4068650 2024-04-26T23:48:10.136 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:10.137 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:10.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068650 msgr2=0x7ff4e406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068650 0x7ff4e406ab10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8000c10 tx=0x7ff4f8009040 comp rx=0 tx=0).stop 2024-04-26T23:48:10.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5080cf9e0 msgr2=0x7ff508151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5080cf9e0 0x7ff508151100 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000f7f0 tx=0x7ff4f000fcb0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 shutdown_connections 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068650 0x7ff4e406ab10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff508151640 0x7ff508151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff5080cf9e0 0x7ff508151100 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 --2- 172.21.15.47:0/1929985561 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff4ec005090 0x7ff5081f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 >> 172.21.15.47:0/1929985561 conn(0x7ff5080d2e90 msgr2=0x7ff5080b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 shutdown_connections 2024-04-26T23:48:10.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.130+0000 7ff50fa00640 1 -- 172.21.15.47:0/1929985561 wait complete. 2024-04-26T23:48:10.157 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-04-26T23:48:08.190536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238152,"kb_used_data":5320,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736568,"statfs":{"total":773094113280,"available":772850245632,"internally_reserved":0,"allocated":5447680,"data_stored":2885170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.994676"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208885+0000","last_change":"2024-04-26T23:48:04.208885+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208885+0000","last_undegraded":"2024-04-26T23:48:04.208885+0000","last_fullsized":"2024-04-26T23:48:04.208885+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206516+0000","last_change":"2024-04-26T23:48:04.206516+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206516+0000","last_undegraded":"2024-04-26T23:48:04.206516+0000","last_fullsized":"2024-04-26T23:48:04.206516+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214093+0000","last_change":"2024-04-26T23:48:04.214093+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214093+0000","last_undegraded":"2024-04-26T23:48:04.214093+0000","last_fullsized":"2024-04-26T23:48:04.214093+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.205963+0000","last_change":"2024-04-26T23:48:04.205963+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.205963+0000","last_undegraded":"2024-04-26T23:48:04.205963+0000","last_fullsized":"2024-04-26T23:48:04.205963+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.220383+0000","last_change":"2024-04-26T23:48:04.220383+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.220383+0000","last_undegraded":"2024-04-26T23:48:04.220383+0000","last_fullsized":"2024-04-26T23:48:04.220383+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.210811+0000","last_change":"2024-04-26T23:48:04.210811+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.210811+0000","last_undegraded":"2024-04-26T23:48:04.210811+0000","last_fullsized":"2024-04-26T23:48:04.210811+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208962+0000","last_change":"2024-04-26T23:48:04.208962+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208962+0000","last_undegraded":"2024-04-26T23:48:04.208962+0000","last_fullsized":"2024-04-26T23:48:04.208962+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213458+0000","last_change":"2024-04-26T23:48:04.213458+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213458+0000","last_undegraded":"2024-04-26T23:48:04.213458+0000","last_fullsized":"2024-04-26T23:48:04.213458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.217268+0000","last_change":"2024-04-26T23:48:04.217268+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.217268+0000","last_undegraded":"2024-04-26T23:48:04.217268+0000","last_fullsized":"2024-04-26T23:48:04.217268+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212650+0000","last_change":"2024-04-26T23:48:04.212650+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212650+0000","last_undegraded":"2024-04-26T23:48:04.212650+0000","last_fullsized":"2024-04-26T23:48:04.212650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212950+0000","last_change":"2024-04-26T23:48:04.212950+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212950+0000","last_undegraded":"2024-04-26T23:48:04.212950+0000","last_fullsized":"2024-04-26T23:48:04.212950+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212086+0000","last_change":"2024-04-26T23:48:04.212086+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212086+0000","last_undegraded":"2024-04-26T23:48:04.212086+0000","last_fullsized":"2024-04-26T23:48:04.212086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.217238+0000","last_change":"2024-04-26T23:48:04.217238+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.217238+0000","last_undegraded":"2024-04-26T23:48:04.217238+0000","last_fullsized":"2024-04-26T23:48:04.217238+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212849+0000","last_change":"2024-04-26T23:48:04.212849+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212849+0000","last_undegraded":"2024-04-26T23:48:04.212849+0000","last_fullsized":"2024-04-26T23:48:04.212849+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216765+0000","last_change":"2024-04-26T23:48:04.216765+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216765+0000","last_undegraded":"2024-04-26T23:48:04.216765+0000","last_fullsized":"2024-04-26T23:48:04.216765+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213398+0000","last_change":"2024-04-26T23:48:04.213398+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213398+0000","last_undegraded":"2024-04-26T23:48:04.213398+0000","last_fullsized":"2024-04-26T23:48:04.213398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212086+0000","last_change":"2024-04-26T23:48:04.212086+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212086+0000","last_undegraded":"2024-04-26T23:48:04.212086+0000","last_fullsized":"2024-04-26T23:48:04.212086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215835+0000","last_change":"2024-04-26T23:48:04.215835+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215835+0000","last_undegraded":"2024-04-26T23:48:04.215835+0000","last_fullsized":"2024-04-26T23:48:04.215835+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212952+0000","last_change":"2024-04-26T23:48:04.212952+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212952+0000","last_undegraded":"2024-04-26T23:48:04.212952+0000","last_fullsized":"2024-04-26T23:48:04.212952+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211188+0000","last_change":"2024-04-26T23:48:04.211188+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211188+0000","last_undegraded":"2024-04-26T23:48:04.211188+0000","last_fullsized":"2024-04-26T23:48:04.211188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208520+0000","last_change":"2024-04-26T23:48:04.208520+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208520+0000","last_undegraded":"2024-04-26T23:48:04.208520+0000","last_fullsized":"2024-04-26T23:48:04.208520+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216777+0000","last_change":"2024-04-26T23:48:04.216777+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216777+0000","last_undegraded":"2024-04-26T23:48:04.216777+0000","last_fullsized":"2024-04-26T23:48:04.216777+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212192+0000","last_change":"2024-04-26T23:48:04.212192+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212192+0000","last_undegraded":"2024-04-26T23:48:04.212192+0000","last_fullsized":"2024-04-26T23:48:04.212192+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216871+0000","last_change":"2024-04-26T23:48:04.216871+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216871+0000","last_undegraded":"2024-04-26T23:48:04.216871+0000","last_fullsized":"2024-04-26T23:48:04.216871+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.209503+0000","last_change":"2024-04-26T23:48:04.209503+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.209503+0000","last_undegraded":"2024-04-26T23:48:04.209503+0000","last_fullsized":"2024-04-26T23:48:04.209503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206026+0000","last_change":"2024-04-26T23:48:04.206026+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206026+0000","last_undegraded":"2024-04-26T23:48:04.206026+0000","last_fullsized":"2024-04-26T23:48:04.206026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.219508+0000","last_change":"2024-04-26T23:48:04.219508+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.219508+0000","last_undegraded":"2024-04-26T23:48:04.219508+0000","last_fullsized":"2024-04-26T23:48:04.219508+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215450+0000","last_change":"2024-04-26T23:48:04.215450+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215450+0000","last_undegraded":"2024-04-26T23:48:04.215450+0000","last_fullsized":"2024-04-26T23:48:04.215450+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.224657+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:04.224657+0000","last_peered":"2024-04-26T23:48:04.224657+0000","last_clean":"2024-04-26T23:48:04.224657+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:04.224657+0000","last_undegraded":"2024-04-26T23:48:04.224657+0000","last_fullsized":"2024-04-26T23:48:04.224657+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:47.598619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206523+0000","last_change":"2024-04-26T23:48:04.206523+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206523+0000","last_undegraded":"2024-04-26T23:48:04.206523+0000","last_fullsized":"2024-04-26T23:48:04.206523+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.217211+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:04.217211+0000","last_peered":"2024-04-26T23:48:04.217211+0000","last_clean":"2024-04-26T23:48:04.217211+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:04.217211+0000","last_undegraded":"2024-04-26T23:48:04.217211+0000","last_fullsized":"2024-04-26T23:48:04.217211+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:54.975375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206026+0000","last_change":"2024-04-26T23:48:04.206026+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206026+0000","last_undegraded":"2024-04-26T23:48:04.206026+0000","last_fullsized":"2024-04-26T23:48:04.206026+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226422+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:04.226422+0000","last_peered":"2024-04-26T23:48:04.226422+0000","last_clean":"2024-04-26T23:48:04.226422+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:04.226422+0000","last_undegraded":"2024-04-26T23:48:04.226422+0000","last_fullsized":"2024-04-26T23:48:04.226422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:53.056415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211797+0000","last_change":"2024-04-26T23:48:04.211797+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211797+0000","last_undegraded":"2024-04-26T23:48:04.211797+0000","last_fullsized":"2024-04-26T23:48:04.211797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.215958+0000","last_change":"2024-04-26T23:48:04.215958+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215958+0000","last_undegraded":"2024-04-26T23:48:04.215958+0000","last_fullsized":"2024-04-26T23:48:04.215958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227809+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:04.227809+0000","last_peered":"2024-04-26T23:48:04.227809+0000","last_clean":"2024-04-26T23:48:04.227809+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:04.227809+0000","last_undegraded":"2024-04-26T23:48:04.227809+0000","last_fullsized":"2024-04-26T23:48:04.227809+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:00.809941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223130+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:04.223130+0000","last_peered":"2024-04-26T23:48:04.223130+0000","last_clean":"2024-04-26T23:48:04.223130+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:04.223130+0000","last_undegraded":"2024-04-26T23:48:04.223130+0000","last_fullsized":"2024-04-26T23:48:04.223130+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:52.827965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214782+0000","last_change":"2024-04-26T23:48:04.214782+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214782+0000","last_undegraded":"2024-04-26T23:48:04.214782+0000","last_fullsized":"2024-04-26T23:48:04.214782+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.205185+0000","last_change":"2024-04-26T23:48:03.205185+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.205185+0000","last_undegraded":"2024-04-26T23:48:03.205185+0000","last_fullsized":"2024-04-26T23:48:03.205185+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211624+0000","last_change":"2024-04-26T23:48:04.211624+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211624+0000","last_undegraded":"2024-04-26T23:48:04.211624+0000","last_fullsized":"2024-04-26T23:48:04.211624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227603+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:04.227603+0000","last_peered":"2024-04-26T23:48:04.227603+0000","last_clean":"2024-04-26T23:48:04.227603+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:04.227603+0000","last_undegraded":"2024-04-26T23:48:04.227603+0000","last_fullsized":"2024-04-26T23:48:04.227603+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:54.975375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208433+0000","last_change":"2024-04-26T23:48:04.208433+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208433+0000","last_undegraded":"2024-04-26T23:48:04.208433+0000","last_fullsized":"2024-04-26T23:48:04.208433+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203558+0000","last_change":"2024-04-26T23:48:03.203558+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203558+0000","last_undegraded":"2024-04-26T23:48:03.203558+0000","last_fullsized":"2024-04-26T23:48:03.203558+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218103+0000","last_change":"2024-04-26T23:48:04.218103+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218103+0000","last_undegraded":"2024-04-26T23:48:04.218103+0000","last_fullsized":"2024-04-26T23:48:04.218103+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231363+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:04.231363+0000","last_peered":"2024-04-26T23:48:04.231363+0000","last_clean":"2024-04-26T23:48:04.231363+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:04.231363+0000","last_undegraded":"2024-04-26T23:48:04.231363+0000","last_fullsized":"2024-04-26T23:48:04.231363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208245+0000","last_change":"2024-04-26T23:48:04.208245+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208245+0000","last_undegraded":"2024-04-26T23:48:04.208245+0000","last_fullsized":"2024-04-26T23:48:04.208245+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.225356+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:04.225356+0000","last_peered":"2024-04-26T23:48:04.225356+0000","last_clean":"2024-04-26T23:48:04.225356+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:04.225356+0000","last_undegraded":"2024-04-26T23:48:04.225356+0000","last_fullsized":"2024-04-26T23:48:04.225356+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:20:57.087193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213193+0000","last_change":"2024-04-26T23:48:04.213193+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213193+0000","last_undegraded":"2024-04-26T23:48:04.213193+0000","last_fullsized":"2024-04-26T23:48:04.213193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.229217+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:04.229217+0000","last_peered":"2024-04-26T23:48:04.229217+0000","last_clean":"2024-04-26T23:48:04.229217+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:04.229217+0000","last_undegraded":"2024-04-26T23:48:04.229217+0000","last_fullsized":"2024-04-26T23:48:04.229217+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226477+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:04.226477+0000","last_peered":"2024-04-26T23:48:04.226477+0000","last_clean":"2024-04-26T23:48:04.226477+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:04.226477+0000","last_undegraded":"2024-04-26T23:48:04.226477+0000","last_fullsized":"2024-04-26T23:48:04.226477+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:36.484543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.215675+0000","last_change":"2024-04-26T23:48:04.215675+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215675+0000","last_undegraded":"2024-04-26T23:48:04.215675+0000","last_fullsized":"2024-04-26T23:48:04.215675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228608+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:04.228608+0000","last_peered":"2024-04-26T23:48:04.228608+0000","last_clean":"2024-04-26T23:48:04.228608+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:04.228608+0000","last_undegraded":"2024-04-26T23:48:04.228608+0000","last_fullsized":"2024-04-26T23:48:04.228608+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.209586+0000","last_change":"2024-04-26T23:48:04.209586+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.209586+0000","last_undegraded":"2024-04-26T23:48:04.209586+0000","last_fullsized":"2024-04-26T23:48:04.209586+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.204831+0000","last_change":"2024-04-26T23:48:03.204831+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.204831+0000","last_undegraded":"2024-04-26T23:48:03.204831+0000","last_fullsized":"2024-04-26T23:48:03.204831+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.212518+0000","last_change":"2024-04-26T23:48:04.212518+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.212518+0000","last_undegraded":"2024-04-26T23:48:04.212518+0000","last_fullsized":"2024-04-26T23:48:04.212518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226958+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:04.226958+0000","last_peered":"2024-04-26T23:48:04.226958+0000","last_clean":"2024-04-26T23:48:04.226958+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:04.226958+0000","last_undegraded":"2024-04-26T23:48:04.226958+0000","last_fullsized":"2024-04-26T23:48:04.226958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:12:22.423787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223587+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:04.223587+0000","last_peered":"2024-04-26T23:48:04.223587+0000","last_clean":"2024-04-26T23:48:04.223587+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:04.223587+0000","last_undegraded":"2024-04-26T23:48:04.223587+0000","last_fullsized":"2024-04-26T23:48:04.223587+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:12.070544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.213725+0000","last_change":"2024-04-26T23:48:04.213725+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.213725+0000","last_undegraded":"2024-04-26T23:48:04.213725+0000","last_fullsized":"2024-04-26T23:48:04.213725+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.221652+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:04.221652+0000","last_peered":"2024-04-26T23:48:04.221652+0000","last_clean":"2024-04-26T23:48:04.221652+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:04.221652+0000","last_undegraded":"2024-04-26T23:48:04.221652+0000","last_fullsized":"2024-04-26T23:48:04.221652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:36:33.820112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218891+0000","last_change":"2024-04-26T23:48:04.218891+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218891+0000","last_undegraded":"2024-04-26T23:48:04.218891+0000","last_fullsized":"2024-04-26T23:48:04.218891+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.227952+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:04.227952+0000","last_peered":"2024-04-26T23:48:04.227952+0000","last_clean":"2024-04-26T23:48:04.227952+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:04.227952+0000","last_undegraded":"2024-04-26T23:48:04.227952+0000","last_fullsized":"2024-04-26T23:48:04.227952+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.219913+0000","last_change":"2024-04-26T23:48:04.219913+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.219913+0000","last_undegraded":"2024-04-26T23:48:04.219913+0000","last_fullsized":"2024-04-26T23:48:04.219913+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":3,"reported_epoch":47,"state":"creating+activating","last_fresh":"2024-04-26T23:48:04.215235+0000","last_change":"2024-04-26T23:48:04.215235+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.215235+0000","last_undegraded":"2024-04-26T23:48:04.215235+0000","last_fullsized":"2024-04-26T23:48:04.215235+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.206161+0000","last_change":"2024-04-26T23:48:04.206161+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.206161+0000","last_undegraded":"2024-04-26T23:48:04.206161+0000","last_fullsized":"2024-04-26T23:48:04.206161+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228908+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:04.228908+0000","last_peered":"2024-04-26T23:48:04.228908+0000","last_clean":"2024-04-26T23:48:04.228908+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:04.228908+0000","last_undegraded":"2024-04-26T23:48:04.228908+0000","last_fullsized":"2024-04-26T23:48:04.228908+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:00:36.484543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.208969+0000","last_change":"2024-04-26T23:48:04.208969+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.208969+0000","last_undegraded":"2024-04-26T23:48:04.208969+0000","last_fullsized":"2024-04-26T23:48:04.208969+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203562+0000","last_change":"2024-04-26T23:48:03.203562+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203562+0000","last_undegraded":"2024-04-26T23:48:03.203562+0000","last_fullsized":"2024-04-26T23:48:03.203562+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.224343+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:04.224343+0000","last_peered":"2024-04-26T23:48:04.224343+0000","last_clean":"2024-04-26T23:48:04.224343+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:04.224343+0000","last_undegraded":"2024-04-26T23:48:04.224343+0000","last_fullsized":"2024-04-26T23:48:04.224343+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:17:52.827965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.214738+0000","last_change":"2024-04-26T23:48:04.214738+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.214738+0000","last_undegraded":"2024-04-26T23:48:04.214738+0000","last_fullsized":"2024-04-26T23:48:04.214738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.228704+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:04.228704+0000","last_peered":"2024-04-26T23:48:04.228704+0000","last_clean":"2024-04-26T23:48:04.228704+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:04.228704+0000","last_undegraded":"2024-04-26T23:48:04.228704+0000","last_fullsized":"2024-04-26T23:48:04.228704+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226180+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:04.226180+0000","last_peered":"2024-04-26T23:48:04.226180+0000","last_clean":"2024-04-26T23:48:04.226180+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:04.226180+0000","last_undegraded":"2024-04-26T23:48:04.226180+0000","last_fullsized":"2024-04-26T23:48:04.226180+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.207675+0000","last_change":"2024-04-26T23:48:04.207675+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.207675+0000","last_undegraded":"2024-04-26T23:48:04.207675+0000","last_fullsized":"2024-04-26T23:48:04.207675+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.215039+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:04.215039+0000","last_peered":"2024-04-26T23:48:04.215039+0000","last_clean":"2024-04-26T23:48:04.215039+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:04.215039+0000","last_undegraded":"2024-04-26T23:48:04.215039+0000","last_fullsized":"2024-04-26T23:48:04.215039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:47.598619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.218406+0000","last_change":"2024-04-26T23:48:04.218406+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.218406+0000","last_undegraded":"2024-04-26T23:48:04.218406+0000","last_fullsized":"2024-04-26T23:48:04.218406+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231097+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:04.231097+0000","last_peered":"2024-04-26T23:48:04.231097+0000","last_clean":"2024-04-26T23:48:04.231097+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:04.231097+0000","last_undegraded":"2024-04-26T23:48:04.231097+0000","last_fullsized":"2024-04-26T23:48:04.231097+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:38.642110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.216326+0000","last_change":"2024-04-26T23:48:04.216326+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.216326+0000","last_undegraded":"2024-04-26T23:48:04.216326+0000","last_fullsized":"2024-04-26T23:48:04.216326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.231032+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:04.231032+0000","last_peered":"2024-04-26T23:48:04.231032+0000","last_clean":"2024-04-26T23:48:04.231032+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:04.231032+0000","last_undegraded":"2024-04-26T23:48:04.231032+0000","last_fullsized":"2024-04-26T23:48:04.231032+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.205879+0000","last_change":"2024-04-26T23:48:04.205879+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.205879+0000","last_undegraded":"2024-04-26T23:48:04.205879+0000","last_fullsized":"2024-04-26T23:48:04.205879+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.223933+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:04.223933+0000","last_peered":"2024-04-26T23:48:04.223933+0000","last_clean":"2024-04-26T23:48:04.223933+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:04.223933+0000","last_undegraded":"2024-04-26T23:48:04.223933+0000","last_fullsized":"2024-04-26T23:48:04.223933+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:00.809941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2024-04-26T23:48:04.211076+0000","last_change":"2024-04-26T23:48:04.211076+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.211076+0000","last_undegraded":"2024-04-26T23:48:04.211076+0000","last_fullsized":"2024-04-26T23:48:04.211076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":46,"state":"creating+peering","last_fresh":"2024-04-26T23:48:03.203473+0000","last_change":"2024-04-26T23:48:03.203473+0000","last_active":"2024-04-26T23:48:03.187504+0000","last_peered":"2024-04-26T23:48:03.187504+0000","last_clean":"2024-04-26T23:48:03.187504+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:03.203473+0000","last_undegraded":"2024-04-26T23:48:03.203473+0000","last_fullsized":"2024-04-26T23:48:03.203473+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T23:48:04.193819+0000","last_change":"2024-04-26T23:48:04.193819+0000","last_active":"2024-04-26T23:48:04.193819+0000","last_peered":"2024-04-26T23:48:04.193819+0000","last_clean":"2024-04-26T23:48:04.193819+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T23:48:04.193819+0000","last_undegraded":"2024-04-26T23:48:04.193819+0000","last_fullsized":"2024-04-26T23:48:04.193819+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.226769+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:04.226769+0000","last_peered":"2024-04-26T23:48:04.226769+0000","last_clean":"2024-04-26T23:48:04.226769+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:04.226769+0000","last_undegraded":"2024-04-26T23:48:04.226769+0000","last_fullsized":"2024-04-26T23:48:04.226769+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:53.056415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":213,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-04-26T23:48:04.207344+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:04.207344+0000","last_peered":"2024-04-26T23:48:04.207344+0000","last_clean":"2024-04-26T23:48:04.207344+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:04.207344+0000","last_undegraded":"2024-04-26T23:48:04.207344+0000","last_fullsized":"2024-04-26T23:48:04.207344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509476,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1126400,"data_stored":803366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":544768,"data_stored":219265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509475,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509476,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509475,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":532480,"data_stored":212998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32272,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339568,"statfs":{"total":96636764160,"available":96603717632,"internally_reserved":0,"allocated":1114112,"data_stored":797549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.208885+0000', 'last_change': '2024-04-26T23:48:04.208885+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.208885+0000', 'last_undegraded': '2024-04-26T23:48:04.208885+0000', 'last_fullsized': '2024-04-26T23:48:04.208885+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.206516+0000', 'last_change': '2024-04-26T23:48:04.206516+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.206516+0000', 'last_undegraded': '2024-04-26T23:48:04.206516+0000', 'last_fullsized': '2024-04-26T23:48:04.206516+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.214093+0000', 'last_change': '2024-04-26T23:48:04.214093+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.214093+0000', 'last_undegraded': '2024-04-26T23:48:04.214093+0000', 'last_fullsized': '2024-04-26T23:48:04.214093+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-04-26T23:48:10.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.205963+0000', 'last_change': '2024-04-26T23:48:04.205963+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.205963+0000', 'last_undegraded': '2024-04-26T23:48:04.205963+0000', 'last_fullsized': '2024-04-26T23:48:04.205963+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.220383+0000', 'last_change': '2024-04-26T23:48:04.220383+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.220383+0000', 'last_undegraded': '2024-04-26T23:48:04.220383+0000', 'last_fullsized': '2024-04-26T23:48:04.220383+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.210811+0000', 'last_change': '2024-04-26T23:48:04.210811+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.210811+0000', 'last_undegraded': '2024-04-26T23:48:04.210811+0000', 'last_fullsized': '2024-04-26T23:48:04.210811+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-04-26T23:48:10.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.208962+0000', 'last_change': '2024-04-26T23:48:04.208962+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.208962+0000', 'last_undegraded': '2024-04-26T23:48:04.208962+0000', 'last_fullsized': '2024-04-26T23:48:04.208962+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.213458+0000', 'last_change': '2024-04-26T23:48:04.213458+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.213458+0000', 'last_undegraded': '2024-04-26T23:48:04.213458+0000', 'last_fullsized': '2024-04-26T23:48:04.213458+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-04-26T23:48:10.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.217268+0000', 'last_change': '2024-04-26T23:48:04.217268+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.217268+0000', 'last_undegraded': '2024-04-26T23:48:04.217268+0000', 'last_fullsized': '2024-04-26T23:48:04.217268+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212650+0000', 'last_change': '2024-04-26T23:48:04.212650+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212650+0000', 'last_undegraded': '2024-04-26T23:48:04.212650+0000', 'last_fullsized': '2024-04-26T23:48:04.212650+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212950+0000', 'last_change': '2024-04-26T23:48:04.212950+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212950+0000', 'last_undegraded': '2024-04-26T23:48:04.212950+0000', 'last_fullsized': '2024-04-26T23:48:04.212950+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212086+0000', 'last_change': '2024-04-26T23:48:04.212086+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212086+0000', 'last_undegraded': '2024-04-26T23:48:04.212086+0000', 'last_fullsized': '2024-04-26T23:48:04.212086+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.217238+0000', 'last_change': '2024-04-26T23:48:04.217238+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.217238+0000', 'last_undegraded': '2024-04-26T23:48:04.217238+0000', 'last_fullsized': '2024-04-26T23:48:04.217238+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212849+0000', 'last_change': '2024-04-26T23:48:04.212849+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212849+0000', 'last_undegraded': '2024-04-26T23:48:04.212849+0000', 'last_fullsized': '2024-04-26T23:48:04.212849+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-04-26T23:48:10.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.216765+0000', 'last_change': '2024-04-26T23:48:04.216765+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.216765+0000', 'last_undegraded': '2024-04-26T23:48:04.216765+0000', 'last_fullsized': '2024-04-26T23:48:04.216765+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.213398+0000', 'last_change': '2024-04-26T23:48:04.213398+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.213398+0000', 'last_undegraded': '2024-04-26T23:48:04.213398+0000', 'last_fullsized': '2024-04-26T23:48:04.213398+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212086+0000', 'last_change': '2024-04-26T23:48:04.212086+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212086+0000', 'last_undegraded': '2024-04-26T23:48:04.212086+0000', 'last_fullsized': '2024-04-26T23:48:04.212086+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.215835+0000', 'last_change': '2024-04-26T23:48:04.215835+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.215835+0000', 'last_undegraded': '2024-04-26T23:48:04.215835+0000', 'last_fullsized': '2024-04-26T23:48:04.215835+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-04-26T23:48:10.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212952+0000', 'last_change': '2024-04-26T23:48:04.212952+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212952+0000', 'last_undegraded': '2024-04-26T23:48:04.212952+0000', 'last_fullsized': '2024-04-26T23:48:04.212952+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.211188+0000', 'last_change': '2024-04-26T23:48:04.211188+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.211188+0000', 'last_undegraded': '2024-04-26T23:48:04.211188+0000', 'last_fullsized': '2024-04-26T23:48:04.211188+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.208520+0000', 'last_change': '2024-04-26T23:48:04.208520+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.208520+0000', 'last_undegraded': '2024-04-26T23:48:04.208520+0000', 'last_fullsized': '2024-04-26T23:48:04.208520+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.216777+0000', 'last_change': '2024-04-26T23:48:04.216777+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.216777+0000', 'last_undegraded': '2024-04-26T23:48:04.216777+0000', 'last_fullsized': '2024-04-26T23:48:04.216777+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212192+0000', 'last_change': '2024-04-26T23:48:04.212192+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212192+0000', 'last_undegraded': '2024-04-26T23:48:04.212192+0000', 'last_fullsized': '2024-04-26T23:48:04.212192+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-04-26T23:48:10.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.216871+0000', 'last_change': '2024-04-26T23:48:04.216871+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.216871+0000', 'last_undegraded': '2024-04-26T23:48:04.216871+0000', 'last_fullsized': '2024-04-26T23:48:04.216871+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.209503+0000', 'last_change': '2024-04-26T23:48:04.209503+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.209503+0000', 'last_undegraded': '2024-04-26T23:48:04.209503+0000', 'last_fullsized': '2024-04-26T23:48:04.209503+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.206026+0000', 'last_change': '2024-04-26T23:48:04.206026+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.206026+0000', 'last_undegraded': '2024-04-26T23:48:04.206026+0000', 'last_fullsized': '2024-04-26T23:48:04.206026+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 47, 'state': 'creating+activating', 'last_fresh': '2024-04-26T23:48:04.219508+0000', 'last_change': '2024-04-26T23:48:04.219508+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.219508+0000', 'last_undegraded': '2024-04-26T23:48:04.219508+0000', 'last_fullsized': '2024-04-26T23:48:04.219508+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-26T23:48:10.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.215450+0000', 'last_change': '2024-04-26T23:48:04.215450+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.215450+0000', 'last_undegraded': '2024-04-26T23:48:04.215450+0000', 'last_fullsized': '2024-04-26T23:48:04.215450+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.206523+0000', 'last_change': '2024-04-26T23:48:04.206523+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.206523+0000', 'last_undegraded': '2024-04-26T23:48:04.206523+0000', 'last_fullsized': '2024-04-26T23:48:04.206523+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.206026+0000', 'last_change': '2024-04-26T23:48:04.206026+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.206026+0000', 'last_undegraded': '2024-04-26T23:48:04.206026+0000', 'last_fullsized': '2024-04-26T23:48:04.206026+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.211797+0000', 'last_change': '2024-04-26T23:48:04.211797+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.211797+0000', 'last_undegraded': '2024-04-26T23:48:04.211797+0000', 'last_fullsized': '2024-04-26T23:48:04.211797+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 47, 'state': 'creating+activating', 'last_fresh': '2024-04-26T23:48:04.215958+0000', 'last_change': '2024-04-26T23:48:04.215958+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.215958+0000', 'last_undegraded': '2024-04-26T23:48:04.215958+0000', 'last_fullsized': '2024-04-26T23:48:04.215958+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-26T23:48:10.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.214782+0000', 'last_change': '2024-04-26T23:48:04.214782+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.214782+0000', 'last_undegraded': '2024-04-26T23:48:04.214782+0000', 'last_fullsized': '2024-04-26T23:48:04.214782+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:03.205185+0000', 'last_change': '2024-04-26T23:48:03.205185+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:03.205185+0000', 'last_undegraded': '2024-04-26T23:48:03.205185+0000', 'last_fullsized': '2024-04-26T23:48:03.205185+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.211624+0000', 'last_change': '2024-04-26T23:48:04.211624+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.211624+0000', 'last_undegraded': '2024-04-26T23:48:04.211624+0000', 'last_fullsized': '2024-04-26T23:48:04.211624+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.208433+0000', 'last_change': '2024-04-26T23:48:04.208433+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.208433+0000', 'last_undegraded': '2024-04-26T23:48:04.208433+0000', 'last_fullsized': '2024-04-26T23:48:04.208433+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:03.203558+0000', 'last_change': '2024-04-26T23:48:03.203558+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:03.203558+0000', 'last_undegraded': '2024-04-26T23:48:03.203558+0000', 'last_fullsized': '2024-04-26T23:48:03.203558+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:48:10.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.218103+0000', 'last_change': '2024-04-26T23:48:04.218103+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.218103+0000', 'last_undegraded': '2024-04-26T23:48:04.218103+0000', 'last_fullsized': '2024-04-26T23:48:04.218103+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.208245+0000', 'last_change': '2024-04-26T23:48:04.208245+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.208245+0000', 'last_undegraded': '2024-04-26T23:48:04.208245+0000', 'last_fullsized': '2024-04-26T23:48:04.208245+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.213193+0000', 'last_change': '2024-04-26T23:48:04.213193+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.213193+0000', 'last_undegraded': '2024-04-26T23:48:04.213193+0000', 'last_fullsized': '2024-04-26T23:48:04.213193+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.215675+0000', 'last_change': '2024-04-26T23:48:04.215675+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.215675+0000', 'last_undegraded': '2024-04-26T23:48:04.215675+0000', 'last_fullsized': '2024-04-26T23:48:04.215675+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-04-26T23:48:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.209586+0000', 'last_change': '2024-04-26T23:48:04.209586+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.209586+0000', 'last_undegraded': '2024-04-26T23:48:04.209586+0000', 'last_fullsized': '2024-04-26T23:48:04.209586+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:03.204831+0000', 'last_change': '2024-04-26T23:48:03.204831+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:03.204831+0000', 'last_undegraded': '2024-04-26T23:48:03.204831+0000', 'last_fullsized': '2024-04-26T23:48:03.204831+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.212518+0000', 'last_change': '2024-04-26T23:48:04.212518+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.212518+0000', 'last_undegraded': '2024-04-26T23:48:04.212518+0000', 'last_fullsized': '2024-04-26T23:48:04.212518+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.213725+0000', 'last_change': '2024-04-26T23:48:04.213725+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.213725+0000', 'last_undegraded': '2024-04-26T23:48:04.213725+0000', 'last_fullsized': '2024-04-26T23:48:04.213725+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.218891+0000', 'last_change': '2024-04-26T23:48:04.218891+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.218891+0000', 'last_undegraded': '2024-04-26T23:48:04.218891+0000', 'last_fullsized': '2024-04-26T23:48:04.218891+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-26T23:48:10.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.219913+0000', 'last_change': '2024-04-26T23:48:04.219913+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.219913+0000', 'last_undegraded': '2024-04-26T23:48:04.219913+0000', 'last_fullsized': '2024-04-26T23:48:04.219913+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 47, 'state': 'creating+activating', 'last_fresh': '2024-04-26T23:48:04.215235+0000', 'last_change': '2024-04-26T23:48:04.215235+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.215235+0000', 'last_undegraded': '2024-04-26T23:48:04.215235+0000', 'last_fullsized': '2024-04-26T23:48:04.215235+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.206161+0000', 'last_change': '2024-04-26T23:48:04.206161+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.206161+0000', 'last_undegraded': '2024-04-26T23:48:04.206161+0000', 'last_fullsized': '2024-04-26T23:48:04.206161+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.208969+0000', 'last_change': '2024-04-26T23:48:04.208969+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.208969+0000', 'last_undegraded': '2024-04-26T23:48:04.208969+0000', 'last_fullsized': '2024-04-26T23:48:04.208969+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:03.203562+0000', 'last_change': '2024-04-26T23:48:03.203562+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:03.203562+0000', 'last_undegraded': '2024-04-26T23:48:03.203562+0000', 'last_fullsized': '2024-04-26T23:48:03.203562+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-26T23:48:10.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.214738+0000', 'last_change': '2024-04-26T23:48:04.214738+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.214738+0000', 'last_undegraded': '2024-04-26T23:48:04.214738+0000', 'last_fullsized': '2024-04-26T23:48:04.214738+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.207675+0000', 'last_change': '2024-04-26T23:48:04.207675+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.207675+0000', 'last_undegraded': '2024-04-26T23:48:04.207675+0000', 'last_fullsized': '2024-04-26T23:48:04.207675+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.218406+0000', 'last_change': '2024-04-26T23:48:04.218406+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.218406+0000', 'last_undegraded': '2024-04-26T23:48:04.218406+0000', 'last_fullsized': '2024-04-26T23:48:04.218406+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.216326+0000', 'last_change': '2024-04-26T23:48:04.216326+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.216326+0000', 'last_undegraded': '2024-04-26T23:48:04.216326+0000', 'last_fullsized': '2024-04-26T23:48:04.216326+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.205879+0000', 'last_change': '2024-04-26T23:48:04.205879+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.205879+0000', 'last_undegraded': '2024-04-26T23:48:04.205879+0000', 'last_fullsized': '2024-04-26T23:48:04.205879+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-26T23:48:10.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-26T23:48:10.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:04.211076+0000', 'last_change': '2024-04-26T23:48:04.211076+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.211076+0000', 'last_undegraded': '2024-04-26T23:48:04.211076+0000', 'last_fullsized': '2024-04-26T23:48:04.211076+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:10.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-26T23:48:10.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 46, 'state': 'creating+peering', 'last_fresh': '2024-04-26T23:48:03.203473+0000', 'last_change': '2024-04-26T23:48:03.203473+0000', 'last_active': '2024-04-26T23:48:03.187504+0000', 'last_peered': '2024-04-26T23:48:03.187504+0000', 'last_clean': '2024-04-26T23:48:03.187504+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:03.203473+0000', 'last_undegraded': '2024-04-26T23:48:03.203473+0000', 'last_fullsized': '2024-04-26T23:48:03.203473+0000', 'mapping_epoch': 46, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 46, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:03.187504+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-26T23:48:10.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-26T23:48:10.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-26T23:48:04.193819+0000', 'last_change': '2024-04-26T23:48:04.193819+0000', 'last_active': '2024-04-26T23:48:04.193819+0000', 'last_peered': '2024-04-26T23:48:04.193819+0000', 'last_clean': '2024-04-26T23:48:04.193819+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-26T23:48:04.193819+0000', 'last_undegraded': '2024-04-26T23:48:04.193819+0000', 'last_fullsized': '2024-04-26T23:48:04.193819+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-26T23:48:10.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T23:48:10.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.330+0000 7fd972800640 1 Processor -- start 2024-04-26T23:48:10.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.330+0000 7fd972800640 1 -- start start 2024-04-26T23:48:10.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd972800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd96c15d1c0 0x7fd96c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd972800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c0711f0 0x7fd96c0d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd972800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd96c071770 con 0x7fd96c15cde0 2024-04-26T23:48:10.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd972800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd96c0afa50 con 0x7fd96c15d1c0 2024-04-26T23:48:10.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd972800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c071a50 con 0x7fd96c0711f0 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd971400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd96c15cde0 0x7fd96c0d3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37310/0 (socket says 172.21.15.47:37310) 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd971400640 1 -- 172.21.15.47:0/190915197 learned_addr learned my addr 172.21.15.47:0/190915197 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd970a00640 1 --2- 172.21.15.47:0/190915197 >> v2:172.21.15.47:3300/0 conn(0x7fd96c15d1c0 0x7fd96c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd971e00640 1 --2- 172.21.15.47:0/190915197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c0711f0 0x7fd96c0d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd96be00640 1 -- 172.21.15.47:0/190915197 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234016564 0 0) 0x7fd96c071770 con 0x7fd96c15cde0 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd96be00640 1 -- 172.21.15.47:0/190915197 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd954003530 con 0x7fd96c15cde0 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd970a00640 1 -- 172.21.15.47:0/190915197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c0711f0 msgr2=0x7fd96c0d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd970a00640 1 --2- 172.21.15.47:0/190915197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c0711f0 0x7fd96c0d1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd970a00640 1 -- 172.21.15.47:0/190915197 >> v1:172.21.15.47:6789/0 conn(0x7fd96c15cde0 legacy=0x7fd96c0d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.334+0000 7fd970a00640 1 -- 172.21.15.47:0/190915197 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c071d30 con 0x7fd96c15d1c0 2024-04-26T23:48:10.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd970a00640 1 --2- 172.21.15.47:0/190915197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15d1c0 0x7fd96c0d1150 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097c0 tx=0x7fd95801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519c7ad42a175797 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd96be00640 1 -- 172.21.15.47:0/190915197 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580b1070 con 0x7fd96c15d1c0 2024-04-26T23:48:10.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd96be00640 1 -- 172.21.15.47:0/190915197 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9580ac410 con 0x7fd96c15d1c0 2024-04-26T23:48:10.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd96be00640 1 -- 172.21.15.47:0/190915197 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580ac7e0 con 0x7fd96c15d1c0 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- 172.21.15.47:0/190915197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15d1c0 msgr2=0x7fd96c0d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 --2- 172.21.15.47:0/190915197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15d1c0 0x7fd96c0d1150 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd9580097c0 tx=0x7fd95801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- 172.21.15.47:0/190915197 shutdown_connections 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 --2- 172.21.15.47:0/190915197 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c0711f0 0x7fd96c0d1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 --2- 172.21.15.47:0/190915197 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15d1c0 0x7fd96c0d1150 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- 172.21.15.47:0/190915197 >> 172.21.15.47:0/190915197 conn(0x7fd96c09ba60 msgr2=0x7fd96c09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- 172.21.15.47:0/190915197 shutdown_connections 2024-04-26T23:48:10.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- 172.21.15.47:0/190915197 wait complete. 2024-04-26T23:48:10.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 Processor -- start 2024-04-26T23:48:10.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- start start 2024-04-26T23:48:10.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd96c0711f0 0x7fd96c155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15cde0 0x7fd96c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c15d1c0 0x7fd96c165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c0b0a80 con 0x7fd96c15cde0 2024-04-26T23:48:10.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c0b0900 con 0x7fd96c0711f0 2024-04-26T23:48:10.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd972800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c0b0c00 con 0x7fd96c15d1c0 2024-04-26T23:48:10.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd970a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15cde0 0x7fd96c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.338+0000 7fd970a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15cde0 0x7fd96c06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44020/0 (socket says 172.21.15.47:44020) 2024-04-26T23:48:10.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd970a00640 1 -- 172.21.15.47:0/302076530 learned_addr learned my addr 172.21.15.47:0/302076530 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:10.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd971400640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd96c0711f0 0x7fd96c155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd971e00640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c15d1c0 0x7fd96c165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd970a00640 1 -- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c15d1c0 msgr2=0x7fd96c165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd970a00640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c15d1c0 0x7fd96c165790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd970a00640 1 -- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd96c0711f0 msgr2=0x7fd96c155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd970a00640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd96c0711f0 0x7fd96c155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd970a00640 1 -- 172.21.15.47:0/302076530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c1575c0 con 0x7fd96c15cde0 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd971400640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd96c0711f0 0x7fd96c155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd971e00640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c15d1c0 0x7fd96c165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd970a00640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15cde0 0x7fd96c06d930 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd9580af040 tx=0x7fd958019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd969600640 1 -- 172.21.15.47:0/302076530 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580b1040 con 0x7fd96c15cde0 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd969600640 1 -- 172.21.15.47:0/302076530 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9580ba070 con 0x7fd96c15cde0 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd969600640 1 -- 172.21.15.47:0/302076530 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580b5690 con 0x7fd96c15cde0 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c157860 con 0x7fd96c15cde0 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c157e20 con 0x7fd96c15cde0 2024-04-26T23:48:10.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96c06ded0 con 0x7fd96c15cde0 2024-04-26T23:48:10.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.342+0000 7fd969600640 1 -- 172.21.15.47:0/302076530 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fd9580b5830 con 0x7fd96c15cde0 2024-04-26T23:48:10.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.346+0000 7fd969600640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd94c068650 0x7fd94c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.346+0000 7fd969600640 1 -- 172.21.15.47:0/302076530 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7fd958120af0 con 0x7fd96c15cde0 2024-04-26T23:48:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.346+0000 7fd971400640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd94c068650 0x7fd94c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.346+0000 7fd971400640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd94c068650 0x7fd94c06ab10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd960000f70 tx=0x7fd960009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.350+0000 7fd969600640 1 -- 172.21.15.47:0/302076530 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd958016090 con 0x7fd96c15cde0 2024-04-26T23:48:10.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.574+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd96c069470 con 0x7fd96c15cde0 2024-04-26T23:48:10.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.574+0000 7fd969600640 1 -- 172.21.15.47:0/302076530 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7fd9580f0db0 con 0x7fd96c15cde0 2024-04-26T23:48:10.581 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:10.581 INFO:teuthology.orchestra.run.smithi047.stdout:{"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":183,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":49,"num_osds":8,"num_up_osds":8,"osd_up_since":1714175118,"num_in_osds":8,"osd_in_since":1714175109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":244211712,"bytes_avail":772849901568,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5913}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-04-26T23:47:40.184970+0000","services":{}},"progress_events":{}} 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd94c068650 msgr2=0x7fd94c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd94c068650 0x7fd94c06ab10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd960000f70 tx=0x7fd960009040 comp rx=0 tx=0).stop 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15cde0 msgr2=0x7fd96c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15cde0 0x7fd96c06d930 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd9580af040 tx=0x7fd958019240 comp rx=0 tx=0).stop 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 shutdown_connections 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd94c068650 0x7fd94c06ab10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd96c15d1c0 0x7fd96c165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd96c15cde0 0x7fd96c06d930 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 --2- 172.21.15.47:0/302076530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd96c0711f0 0x7fd96c155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 >> 172.21.15.47:0/302076530 conn(0x7fd96c09ba60 msgr2=0x7fd96c0cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 shutdown_connections 2024-04-26T23:48:10.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.578+0000 7fd972800640 1 -- 172.21.15.47:0/302076530 wait complete. 2024-04-26T23:48:10.602 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T23:48:10.602 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:10.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.734+0000 7f3dfb800640 1 Processor -- start 2024-04-26T23:48:10.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.734+0000 7f3dfb800640 1 -- start start 2024-04-26T23:48:10.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3dfb800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f3df415d5b0 0x7f3df415da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3dfb800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df415e050 con 0x7f3df40cdc00 2024-04-26T23:48:10.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3dfb800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df415e330 con 0x7f3df40b4360 2024-04-26T23:48:10.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3dfb800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3df40ceda0 con 0x7f3df415d5b0 2024-04-26T23:48:10.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3df9800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3df40cdc00 0x7f3df415e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37312/0 (socket says 172.21.15.47:37312) 2024-04-26T23:48:10.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3df9800640 1 -- 172.21.15.47:0/1335534301 learned_addr learned my addr 172.21.15.47:0/1335534301 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:10.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3debe00640 1 --2- 172.21.15.47:0/1335534301 >> v2:172.21.15.203:3300/0 conn(0x7f3df415d5b0 0x7f3df415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3df3e00640 1 -- 172.21.15.47:0/1335534301 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417555021 0 0) 0x7f3df415e050 con 0x7f3df40cdc00 2024-04-26T23:48:10.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3df3e00640 1 -- 172.21.15.47:0/1335534301 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dd8003530 con 0x7f3df40cdc00 2024-04-26T23:48:10.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3debe00640 1 -- 172.21.15.47:0/1335534301 >> v1:172.21.15.203:6789/0 conn(0x7f3df40b4360 legacy=0x7f3df40cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3debe00640 1 -- 172.21.15.47:0/1335534301 >> v1:172.21.15.47:6789/0 conn(0x7f3df40cdc00 legacy=0x7f3df415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.738+0000 7f3debe00640 1 -- 172.21.15.47:0/1335534301 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df40cf080 con 0x7f3df415d5b0 2024-04-26T23:48:10.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3debe00640 1 --2- 172.21.15.47:0/1335534301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df415d5b0 0x7f3df415da40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0097a0 tx=0x7f3ddc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a2c9b2d645531a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3df3e00640 1 -- 172.21.15.47:0/1335534301 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0b0070 con 0x7f3df415d5b0 2024-04-26T23:48:10.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3df3e00640 1 -- 172.21.15.47:0/1335534301 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0ab600 con 0x7f3df415d5b0 2024-04-26T23:48:10.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3df3e00640 1 -- 172.21.15.47:0/1335534301 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0ab9d0 con 0x7f3df415d5b0 2024-04-26T23:48:10.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 -- 172.21.15.47:0/1335534301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df415d5b0 msgr2=0x7f3df415da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 --2- 172.21.15.47:0/1335534301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df415d5b0 0x7f3df415da40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0097a0 tx=0x7f3ddc01c480 comp rx=0 tx=0).stop 2024-04-26T23:48:10.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 -- 172.21.15.47:0/1335534301 shutdown_connections 2024-04-26T23:48:10.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 --2- 172.21.15.47:0/1335534301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df415d5b0 0x7f3df415da40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 -- 172.21.15.47:0/1335534301 >> 172.21.15.47:0/1335534301 conn(0x7f3df406c800 msgr2=0x7f3df406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:10.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 -- 172.21.15.47:0/1335534301 shutdown_connections 2024-04-26T23:48:10.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 -- 172.21.15.47:0/1335534301 wait complete. 2024-04-26T23:48:10.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.742+0000 7f3dfb800640 1 Processor -- start 2024-04-26T23:48:10.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 -- start start 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3df40b4360 0x7f3df409e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df40cdc00 0x7f3df40b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df415d5b0 0x7f3df406ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3df416b8e0 con 0x7f3df415d5b0 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3df416b760 con 0x7f3df40cdc00 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3df416ba60 con 0x7f3df40b4360 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df415d5b0 0x7f3df406ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df415d5b0 0x7f3df406ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44024/0 (socket says 172.21.15.47:44024) 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 -- 172.21.15.47:0/2692021650 learned_addr learned my addr 172.21.15.47:0/2692021650 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:10.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 -- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3df40b4360 msgr2=0x7f3df409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3df40b4360 0x7f3df409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 -- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df40cdc00 msgr2=0x7f3df40b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df40cdc00 0x7f3df40b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 -- 172.21.15.47:0/2692021650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df409e880 con 0x7f3df415d5b0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df9800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df415d5b0 0x7f3df406ef20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00cb70 tx=0x7f3dec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df1600640 1 -- 172.21.15.47:0/2692021650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec017070 con 0x7f3df415d5b0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df1600640 1 -- 172.21.15.47:0/2692021650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec00ad40 con 0x7f3df415d5b0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3df1600640 1 -- 172.21.15.47:0/2692021650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec012620 con 0x7f3df415d5b0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df409bb00 con 0x7f3df415d5b0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df415fcf0 con 0x7f3df415d5b0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.746+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df4069700 con 0x7f3df415d5b0 2024-04-26T23:48:10.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.750+0000 7f3df1600640 1 -- 172.21.15.47:0/2692021650 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f3dec01a070 con 0x7f3df415d5b0 2024-04-26T23:48:10.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.750+0000 7f3df1600640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd0068650 0x7f3dd006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:10.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.750+0000 7f3df1600640 1 -- 172.21.15.47:0/2692021650 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5709+0+0 (secure 0 0 0) 0x7f3dec086d80 con 0x7f3df415d5b0 2024-04-26T23:48:10.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.750+0000 7f3df8e00640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd0068650 0x7f3dd006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:10.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.750+0000 7f3df8e00640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd0068650 0x7f3dd006ab10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000f70 tx=0x7f3de40079c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:10.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.754+0000 7f3df1600640 1 -- 172.21.15.47:0/2692021650 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3dec056ed0 con 0x7f3df415d5b0 2024-04-26T23:48:10.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.914+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3df40d06a0 con 0x7f3dd0068650 2024-04-26T23:48:10.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.922+0000 7f3df1600640 1 -- 172.21.15.47:0/2692021650 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251960 (secure 0 0 0) 0x7f3df40d06a0 con 0x7f3dd0068650 2024-04-26T23:48:10.931 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:10.932 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd0068650 msgr2=0x7f3dd006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd0068650 0x7f3dd006ab10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3de4000f70 tx=0x7f3de40079c0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df415d5b0 msgr2=0x7f3df406ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df415d5b0 0x7f3df406ef20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00cb70 tx=0x7f3dec00a430 comp rx=0 tx=0).stop 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 shutdown_connections 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3dd0068650 0x7f3dd006ab10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3df415d5b0 0x7f3df406ef20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3df40cdc00 0x7f3df40b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 --2- 172.21.15.47:0/2692021650 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3df40b4360 0x7f3df409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 >> 172.21.15.47:0/2692021650 conn(0x7f3df406c800 msgr2=0x7f3df415e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 shutdown_connections 2024-04-26T23:48:10.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:10.926+0000 7f3dfb800640 1 -- 172.21.15.47:0/2692021650 wait complete. 2024-04-26T23:48:10.951 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-04-26T23:48:10.191009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238488,"kb_used_data":5672,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736232,"statfs":{"total":773094113280,"available":772849901568,"internally_reserved":0,"allocated":5808128,"data_stored":3044276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001405"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666988+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:06.666988+0000","last_peered":"2024-04-26T23:48:06.666988+0000","last_clean":"2024-04-26T23:48:06.666988+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:06.666988+0000","last_undegraded":"2024-04-26T23:48:06.666988+0000","last_fullsized":"2024-04-26T23:48:06.666988+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231613+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:06.231613+0000","last_peered":"2024-04-26T23:48:06.231613+0000","last_clean":"2024-04-26T23:48:06.231613+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:06.231613+0000","last_undegraded":"2024-04-26T23:48:06.231613+0000","last_fullsized":"2024-04-26T23:48:06.231613+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231328+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:06.231328+0000","last_peered":"2024-04-26T23:48:06.231328+0000","last_clean":"2024-04-26T23:48:06.231328+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:06.231328+0000","last_undegraded":"2024-04-26T23:48:06.231328+0000","last_fullsized":"2024-04-26T23:48:06.231328+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665408+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:06.665408+0000","last_peered":"2024-04-26T23:48:06.665408+0000","last_clean":"2024-04-26T23:48:06.665408+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:06.665408+0000","last_undegraded":"2024-04-26T23:48:06.665408+0000","last_fullsized":"2024-04-26T23:48:06.665408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231339+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:06.231339+0000","last_peered":"2024-04-26T23:48:06.231339+0000","last_clean":"2024-04-26T23:48:06.231339+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:06.231339+0000","last_undegraded":"2024-04-26T23:48:06.231339+0000","last_fullsized":"2024-04-26T23:48:06.231339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663448+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:06.663448+0000","last_peered":"2024-04-26T23:48:06.663448+0000","last_clean":"2024-04-26T23:48:06.663448+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:06.663448+0000","last_undegraded":"2024-04-26T23:48:06.663448+0000","last_fullsized":"2024-04-26T23:48:06.663448+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666669+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:06.666669+0000","last_peered":"2024-04-26T23:48:06.666669+0000","last_clean":"2024-04-26T23:48:06.666669+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:06.666669+0000","last_undegraded":"2024-04-26T23:48:06.666669+0000","last_fullsized":"2024-04-26T23:48:06.666669+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664211+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:06.664211+0000","last_peered":"2024-04-26T23:48:06.664211+0000","last_clean":"2024-04-26T23:48:06.664211+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:06.664211+0000","last_undegraded":"2024-04-26T23:48:06.664211+0000","last_fullsized":"2024-04-26T23:48:06.664211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665384+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:06.665384+0000","last_peered":"2024-04-26T23:48:06.665384+0000","last_clean":"2024-04-26T23:48:06.665384+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:06.665384+0000","last_undegraded":"2024-04-26T23:48:06.665384+0000","last_fullsized":"2024-04-26T23:48:06.665384+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665422+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:06.665422+0000","last_peered":"2024-04-26T23:48:06.665422+0000","last_clean":"2024-04-26T23:48:06.665422+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:06.665422+0000","last_undegraded":"2024-04-26T23:48:06.665422+0000","last_fullsized":"2024-04-26T23:48:06.665422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665483+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:06.665483+0000","last_peered":"2024-04-26T23:48:06.665483+0000","last_clean":"2024-04-26T23:48:06.665483+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:06.665483+0000","last_undegraded":"2024-04-26T23:48:06.665483+0000","last_fullsized":"2024-04-26T23:48:06.665483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231225+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:06.231225+0000","last_peered":"2024-04-26T23:48:06.231225+0000","last_clean":"2024-04-26T23:48:06.231225+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:06.231225+0000","last_undegraded":"2024-04-26T23:48:06.231225+0000","last_fullsized":"2024-04-26T23:48:06.231225+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664581+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:06.664581+0000","last_peered":"2024-04-26T23:48:06.664581+0000","last_clean":"2024-04-26T23:48:06.664581+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:06.664581+0000","last_undegraded":"2024-04-26T23:48:06.664581+0000","last_fullsized":"2024-04-26T23:48:06.664581+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664798+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:06.664798+0000","last_peered":"2024-04-26T23:48:06.664798+0000","last_clean":"2024-04-26T23:48:06.664798+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:06.664798+0000","last_undegraded":"2024-04-26T23:48:06.664798+0000","last_fullsized":"2024-04-26T23:48:06.664798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663428+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:06.663428+0000","last_peered":"2024-04-26T23:48:06.663428+0000","last_clean":"2024-04-26T23:48:06.663428+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:06.663428+0000","last_undegraded":"2024-04-26T23:48:06.663428+0000","last_fullsized":"2024-04-26T23:48:06.663428+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665959+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:06.665959+0000","last_peered":"2024-04-26T23:48:06.665959+0000","last_clean":"2024-04-26T23:48:06.665959+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:06.665959+0000","last_undegraded":"2024-04-26T23:48:06.665959+0000","last_fullsized":"2024-04-26T23:48:06.665959+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.232244+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:06.232244+0000","last_peered":"2024-04-26T23:48:06.232244+0000","last_clean":"2024-04-26T23:48:06.232244+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:06.232244+0000","last_undegraded":"2024-04-26T23:48:06.232244+0000","last_fullsized":"2024-04-26T23:48:06.232244+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.232194+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:06.232194+0000","last_peered":"2024-04-26T23:48:06.232194+0000","last_clean":"2024-04-26T23:48:06.232194+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:06.232194+0000","last_undegraded":"2024-04-26T23:48:06.232194+0000","last_fullsized":"2024-04-26T23:48:06.232194+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666364+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:06.666364+0000","last_peered":"2024-04-26T23:48:06.666364+0000","last_clean":"2024-04-26T23:48:06.666364+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:06.666364+0000","last_undegraded":"2024-04-26T23:48:06.666364+0000","last_fullsized":"2024-04-26T23:48:06.666364+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664865+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:06.664865+0000","last_peered":"2024-04-26T23:48:06.664865+0000","last_clean":"2024-04-26T23:48:06.664865+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:06.664865+0000","last_undegraded":"2024-04-26T23:48:06.664865+0000","last_fullsized":"2024-04-26T23:48:06.664865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663501+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:06.663501+0000","last_peered":"2024-04-26T23:48:06.663501+0000","last_clean":"2024-04-26T23:48:06.663501+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:06.663501+0000","last_undegraded":"2024-04-26T23:48:06.663501+0000","last_fullsized":"2024-04-26T23:48:06.663501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665008+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:06.665008+0000","last_peered":"2024-04-26T23:48:06.665008+0000","last_clean":"2024-04-26T23:48:06.665008+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:06.665008+0000","last_undegraded":"2024-04-26T23:48:06.665008+0000","last_fullsized":"2024-04-26T23:48:06.665008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665741+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:06.665741+0000","last_peered":"2024-04-26T23:48:06.665741+0000","last_clean":"2024-04-26T23:48:06.665741+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:06.665741+0000","last_undegraded":"2024-04-26T23:48:06.665741+0000","last_fullsized":"2024-04-26T23:48:06.665741+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665703+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:06.665703+0000","last_peered":"2024-04-26T23:48:06.665703+0000","last_clean":"2024-04-26T23:48:06.665703+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:06.665703+0000","last_undegraded":"2024-04-26T23:48:06.665703+0000","last_fullsized":"2024-04-26T23:48:06.665703+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666397+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:06.666397+0000","last_peered":"2024-04-26T23:48:06.666397+0000","last_clean":"2024-04-26T23:48:06.666397+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:06.666397+0000","last_undegraded":"2024-04-26T23:48:06.666397+0000","last_fullsized":"2024-04-26T23:48:06.666397+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664360+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:06.664360+0000","last_peered":"2024-04-26T23:48:06.664360+0000","last_clean":"2024-04-26T23:48:06.664360+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:06.664360+0000","last_undegraded":"2024-04-26T23:48:06.664360+0000","last_fullsized":"2024-04-26T23:48:06.664360+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231466+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:06.231466+0000","last_peered":"2024-04-26T23:48:06.231466+0000","last_clean":"2024-04-26T23:48:06.231466+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:06.231466+0000","last_undegraded":"2024-04-26T23:48:06.231466+0000","last_fullsized":"2024-04-26T23:48:06.231466+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231283+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:06.231283+0000","last_peered":"2024-04-26T23:48:06.231283+0000","last_clean":"2024-04-26T23:48:06.231283+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:06.231283+0000","last_undegraded":"2024-04-26T23:48:06.231283+0000","last_fullsized":"2024-04-26T23:48:06.231283+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666009+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:06.666009+0000","last_peered":"2024-04-26T23:48:06.666009+0000","last_clean":"2024-04-26T23:48:06.666009+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:06.666009+0000","last_undegraded":"2024-04-26T23:48:06.666009+0000","last_fullsized":"2024-04-26T23:48:06.666009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.230899+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:06.230899+0000","last_peered":"2024-04-26T23:48:06.230899+0000","last_clean":"2024-04-26T23:48:06.230899+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:06.230899+0000","last_undegraded":"2024-04-26T23:48:06.230899+0000","last_fullsized":"2024-04-26T23:48:06.230899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663584+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:06.663584+0000","last_peered":"2024-04-26T23:48:06.663584+0000","last_clean":"2024-04-26T23:48:06.663584+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:06.663584+0000","last_undegraded":"2024-04-26T23:48:06.663584+0000","last_fullsized":"2024-04-26T23:48:06.663584+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663895+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:06.663895+0000","last_peered":"2024-04-26T23:48:06.663895+0000","last_clean":"2024-04-26T23:48:06.663895+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:06.663895+0000","last_undegraded":"2024-04-26T23:48:06.663895+0000","last_fullsized":"2024-04-26T23:48:06.663895+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.228377+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:06.228377+0000","last_peered":"2024-04-26T23:48:06.228377+0000","last_clean":"2024-04-26T23:48:06.228377+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:06.228377+0000","last_undegraded":"2024-04-26T23:48:06.228377+0000","last_fullsized":"2024-04-26T23:48:06.228377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664478+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:06.664478+0000","last_peered":"2024-04-26T23:48:06.664478+0000","last_clean":"2024-04-26T23:48:06.664478+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:06.664478+0000","last_undegraded":"2024-04-26T23:48:06.664478+0000","last_fullsized":"2024-04-26T23:48:06.664478+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666436+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:06.666436+0000","last_peered":"2024-04-26T23:48:06.666436+0000","last_clean":"2024-04-26T23:48:06.666436+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:06.666436+0000","last_undegraded":"2024-04-26T23:48:06.666436+0000","last_fullsized":"2024-04-26T23:48:06.666436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.232236+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:06.232236+0000","last_peered":"2024-04-26T23:48:06.232236+0000","last_clean":"2024-04-26T23:48:06.232236+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:06.232236+0000","last_undegraded":"2024-04-26T23:48:06.232236+0000","last_fullsized":"2024-04-26T23:48:06.232236+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231408+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:06.231408+0000","last_peered":"2024-04-26T23:48:06.231408+0000","last_clean":"2024-04-26T23:48:06.231408+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:06.231408+0000","last_undegraded":"2024-04-26T23:48:06.231408+0000","last_fullsized":"2024-04-26T23:48:06.231408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.228426+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:06.228426+0000","last_peered":"2024-04-26T23:48:06.228426+0000","last_clean":"2024-04-26T23:48:06.228426+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:06.228426+0000","last_undegraded":"2024-04-26T23:48:06.228426+0000","last_fullsized":"2024-04-26T23:48:06.228426+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.228490+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:06.228490+0000","last_peered":"2024-04-26T23:48:06.228490+0000","last_clean":"2024-04-26T23:48:06.228490+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:06.228490+0000","last_undegraded":"2024-04-26T23:48:06.228490+0000","last_fullsized":"2024-04-26T23:48:06.228490+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666919+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:06.666919+0000","last_peered":"2024-04-26T23:48:06.666919+0000","last_clean":"2024-04-26T23:48:06.666919+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:06.666919+0000","last_undegraded":"2024-04-26T23:48:06.666919+0000","last_fullsized":"2024-04-26T23:48:06.666919+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231071+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:06.231071+0000","last_peered":"2024-04-26T23:48:06.231071+0000","last_clean":"2024-04-26T23:48:06.231071+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:06.231071+0000","last_undegraded":"2024-04-26T23:48:06.231071+0000","last_fullsized":"2024-04-26T23:48:06.231071+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663703+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:06.663703+0000","last_peered":"2024-04-26T23:48:06.663703+0000","last_clean":"2024-04-26T23:48:06.663703+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:06.663703+0000","last_undegraded":"2024-04-26T23:48:06.663703+0000","last_fullsized":"2024-04-26T23:48:06.663703+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665133+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:06.665133+0000","last_peered":"2024-04-26T23:48:06.665133+0000","last_clean":"2024-04-26T23:48:06.665133+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:06.665133+0000","last_undegraded":"2024-04-26T23:48:06.665133+0000","last_fullsized":"2024-04-26T23:48:06.665133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231113+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:06.231113+0000","last_peered":"2024-04-26T23:48:06.231113+0000","last_clean":"2024-04-26T23:48:06.231113+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:06.231113+0000","last_undegraded":"2024-04-26T23:48:06.231113+0000","last_fullsized":"2024-04-26T23:48:06.231113+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664470+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:06.664470+0000","last_peered":"2024-04-26T23:48:06.664470+0000","last_clean":"2024-04-26T23:48:06.664470+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:06.664470+0000","last_undegraded":"2024-04-26T23:48:06.664470+0000","last_fullsized":"2024-04-26T23:48:06.664470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.230739+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:06.230739+0000","last_peered":"2024-04-26T23:48:06.230739+0000","last_clean":"2024-04-26T23:48:06.230739+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:06.230739+0000","last_undegraded":"2024-04-26T23:48:06.230739+0000","last_fullsized":"2024-04-26T23:48:06.230739+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665575+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:06.665575+0000","last_peered":"2024-04-26T23:48:06.665575+0000","last_clean":"2024-04-26T23:48:06.665575+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:06.665575+0000","last_undegraded":"2024-04-26T23:48:06.665575+0000","last_fullsized":"2024-04-26T23:48:06.665575+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664523+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:06.664523+0000","last_peered":"2024-04-26T23:48:06.664523+0000","last_clean":"2024-04-26T23:48:06.664523+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:06.664523+0000","last_undegraded":"2024-04-26T23:48:06.664523+0000","last_fullsized":"2024-04-26T23:48:06.664523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.232104+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:06.232104+0000","last_peered":"2024-04-26T23:48:06.232104+0000","last_clean":"2024-04-26T23:48:06.232104+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:06.232104+0000","last_undegraded":"2024-04-26T23:48:06.232104+0000","last_fullsized":"2024-04-26T23:48:06.232104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.232317+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:06.232317+0000","last_peered":"2024-04-26T23:48:06.232317+0000","last_clean":"2024-04-26T23:48:06.232317+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:06.232317+0000","last_undegraded":"2024-04-26T23:48:06.232317+0000","last_fullsized":"2024-04-26T23:48:06.232317+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.667116+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:06.667116+0000","last_peered":"2024-04-26T23:48:06.667116+0000","last_clean":"2024-04-26T23:48:06.667116+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:06.667116+0000","last_undegraded":"2024-04-26T23:48:06.667116+0000","last_fullsized":"2024-04-26T23:48:06.667116+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665469+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:06.665469+0000","last_peered":"2024-04-26T23:48:06.665469+0000","last_clean":"2024-04-26T23:48:06.665469+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:06.665469+0000","last_undegraded":"2024-04-26T23:48:06.665469+0000","last_fullsized":"2024-04-26T23:48:06.665469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664063+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:06.664063+0000","last_peered":"2024-04-26T23:48:06.664063+0000","last_clean":"2024-04-26T23:48:06.664063+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:06.664063+0000","last_undegraded":"2024-04-26T23:48:06.664063+0000","last_fullsized":"2024-04-26T23:48:06.664063+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":17,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.667022+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:06.667022+0000","last_peered":"2024-04-26T23:48:06.667022+0000","last_clean":"2024-04-26T23:48:06.667022+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:06.667022+0000","last_undegraded":"2024-04-26T23:48:06.667022+0000","last_fullsized":"2024-04-26T23:48:06.667022+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666883+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:06.666883+0000","last_peered":"2024-04-26T23:48:06.666883+0000","last_clean":"2024-04-26T23:48:06.666883+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:06.666883+0000","last_undegraded":"2024-04-26T23:48:06.666883+0000","last_fullsized":"2024-04-26T23:48:06.666883+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664954+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:06.664954+0000","last_peered":"2024-04-26T23:48:06.664954+0000","last_clean":"2024-04-26T23:48:06.664954+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:06.664954+0000","last_undegraded":"2024-04-26T23:48:06.664954+0000","last_fullsized":"2024-04-26T23:48:06.664954+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665949+0000","last_change":"2024-04-26T23:48:05.241831+0000","last_active":"2024-04-26T23:48:06.665949+0000","last_peered":"2024-04-26T23:48:06.665949+0000","last_clean":"2024-04-26T23:48:06.665949+0000","last_became_active":"2024-04-26T23:48:05.241549+0000","last_became_peered":"2024-04-26T23:48:05.241549+0000","last_unstale":"2024-04-26T23:48:06.665949+0000","last_undegraded":"2024-04-26T23:48:06.665949+0000","last_fullsized":"2024-04-26T23:48:06.665949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:10.342842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663859+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:06.663859+0000","last_peered":"2024-04-26T23:48:06.663859+0000","last_clean":"2024-04-26T23:48:06.663859+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:06.663859+0000","last_undegraded":"2024-04-26T23:48:06.663859+0000","last_fullsized":"2024-04-26T23:48:06.663859+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665347+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:06.665347+0000","last_peered":"2024-04-26T23:48:06.665347+0000","last_clean":"2024-04-26T23:48:06.665347+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:06.665347+0000","last_undegraded":"2024-04-26T23:48:06.665347+0000","last_fullsized":"2024-04-26T23:48:06.665347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666773+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:06.666773+0000","last_peered":"2024-04-26T23:48:06.666773+0000","last_clean":"2024-04-26T23:48:06.666773+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:06.666773+0000","last_undegraded":"2024-04-26T23:48:06.666773+0000","last_fullsized":"2024-04-26T23:48:06.666773+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663757+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:06.663757+0000","last_peered":"2024-04-26T23:48:06.663757+0000","last_clean":"2024-04-26T23:48:06.663757+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:06.663757+0000","last_undegraded":"2024-04-26T23:48:06.663757+0000","last_fullsized":"2024-04-26T23:48:06.663757+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663661+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:06.663661+0000","last_peered":"2024-04-26T23:48:06.663661+0000","last_clean":"2024-04-26T23:48:06.663661+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:06.663661+0000","last_undegraded":"2024-04-26T23:48:06.663661+0000","last_fullsized":"2024-04-26T23:48:06.663661+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666899+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:06.666899+0000","last_peered":"2024-04-26T23:48:06.666899+0000","last_clean":"2024-04-26T23:48:06.666899+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:06.666899+0000","last_undegraded":"2024-04-26T23:48:06.666899+0000","last_fullsized":"2024-04-26T23:48:06.666899+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664615+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:06.664615+0000","last_peered":"2024-04-26T23:48:06.664615+0000","last_clean":"2024-04-26T23:48:06.664615+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:06.664615+0000","last_undegraded":"2024-04-26T23:48:06.664615+0000","last_fullsized":"2024-04-26T23:48:06.664615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664505+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:06.664505+0000","last_peered":"2024-04-26T23:48:06.664505+0000","last_clean":"2024-04-26T23:48:06.664505+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:06.664505+0000","last_undegraded":"2024-04-26T23:48:06.664505+0000","last_fullsized":"2024-04-26T23:48:06.664505+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664395+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:06.664395+0000","last_peered":"2024-04-26T23:48:06.664395+0000","last_clean":"2024-04-26T23:48:06.664395+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:06.664395+0000","last_undegraded":"2024-04-26T23:48:06.664395+0000","last_fullsized":"2024-04-26T23:48:06.664395+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665484+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:06.665484+0000","last_peered":"2024-04-26T23:48:06.665484+0000","last_clean":"2024-04-26T23:48:06.665484+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:06.665484+0000","last_undegraded":"2024-04-26T23:48:06.665484+0000","last_fullsized":"2024-04-26T23:48:06.665484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.232319+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:06.232319+0000","last_peered":"2024-04-26T23:48:06.232319+0000","last_clean":"2024-04-26T23:48:06.232319+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:06.232319+0000","last_undegraded":"2024-04-26T23:48:06.232319+0000","last_fullsized":"2024-04-26T23:48:06.232319+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666209+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:06.666209+0000","last_peered":"2024-04-26T23:48:06.666209+0000","last_clean":"2024-04-26T23:48:06.666209+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:06.666209+0000","last_undegraded":"2024-04-26T23:48:06.666209+0000","last_fullsized":"2024-04-26T23:48:06.666209+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231506+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:06.231506+0000","last_peered":"2024-04-26T23:48:06.231506+0000","last_clean":"2024-04-26T23:48:06.231506+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:06.231506+0000","last_undegraded":"2024-04-26T23:48:06.231506+0000","last_fullsized":"2024-04-26T23:48:06.231506+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666218+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:06.666218+0000","last_peered":"2024-04-26T23:48:06.666218+0000","last_clean":"2024-04-26T23:48:06.666218+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:06.666218+0000","last_undegraded":"2024-04-26T23:48:06.666218+0000","last_fullsized":"2024-04-26T23:48:06.666218+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664178+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:06.664178+0000","last_peered":"2024-04-26T23:48:06.664178+0000","last_clean":"2024-04-26T23:48:06.664178+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:06.664178+0000","last_undegraded":"2024-04-26T23:48:06.664178+0000","last_fullsized":"2024-04-26T23:48:06.664178+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663510+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:06.663510+0000","last_peered":"2024-04-26T23:48:06.663510+0000","last_clean":"2024-04-26T23:48:06.663510+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:06.663510+0000","last_undegraded":"2024-04-26T23:48:06.663510+0000","last_fullsized":"2024-04-26T23:48:06.663510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663981+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:06.663981+0000","last_peered":"2024-04-26T23:48:06.663981+0000","last_clean":"2024-04-26T23:48:06.663981+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:06.663981+0000","last_undegraded":"2024-04-26T23:48:06.663981+0000","last_fullsized":"2024-04-26T23:48:06.663981+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.228174+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:06.228174+0000","last_peered":"2024-04-26T23:48:06.228174+0000","last_clean":"2024-04-26T23:48:06.228174+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:06.228174+0000","last_undegraded":"2024-04-26T23:48:06.228174+0000","last_fullsized":"2024-04-26T23:48:06.228174+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.230803+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:06.230803+0000","last_peered":"2024-04-26T23:48:06.230803+0000","last_clean":"2024-04-26T23:48:06.230803+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:06.230803+0000","last_undegraded":"2024-04-26T23:48:06.230803+0000","last_fullsized":"2024-04-26T23:48:06.230803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663923+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:06.663923+0000","last_peered":"2024-04-26T23:48:06.663923+0000","last_clean":"2024-04-26T23:48:06.663923+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:06.663923+0000","last_undegraded":"2024-04-26T23:48:06.663923+0000","last_fullsized":"2024-04-26T23:48:06.663923+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664652+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:06.664652+0000","last_peered":"2024-04-26T23:48:06.664652+0000","last_clean":"2024-04-26T23:48:06.664652+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:06.664652+0000","last_undegraded":"2024-04-26T23:48:06.664652+0000","last_fullsized":"2024-04-26T23:48:06.664652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664546+0000","last_change":"2024-04-26T23:48:05.234382+0000","last_active":"2024-04-26T23:48:06.664546+0000","last_peered":"2024-04-26T23:48:06.664546+0000","last_clean":"2024-04-26T23:48:06.664546+0000","last_became_active":"2024-04-26T23:48:05.234135+0000","last_became_peered":"2024-04-26T23:48:05.234135+0000","last_unstale":"2024-04-26T23:48:06.664546+0000","last_undegraded":"2024-04-26T23:48:06.664546+0000","last_fullsized":"2024-04-26T23:48:06.664546+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:49:55.611442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665722+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:06.665722+0000","last_peered":"2024-04-26T23:48:06.665722+0000","last_clean":"2024-04-26T23:48:06.665722+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:06.665722+0000","last_undegraded":"2024-04-26T23:48:06.665722+0000","last_fullsized":"2024-04-26T23:48:06.665722+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.666563+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:06.666563+0000","last_peered":"2024-04-26T23:48:06.666563+0000","last_clean":"2024-04-26T23:48:06.666563+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:06.666563+0000","last_undegraded":"2024-04-26T23:48:06.666563+0000","last_fullsized":"2024-04-26T23:48:06.666563+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664669+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:06.664669+0000","last_peered":"2024-04-26T23:48:06.664669+0000","last_clean":"2024-04-26T23:48:06.664669+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:06.664669+0000","last_undegraded":"2024-04-26T23:48:06.664669+0000","last_fullsized":"2024-04-26T23:48:06.664669+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665535+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:06.665535+0000","last_peered":"2024-04-26T23:48:06.665535+0000","last_clean":"2024-04-26T23:48:06.665535+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:06.665535+0000","last_undegraded":"2024-04-26T23:48:06.665535+0000","last_fullsized":"2024-04-26T23:48:06.665535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.667111+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:06.667111+0000","last_peered":"2024-04-26T23:48:06.667111+0000","last_clean":"2024-04-26T23:48:06.667111+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:06.667111+0000","last_undegraded":"2024-04-26T23:48:06.667111+0000","last_fullsized":"2024-04-26T23:48:06.667111+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.667104+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:06.667104+0000","last_peered":"2024-04-26T23:48:06.667104+0000","last_clean":"2024-04-26T23:48:06.667104+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:06.667104+0000","last_undegraded":"2024-04-26T23:48:06.667104+0000","last_fullsized":"2024-04-26T23:48:06.667104+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.228133+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:06.228133+0000","last_peered":"2024-04-26T23:48:06.228133+0000","last_clean":"2024-04-26T23:48:06.228133+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:06.228133+0000","last_undegraded":"2024-04-26T23:48:06.228133+0000","last_fullsized":"2024-04-26T23:48:06.228133+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663616+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:06.663616+0000","last_peered":"2024-04-26T23:48:06.663616+0000","last_clean":"2024-04-26T23:48:06.663616+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:06.663616+0000","last_undegraded":"2024-04-26T23:48:06.663616+0000","last_fullsized":"2024-04-26T23:48:06.663616+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.667025+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:06.667025+0000","last_peered":"2024-04-26T23:48:06.667025+0000","last_clean":"2024-04-26T23:48:06.667025+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:06.667025+0000","last_undegraded":"2024-04-26T23:48:06.667025+0000","last_fullsized":"2024-04-26T23:48:06.667025+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.663756+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:06.663756+0000","last_peered":"2024-04-26T23:48:06.663756+0000","last_clean":"2024-04-26T23:48:06.663756+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:06.663756+0000","last_undegraded":"2024-04-26T23:48:06.663756+0000","last_fullsized":"2024-04-26T23:48:06.663756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231171+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:06.231171+0000","last_peered":"2024-04-26T23:48:06.231171+0000","last_clean":"2024-04-26T23:48:06.231171+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:06.231171+0000","last_undegraded":"2024-04-26T23:48:06.231171+0000","last_fullsized":"2024-04-26T23:48:06.231171+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.230859+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:06.230859+0000","last_peered":"2024-04-26T23:48:06.230859+0000","last_clean":"2024-04-26T23:48:06.230859+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:06.230859+0000","last_undegraded":"2024-04-26T23:48:06.230859+0000","last_fullsized":"2024-04-26T23:48:06.230859+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.227972+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:06.227972+0000","last_peered":"2024-04-26T23:48:06.227972+0000","last_clean":"2024-04-26T23:48:06.227972+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:06.227972+0000","last_undegraded":"2024-04-26T23:48:06.227972+0000","last_fullsized":"2024-04-26T23:48:06.227972+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231115+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:06.231115+0000","last_peered":"2024-04-26T23:48:06.231115+0000","last_clean":"2024-04-26T23:48:06.231115+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:06.231115+0000","last_undegraded":"2024-04-26T23:48:06.231115+0000","last_fullsized":"2024-04-26T23:48:06.231115+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664749+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:06.664749+0000","last_peered":"2024-04-26T23:48:06.664749+0000","last_clean":"2024-04-26T23:48:06.664749+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:06.664749+0000","last_undegraded":"2024-04-26T23:48:06.664749+0000","last_fullsized":"2024-04-26T23:48:06.664749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665417+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:06.665417+0000","last_peered":"2024-04-26T23:48:06.665417+0000","last_clean":"2024-04-26T23:48:06.665417+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:06.665417+0000","last_undegraded":"2024-04-26T23:48:06.665417+0000","last_fullsized":"2024-04-26T23:48:06.665417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.231740+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:06.231740+0000","last_peered":"2024-04-26T23:48:06.231740+0000","last_clean":"2024-04-26T23:48:06.231740+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:06.231740+0000","last_undegraded":"2024-04-26T23:48:06.231740+0000","last_fullsized":"2024-04-26T23:48:06.231740+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":217,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665751+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:06.665751+0000","last_peered":"2024-04-26T23:48:06.665751+0000","last_clean":"2024-04-26T23:48:06.665751+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:06.665751+0000","last_undegraded":"2024-04-26T23:48:06.665751+0000","last_fullsized":"2024-04-26T23:48:06.665751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509477,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1167360,"data_stored":822798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":233012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509476,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":232410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509477,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":581632,"data_stored":233952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509476,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31756,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340084,"statfs":{"total":96636764160,"available":96604246016,"internally_reserved":0,"allocated":581632,"data_stored":232978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":233974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509476,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":573440,"data_stored":232410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":822742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:13.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:14.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dbc400640 1 Processor -- start 2024-04-26T23:48:14.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dbc400640 1 -- start start 2024-04-26T23:48:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dbc400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8db40d1860 0x7f8db4167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dbc400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db40cd830 con 0x7f8db4072150 2024-04-26T23:48:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dbc400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db4071080 con 0x7f8db4160810 2024-04-26T23:48:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dbc400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8db4071360 con 0x7f8db40d1860 2024-04-26T23:48:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8db9000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8db4072150 0x7f8db40d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37318/0 (socket says 172.21.15.47:37318) 2024-04-26T23:48:14.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8db9000640 1 -- 172.21.15.47:0/2043448649 learned_addr learned my addr 172.21.15.47:0/2043448649 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dba400640 1 --2- 172.21.15.47:0/2043448649 >> v2:172.21.15.203:3300/0 conn(0x7f8db40d1860 0x7f8db4167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8db3e00640 1 -- 172.21.15.47:0/2043448649 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150377423 0 0) 0x7f8db40cd830 con 0x7f8db4072150 2024-04-26T23:48:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8db3e00640 1 -- 172.21.15.47:0/2043448649 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d9c003530 con 0x7f8db4072150 2024-04-26T23:48:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dba400640 1 -- 172.21.15.47:0/2043448649 >> v1:172.21.15.203:6789/0 conn(0x7f8db4160810 legacy=0x7f8db4071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dba400640 1 -- 172.21.15.47:0/2043448649 >> v1:172.21.15.47:6789/0 conn(0x7f8db4072150 legacy=0x7f8db40d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.102+0000 7f8dba400640 1 -- 172.21.15.47:0/2043448649 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db40cdad0 con 0x7f8db40d1860 2024-04-26T23:48:14.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dba400640 1 --2- 172.21.15.47:0/2043448649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db40d1860 0x7f8db4167fc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009d90 tx=0x7f8dac01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79030dc50aef8e51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8db3e00640 1 -- 172.21.15.47:0/2043448649 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0b4070 con 0x7f8db40d1860 2024-04-26T23:48:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8db3e00640 1 -- 172.21.15.47:0/2043448649 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac0af600 con 0x7f8db40d1860 2024-04-26T23:48:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8db3e00640 1 -- 172.21.15.47:0/2043448649 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0af9d0 con 0x7f8db40d1860 2024-04-26T23:48:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dbc400640 1 -- 172.21.15.47:0/2043448649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db40d1860 msgr2=0x7f8db4167fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dbc400640 1 --2- 172.21.15.47:0/2043448649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db40d1860 0x7f8db4167fc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009d90 tx=0x7f8dac01f150 comp rx=0 tx=0).stop 2024-04-26T23:48:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dbc400640 1 -- 172.21.15.47:0/2043448649 shutdown_connections 2024-04-26T23:48:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dbc400640 1 --2- 172.21.15.47:0/2043448649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db40d1860 0x7f8db4167fc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dbc400640 1 -- 172.21.15.47:0/2043448649 >> 172.21.15.47:0/2043448649 conn(0x7f8db40d2e90 msgr2=0x7f8db40d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dbc400640 1 -- 172.21.15.47:0/2043448649 shutdown_connections 2024-04-26T23:48:14.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.106+0000 7f8dbc400640 1 -- 172.21.15.47:0/2043448649 wait complete. 2024-04-26T23:48:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 Processor -- start 2024-04-26T23:48:14.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 -- start start 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db4072150 0x7f8db41f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8db40d1860 0x7f8db40cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8db4160810 0x7f8db40b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4160d70 con 0x7f8db40d1860 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4160bf0 con 0x7f8db4072150 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8db40cf000 con 0x7f8db4160810 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8db40d1860 0x7f8db40cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8db40d1860 0x7f8db40cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44034/0 (socket says 172.21.15.47:44034) 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 -- 172.21.15.47:0/1132611025 learned_addr learned my addr 172.21.15.47:0/1132611025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dba400640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8db4160810 0x7f8db40b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9a00640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db4072150 0x7f8db41f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 -- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8db4160810 msgr2=0x7f8db40b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8db4160810 0x7f8db40b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 -- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db4072150 msgr2=0x7f8db41f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db4072150 0x7f8db41f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 -- 172.21.15.47:0/1132611025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db40cba30 con 0x7f8db40d1860 2024-04-26T23:48:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db9000640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8db40d1860 0x7f8db40cb4f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8da000c4d0 tx=0x7f8da000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db1600640 1 -- 172.21.15.47:0/1132611025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0017070 con 0x7f8db40d1860 2024-04-26T23:48:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db1600640 1 -- 172.21.15.47:0/1132611025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da0005cf0 con 0x7f8db40d1860 2024-04-26T23:48:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8db1600640 1 -- 172.21.15.47:0/1132611025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da0007270 con 0x7f8db40d1860 2024-04-26T23:48:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db40cbcd0 con 0x7f8db40d1860 2024-04-26T23:48:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.110+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db40b28a0 con 0x7f8db40d1860 2024-04-26T23:48:14.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.114+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db40b2bd0 con 0x7f8db40d1860 2024-04-26T23:48:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.114+0000 7f8db1600640 1 -- 172.21.15.47:0/1132611025 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f8da001a070 con 0x7f8db40d1860 2024-04-26T23:48:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.114+0000 7f8db1600640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d94068650 0x7f8d9406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.114+0000 7f8db1600640 1 -- 172.21.15.47:0/1132611025 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5767+0+0 (secure 0 0 0) 0x7f8da00860e0 con 0x7f8db40d1860 2024-04-26T23:48:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.114+0000 7f8db9a00640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d94068650 0x7f8d9406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.114+0000 7f8db9a00640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d94068650 0x7f8d9406ab10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8da80015b0 tx=0x7f8da8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.118+0000 7f8db1600640 1 -- 172.21.15.47:0/1132611025 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8da0055d10 con 0x7f8db40d1860 2024-04-26T23:48:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.282+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8db4069700 con 0x7f8d94068650 2024-04-26T23:48:14.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.290+0000 7f8db1600640 1 -- 172.21.15.47:0/1132611025 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f8db4069700 con 0x7f8d94068650 2024-04-26T23:48:14.299 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:14.301 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d94068650 msgr2=0x7f8d9406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d94068650 0x7f8d9406ab10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8da80015b0 tx=0x7f8da8009040 comp rx=0 tx=0).stop 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8db40d1860 msgr2=0x7f8db40cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8db40d1860 0x7f8db40cb4f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8da000c4d0 tx=0x7f8da000c990 comp rx=0 tx=0).stop 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 shutdown_connections 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8d94068650 0x7f8d9406ab10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8db4160810 0x7f8db40b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8db40d1860 0x7f8db40cb4f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 --2- 172.21.15.47:0/1132611025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8db4072150 0x7f8db41f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 >> 172.21.15.47:0/1132611025 conn(0x7f8db40d2e90 msgr2=0x7f8db40cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:14.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 shutdown_connections 2024-04-26T23:48:14.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.294+0000 7f8dbc400640 1 -- 172.21.15.47:0/1132611025 wait complete. 2024-04-26T23:48:14.320 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-04-26T23:48:14.270972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238556,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736164,"statfs":{"total":773094113280,"available":772849831936,"internally_reserved":0,"allocated":5894144,"data_stored":3086451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.042406"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467224+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:13.467224+0000","last_peered":"2024-04-26T23:48:13.467224+0000","last_clean":"2024-04-26T23:48:13.467224+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:13.467224+0000","last_undegraded":"2024-04-26T23:48:13.467224+0000","last_fullsized":"2024-04-26T23:48:13.467224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261817+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:13.261817+0000","last_peered":"2024-04-26T23:48:13.261817+0000","last_clean":"2024-04-26T23:48:13.261817+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:13.261817+0000","last_undegraded":"2024-04-26T23:48:13.261817+0000","last_fullsized":"2024-04-26T23:48:13.261817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665408+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:06.665408+0000","last_peered":"2024-04-26T23:48:06.665408+0000","last_clean":"2024-04-26T23:48:06.665408+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:06.665408+0000","last_undegraded":"2024-04-26T23:48:06.665408+0000","last_fullsized":"2024-04-26T23:48:06.665408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262483+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:13.262483+0000","last_peered":"2024-04-26T23:48:13.262483+0000","last_clean":"2024-04-26T23:48:13.262483+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:13.262483+0000","last_undegraded":"2024-04-26T23:48:13.262483+0000","last_fullsized":"2024-04-26T23:48:13.262483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465420+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:13.465420+0000","last_peered":"2024-04-26T23:48:13.465420+0000","last_clean":"2024-04-26T23:48:13.465420+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:13.465420+0000","last_undegraded":"2024-04-26T23:48:13.465420+0000","last_fullsized":"2024-04-26T23:48:13.465420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466901+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:13.466901+0000","last_peered":"2024-04-26T23:48:13.466901+0000","last_clean":"2024-04-26T23:48:13.466901+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:13.466901+0000","last_undegraded":"2024-04-26T23:48:13.466901+0000","last_fullsized":"2024-04-26T23:48:13.466901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664211+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:06.664211+0000","last_peered":"2024-04-26T23:48:06.664211+0000","last_clean":"2024-04-26T23:48:06.664211+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:06.664211+0000","last_undegraded":"2024-04-26T23:48:06.664211+0000","last_fullsized":"2024-04-26T23:48:06.664211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665384+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:06.665384+0000","last_peered":"2024-04-26T23:48:06.665384+0000","last_clean":"2024-04-26T23:48:06.665384+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:06.665384+0000","last_undegraded":"2024-04-26T23:48:06.665384+0000","last_fullsized":"2024-04-26T23:48:06.665384+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665422+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:06.665422+0000","last_peered":"2024-04-26T23:48:06.665422+0000","last_clean":"2024-04-26T23:48:06.665422+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:06.665422+0000","last_undegraded":"2024-04-26T23:48:06.665422+0000","last_fullsized":"2024-04-26T23:48:06.665422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665483+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:06.665483+0000","last_peered":"2024-04-26T23:48:06.665483+0000","last_clean":"2024-04-26T23:48:06.665483+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:06.665483+0000","last_undegraded":"2024-04-26T23:48:06.665483+0000","last_fullsized":"2024-04-26T23:48:06.665483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262670+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:13.262670+0000","last_peered":"2024-04-26T23:48:13.262670+0000","last_clean":"2024-04-26T23:48:13.262670+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:13.262670+0000","last_undegraded":"2024-04-26T23:48:13.262670+0000","last_fullsized":"2024-04-26T23:48:13.262670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465049+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:13.465049+0000","last_peered":"2024-04-26T23:48:13.465049+0000","last_clean":"2024-04-26T23:48:13.465049+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:13.465049+0000","last_undegraded":"2024-04-26T23:48:13.465049+0000","last_fullsized":"2024-04-26T23:48:13.465049+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664798+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:06.664798+0000","last_peered":"2024-04-26T23:48:06.664798+0000","last_clean":"2024-04-26T23:48:06.664798+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:06.664798+0000","last_undegraded":"2024-04-26T23:48:06.664798+0000","last_fullsized":"2024-04-26T23:48:06.664798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465009+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:13.465009+0000","last_peered":"2024-04-26T23:48:13.465009+0000","last_clean":"2024-04-26T23:48:13.465009+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:13.465009+0000","last_undegraded":"2024-04-26T23:48:13.465009+0000","last_fullsized":"2024-04-26T23:48:13.465009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265153+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:13.265153+0000","last_peered":"2024-04-26T23:48:13.265153+0000","last_clean":"2024-04-26T23:48:13.265153+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:13.265153+0000","last_undegraded":"2024-04-26T23:48:13.265153+0000","last_fullsized":"2024-04-26T23:48:13.265153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261987+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:13.261987+0000","last_peered":"2024-04-26T23:48:13.261987+0000","last_clean":"2024-04-26T23:48:13.261987+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:13.261987+0000","last_undegraded":"2024-04-26T23:48:13.261987+0000","last_fullsized":"2024-04-26T23:48:13.261987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262037+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:13.262037+0000","last_peered":"2024-04-26T23:48:13.262037+0000","last_clean":"2024-04-26T23:48:13.262037+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:13.262037+0000","last_undegraded":"2024-04-26T23:48:13.262037+0000","last_fullsized":"2024-04-26T23:48:13.262037+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265949+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:13.265949+0000","last_peered":"2024-04-26T23:48:13.265949+0000","last_clean":"2024-04-26T23:48:13.265949+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:13.265949+0000","last_undegraded":"2024-04-26T23:48:13.265949+0000","last_fullsized":"2024-04-26T23:48:13.265949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465359+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:13.465359+0000","last_peered":"2024-04-26T23:48:13.465359+0000","last_clean":"2024-04-26T23:48:13.465359+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:13.465359+0000","last_undegraded":"2024-04-26T23:48:13.465359+0000","last_fullsized":"2024-04-26T23:48:13.465359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465567+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:13.465567+0000","last_peered":"2024-04-26T23:48:13.465567+0000","last_clean":"2024-04-26T23:48:13.465567+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:13.465567+0000","last_undegraded":"2024-04-26T23:48:13.465567+0000","last_fullsized":"2024-04-26T23:48:13.465567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665008+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:06.665008+0000","last_peered":"2024-04-26T23:48:06.665008+0000","last_clean":"2024-04-26T23:48:06.665008+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:06.665008+0000","last_undegraded":"2024-04-26T23:48:06.665008+0000","last_fullsized":"2024-04-26T23:48:06.665008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265223+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:13.265223+0000","last_peered":"2024-04-26T23:48:13.265223+0000","last_clean":"2024-04-26T23:48:13.265223+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:13.265223+0000","last_undegraded":"2024-04-26T23:48:13.265223+0000","last_fullsized":"2024-04-26T23:48:13.265223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265180+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:13.265180+0000","last_peered":"2024-04-26T23:48:13.265180+0000","last_clean":"2024-04-26T23:48:13.265180+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:13.265180+0000","last_undegraded":"2024-04-26T23:48:13.265180+0000","last_fullsized":"2024-04-26T23:48:13.265180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265900+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:13.265900+0000","last_peered":"2024-04-26T23:48:13.265900+0000","last_clean":"2024-04-26T23:48:13.265900+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:13.265900+0000","last_undegraded":"2024-04-26T23:48:13.265900+0000","last_fullsized":"2024-04-26T23:48:13.265900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465065+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:13.465065+0000","last_peered":"2024-04-26T23:48:13.465065+0000","last_clean":"2024-04-26T23:48:13.465065+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:13.465065+0000","last_undegraded":"2024-04-26T23:48:13.465065+0000","last_fullsized":"2024-04-26T23:48:13.465065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261872+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:13.261872+0000","last_peered":"2024-04-26T23:48:13.261872+0000","last_clean":"2024-04-26T23:48:13.261872+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:13.261872+0000","last_undegraded":"2024-04-26T23:48:13.261872+0000","last_fullsized":"2024-04-26T23:48:13.261872+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262762+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:13.262762+0000","last_peered":"2024-04-26T23:48:13.262762+0000","last_clean":"2024-04-26T23:48:13.262762+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:13.262762+0000","last_undegraded":"2024-04-26T23:48:13.262762+0000","last_fullsized":"2024-04-26T23:48:13.262762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265301+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:13.265301+0000","last_peered":"2024-04-26T23:48:13.265301+0000","last_clean":"2024-04-26T23:48:13.265301+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:13.265301+0000","last_undegraded":"2024-04-26T23:48:13.265301+0000","last_fullsized":"2024-04-26T23:48:13.265301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261496+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:13.261496+0000","last_peered":"2024-04-26T23:48:13.261496+0000","last_clean":"2024-04-26T23:48:13.261496+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:13.261496+0000","last_undegraded":"2024-04-26T23:48:13.261496+0000","last_fullsized":"2024-04-26T23:48:13.261496+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465121+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:13.465121+0000","last_peered":"2024-04-26T23:48:13.465121+0000","last_clean":"2024-04-26T23:48:13.465121+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:13.465121+0000","last_undegraded":"2024-04-26T23:48:13.465121+0000","last_fullsized":"2024-04-26T23:48:13.465121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464975+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:13.464975+0000","last_peered":"2024-04-26T23:48:13.464975+0000","last_clean":"2024-04-26T23:48:13.464975+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:13.464975+0000","last_undegraded":"2024-04-26T23:48:13.464975+0000","last_fullsized":"2024-04-26T23:48:13.464975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264054+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:13.264054+0000","last_peered":"2024-04-26T23:48:13.264054+0000","last_clean":"2024-04-26T23:48:13.264054+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:13.264054+0000","last_undegraded":"2024-04-26T23:48:13.264054+0000","last_fullsized":"2024-04-26T23:48:13.264054+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465930+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:13.465930+0000","last_peered":"2024-04-26T23:48:13.465930+0000","last_clean":"2024-04-26T23:48:13.465930+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:13.465930+0000","last_undegraded":"2024-04-26T23:48:13.465930+0000","last_fullsized":"2024-04-26T23:48:13.465930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265798+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:13.265798+0000","last_peered":"2024-04-26T23:48:13.265798+0000","last_clean":"2024-04-26T23:48:13.265798+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:13.265798+0000","last_undegraded":"2024-04-26T23:48:13.265798+0000","last_fullsized":"2024-04-26T23:48:13.265798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262239+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:13.262239+0000","last_peered":"2024-04-26T23:48:13.262239+0000","last_clean":"2024-04-26T23:48:13.262239+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:13.262239+0000","last_undegraded":"2024-04-26T23:48:13.262239+0000","last_fullsized":"2024-04-26T23:48:13.262239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262764+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:13.262764+0000","last_peered":"2024-04-26T23:48:13.262764+0000","last_clean":"2024-04-26T23:48:13.262764+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:13.262764+0000","last_undegraded":"2024-04-26T23:48:13.262764+0000","last_fullsized":"2024-04-26T23:48:13.262764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264321+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:13.264321+0000","last_peered":"2024-04-26T23:48:13.264321+0000","last_clean":"2024-04-26T23:48:13.264321+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:13.264321+0000","last_undegraded":"2024-04-26T23:48:13.264321+0000","last_fullsized":"2024-04-26T23:48:13.264321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264217+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:13.264217+0000","last_peered":"2024-04-26T23:48:13.264217+0000","last_clean":"2024-04-26T23:48:13.264217+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:13.264217+0000","last_undegraded":"2024-04-26T23:48:13.264217+0000","last_fullsized":"2024-04-26T23:48:13.264217+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467039+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:13.467039+0000","last_peered":"2024-04-26T23:48:13.467039+0000","last_clean":"2024-04-26T23:48:13.467039+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:13.467039+0000","last_undegraded":"2024-04-26T23:48:13.467039+0000","last_fullsized":"2024-04-26T23:48:13.467039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261650+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:13.261650+0000","last_peered":"2024-04-26T23:48:13.261650+0000","last_clean":"2024-04-26T23:48:13.261650+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:13.261650+0000","last_undegraded":"2024-04-26T23:48:13.261650+0000","last_fullsized":"2024-04-26T23:48:13.261650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465723+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:13.465723+0000","last_peered":"2024-04-26T23:48:13.465723+0000","last_clean":"2024-04-26T23:48:13.465723+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:13.465723+0000","last_undegraded":"2024-04-26T23:48:13.465723+0000","last_fullsized":"2024-04-26T23:48:13.465723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665133+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:06.665133+0000","last_peered":"2024-04-26T23:48:06.665133+0000","last_clean":"2024-04-26T23:48:06.665133+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:06.665133+0000","last_undegraded":"2024-04-26T23:48:06.665133+0000","last_fullsized":"2024-04-26T23:48:06.665133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261734+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:13.261734+0000","last_peered":"2024-04-26T23:48:13.261734+0000","last_clean":"2024-04-26T23:48:13.261734+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:13.261734+0000","last_undegraded":"2024-04-26T23:48:13.261734+0000","last_fullsized":"2024-04-26T23:48:13.261734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664470+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:06.664470+0000","last_peered":"2024-04-26T23:48:06.664470+0000","last_clean":"2024-04-26T23:48:06.664470+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:06.664470+0000","last_undegraded":"2024-04-26T23:48:06.664470+0000","last_fullsized":"2024-04-26T23:48:06.664470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262066+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:13.262066+0000","last_peered":"2024-04-26T23:48:13.262066+0000","last_clean":"2024-04-26T23:48:13.262066+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:13.262066+0000","last_undegraded":"2024-04-26T23:48:13.262066+0000","last_fullsized":"2024-04-26T23:48:13.262066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265173+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:13.265173+0000","last_peered":"2024-04-26T23:48:13.265173+0000","last_clean":"2024-04-26T23:48:13.265173+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:13.265173+0000","last_undegraded":"2024-04-26T23:48:13.265173+0000","last_fullsized":"2024-04-26T23:48:13.265173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664523+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:06.664523+0000","last_peered":"2024-04-26T23:48:06.664523+0000","last_clean":"2024-04-26T23:48:06.664523+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:06.664523+0000","last_undegraded":"2024-04-26T23:48:06.664523+0000","last_fullsized":"2024-04-26T23:48:06.664523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262137+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:13.262137+0000","last_peered":"2024-04-26T23:48:13.262137+0000","last_clean":"2024-04-26T23:48:13.262137+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:13.262137+0000","last_undegraded":"2024-04-26T23:48:13.262137+0000","last_fullsized":"2024-04-26T23:48:13.262137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262297+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:13.262297+0000","last_peered":"2024-04-26T23:48:13.262297+0000","last_clean":"2024-04-26T23:48:13.262297+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:13.262297+0000","last_undegraded":"2024-04-26T23:48:13.262297+0000","last_fullsized":"2024-04-26T23:48:13.262297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467273+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:13.467273+0000","last_peered":"2024-04-26T23:48:13.467273+0000","last_clean":"2024-04-26T23:48:13.467273+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:13.467273+0000","last_undegraded":"2024-04-26T23:48:13.467273+0000","last_fullsized":"2024-04-26T23:48:13.467273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665469+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:06.665469+0000","last_peered":"2024-04-26T23:48:06.665469+0000","last_clean":"2024-04-26T23:48:06.665469+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:06.665469+0000","last_undegraded":"2024-04-26T23:48:06.665469+0000","last_fullsized":"2024-04-26T23:48:06.665469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465548+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:13.465548+0000","last_peered":"2024-04-26T23:48:13.465548+0000","last_clean":"2024-04-26T23:48:13.465548+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:13.465548+0000","last_undegraded":"2024-04-26T23:48:13.465548+0000","last_fullsized":"2024-04-26T23:48:13.465548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467210+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:13.467210+0000","last_peered":"2024-04-26T23:48:13.467210+0000","last_clean":"2024-04-26T23:48:13.467210+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:13.467210+0000","last_undegraded":"2024-04-26T23:48:13.467210+0000","last_fullsized":"2024-04-26T23:48:13.467210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467087+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:13.467087+0000","last_peered":"2024-04-26T23:48:13.467087+0000","last_clean":"2024-04-26T23:48:13.467087+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:13.467087+0000","last_undegraded":"2024-04-26T23:48:13.467087+0000","last_fullsized":"2024-04-26T23:48:13.467087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465415+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:13.465415+0000","last_peered":"2024-04-26T23:48:13.465415+0000","last_clean":"2024-04-26T23:48:13.465415+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:13.465415+0000","last_undegraded":"2024-04-26T23:48:13.465415+0000","last_fullsized":"2024-04-26T23:48:13.465415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"peering","last_fresh":"2024-04-26T23:48:06.666012+0000","last_change":"2024-04-26T23:48:13.265524+0000","last_active":"2024-04-26T23:48:13.265524+0000","last_peered":"2024-04-26T23:48:06.666012+0000","last_clean":"2024-04-26T23:48:06.666012+0000","last_became_active":"2024-04-26T23:48:05.241549+0000","last_became_peered":"2024-04-26T23:48:05.241549+0000","last_unstale":"2024-04-26T23:48:06.666012+0000","last_undegraded":"2024-04-26T23:48:06.666012+0000","last_fullsized":"2024-04-26T23:48:06.666012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465895+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:13.465895+0000","last_peered":"2024-04-26T23:48:13.465895+0000","last_clean":"2024-04-26T23:48:13.465895+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:13.465895+0000","last_undegraded":"2024-04-26T23:48:13.465895+0000","last_fullsized":"2024-04-26T23:48:13.465895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665347+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:06.665347+0000","last_peered":"2024-04-26T23:48:06.665347+0000","last_clean":"2024-04-26T23:48:06.665347+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:06.665347+0000","last_undegraded":"2024-04-26T23:48:06.665347+0000","last_fullsized":"2024-04-26T23:48:06.665347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467069+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:13.467069+0000","last_peered":"2024-04-26T23:48:13.467069+0000","last_clean":"2024-04-26T23:48:13.467069+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:13.467069+0000","last_undegraded":"2024-04-26T23:48:13.467069+0000","last_fullsized":"2024-04-26T23:48:13.467069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464910+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:13.464910+0000","last_peered":"2024-04-26T23:48:13.464910+0000","last_clean":"2024-04-26T23:48:13.464910+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:13.464910+0000","last_undegraded":"2024-04-26T23:48:13.464910+0000","last_fullsized":"2024-04-26T23:48:13.464910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465285+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:13.465285+0000","last_peered":"2024-04-26T23:48:13.465285+0000","last_clean":"2024-04-26T23:48:13.465285+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:13.465285+0000","last_undegraded":"2024-04-26T23:48:13.465285+0000","last_fullsized":"2024-04-26T23:48:13.465285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466990+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:13.466990+0000","last_peered":"2024-04-26T23:48:13.466990+0000","last_clean":"2024-04-26T23:48:13.466990+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:13.466990+0000","last_undegraded":"2024-04-26T23:48:13.466990+0000","last_fullsized":"2024-04-26T23:48:13.466990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664615+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:06.664615+0000","last_peered":"2024-04-26T23:48:06.664615+0000","last_clean":"2024-04-26T23:48:06.664615+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:06.664615+0000","last_undegraded":"2024-04-26T23:48:06.664615+0000","last_fullsized":"2024-04-26T23:48:06.664615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465317+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:13.465317+0000","last_peered":"2024-04-26T23:48:13.465317+0000","last_clean":"2024-04-26T23:48:13.465317+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:13.465317+0000","last_undegraded":"2024-04-26T23:48:13.465317+0000","last_fullsized":"2024-04-26T23:48:13.465317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465169+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:13.465169+0000","last_peered":"2024-04-26T23:48:13.465169+0000","last_clean":"2024-04-26T23:48:13.465169+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:13.465169+0000","last_undegraded":"2024-04-26T23:48:13.465169+0000","last_fullsized":"2024-04-26T23:48:13.465169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665484+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:06.665484+0000","last_peered":"2024-04-26T23:48:06.665484+0000","last_clean":"2024-04-26T23:48:06.665484+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:06.665484+0000","last_undegraded":"2024-04-26T23:48:06.665484+0000","last_fullsized":"2024-04-26T23:48:06.665484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262363+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:13.262363+0000","last_peered":"2024-04-26T23:48:13.262363+0000","last_clean":"2024-04-26T23:48:13.262363+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:13.262363+0000","last_undegraded":"2024-04-26T23:48:13.262363+0000","last_fullsized":"2024-04-26T23:48:13.262363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265616+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:13.265616+0000","last_peered":"2024-04-26T23:48:13.265616+0000","last_clean":"2024-04-26T23:48:13.265616+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:13.265616+0000","last_undegraded":"2024-04-26T23:48:13.265616+0000","last_fullsized":"2024-04-26T23:48:13.265616+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265773+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:13.265773+0000","last_peered":"2024-04-26T23:48:13.265773+0000","last_clean":"2024-04-26T23:48:13.265773+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:13.265773+0000","last_undegraded":"2024-04-26T23:48:13.265773+0000","last_fullsized":"2024-04-26T23:48:13.265773+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465668+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:13.465668+0000","last_peered":"2024-04-26T23:48:13.465668+0000","last_clean":"2024-04-26T23:48:13.465668+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:13.465668+0000","last_undegraded":"2024-04-26T23:48:13.465668+0000","last_fullsized":"2024-04-26T23:48:13.465668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465471+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:13.465471+0000","last_peered":"2024-04-26T23:48:13.465471+0000","last_clean":"2024-04-26T23:48:13.465471+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:13.465471+0000","last_undegraded":"2024-04-26T23:48:13.465471+0000","last_fullsized":"2024-04-26T23:48:13.465471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466010+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:13.466010+0000","last_peered":"2024-04-26T23:48:13.466010+0000","last_clean":"2024-04-26T23:48:13.466010+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:13.466010+0000","last_undegraded":"2024-04-26T23:48:13.466010+0000","last_fullsized":"2024-04-26T23:48:13.466010+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263881+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:13.263881+0000","last_peered":"2024-04-26T23:48:13.263881+0000","last_clean":"2024-04-26T23:48:13.263881+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:13.263881+0000","last_undegraded":"2024-04-26T23:48:13.263881+0000","last_fullsized":"2024-04-26T23:48:13.263881+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262263+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:13.262263+0000","last_peered":"2024-04-26T23:48:13.262263+0000","last_clean":"2024-04-26T23:48:13.262263+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:13.262263+0000","last_undegraded":"2024-04-26T23:48:13.262263+0000","last_fullsized":"2024-04-26T23:48:13.262263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465110+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:13.465110+0000","last_peered":"2024-04-26T23:48:13.465110+0000","last_clean":"2024-04-26T23:48:13.465110+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:13.465110+0000","last_undegraded":"2024-04-26T23:48:13.465110+0000","last_fullsized":"2024-04-26T23:48:13.465110+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664652+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:06.664652+0000","last_peered":"2024-04-26T23:48:06.664652+0000","last_clean":"2024-04-26T23:48:06.664652+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:06.664652+0000","last_undegraded":"2024-04-26T23:48:06.664652+0000","last_fullsized":"2024-04-26T23:48:06.664652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":2,"reported_epoch":50,"state":"peering","last_fresh":"2024-04-26T23:48:08.229566+0000","last_change":"2024-04-26T23:48:14.233851+0000","last_active":"2024-04-26T23:48:14.233851+0000","last_peered":"2024-04-26T23:48:08.229566+0000","last_clean":"2024-04-26T23:48:08.229566+0000","last_became_active":"2024-04-26T23:48:05.234135+0000","last_became_peered":"2024-04-26T23:48:05.234135+0000","last_unstale":"2024-04-26T23:48:08.229566+0000","last_undegraded":"2024-04-26T23:48:08.229566+0000","last_fullsized":"2024-04-26T23:48:08.229566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466803+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:13.466803+0000","last_peered":"2024-04-26T23:48:13.466803+0000","last_clean":"2024-04-26T23:48:13.466803+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:13.466803+0000","last_undegraded":"2024-04-26T23:48:13.466803+0000","last_fullsized":"2024-04-26T23:48:13.466803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.266233+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:13.266233+0000","last_peered":"2024-04-26T23:48:13.266233+0000","last_clean":"2024-04-26T23:48:13.266233+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:13.266233+0000","last_undegraded":"2024-04-26T23:48:13.266233+0000","last_fullsized":"2024-04-26T23:48:13.266233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465822+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:13.465822+0000","last_peered":"2024-04-26T23:48:13.465822+0000","last_clean":"2024-04-26T23:48:13.465822+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:13.465822+0000","last_undegraded":"2024-04-26T23:48:13.465822+0000","last_fullsized":"2024-04-26T23:48:13.465822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665535+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:06.665535+0000","last_peered":"2024-04-26T23:48:06.665535+0000","last_clean":"2024-04-26T23:48:06.665535+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:06.665535+0000","last_undegraded":"2024-04-26T23:48:06.665535+0000","last_fullsized":"2024-04-26T23:48:06.665535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467308+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:13.467308+0000","last_peered":"2024-04-26T23:48:13.467308+0000","last_clean":"2024-04-26T23:48:13.467308+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:13.467308+0000","last_undegraded":"2024-04-26T23:48:13.467308+0000","last_fullsized":"2024-04-26T23:48:13.467308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467160+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:13.467160+0000","last_peered":"2024-04-26T23:48:13.467160+0000","last_clean":"2024-04-26T23:48:13.467160+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:13.467160+0000","last_undegraded":"2024-04-26T23:48:13.467160+0000","last_fullsized":"2024-04-26T23:48:13.467160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263889+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:13.263889+0000","last_peered":"2024-04-26T23:48:13.263889+0000","last_clean":"2024-04-26T23:48:13.263889+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:13.263889+0000","last_undegraded":"2024-04-26T23:48:13.263889+0000","last_fullsized":"2024-04-26T23:48:13.263889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465536+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:13.465536+0000","last_peered":"2024-04-26T23:48:13.465536+0000","last_clean":"2024-04-26T23:48:13.465536+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:13.465536+0000","last_undegraded":"2024-04-26T23:48:13.465536+0000","last_fullsized":"2024-04-26T23:48:13.465536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467161+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:13.467161+0000","last_peered":"2024-04-26T23:48:13.467161+0000","last_clean":"2024-04-26T23:48:13.467161+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:13.467161+0000","last_undegraded":"2024-04-26T23:48:13.467161+0000","last_fullsized":"2024-04-26T23:48:13.467161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465769+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:13.465769+0000","last_peered":"2024-04-26T23:48:13.465769+0000","last_clean":"2024-04-26T23:48:13.465769+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:13.465769+0000","last_undegraded":"2024-04-26T23:48:13.465769+0000","last_fullsized":"2024-04-26T23:48:13.465769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261840+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:13.261840+0000","last_peered":"2024-04-26T23:48:13.261840+0000","last_clean":"2024-04-26T23:48:13.261840+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:13.261840+0000","last_undegraded":"2024-04-26T23:48:13.261840+0000","last_fullsized":"2024-04-26T23:48:13.261840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261873+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:13.261873+0000","last_peered":"2024-04-26T23:48:13.261873+0000","last_clean":"2024-04-26T23:48:13.261873+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:13.261873+0000","last_undegraded":"2024-04-26T23:48:13.261873+0000","last_fullsized":"2024-04-26T23:48:13.261873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264422+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:13.264422+0000","last_peered":"2024-04-26T23:48:13.264422+0000","last_clean":"2024-04-26T23:48:13.264422+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:13.264422+0000","last_undegraded":"2024-04-26T23:48:13.264422+0000","last_fullsized":"2024-04-26T23:48:13.264422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261503+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:13.261503+0000","last_peered":"2024-04-26T23:48:13.261503+0000","last_clean":"2024-04-26T23:48:13.261503+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:13.261503+0000","last_undegraded":"2024-04-26T23:48:13.261503+0000","last_fullsized":"2024-04-26T23:48:13.261503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664749+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:06.664749+0000","last_peered":"2024-04-26T23:48:06.664749+0000","last_clean":"2024-04-26T23:48:06.664749+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:06.664749+0000","last_undegraded":"2024-04-26T23:48:06.664749+0000","last_fullsized":"2024-04-26T23:48:06.664749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665417+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:06.665417+0000","last_peered":"2024-04-26T23:48:06.665417+0000","last_clean":"2024-04-26T23:48:06.665417+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:06.665417+0000","last_undegraded":"2024-04-26T23:48:06.665417+0000","last_fullsized":"2024-04-26T23:48:06.665417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263115+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:13.263115+0000","last_peered":"2024-04-26T23:48:13.263115+0000","last_clean":"2024-04-26T23:48:13.263115+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:13.263115+0000","last_undegraded":"2024-04-26T23:48:13.263115+0000","last_fullsized":"2024-04-26T23:48:13.263115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466845+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:13.466845+0000","last_peered":"2024-04-26T23:48:13.466845+0000","last_clean":"2024-04-26T23:48:13.466845+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:13.466845+0000","last_undegraded":"2024-04-26T23:48:13.466845+0000","last_fullsized":"2024-04-26T23:48:13.466845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":239037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":239977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":239003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":598016,"data_stored":239999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":822742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:14.324 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:14.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 Processor -- start 2024-04-26T23:48:14.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 -- start start 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe82c15f080 0x7fe82c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c0cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe82c0731e0 0x7fe82c073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c0b6c90 con 0x7fe82c15f080 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c0b4db0 con 0x7fe82c0731e0 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe832e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c0b5090 con 0x7fe82c0b6830 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe82be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe82c15f080 0x7fe82c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe82be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe82c15f080 0x7fe82c0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44050/0 (socket says 172.21.15.47:44050) 2024-04-26T23:48:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.498+0000 7fe82be00640 1 -- 172.21.15.47:0/2419900644 learned_addr learned my addr 172.21.15.47:0/2419900644 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe830e00640 1 --2- 172.21.15.47:0/2419900644 >> v2:172.21.15.203:3300/0 conn(0x7fe82c0731e0 0x7fe82c073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe823e00640 1 --2- 172.21.15.47:0/2419900644 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c0cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82be00640 1 -- 172.21.15.47:0/2419900644 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 msgr2=0x7fe82c0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82be00640 1 --2- 172.21.15.47:0/2419900644 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c0cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82be00640 1 -- 172.21.15.47:0/2419900644 >> v2:172.21.15.203:3300/0 conn(0x7fe82c0731e0 msgr2=0x7fe82c073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82be00640 1 --2- 172.21.15.47:0/2419900644 >> v2:172.21.15.203:3300/0 conn(0x7fe82c0731e0 0x7fe82c073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82be00640 1 -- 172.21.15.47:0/2419900644 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0ce210 con 0x7fe82c15f080 2024-04-26T23:48:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe823e00640 1 --2- 172.21.15.47:0/2419900644 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c0cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82be00640 1 --2- 172.21.15.47:0/2419900644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0b47d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0b41a0 tx=0x7fe81c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a18a7a6291283f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82b400640 1 -- 172.21.15.47:0/2419900644 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0b0070 con 0x7fe82c15f080 2024-04-26T23:48:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82b400640 1 -- 172.21.15.47:0/2419900644 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c0ab600 con 0x7fe82c15f080 2024-04-26T23:48:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe82b400640 1 -- 172.21.15.47:0/2419900644 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0ab9d0 con 0x7fe82c15f080 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe832e00640 1 -- 172.21.15.47:0/2419900644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 msgr2=0x7fe82c0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.502+0000 7fe832e00640 1 --2- 172.21.15.47:0/2419900644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0b47d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe82c0b41a0 tx=0x7fe81c01c520 comp rx=0 tx=0).stop 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- 172.21.15.47:0/2419900644 shutdown_connections 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 --2- 172.21.15.47:0/2419900644 >> v2:172.21.15.203:3300/0 conn(0x7fe82c0731e0 0x7fe82c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 --2- 172.21.15.47:0/2419900644 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c0cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 --2- 172.21.15.47:0/2419900644 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0b47d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- 172.21.15.47:0/2419900644 >> 172.21.15.47:0/2419900644 conn(0x7fe82c075c20 msgr2=0x7fe82c076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- 172.21.15.47:0/2419900644 shutdown_connections 2024-04-26T23:48:14.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- 172.21.15.47:0/2419900644 wait complete. 2024-04-26T23:48:14.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 Processor -- start 2024-04-26T23:48:14.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- start start 2024-04-26T23:48:14.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe82c0731e0 0x7fe82c14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c15f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0d0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c15f5e0 con 0x7fe82c15f080 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c15f460 con 0x7fe82c0731e0 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe832e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c06f120 con 0x7fe82c0b6830 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0d0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0d0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44064/0 (socket says 172.21.15.47:44064) 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 -- 172.21.15.47:0/978197209 learned_addr learned my addr 172.21.15.47:0/978197209 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe823e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe82be00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe82c0731e0 0x7fe82c14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 -- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 msgr2=0x7fe82c15f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c15f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 -- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe82c0731e0 msgr2=0x7fe82c14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe82c0731e0 0x7fe82c14b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 -- 172.21.15.47:0/978197209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c14bb60 con 0x7fe82c15f080 2024-04-26T23:48:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe823e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c15f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:14.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe830e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0d0720 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe824007e70 tx=0x7fe82400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe828c00640 1 -- 172.21.15.47:0/978197209 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824014420 con 0x7fe82c15f080 2024-04-26T23:48:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe828c00640 1 -- 172.21.15.47:0/978197209 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe824019070 con 0x7fe82c15f080 2024-04-26T23:48:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.506+0000 7fe828c00640 1 -- 172.21.15.47:0/978197209 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824014820 con 0x7fe82c15f080 2024-04-26T23:48:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.510+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c14bdd0 con 0x7fe82c15f080 2024-04-26T23:48:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.510+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c14c390 con 0x7fe82c15f080 2024-04-26T23:48:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.510+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c069700 con 0x7fe82c15f080 2024-04-26T23:48:14.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.510+0000 7fe828c00640 1 -- 172.21.15.47:0/978197209 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe8240149c0 con 0x7fe82c15f080 2024-04-26T23:48:14.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.510+0000 7fe828c00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe808068650 0x7fe80806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.510+0000 7fe828c00640 1 -- 172.21.15.47:0/978197209 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fe8240875b0 con 0x7fe82c15f080 2024-04-26T23:48:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.510+0000 7fe82be00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe808068650 0x7fe80806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.514+0000 7fe82be00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe808068650 0x7fe80806ab10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0ad000 tx=0x7fe81c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.514+0000 7fe828c00640 1 -- 172.21.15.47:0/978197209 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe824057830 con 0x7fe82c15f080 2024-04-26T23:48:14.683 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.678+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe82c06da40 con 0x7fe808068650 2024-04-26T23:48:14.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe828c00640 1 -- 172.21.15.47:0/978197209 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7fe82c06da40 con 0x7fe808068650 2024-04-26T23:48:14.693 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:14.694 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe808068650 msgr2=0x7fe80806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe808068650 0x7fe80806ab10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0ad000 tx=0x7fe81c008040 comp rx=0 tx=0).stop 2024-04-26T23:48:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 msgr2=0x7fe82c0d0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0d0720 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe824007e70 tx=0x7fe82400e4b0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 shutdown_connections 2024-04-26T23:48:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe808068650 0x7fe80806ab10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe82c15f080 0x7fe82c0d0720 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe82c0b6830 0x7fe82c15f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 --2- 172.21.15.47:0/978197209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe82c0731e0 0x7fe82c14b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 >> 172.21.15.47:0/978197209 conn(0x7fe82c075c20 msgr2=0x7fe82c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 shutdown_connections 2024-04-26T23:48:14.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.686+0000 7fe832e00640 1 -- 172.21.15.47:0/978197209 wait complete. 2024-04-26T23:48:14.712 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-04-26T23:48:14.270972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238556,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736164,"statfs":{"total":773094113280,"available":772849831936,"internally_reserved":0,"allocated":5894144,"data_stored":3086451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.042406"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467224+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:13.467224+0000","last_peered":"2024-04-26T23:48:13.467224+0000","last_clean":"2024-04-26T23:48:13.467224+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:13.467224+0000","last_undegraded":"2024-04-26T23:48:13.467224+0000","last_fullsized":"2024-04-26T23:48:13.467224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261817+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:13.261817+0000","last_peered":"2024-04-26T23:48:13.261817+0000","last_clean":"2024-04-26T23:48:13.261817+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:13.261817+0000","last_undegraded":"2024-04-26T23:48:13.261817+0000","last_fullsized":"2024-04-26T23:48:13.261817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665408+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:06.665408+0000","last_peered":"2024-04-26T23:48:06.665408+0000","last_clean":"2024-04-26T23:48:06.665408+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:06.665408+0000","last_undegraded":"2024-04-26T23:48:06.665408+0000","last_fullsized":"2024-04-26T23:48:06.665408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262483+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:13.262483+0000","last_peered":"2024-04-26T23:48:13.262483+0000","last_clean":"2024-04-26T23:48:13.262483+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:13.262483+0000","last_undegraded":"2024-04-26T23:48:13.262483+0000","last_fullsized":"2024-04-26T23:48:13.262483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465420+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:13.465420+0000","last_peered":"2024-04-26T23:48:13.465420+0000","last_clean":"2024-04-26T23:48:13.465420+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:13.465420+0000","last_undegraded":"2024-04-26T23:48:13.465420+0000","last_fullsized":"2024-04-26T23:48:13.465420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466901+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:13.466901+0000","last_peered":"2024-04-26T23:48:13.466901+0000","last_clean":"2024-04-26T23:48:13.466901+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:13.466901+0000","last_undegraded":"2024-04-26T23:48:13.466901+0000","last_fullsized":"2024-04-26T23:48:13.466901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664211+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:06.664211+0000","last_peered":"2024-04-26T23:48:06.664211+0000","last_clean":"2024-04-26T23:48:06.664211+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:06.664211+0000","last_undegraded":"2024-04-26T23:48:06.664211+0000","last_fullsized":"2024-04-26T23:48:06.664211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665384+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:06.665384+0000","last_peered":"2024-04-26T23:48:06.665384+0000","last_clean":"2024-04-26T23:48:06.665384+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:06.665384+0000","last_undegraded":"2024-04-26T23:48:06.665384+0000","last_fullsized":"2024-04-26T23:48:06.665384+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665422+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:06.665422+0000","last_peered":"2024-04-26T23:48:06.665422+0000","last_clean":"2024-04-26T23:48:06.665422+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:06.665422+0000","last_undegraded":"2024-04-26T23:48:06.665422+0000","last_fullsized":"2024-04-26T23:48:06.665422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665483+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:06.665483+0000","last_peered":"2024-04-26T23:48:06.665483+0000","last_clean":"2024-04-26T23:48:06.665483+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:06.665483+0000","last_undegraded":"2024-04-26T23:48:06.665483+0000","last_fullsized":"2024-04-26T23:48:06.665483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262670+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:13.262670+0000","last_peered":"2024-04-26T23:48:13.262670+0000","last_clean":"2024-04-26T23:48:13.262670+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:13.262670+0000","last_undegraded":"2024-04-26T23:48:13.262670+0000","last_fullsized":"2024-04-26T23:48:13.262670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465049+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:13.465049+0000","last_peered":"2024-04-26T23:48:13.465049+0000","last_clean":"2024-04-26T23:48:13.465049+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:13.465049+0000","last_undegraded":"2024-04-26T23:48:13.465049+0000","last_fullsized":"2024-04-26T23:48:13.465049+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664798+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:06.664798+0000","last_peered":"2024-04-26T23:48:06.664798+0000","last_clean":"2024-04-26T23:48:06.664798+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:06.664798+0000","last_undegraded":"2024-04-26T23:48:06.664798+0000","last_fullsized":"2024-04-26T23:48:06.664798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465009+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:13.465009+0000","last_peered":"2024-04-26T23:48:13.465009+0000","last_clean":"2024-04-26T23:48:13.465009+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:13.465009+0000","last_undegraded":"2024-04-26T23:48:13.465009+0000","last_fullsized":"2024-04-26T23:48:13.465009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265153+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:13.265153+0000","last_peered":"2024-04-26T23:48:13.265153+0000","last_clean":"2024-04-26T23:48:13.265153+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:13.265153+0000","last_undegraded":"2024-04-26T23:48:13.265153+0000","last_fullsized":"2024-04-26T23:48:13.265153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261987+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:13.261987+0000","last_peered":"2024-04-26T23:48:13.261987+0000","last_clean":"2024-04-26T23:48:13.261987+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:13.261987+0000","last_undegraded":"2024-04-26T23:48:13.261987+0000","last_fullsized":"2024-04-26T23:48:13.261987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262037+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:13.262037+0000","last_peered":"2024-04-26T23:48:13.262037+0000","last_clean":"2024-04-26T23:48:13.262037+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:13.262037+0000","last_undegraded":"2024-04-26T23:48:13.262037+0000","last_fullsized":"2024-04-26T23:48:13.262037+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265949+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:13.265949+0000","last_peered":"2024-04-26T23:48:13.265949+0000","last_clean":"2024-04-26T23:48:13.265949+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:13.265949+0000","last_undegraded":"2024-04-26T23:48:13.265949+0000","last_fullsized":"2024-04-26T23:48:13.265949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465359+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:13.465359+0000","last_peered":"2024-04-26T23:48:13.465359+0000","last_clean":"2024-04-26T23:48:13.465359+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:13.465359+0000","last_undegraded":"2024-04-26T23:48:13.465359+0000","last_fullsized":"2024-04-26T23:48:13.465359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465567+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:13.465567+0000","last_peered":"2024-04-26T23:48:13.465567+0000","last_clean":"2024-04-26T23:48:13.465567+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:13.465567+0000","last_undegraded":"2024-04-26T23:48:13.465567+0000","last_fullsized":"2024-04-26T23:48:13.465567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665008+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:06.665008+0000","last_peered":"2024-04-26T23:48:06.665008+0000","last_clean":"2024-04-26T23:48:06.665008+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:06.665008+0000","last_undegraded":"2024-04-26T23:48:06.665008+0000","last_fullsized":"2024-04-26T23:48:06.665008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265223+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:13.265223+0000","last_peered":"2024-04-26T23:48:13.265223+0000","last_clean":"2024-04-26T23:48:13.265223+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:13.265223+0000","last_undegraded":"2024-04-26T23:48:13.265223+0000","last_fullsized":"2024-04-26T23:48:13.265223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265180+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:13.265180+0000","last_peered":"2024-04-26T23:48:13.265180+0000","last_clean":"2024-04-26T23:48:13.265180+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:13.265180+0000","last_undegraded":"2024-04-26T23:48:13.265180+0000","last_fullsized":"2024-04-26T23:48:13.265180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265900+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:13.265900+0000","last_peered":"2024-04-26T23:48:13.265900+0000","last_clean":"2024-04-26T23:48:13.265900+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:13.265900+0000","last_undegraded":"2024-04-26T23:48:13.265900+0000","last_fullsized":"2024-04-26T23:48:13.265900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465065+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:13.465065+0000","last_peered":"2024-04-26T23:48:13.465065+0000","last_clean":"2024-04-26T23:48:13.465065+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:13.465065+0000","last_undegraded":"2024-04-26T23:48:13.465065+0000","last_fullsized":"2024-04-26T23:48:13.465065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261872+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:13.261872+0000","last_peered":"2024-04-26T23:48:13.261872+0000","last_clean":"2024-04-26T23:48:13.261872+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:13.261872+0000","last_undegraded":"2024-04-26T23:48:13.261872+0000","last_fullsized":"2024-04-26T23:48:13.261872+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262762+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:13.262762+0000","last_peered":"2024-04-26T23:48:13.262762+0000","last_clean":"2024-04-26T23:48:13.262762+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:13.262762+0000","last_undegraded":"2024-04-26T23:48:13.262762+0000","last_fullsized":"2024-04-26T23:48:13.262762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265301+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:13.265301+0000","last_peered":"2024-04-26T23:48:13.265301+0000","last_clean":"2024-04-26T23:48:13.265301+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:13.265301+0000","last_undegraded":"2024-04-26T23:48:13.265301+0000","last_fullsized":"2024-04-26T23:48:13.265301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261496+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:13.261496+0000","last_peered":"2024-04-26T23:48:13.261496+0000","last_clean":"2024-04-26T23:48:13.261496+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:13.261496+0000","last_undegraded":"2024-04-26T23:48:13.261496+0000","last_fullsized":"2024-04-26T23:48:13.261496+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465121+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:13.465121+0000","last_peered":"2024-04-26T23:48:13.465121+0000","last_clean":"2024-04-26T23:48:13.465121+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:13.465121+0000","last_undegraded":"2024-04-26T23:48:13.465121+0000","last_fullsized":"2024-04-26T23:48:13.465121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464975+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:13.464975+0000","last_peered":"2024-04-26T23:48:13.464975+0000","last_clean":"2024-04-26T23:48:13.464975+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:13.464975+0000","last_undegraded":"2024-04-26T23:48:13.464975+0000","last_fullsized":"2024-04-26T23:48:13.464975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264054+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:13.264054+0000","last_peered":"2024-04-26T23:48:13.264054+0000","last_clean":"2024-04-26T23:48:13.264054+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:13.264054+0000","last_undegraded":"2024-04-26T23:48:13.264054+0000","last_fullsized":"2024-04-26T23:48:13.264054+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465930+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:13.465930+0000","last_peered":"2024-04-26T23:48:13.465930+0000","last_clean":"2024-04-26T23:48:13.465930+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:13.465930+0000","last_undegraded":"2024-04-26T23:48:13.465930+0000","last_fullsized":"2024-04-26T23:48:13.465930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265798+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:13.265798+0000","last_peered":"2024-04-26T23:48:13.265798+0000","last_clean":"2024-04-26T23:48:13.265798+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:13.265798+0000","last_undegraded":"2024-04-26T23:48:13.265798+0000","last_fullsized":"2024-04-26T23:48:13.265798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262239+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:13.262239+0000","last_peered":"2024-04-26T23:48:13.262239+0000","last_clean":"2024-04-26T23:48:13.262239+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:13.262239+0000","last_undegraded":"2024-04-26T23:48:13.262239+0000","last_fullsized":"2024-04-26T23:48:13.262239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262764+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:13.262764+0000","last_peered":"2024-04-26T23:48:13.262764+0000","last_clean":"2024-04-26T23:48:13.262764+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:13.262764+0000","last_undegraded":"2024-04-26T23:48:13.262764+0000","last_fullsized":"2024-04-26T23:48:13.262764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264321+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:13.264321+0000","last_peered":"2024-04-26T23:48:13.264321+0000","last_clean":"2024-04-26T23:48:13.264321+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:13.264321+0000","last_undegraded":"2024-04-26T23:48:13.264321+0000","last_fullsized":"2024-04-26T23:48:13.264321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264217+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:13.264217+0000","last_peered":"2024-04-26T23:48:13.264217+0000","last_clean":"2024-04-26T23:48:13.264217+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:13.264217+0000","last_undegraded":"2024-04-26T23:48:13.264217+0000","last_fullsized":"2024-04-26T23:48:13.264217+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467039+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:13.467039+0000","last_peered":"2024-04-26T23:48:13.467039+0000","last_clean":"2024-04-26T23:48:13.467039+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:13.467039+0000","last_undegraded":"2024-04-26T23:48:13.467039+0000","last_fullsized":"2024-04-26T23:48:13.467039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261650+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:13.261650+0000","last_peered":"2024-04-26T23:48:13.261650+0000","last_clean":"2024-04-26T23:48:13.261650+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:13.261650+0000","last_undegraded":"2024-04-26T23:48:13.261650+0000","last_fullsized":"2024-04-26T23:48:13.261650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465723+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:13.465723+0000","last_peered":"2024-04-26T23:48:13.465723+0000","last_clean":"2024-04-26T23:48:13.465723+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:13.465723+0000","last_undegraded":"2024-04-26T23:48:13.465723+0000","last_fullsized":"2024-04-26T23:48:13.465723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665133+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:06.665133+0000","last_peered":"2024-04-26T23:48:06.665133+0000","last_clean":"2024-04-26T23:48:06.665133+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:06.665133+0000","last_undegraded":"2024-04-26T23:48:06.665133+0000","last_fullsized":"2024-04-26T23:48:06.665133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261734+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:13.261734+0000","last_peered":"2024-04-26T23:48:13.261734+0000","last_clean":"2024-04-26T23:48:13.261734+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:13.261734+0000","last_undegraded":"2024-04-26T23:48:13.261734+0000","last_fullsized":"2024-04-26T23:48:13.261734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664470+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:06.664470+0000","last_peered":"2024-04-26T23:48:06.664470+0000","last_clean":"2024-04-26T23:48:06.664470+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:06.664470+0000","last_undegraded":"2024-04-26T23:48:06.664470+0000","last_fullsized":"2024-04-26T23:48:06.664470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262066+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:13.262066+0000","last_peered":"2024-04-26T23:48:13.262066+0000","last_clean":"2024-04-26T23:48:13.262066+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:13.262066+0000","last_undegraded":"2024-04-26T23:48:13.262066+0000","last_fullsized":"2024-04-26T23:48:13.262066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265173+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:13.265173+0000","last_peered":"2024-04-26T23:48:13.265173+0000","last_clean":"2024-04-26T23:48:13.265173+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:13.265173+0000","last_undegraded":"2024-04-26T23:48:13.265173+0000","last_fullsized":"2024-04-26T23:48:13.265173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664523+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:06.664523+0000","last_peered":"2024-04-26T23:48:06.664523+0000","last_clean":"2024-04-26T23:48:06.664523+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:06.664523+0000","last_undegraded":"2024-04-26T23:48:06.664523+0000","last_fullsized":"2024-04-26T23:48:06.664523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262137+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:13.262137+0000","last_peered":"2024-04-26T23:48:13.262137+0000","last_clean":"2024-04-26T23:48:13.262137+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:13.262137+0000","last_undegraded":"2024-04-26T23:48:13.262137+0000","last_fullsized":"2024-04-26T23:48:13.262137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262297+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:13.262297+0000","last_peered":"2024-04-26T23:48:13.262297+0000","last_clean":"2024-04-26T23:48:13.262297+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:13.262297+0000","last_undegraded":"2024-04-26T23:48:13.262297+0000","last_fullsized":"2024-04-26T23:48:13.262297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467273+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:13.467273+0000","last_peered":"2024-04-26T23:48:13.467273+0000","last_clean":"2024-04-26T23:48:13.467273+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:13.467273+0000","last_undegraded":"2024-04-26T23:48:13.467273+0000","last_fullsized":"2024-04-26T23:48:13.467273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665469+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:06.665469+0000","last_peered":"2024-04-26T23:48:06.665469+0000","last_clean":"2024-04-26T23:48:06.665469+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:06.665469+0000","last_undegraded":"2024-04-26T23:48:06.665469+0000","last_fullsized":"2024-04-26T23:48:06.665469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465548+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:13.465548+0000","last_peered":"2024-04-26T23:48:13.465548+0000","last_clean":"2024-04-26T23:48:13.465548+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:13.465548+0000","last_undegraded":"2024-04-26T23:48:13.465548+0000","last_fullsized":"2024-04-26T23:48:13.465548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467210+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:13.467210+0000","last_peered":"2024-04-26T23:48:13.467210+0000","last_clean":"2024-04-26T23:48:13.467210+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:13.467210+0000","last_undegraded":"2024-04-26T23:48:13.467210+0000","last_fullsized":"2024-04-26T23:48:13.467210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467087+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:13.467087+0000","last_peered":"2024-04-26T23:48:13.467087+0000","last_clean":"2024-04-26T23:48:13.467087+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:13.467087+0000","last_undegraded":"2024-04-26T23:48:13.467087+0000","last_fullsized":"2024-04-26T23:48:13.467087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465415+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:13.465415+0000","last_peered":"2024-04-26T23:48:13.465415+0000","last_clean":"2024-04-26T23:48:13.465415+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:13.465415+0000","last_undegraded":"2024-04-26T23:48:13.465415+0000","last_fullsized":"2024-04-26T23:48:13.465415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"peering","last_fresh":"2024-04-26T23:48:06.666012+0000","last_change":"2024-04-26T23:48:13.265524+0000","last_active":"2024-04-26T23:48:13.265524+0000","last_peered":"2024-04-26T23:48:06.666012+0000","last_clean":"2024-04-26T23:48:06.666012+0000","last_became_active":"2024-04-26T23:48:05.241549+0000","last_became_peered":"2024-04-26T23:48:05.241549+0000","last_unstale":"2024-04-26T23:48:06.666012+0000","last_undegraded":"2024-04-26T23:48:06.666012+0000","last_fullsized":"2024-04-26T23:48:06.666012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465895+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:13.465895+0000","last_peered":"2024-04-26T23:48:13.465895+0000","last_clean":"2024-04-26T23:48:13.465895+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:13.465895+0000","last_undegraded":"2024-04-26T23:48:13.465895+0000","last_fullsized":"2024-04-26T23:48:13.465895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665347+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:06.665347+0000","last_peered":"2024-04-26T23:48:06.665347+0000","last_clean":"2024-04-26T23:48:06.665347+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:06.665347+0000","last_undegraded":"2024-04-26T23:48:06.665347+0000","last_fullsized":"2024-04-26T23:48:06.665347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467069+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:13.467069+0000","last_peered":"2024-04-26T23:48:13.467069+0000","last_clean":"2024-04-26T23:48:13.467069+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:13.467069+0000","last_undegraded":"2024-04-26T23:48:13.467069+0000","last_fullsized":"2024-04-26T23:48:13.467069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464910+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:13.464910+0000","last_peered":"2024-04-26T23:48:13.464910+0000","last_clean":"2024-04-26T23:48:13.464910+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:13.464910+0000","last_undegraded":"2024-04-26T23:48:13.464910+0000","last_fullsized":"2024-04-26T23:48:13.464910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465285+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:13.465285+0000","last_peered":"2024-04-26T23:48:13.465285+0000","last_clean":"2024-04-26T23:48:13.465285+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:13.465285+0000","last_undegraded":"2024-04-26T23:48:13.465285+0000","last_fullsized":"2024-04-26T23:48:13.465285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466990+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:13.466990+0000","last_peered":"2024-04-26T23:48:13.466990+0000","last_clean":"2024-04-26T23:48:13.466990+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:13.466990+0000","last_undegraded":"2024-04-26T23:48:13.466990+0000","last_fullsized":"2024-04-26T23:48:13.466990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664615+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:06.664615+0000","last_peered":"2024-04-26T23:48:06.664615+0000","last_clean":"2024-04-26T23:48:06.664615+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:06.664615+0000","last_undegraded":"2024-04-26T23:48:06.664615+0000","last_fullsized":"2024-04-26T23:48:06.664615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465317+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:13.465317+0000","last_peered":"2024-04-26T23:48:13.465317+0000","last_clean":"2024-04-26T23:48:13.465317+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:13.465317+0000","last_undegraded":"2024-04-26T23:48:13.465317+0000","last_fullsized":"2024-04-26T23:48:13.465317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465169+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:13.465169+0000","last_peered":"2024-04-26T23:48:13.465169+0000","last_clean":"2024-04-26T23:48:13.465169+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:13.465169+0000","last_undegraded":"2024-04-26T23:48:13.465169+0000","last_fullsized":"2024-04-26T23:48:13.465169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665484+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:06.665484+0000","last_peered":"2024-04-26T23:48:06.665484+0000","last_clean":"2024-04-26T23:48:06.665484+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:06.665484+0000","last_undegraded":"2024-04-26T23:48:06.665484+0000","last_fullsized":"2024-04-26T23:48:06.665484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262363+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:13.262363+0000","last_peered":"2024-04-26T23:48:13.262363+0000","last_clean":"2024-04-26T23:48:13.262363+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:13.262363+0000","last_undegraded":"2024-04-26T23:48:13.262363+0000","last_fullsized":"2024-04-26T23:48:13.262363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265616+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:13.265616+0000","last_peered":"2024-04-26T23:48:13.265616+0000","last_clean":"2024-04-26T23:48:13.265616+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:13.265616+0000","last_undegraded":"2024-04-26T23:48:13.265616+0000","last_fullsized":"2024-04-26T23:48:13.265616+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265773+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:13.265773+0000","last_peered":"2024-04-26T23:48:13.265773+0000","last_clean":"2024-04-26T23:48:13.265773+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:13.265773+0000","last_undegraded":"2024-04-26T23:48:13.265773+0000","last_fullsized":"2024-04-26T23:48:13.265773+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465668+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:13.465668+0000","last_peered":"2024-04-26T23:48:13.465668+0000","last_clean":"2024-04-26T23:48:13.465668+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:13.465668+0000","last_undegraded":"2024-04-26T23:48:13.465668+0000","last_fullsized":"2024-04-26T23:48:13.465668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465471+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:13.465471+0000","last_peered":"2024-04-26T23:48:13.465471+0000","last_clean":"2024-04-26T23:48:13.465471+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:13.465471+0000","last_undegraded":"2024-04-26T23:48:13.465471+0000","last_fullsized":"2024-04-26T23:48:13.465471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466010+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:13.466010+0000","last_peered":"2024-04-26T23:48:13.466010+0000","last_clean":"2024-04-26T23:48:13.466010+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:13.466010+0000","last_undegraded":"2024-04-26T23:48:13.466010+0000","last_fullsized":"2024-04-26T23:48:13.466010+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263881+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:13.263881+0000","last_peered":"2024-04-26T23:48:13.263881+0000","last_clean":"2024-04-26T23:48:13.263881+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:13.263881+0000","last_undegraded":"2024-04-26T23:48:13.263881+0000","last_fullsized":"2024-04-26T23:48:13.263881+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262263+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:13.262263+0000","last_peered":"2024-04-26T23:48:13.262263+0000","last_clean":"2024-04-26T23:48:13.262263+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:13.262263+0000","last_undegraded":"2024-04-26T23:48:13.262263+0000","last_fullsized":"2024-04-26T23:48:13.262263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465110+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:13.465110+0000","last_peered":"2024-04-26T23:48:13.465110+0000","last_clean":"2024-04-26T23:48:13.465110+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:13.465110+0000","last_undegraded":"2024-04-26T23:48:13.465110+0000","last_fullsized":"2024-04-26T23:48:13.465110+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664652+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:06.664652+0000","last_peered":"2024-04-26T23:48:06.664652+0000","last_clean":"2024-04-26T23:48:06.664652+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:06.664652+0000","last_undegraded":"2024-04-26T23:48:06.664652+0000","last_fullsized":"2024-04-26T23:48:06.664652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":2,"reported_epoch":50,"state":"peering","last_fresh":"2024-04-26T23:48:08.229566+0000","last_change":"2024-04-26T23:48:14.233851+0000","last_active":"2024-04-26T23:48:14.233851+0000","last_peered":"2024-04-26T23:48:08.229566+0000","last_clean":"2024-04-26T23:48:08.229566+0000","last_became_active":"2024-04-26T23:48:05.234135+0000","last_became_peered":"2024-04-26T23:48:05.234135+0000","last_unstale":"2024-04-26T23:48:08.229566+0000","last_undegraded":"2024-04-26T23:48:08.229566+0000","last_fullsized":"2024-04-26T23:48:08.229566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466803+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:13.466803+0000","last_peered":"2024-04-26T23:48:13.466803+0000","last_clean":"2024-04-26T23:48:13.466803+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:13.466803+0000","last_undegraded":"2024-04-26T23:48:13.466803+0000","last_fullsized":"2024-04-26T23:48:13.466803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.266233+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:13.266233+0000","last_peered":"2024-04-26T23:48:13.266233+0000","last_clean":"2024-04-26T23:48:13.266233+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:13.266233+0000","last_undegraded":"2024-04-26T23:48:13.266233+0000","last_fullsized":"2024-04-26T23:48:13.266233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465822+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:13.465822+0000","last_peered":"2024-04-26T23:48:13.465822+0000","last_clean":"2024-04-26T23:48:13.465822+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:13.465822+0000","last_undegraded":"2024-04-26T23:48:13.465822+0000","last_fullsized":"2024-04-26T23:48:13.465822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665535+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:06.665535+0000","last_peered":"2024-04-26T23:48:06.665535+0000","last_clean":"2024-04-26T23:48:06.665535+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:06.665535+0000","last_undegraded":"2024-04-26T23:48:06.665535+0000","last_fullsized":"2024-04-26T23:48:06.665535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467308+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:13.467308+0000","last_peered":"2024-04-26T23:48:13.467308+0000","last_clean":"2024-04-26T23:48:13.467308+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:13.467308+0000","last_undegraded":"2024-04-26T23:48:13.467308+0000","last_fullsized":"2024-04-26T23:48:13.467308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467160+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:13.467160+0000","last_peered":"2024-04-26T23:48:13.467160+0000","last_clean":"2024-04-26T23:48:13.467160+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:13.467160+0000","last_undegraded":"2024-04-26T23:48:13.467160+0000","last_fullsized":"2024-04-26T23:48:13.467160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263889+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:13.263889+0000","last_peered":"2024-04-26T23:48:13.263889+0000","last_clean":"2024-04-26T23:48:13.263889+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:13.263889+0000","last_undegraded":"2024-04-26T23:48:13.263889+0000","last_fullsized":"2024-04-26T23:48:13.263889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465536+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:13.465536+0000","last_peered":"2024-04-26T23:48:13.465536+0000","last_clean":"2024-04-26T23:48:13.465536+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:13.465536+0000","last_undegraded":"2024-04-26T23:48:13.465536+0000","last_fullsized":"2024-04-26T23:48:13.465536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467161+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:13.467161+0000","last_peered":"2024-04-26T23:48:13.467161+0000","last_clean":"2024-04-26T23:48:13.467161+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:13.467161+0000","last_undegraded":"2024-04-26T23:48:13.467161+0000","last_fullsized":"2024-04-26T23:48:13.467161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465769+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:13.465769+0000","last_peered":"2024-04-26T23:48:13.465769+0000","last_clean":"2024-04-26T23:48:13.465769+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:13.465769+0000","last_undegraded":"2024-04-26T23:48:13.465769+0000","last_fullsized":"2024-04-26T23:48:13.465769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261840+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:13.261840+0000","last_peered":"2024-04-26T23:48:13.261840+0000","last_clean":"2024-04-26T23:48:13.261840+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:13.261840+0000","last_undegraded":"2024-04-26T23:48:13.261840+0000","last_fullsized":"2024-04-26T23:48:13.261840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261873+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:13.261873+0000","last_peered":"2024-04-26T23:48:13.261873+0000","last_clean":"2024-04-26T23:48:13.261873+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:13.261873+0000","last_undegraded":"2024-04-26T23:48:13.261873+0000","last_fullsized":"2024-04-26T23:48:13.261873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264422+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:13.264422+0000","last_peered":"2024-04-26T23:48:13.264422+0000","last_clean":"2024-04-26T23:48:13.264422+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:13.264422+0000","last_undegraded":"2024-04-26T23:48:13.264422+0000","last_fullsized":"2024-04-26T23:48:13.264422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261503+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:13.261503+0000","last_peered":"2024-04-26T23:48:13.261503+0000","last_clean":"2024-04-26T23:48:13.261503+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:13.261503+0000","last_undegraded":"2024-04-26T23:48:13.261503+0000","last_fullsized":"2024-04-26T23:48:13.261503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664749+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:06.664749+0000","last_peered":"2024-04-26T23:48:06.664749+0000","last_clean":"2024-04-26T23:48:06.664749+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:06.664749+0000","last_undegraded":"2024-04-26T23:48:06.664749+0000","last_fullsized":"2024-04-26T23:48:06.664749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665417+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:06.665417+0000","last_peered":"2024-04-26T23:48:06.665417+0000","last_clean":"2024-04-26T23:48:06.665417+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:06.665417+0000","last_undegraded":"2024-04-26T23:48:06.665417+0000","last_fullsized":"2024-04-26T23:48:06.665417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263115+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:13.263115+0000","last_peered":"2024-04-26T23:48:13.263115+0000","last_clean":"2024-04-26T23:48:13.263115+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:13.263115+0000","last_undegraded":"2024-04-26T23:48:13.263115+0000","last_fullsized":"2024-04-26T23:48:13.263115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466845+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:13.466845+0000","last_peered":"2024-04-26T23:48:13.466845+0000","last_clean":"2024-04-26T23:48:13.466845+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:13.466845+0000","last_undegraded":"2024-04-26T23:48:13.466845+0000","last_fullsized":"2024-04-26T23:48:13.466845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":239037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":239977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":239003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":598016,"data_stored":239999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":822742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:14.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-26T23:48:14.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 13, 'reported_epoch': 49, 'state': 'peering', 'last_fresh': '2024-04-26T23:48:06.666012+0000', 'last_change': '2024-04-26T23:48:13.265524+0000', 'last_active': '2024-04-26T23:48:13.265524+0000', 'last_peered': '2024-04-26T23:48:06.666012+0000', 'last_clean': '2024-04-26T23:48:06.666012+0000', 'last_became_active': '2024-04-26T23:48:05.241549+0000', 'last_became_peered': '2024-04-26T23:48:05.241549+0000', 'last_unstale': '2024-04-26T23:48:06.666012+0000', 'last_undegraded': '2024-04-26T23:48:06.666012+0000', 'last_fullsized': '2024-04-26T23:48:06.666012+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:14.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-26T23:48:14.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 50, 'state': 'peering', 'last_fresh': '2024-04-26T23:48:08.229566+0000', 'last_change': '2024-04-26T23:48:14.233851+0000', 'last_active': '2024-04-26T23:48:14.233851+0000', 'last_peered': '2024-04-26T23:48:08.229566+0000', 'last_clean': '2024-04-26T23:48:08.229566+0000', 'last_became_active': '2024-04-26T23:48:05.234135+0000', 'last_became_peered': '2024-04-26T23:48:05.234135+0000', 'last_unstale': '2024-04-26T23:48:08.229566+0000', 'last_undegraded': '2024-04-26T23:48:08.229566+0000', 'last_fullsized': '2024-04-26T23:48:08.229566+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:14.717 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T23:48:14.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.886+0000 7f8317400640 1 Processor -- start 2024-04-26T23:48:14.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.886+0000 7f8317400640 1 -- start start 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8317400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f831015f080 0x7f83100b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8317400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f83100b6830 0x7f83100cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8317400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83100b4db0 con 0x7f83100731e0 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8317400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f83100b5090 con 0x7f83100b6830 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8317400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f83100ce210 con 0x7f831015f080 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8307e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f83100b6830 0x7f83100cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8315400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f83100731e0 0x7f831006e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37330/0 (socket says 172.21.15.47:37330) 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8315400640 1 -- 172.21.15.47:0/2304226332 learned_addr learned my addr 172.21.15.47:0/2304226332 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:14.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8314a00640 1 --2- 172.21.15.47:0/2304226332 >> v2:172.21.15.203:3300/0 conn(0x7f831015f080 0x7f83100b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8307e00640 1 -- 172.21.15.47:0/2304226332 >> v2:172.21.15.203:3300/0 conn(0x7f831015f080 msgr2=0x7f83100b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:14.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8307e00640 1 --2- 172.21.15.47:0/2304226332 >> v2:172.21.15.203:3300/0 conn(0x7f831015f080 0x7f83100b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8307e00640 1 -- 172.21.15.47:0/2304226332 >> v1:172.21.15.47:6789/0 conn(0x7f83100731e0 legacy=0x7f831006e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8307e00640 1 -- 172.21.15.47:0/2304226332 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83100ce4f0 con 0x7f83100b6830 2024-04-26T23:48:14.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f830fe00640 1 -- 172.21.15.47:0/2304226332 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838464929 0 0) 0x7f83100b4db0 con 0x7f83100731e0 2024-04-26T23:48:14.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f8307e00640 1 --2- 172.21.15.47:0/2304226332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f83100cea10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8310071df0 tx=0x7f82f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3080971bd27fb725 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.890+0000 7f830fe00640 1 -- 172.21.15.47:0/2304226332 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80b0070 con 0x7f83100b6830 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f830fe00640 1 -- 172.21.15.47:0/2304226332 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f80ab600 con 0x7f83100b6830 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f830fe00640 1 -- 172.21.15.47:0/2304226332 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80ab9d0 con 0x7f83100b6830 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- 172.21.15.47:0/2304226332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 msgr2=0x7f83100cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 --2- 172.21.15.47:0/2304226332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f83100cea10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8310071df0 tx=0x7f82f801c460 comp rx=0 tx=0).stop 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- 172.21.15.47:0/2304226332 shutdown_connections 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 --2- 172.21.15.47:0/2304226332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f83100cea10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 --2- 172.21.15.47:0/2304226332 >> v2:172.21.15.203:3300/0 conn(0x7f831015f080 0x7f83100b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- 172.21.15.47:0/2304226332 >> 172.21.15.47:0/2304226332 conn(0x7f8310075c20 msgr2=0x7f8310076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:14.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- 172.21.15.47:0/2304226332 shutdown_connections 2024-04-26T23:48:14.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- 172.21.15.47:0/2304226332 wait complete. 2024-04-26T23:48:14.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 Processor -- start 2024-04-26T23:48:14.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- start start 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100731e0 0x7f831014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f8310157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f831015f080 0x7f83101576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f831015f5e0 con 0x7f83100b6830 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f831015f460 con 0x7f83100731e0 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8317400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f831016c750 con 0x7f831015f080 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f8310157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f8310157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44090/0 (socket says 172.21.15.47:44090) 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 -- 172.21.15.47:0/3724431657 learned_addr learned my addr 172.21.15.47:0/3724431657 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8314a00640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100731e0 0x7f831014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8315400640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f831015f080 0x7f83101576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 -- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f831015f080 msgr2=0x7f83101576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f831015f080 0x7f83101576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 -- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100731e0 msgr2=0x7f831014b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100731e0 0x7f831014b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.894+0000 7f8307e00640 1 -- 172.21.15.47:0/3724431657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831014c300 con 0x7f83100b6830 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f8307e00640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f8310157190 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f82f801a090 tx=0x7f82f8019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f830d600640 1 -- 172.21.15.47:0/3724431657 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f80b0040 con 0x7f83100b6830 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f830d600640 1 -- 172.21.15.47:0/3724431657 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f80ab400 con 0x7f83100b6830 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f830d600640 1 -- 172.21.15.47:0/3724431657 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f8006dc0 con 0x7f83100b6830 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f831014c5e0 con 0x7f83100b6830 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f831014cba0 con 0x7f83100b6830 2024-04-26T23:48:14.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8310069700 con 0x7f83100b6830 2024-04-26T23:48:14.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f830d600640 1 -- 172.21.15.47:0/3724431657 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f82f80bb020 con 0x7f83100b6830 2024-04-26T23:48:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f830d600640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f82ec068650 0x7f82ec06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.898+0000 7f830d600640 1 -- 172.21.15.47:0/3724431657 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f82f81203b0 con 0x7f83100b6830 2024-04-26T23:48:14.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.902+0000 7f8314a00640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f82ec068650 0x7f82ec06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:14.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.902+0000 7f8314a00640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f82ec068650 0x7f82ec06ab10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8310168fe0 tx=0x7f8300009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:14.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:14.902+0000 7f830d600640 1 -- 172.21.15.47:0/3724431657 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f82f8016050 con 0x7f83100b6830 2024-04-26T23:48:15.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f83100b2660 con 0x7f83100b6830 2024-04-26T23:48:15.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f830d600640 1 -- 172.21.15.47:0/3724431657 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7f82f80f0670 con 0x7f83100b6830 2024-04-26T23:48:15.139 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:15.139 INFO:teuthology.orchestra.run.smithi047.stdout:{"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1714175118,"num_in_osds":8,"osd_in_since":1714175109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":244211712,"bytes_avail":772849901568,"bytes_total":773094113280,"write_bytes_sec":1791,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5913}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-04-26T23:47:40.184970+0000","services":{}},"progress_events":{}} 2024-04-26T23:48:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f82ec068650 msgr2=0x7f82ec06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f82ec068650 0x7f82ec06ab10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8310168fe0 tx=0x7f8300009190 comp rx=0 tx=0).stop 2024-04-26T23:48:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 msgr2=0x7f8310157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f8310157190 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f82f801a090 tx=0x7f82f8019200 comp rx=0 tx=0).stop 2024-04-26T23:48:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 shutdown_connections 2024-04-26T23:48:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f82ec068650 0x7f82ec06ab10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f831015f080 0x7f83101576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f83100b6830 0x7f8310157190 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 --2- 172.21.15.47:0/3724431657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83100731e0 0x7f831014b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 >> 172.21.15.47:0/3724431657 conn(0x7f8310075c20 msgr2=0x7f83100cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:15.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 shutdown_connections 2024-04-26T23:48:15.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.134+0000 7f8317400640 1 -- 172.21.15.47:0/3724431657 wait complete. 2024-04-26T23:48:15.158 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T23:48:15.158 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f369ea00640 1 Processor -- start 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f369ea00640 1 -- start start 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f369ea00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f369806f0a0 0x7f36980d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f369ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f369809ba60 0x7f369809bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f369ea00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36980d2340 con 0x7f36980ce340 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f369ea00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f36980cd580 con 0x7f369806f0a0 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f369ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f36980cd860 con 0x7f369809ba60 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f3697e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f369806f0a0 0x7f36980d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f3697e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f369806f0a0 0x7f36980d0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44102/0 (socket says 172.21.15.47:44102) 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f3697e00640 1 -- 172.21.15.47:0/3581264359 learned_addr learned my addr 172.21.15.47:0/3581264359 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f368f400640 1 --2- 172.21.15.47:0/3581264359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f369809ba60 0x7f369809bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:15.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f3697e00640 1 -- 172.21.15.47:0/3581264359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f369809ba60 msgr2=0x7f369809bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:15.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f3697e00640 1 --2- 172.21.15.47:0/3581264359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f369809ba60 0x7f369809bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f3697e00640 1 -- 172.21.15.47:0/3581264359 >> v1:172.21.15.203:6789/0 conn(0x7f36980ce340 legacy=0x7f36980ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.294+0000 7f3697e00640 1 -- 172.21.15.47:0/3581264359 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36980cdb40 con 0x7f369806f0a0 2024-04-26T23:48:15.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f3697e00640 1 --2- 172.21.15.47:0/3581264359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369806f0a0 0x7f36980d0fb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f36880098a0 tx=0x7f368801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a60c46e24d5e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:15.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f3697400640 1 -- 172.21.15.47:0/3581264359 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36880b0070 con 0x7f369806f0a0 2024-04-26T23:48:15.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f3697400640 1 -- 172.21.15.47:0/3581264359 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36880ab600 con 0x7f369806f0a0 2024-04-26T23:48:15.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f3697400640 1 -- 172.21.15.47:0/3581264359 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36880ab9d0 con 0x7f369806f0a0 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 -- 172.21.15.47:0/3581264359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369806f0a0 msgr2=0x7f36980d0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 --2- 172.21.15.47:0/3581264359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369806f0a0 0x7f36980d0fb0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f36880098a0 tx=0x7f368801c540 comp rx=0 tx=0).stop 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 -- 172.21.15.47:0/3581264359 shutdown_connections 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 --2- 172.21.15.47:0/3581264359 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f369809ba60 0x7f369809bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 --2- 172.21.15.47:0/3581264359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369806f0a0 0x7f36980d0fb0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 -- 172.21.15.47:0/3581264359 >> 172.21.15.47:0/3581264359 conn(0x7f36980d2e90 msgr2=0x7f36980d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 -- 172.21.15.47:0/3581264359 shutdown_connections 2024-04-26T23:48:15.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.298+0000 7f369ea00640 1 -- 172.21.15.47:0/3581264359 wait complete. 2024-04-26T23:48:15.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 Processor -- start 2024-04-26T23:48:15.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 -- start start 2024-04-26T23:48:15.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f369806f0a0 0x7f36981564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:15.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369809ba60 0x7f36980b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36980ce340 0x7f36980cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f36980d2120 con 0x7f369809ba60 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36980d1fa0 con 0x7f369806f0a0 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f369806d510 con 0x7f36980ce340 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369809ba60 0x7f36980b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369809ba60 0x7f36980b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44114/0 (socket says 172.21.15.47:44114) 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 -- 172.21.15.47:0/3250655264 learned_addr learned my addr 172.21.15.47:0/3250655264 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f3697e00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f369806f0a0 0x7f36981564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ca00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36980ce340 0x7f36980cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 -- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36980ce340 msgr2=0x7f36980cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36980ce340 0x7f36980cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 -- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f369806f0a0 msgr2=0x7f36981564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f369806f0a0 0x7f36981564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 -- 172.21.15.47:0/3250655264 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36980cba70 con 0x7f369809ba60 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ca00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36980ce340 0x7f36980cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f368f400640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369809ba60 0x7f36980b7ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f368000d5f0 tx=0x7f368000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f3694c00640 1 -- 172.21.15.47:0/3250655264 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36800125f0 con 0x7f369809ba60 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f3694c00640 1 -- 172.21.15.47:0/3250655264 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3680019070 con 0x7f369809ba60 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36980cbd50 con 0x7f369809ba60 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f3694c00640 1 -- 172.21.15.47:0/3250655264 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36800129b0 con 0x7f369809ba60 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.302+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36980b75c0 con 0x7f369809ba60 2024-04-26T23:48:15.311 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.306+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36980b70f0 con 0x7f369809ba60 2024-04-26T23:48:15.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.306+0000 7f3694c00640 1 -- 172.21.15.47:0/3250655264 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f3680012b50 con 0x7f369809ba60 2024-04-26T23:48:15.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.306+0000 7f3694c00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3674068650 0x7f367406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:15.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.306+0000 7f3694c00640 1 -- 172.21.15.47:0/3250655264 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f36800871f0 con 0x7f369809ba60 2024-04-26T23:48:15.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.306+0000 7f3697e00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3674068650 0x7f367406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:15.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.306+0000 7f3697e00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3674068650 0x7f367406ab10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3688009870 tx=0x7f36880a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:15.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.310+0000 7f3694c00640 1 -- 172.21.15.47:0/3250655264 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f36800573e0 con 0x7f369809ba60 2024-04-26T23:48:15.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.470+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3698069700 con 0x7f3674068650 2024-04-26T23:48:15.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.478+0000 7f3694c00640 1 -- 172.21.15.47:0/3250655264 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251838 (secure 0 0 0) 0x7f3698069700 con 0x7f3674068650 2024-04-26T23:48:15.487 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:15.488 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:15.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3674068650 msgr2=0x7f367406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3674068650 0x7f367406ab10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3688009870 tx=0x7f36880a6000 comp rx=0 tx=0).stop 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369809ba60 msgr2=0x7f36980b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369809ba60 0x7f36980b7ae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f368000d5f0 tx=0x7f368000dab0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 shutdown_connections 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3674068650 0x7f367406ab10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f36980ce340 0x7f36980cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f369809ba60 0x7f36980b7ae0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 --2- 172.21.15.47:0/3250655264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f369806f0a0 0x7f36981564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 >> 172.21.15.47:0/3250655264 conn(0x7f36980d2e90 msgr2=0x7f36980d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 shutdown_connections 2024-04-26T23:48:15.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:15.482+0000 7f369ea00640 1 -- 172.21.15.47:0/3250655264 wait complete. 2024-04-26T23:48:15.508 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-04-26T23:48:14.270972+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238556,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736164,"statfs":{"total":773094113280,"available":772849831936,"internally_reserved":0,"allocated":5894144,"data_stored":3086451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.042406"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467224+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:13.467224+0000","last_peered":"2024-04-26T23:48:13.467224+0000","last_clean":"2024-04-26T23:48:13.467224+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:13.467224+0000","last_undegraded":"2024-04-26T23:48:13.467224+0000","last_fullsized":"2024-04-26T23:48:13.467224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261817+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:13.261817+0000","last_peered":"2024-04-26T23:48:13.261817+0000","last_clean":"2024-04-26T23:48:13.261817+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:13.261817+0000","last_undegraded":"2024-04-26T23:48:13.261817+0000","last_fullsized":"2024-04-26T23:48:13.261817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665408+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:06.665408+0000","last_peered":"2024-04-26T23:48:06.665408+0000","last_clean":"2024-04-26T23:48:06.665408+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:06.665408+0000","last_undegraded":"2024-04-26T23:48:06.665408+0000","last_fullsized":"2024-04-26T23:48:06.665408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262483+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:13.262483+0000","last_peered":"2024-04-26T23:48:13.262483+0000","last_clean":"2024-04-26T23:48:13.262483+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:13.262483+0000","last_undegraded":"2024-04-26T23:48:13.262483+0000","last_fullsized":"2024-04-26T23:48:13.262483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465420+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:13.465420+0000","last_peered":"2024-04-26T23:48:13.465420+0000","last_clean":"2024-04-26T23:48:13.465420+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:13.465420+0000","last_undegraded":"2024-04-26T23:48:13.465420+0000","last_fullsized":"2024-04-26T23:48:13.465420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466901+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:13.466901+0000","last_peered":"2024-04-26T23:48:13.466901+0000","last_clean":"2024-04-26T23:48:13.466901+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:13.466901+0000","last_undegraded":"2024-04-26T23:48:13.466901+0000","last_fullsized":"2024-04-26T23:48:13.466901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664211+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:06.664211+0000","last_peered":"2024-04-26T23:48:06.664211+0000","last_clean":"2024-04-26T23:48:06.664211+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:06.664211+0000","last_undegraded":"2024-04-26T23:48:06.664211+0000","last_fullsized":"2024-04-26T23:48:06.664211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665384+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:06.665384+0000","last_peered":"2024-04-26T23:48:06.665384+0000","last_clean":"2024-04-26T23:48:06.665384+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:06.665384+0000","last_undegraded":"2024-04-26T23:48:06.665384+0000","last_fullsized":"2024-04-26T23:48:06.665384+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665422+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:06.665422+0000","last_peered":"2024-04-26T23:48:06.665422+0000","last_clean":"2024-04-26T23:48:06.665422+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:06.665422+0000","last_undegraded":"2024-04-26T23:48:06.665422+0000","last_fullsized":"2024-04-26T23:48:06.665422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665483+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:06.665483+0000","last_peered":"2024-04-26T23:48:06.665483+0000","last_clean":"2024-04-26T23:48:06.665483+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:06.665483+0000","last_undegraded":"2024-04-26T23:48:06.665483+0000","last_fullsized":"2024-04-26T23:48:06.665483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262670+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:13.262670+0000","last_peered":"2024-04-26T23:48:13.262670+0000","last_clean":"2024-04-26T23:48:13.262670+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:13.262670+0000","last_undegraded":"2024-04-26T23:48:13.262670+0000","last_fullsized":"2024-04-26T23:48:13.262670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465049+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:13.465049+0000","last_peered":"2024-04-26T23:48:13.465049+0000","last_clean":"2024-04-26T23:48:13.465049+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:13.465049+0000","last_undegraded":"2024-04-26T23:48:13.465049+0000","last_fullsized":"2024-04-26T23:48:13.465049+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664798+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:06.664798+0000","last_peered":"2024-04-26T23:48:06.664798+0000","last_clean":"2024-04-26T23:48:06.664798+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:06.664798+0000","last_undegraded":"2024-04-26T23:48:06.664798+0000","last_fullsized":"2024-04-26T23:48:06.664798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465009+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:13.465009+0000","last_peered":"2024-04-26T23:48:13.465009+0000","last_clean":"2024-04-26T23:48:13.465009+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:13.465009+0000","last_undegraded":"2024-04-26T23:48:13.465009+0000","last_fullsized":"2024-04-26T23:48:13.465009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265153+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:13.265153+0000","last_peered":"2024-04-26T23:48:13.265153+0000","last_clean":"2024-04-26T23:48:13.265153+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:13.265153+0000","last_undegraded":"2024-04-26T23:48:13.265153+0000","last_fullsized":"2024-04-26T23:48:13.265153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261987+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:13.261987+0000","last_peered":"2024-04-26T23:48:13.261987+0000","last_clean":"2024-04-26T23:48:13.261987+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:13.261987+0000","last_undegraded":"2024-04-26T23:48:13.261987+0000","last_fullsized":"2024-04-26T23:48:13.261987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262037+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:13.262037+0000","last_peered":"2024-04-26T23:48:13.262037+0000","last_clean":"2024-04-26T23:48:13.262037+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:13.262037+0000","last_undegraded":"2024-04-26T23:48:13.262037+0000","last_fullsized":"2024-04-26T23:48:13.262037+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265949+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:13.265949+0000","last_peered":"2024-04-26T23:48:13.265949+0000","last_clean":"2024-04-26T23:48:13.265949+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:13.265949+0000","last_undegraded":"2024-04-26T23:48:13.265949+0000","last_fullsized":"2024-04-26T23:48:13.265949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465359+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:13.465359+0000","last_peered":"2024-04-26T23:48:13.465359+0000","last_clean":"2024-04-26T23:48:13.465359+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:13.465359+0000","last_undegraded":"2024-04-26T23:48:13.465359+0000","last_fullsized":"2024-04-26T23:48:13.465359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465567+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:13.465567+0000","last_peered":"2024-04-26T23:48:13.465567+0000","last_clean":"2024-04-26T23:48:13.465567+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:13.465567+0000","last_undegraded":"2024-04-26T23:48:13.465567+0000","last_fullsized":"2024-04-26T23:48:13.465567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665008+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:06.665008+0000","last_peered":"2024-04-26T23:48:06.665008+0000","last_clean":"2024-04-26T23:48:06.665008+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:06.665008+0000","last_undegraded":"2024-04-26T23:48:06.665008+0000","last_fullsized":"2024-04-26T23:48:06.665008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265223+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:13.265223+0000","last_peered":"2024-04-26T23:48:13.265223+0000","last_clean":"2024-04-26T23:48:13.265223+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:13.265223+0000","last_undegraded":"2024-04-26T23:48:13.265223+0000","last_fullsized":"2024-04-26T23:48:13.265223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265180+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:13.265180+0000","last_peered":"2024-04-26T23:48:13.265180+0000","last_clean":"2024-04-26T23:48:13.265180+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:13.265180+0000","last_undegraded":"2024-04-26T23:48:13.265180+0000","last_fullsized":"2024-04-26T23:48:13.265180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265900+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:13.265900+0000","last_peered":"2024-04-26T23:48:13.265900+0000","last_clean":"2024-04-26T23:48:13.265900+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:13.265900+0000","last_undegraded":"2024-04-26T23:48:13.265900+0000","last_fullsized":"2024-04-26T23:48:13.265900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465065+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:13.465065+0000","last_peered":"2024-04-26T23:48:13.465065+0000","last_clean":"2024-04-26T23:48:13.465065+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:13.465065+0000","last_undegraded":"2024-04-26T23:48:13.465065+0000","last_fullsized":"2024-04-26T23:48:13.465065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261872+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:13.261872+0000","last_peered":"2024-04-26T23:48:13.261872+0000","last_clean":"2024-04-26T23:48:13.261872+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:13.261872+0000","last_undegraded":"2024-04-26T23:48:13.261872+0000","last_fullsized":"2024-04-26T23:48:13.261872+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262762+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:13.262762+0000","last_peered":"2024-04-26T23:48:13.262762+0000","last_clean":"2024-04-26T23:48:13.262762+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:13.262762+0000","last_undegraded":"2024-04-26T23:48:13.262762+0000","last_fullsized":"2024-04-26T23:48:13.262762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265301+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:13.265301+0000","last_peered":"2024-04-26T23:48:13.265301+0000","last_clean":"2024-04-26T23:48:13.265301+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:13.265301+0000","last_undegraded":"2024-04-26T23:48:13.265301+0000","last_fullsized":"2024-04-26T23:48:13.265301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261496+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:13.261496+0000","last_peered":"2024-04-26T23:48:13.261496+0000","last_clean":"2024-04-26T23:48:13.261496+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:13.261496+0000","last_undegraded":"2024-04-26T23:48:13.261496+0000","last_fullsized":"2024-04-26T23:48:13.261496+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465121+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:13.465121+0000","last_peered":"2024-04-26T23:48:13.465121+0000","last_clean":"2024-04-26T23:48:13.465121+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:13.465121+0000","last_undegraded":"2024-04-26T23:48:13.465121+0000","last_fullsized":"2024-04-26T23:48:13.465121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464975+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:13.464975+0000","last_peered":"2024-04-26T23:48:13.464975+0000","last_clean":"2024-04-26T23:48:13.464975+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:13.464975+0000","last_undegraded":"2024-04-26T23:48:13.464975+0000","last_fullsized":"2024-04-26T23:48:13.464975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264054+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:13.264054+0000","last_peered":"2024-04-26T23:48:13.264054+0000","last_clean":"2024-04-26T23:48:13.264054+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:13.264054+0000","last_undegraded":"2024-04-26T23:48:13.264054+0000","last_fullsized":"2024-04-26T23:48:13.264054+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465930+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:13.465930+0000","last_peered":"2024-04-26T23:48:13.465930+0000","last_clean":"2024-04-26T23:48:13.465930+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:13.465930+0000","last_undegraded":"2024-04-26T23:48:13.465930+0000","last_fullsized":"2024-04-26T23:48:13.465930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265798+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:13.265798+0000","last_peered":"2024-04-26T23:48:13.265798+0000","last_clean":"2024-04-26T23:48:13.265798+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:13.265798+0000","last_undegraded":"2024-04-26T23:48:13.265798+0000","last_fullsized":"2024-04-26T23:48:13.265798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262239+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:13.262239+0000","last_peered":"2024-04-26T23:48:13.262239+0000","last_clean":"2024-04-26T23:48:13.262239+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:13.262239+0000","last_undegraded":"2024-04-26T23:48:13.262239+0000","last_fullsized":"2024-04-26T23:48:13.262239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262764+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:13.262764+0000","last_peered":"2024-04-26T23:48:13.262764+0000","last_clean":"2024-04-26T23:48:13.262764+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:13.262764+0000","last_undegraded":"2024-04-26T23:48:13.262764+0000","last_fullsized":"2024-04-26T23:48:13.262764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264321+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:13.264321+0000","last_peered":"2024-04-26T23:48:13.264321+0000","last_clean":"2024-04-26T23:48:13.264321+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:13.264321+0000","last_undegraded":"2024-04-26T23:48:13.264321+0000","last_fullsized":"2024-04-26T23:48:13.264321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264217+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:13.264217+0000","last_peered":"2024-04-26T23:48:13.264217+0000","last_clean":"2024-04-26T23:48:13.264217+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:13.264217+0000","last_undegraded":"2024-04-26T23:48:13.264217+0000","last_fullsized":"2024-04-26T23:48:13.264217+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467039+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:13.467039+0000","last_peered":"2024-04-26T23:48:13.467039+0000","last_clean":"2024-04-26T23:48:13.467039+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:13.467039+0000","last_undegraded":"2024-04-26T23:48:13.467039+0000","last_fullsized":"2024-04-26T23:48:13.467039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261650+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:13.261650+0000","last_peered":"2024-04-26T23:48:13.261650+0000","last_clean":"2024-04-26T23:48:13.261650+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:13.261650+0000","last_undegraded":"2024-04-26T23:48:13.261650+0000","last_fullsized":"2024-04-26T23:48:13.261650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465723+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:13.465723+0000","last_peered":"2024-04-26T23:48:13.465723+0000","last_clean":"2024-04-26T23:48:13.465723+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:13.465723+0000","last_undegraded":"2024-04-26T23:48:13.465723+0000","last_fullsized":"2024-04-26T23:48:13.465723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665133+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:06.665133+0000","last_peered":"2024-04-26T23:48:06.665133+0000","last_clean":"2024-04-26T23:48:06.665133+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:06.665133+0000","last_undegraded":"2024-04-26T23:48:06.665133+0000","last_fullsized":"2024-04-26T23:48:06.665133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261734+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:13.261734+0000","last_peered":"2024-04-26T23:48:13.261734+0000","last_clean":"2024-04-26T23:48:13.261734+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:13.261734+0000","last_undegraded":"2024-04-26T23:48:13.261734+0000","last_fullsized":"2024-04-26T23:48:13.261734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664470+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:06.664470+0000","last_peered":"2024-04-26T23:48:06.664470+0000","last_clean":"2024-04-26T23:48:06.664470+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:06.664470+0000","last_undegraded":"2024-04-26T23:48:06.664470+0000","last_fullsized":"2024-04-26T23:48:06.664470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262066+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:13.262066+0000","last_peered":"2024-04-26T23:48:13.262066+0000","last_clean":"2024-04-26T23:48:13.262066+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:13.262066+0000","last_undegraded":"2024-04-26T23:48:13.262066+0000","last_fullsized":"2024-04-26T23:48:13.262066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265173+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:13.265173+0000","last_peered":"2024-04-26T23:48:13.265173+0000","last_clean":"2024-04-26T23:48:13.265173+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:13.265173+0000","last_undegraded":"2024-04-26T23:48:13.265173+0000","last_fullsized":"2024-04-26T23:48:13.265173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664523+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:06.664523+0000","last_peered":"2024-04-26T23:48:06.664523+0000","last_clean":"2024-04-26T23:48:06.664523+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:06.664523+0000","last_undegraded":"2024-04-26T23:48:06.664523+0000","last_fullsized":"2024-04-26T23:48:06.664523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262137+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:13.262137+0000","last_peered":"2024-04-26T23:48:13.262137+0000","last_clean":"2024-04-26T23:48:13.262137+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:13.262137+0000","last_undegraded":"2024-04-26T23:48:13.262137+0000","last_fullsized":"2024-04-26T23:48:13.262137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262297+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:13.262297+0000","last_peered":"2024-04-26T23:48:13.262297+0000","last_clean":"2024-04-26T23:48:13.262297+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:13.262297+0000","last_undegraded":"2024-04-26T23:48:13.262297+0000","last_fullsized":"2024-04-26T23:48:13.262297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467273+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:13.467273+0000","last_peered":"2024-04-26T23:48:13.467273+0000","last_clean":"2024-04-26T23:48:13.467273+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:13.467273+0000","last_undegraded":"2024-04-26T23:48:13.467273+0000","last_fullsized":"2024-04-26T23:48:13.467273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665469+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:06.665469+0000","last_peered":"2024-04-26T23:48:06.665469+0000","last_clean":"2024-04-26T23:48:06.665469+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:06.665469+0000","last_undegraded":"2024-04-26T23:48:06.665469+0000","last_fullsized":"2024-04-26T23:48:06.665469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465548+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:13.465548+0000","last_peered":"2024-04-26T23:48:13.465548+0000","last_clean":"2024-04-26T23:48:13.465548+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:13.465548+0000","last_undegraded":"2024-04-26T23:48:13.465548+0000","last_fullsized":"2024-04-26T23:48:13.465548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467210+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:13.467210+0000","last_peered":"2024-04-26T23:48:13.467210+0000","last_clean":"2024-04-26T23:48:13.467210+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:13.467210+0000","last_undegraded":"2024-04-26T23:48:13.467210+0000","last_fullsized":"2024-04-26T23:48:13.467210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467087+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:13.467087+0000","last_peered":"2024-04-26T23:48:13.467087+0000","last_clean":"2024-04-26T23:48:13.467087+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:13.467087+0000","last_undegraded":"2024-04-26T23:48:13.467087+0000","last_fullsized":"2024-04-26T23:48:13.467087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465415+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:13.465415+0000","last_peered":"2024-04-26T23:48:13.465415+0000","last_clean":"2024-04-26T23:48:13.465415+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:13.465415+0000","last_undegraded":"2024-04-26T23:48:13.465415+0000","last_fullsized":"2024-04-26T23:48:13.465415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"peering","last_fresh":"2024-04-26T23:48:06.666012+0000","last_change":"2024-04-26T23:48:13.265524+0000","last_active":"2024-04-26T23:48:13.265524+0000","last_peered":"2024-04-26T23:48:06.666012+0000","last_clean":"2024-04-26T23:48:06.666012+0000","last_became_active":"2024-04-26T23:48:05.241549+0000","last_became_peered":"2024-04-26T23:48:05.241549+0000","last_unstale":"2024-04-26T23:48:06.666012+0000","last_undegraded":"2024-04-26T23:48:06.666012+0000","last_fullsized":"2024-04-26T23:48:06.666012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465895+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:13.465895+0000","last_peered":"2024-04-26T23:48:13.465895+0000","last_clean":"2024-04-26T23:48:13.465895+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:13.465895+0000","last_undegraded":"2024-04-26T23:48:13.465895+0000","last_fullsized":"2024-04-26T23:48:13.465895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665347+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:06.665347+0000","last_peered":"2024-04-26T23:48:06.665347+0000","last_clean":"2024-04-26T23:48:06.665347+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:06.665347+0000","last_undegraded":"2024-04-26T23:48:06.665347+0000","last_fullsized":"2024-04-26T23:48:06.665347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467069+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:13.467069+0000","last_peered":"2024-04-26T23:48:13.467069+0000","last_clean":"2024-04-26T23:48:13.467069+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:13.467069+0000","last_undegraded":"2024-04-26T23:48:13.467069+0000","last_fullsized":"2024-04-26T23:48:13.467069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464910+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:13.464910+0000","last_peered":"2024-04-26T23:48:13.464910+0000","last_clean":"2024-04-26T23:48:13.464910+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:13.464910+0000","last_undegraded":"2024-04-26T23:48:13.464910+0000","last_fullsized":"2024-04-26T23:48:13.464910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465285+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:13.465285+0000","last_peered":"2024-04-26T23:48:13.465285+0000","last_clean":"2024-04-26T23:48:13.465285+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:13.465285+0000","last_undegraded":"2024-04-26T23:48:13.465285+0000","last_fullsized":"2024-04-26T23:48:13.465285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466990+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:13.466990+0000","last_peered":"2024-04-26T23:48:13.466990+0000","last_clean":"2024-04-26T23:48:13.466990+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:13.466990+0000","last_undegraded":"2024-04-26T23:48:13.466990+0000","last_fullsized":"2024-04-26T23:48:13.466990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664615+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:06.664615+0000","last_peered":"2024-04-26T23:48:06.664615+0000","last_clean":"2024-04-26T23:48:06.664615+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:06.664615+0000","last_undegraded":"2024-04-26T23:48:06.664615+0000","last_fullsized":"2024-04-26T23:48:06.664615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465317+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:13.465317+0000","last_peered":"2024-04-26T23:48:13.465317+0000","last_clean":"2024-04-26T23:48:13.465317+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:13.465317+0000","last_undegraded":"2024-04-26T23:48:13.465317+0000","last_fullsized":"2024-04-26T23:48:13.465317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465169+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:13.465169+0000","last_peered":"2024-04-26T23:48:13.465169+0000","last_clean":"2024-04-26T23:48:13.465169+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:13.465169+0000","last_undegraded":"2024-04-26T23:48:13.465169+0000","last_fullsized":"2024-04-26T23:48:13.465169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665484+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:06.665484+0000","last_peered":"2024-04-26T23:48:06.665484+0000","last_clean":"2024-04-26T23:48:06.665484+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:06.665484+0000","last_undegraded":"2024-04-26T23:48:06.665484+0000","last_fullsized":"2024-04-26T23:48:06.665484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262363+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:13.262363+0000","last_peered":"2024-04-26T23:48:13.262363+0000","last_clean":"2024-04-26T23:48:13.262363+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:13.262363+0000","last_undegraded":"2024-04-26T23:48:13.262363+0000","last_fullsized":"2024-04-26T23:48:13.262363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265616+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:13.265616+0000","last_peered":"2024-04-26T23:48:13.265616+0000","last_clean":"2024-04-26T23:48:13.265616+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:13.265616+0000","last_undegraded":"2024-04-26T23:48:13.265616+0000","last_fullsized":"2024-04-26T23:48:13.265616+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265773+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:13.265773+0000","last_peered":"2024-04-26T23:48:13.265773+0000","last_clean":"2024-04-26T23:48:13.265773+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:13.265773+0000","last_undegraded":"2024-04-26T23:48:13.265773+0000","last_fullsized":"2024-04-26T23:48:13.265773+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465668+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:13.465668+0000","last_peered":"2024-04-26T23:48:13.465668+0000","last_clean":"2024-04-26T23:48:13.465668+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:13.465668+0000","last_undegraded":"2024-04-26T23:48:13.465668+0000","last_fullsized":"2024-04-26T23:48:13.465668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465471+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:13.465471+0000","last_peered":"2024-04-26T23:48:13.465471+0000","last_clean":"2024-04-26T23:48:13.465471+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:13.465471+0000","last_undegraded":"2024-04-26T23:48:13.465471+0000","last_fullsized":"2024-04-26T23:48:13.465471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466010+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:13.466010+0000","last_peered":"2024-04-26T23:48:13.466010+0000","last_clean":"2024-04-26T23:48:13.466010+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:13.466010+0000","last_undegraded":"2024-04-26T23:48:13.466010+0000","last_fullsized":"2024-04-26T23:48:13.466010+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263881+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:13.263881+0000","last_peered":"2024-04-26T23:48:13.263881+0000","last_clean":"2024-04-26T23:48:13.263881+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:13.263881+0000","last_undegraded":"2024-04-26T23:48:13.263881+0000","last_fullsized":"2024-04-26T23:48:13.263881+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262263+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:13.262263+0000","last_peered":"2024-04-26T23:48:13.262263+0000","last_clean":"2024-04-26T23:48:13.262263+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:13.262263+0000","last_undegraded":"2024-04-26T23:48:13.262263+0000","last_fullsized":"2024-04-26T23:48:13.262263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465110+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:13.465110+0000","last_peered":"2024-04-26T23:48:13.465110+0000","last_clean":"2024-04-26T23:48:13.465110+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:13.465110+0000","last_undegraded":"2024-04-26T23:48:13.465110+0000","last_fullsized":"2024-04-26T23:48:13.465110+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664652+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:06.664652+0000","last_peered":"2024-04-26T23:48:06.664652+0000","last_clean":"2024-04-26T23:48:06.664652+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:06.664652+0000","last_undegraded":"2024-04-26T23:48:06.664652+0000","last_fullsized":"2024-04-26T23:48:06.664652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":2,"reported_epoch":50,"state":"peering","last_fresh":"2024-04-26T23:48:08.229566+0000","last_change":"2024-04-26T23:48:14.233851+0000","last_active":"2024-04-26T23:48:14.233851+0000","last_peered":"2024-04-26T23:48:08.229566+0000","last_clean":"2024-04-26T23:48:08.229566+0000","last_became_active":"2024-04-26T23:48:05.234135+0000","last_became_peered":"2024-04-26T23:48:05.234135+0000","last_unstale":"2024-04-26T23:48:08.229566+0000","last_undegraded":"2024-04-26T23:48:08.229566+0000","last_fullsized":"2024-04-26T23:48:08.229566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466803+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:13.466803+0000","last_peered":"2024-04-26T23:48:13.466803+0000","last_clean":"2024-04-26T23:48:13.466803+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:13.466803+0000","last_undegraded":"2024-04-26T23:48:13.466803+0000","last_fullsized":"2024-04-26T23:48:13.466803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.266233+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:13.266233+0000","last_peered":"2024-04-26T23:48:13.266233+0000","last_clean":"2024-04-26T23:48:13.266233+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:13.266233+0000","last_undegraded":"2024-04-26T23:48:13.266233+0000","last_fullsized":"2024-04-26T23:48:13.266233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465822+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:13.465822+0000","last_peered":"2024-04-26T23:48:13.465822+0000","last_clean":"2024-04-26T23:48:13.465822+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:13.465822+0000","last_undegraded":"2024-04-26T23:48:13.465822+0000","last_fullsized":"2024-04-26T23:48:13.465822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665535+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:06.665535+0000","last_peered":"2024-04-26T23:48:06.665535+0000","last_clean":"2024-04-26T23:48:06.665535+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:06.665535+0000","last_undegraded":"2024-04-26T23:48:06.665535+0000","last_fullsized":"2024-04-26T23:48:06.665535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467308+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:13.467308+0000","last_peered":"2024-04-26T23:48:13.467308+0000","last_clean":"2024-04-26T23:48:13.467308+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:13.467308+0000","last_undegraded":"2024-04-26T23:48:13.467308+0000","last_fullsized":"2024-04-26T23:48:13.467308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467160+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:13.467160+0000","last_peered":"2024-04-26T23:48:13.467160+0000","last_clean":"2024-04-26T23:48:13.467160+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:13.467160+0000","last_undegraded":"2024-04-26T23:48:13.467160+0000","last_fullsized":"2024-04-26T23:48:13.467160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263889+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:13.263889+0000","last_peered":"2024-04-26T23:48:13.263889+0000","last_clean":"2024-04-26T23:48:13.263889+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:13.263889+0000","last_undegraded":"2024-04-26T23:48:13.263889+0000","last_fullsized":"2024-04-26T23:48:13.263889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465536+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:13.465536+0000","last_peered":"2024-04-26T23:48:13.465536+0000","last_clean":"2024-04-26T23:48:13.465536+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:13.465536+0000","last_undegraded":"2024-04-26T23:48:13.465536+0000","last_fullsized":"2024-04-26T23:48:13.465536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467161+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:13.467161+0000","last_peered":"2024-04-26T23:48:13.467161+0000","last_clean":"2024-04-26T23:48:13.467161+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:13.467161+0000","last_undegraded":"2024-04-26T23:48:13.467161+0000","last_fullsized":"2024-04-26T23:48:13.467161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465769+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:13.465769+0000","last_peered":"2024-04-26T23:48:13.465769+0000","last_clean":"2024-04-26T23:48:13.465769+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:13.465769+0000","last_undegraded":"2024-04-26T23:48:13.465769+0000","last_fullsized":"2024-04-26T23:48:13.465769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261840+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:13.261840+0000","last_peered":"2024-04-26T23:48:13.261840+0000","last_clean":"2024-04-26T23:48:13.261840+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:13.261840+0000","last_undegraded":"2024-04-26T23:48:13.261840+0000","last_fullsized":"2024-04-26T23:48:13.261840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261873+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:13.261873+0000","last_peered":"2024-04-26T23:48:13.261873+0000","last_clean":"2024-04-26T23:48:13.261873+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:13.261873+0000","last_undegraded":"2024-04-26T23:48:13.261873+0000","last_fullsized":"2024-04-26T23:48:13.261873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264422+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:13.264422+0000","last_peered":"2024-04-26T23:48:13.264422+0000","last_clean":"2024-04-26T23:48:13.264422+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:13.264422+0000","last_undegraded":"2024-04-26T23:48:13.264422+0000","last_fullsized":"2024-04-26T23:48:13.264422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261503+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:13.261503+0000","last_peered":"2024-04-26T23:48:13.261503+0000","last_clean":"2024-04-26T23:48:13.261503+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:13.261503+0000","last_undegraded":"2024-04-26T23:48:13.261503+0000","last_fullsized":"2024-04-26T23:48:13.261503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664749+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:06.664749+0000","last_peered":"2024-04-26T23:48:06.664749+0000","last_clean":"2024-04-26T23:48:06.664749+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:06.664749+0000","last_undegraded":"2024-04-26T23:48:06.664749+0000","last_fullsized":"2024-04-26T23:48:06.664749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665417+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:06.665417+0000","last_peered":"2024-04-26T23:48:06.665417+0000","last_clean":"2024-04-26T23:48:06.665417+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:06.665417+0000","last_undegraded":"2024-04-26T23:48:06.665417+0000","last_fullsized":"2024-04-26T23:48:06.665417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263115+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:13.263115+0000","last_peered":"2024-04-26T23:48:13.263115+0000","last_clean":"2024-04-26T23:48:13.263115+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:13.263115+0000","last_undegraded":"2024-04-26T23:48:13.263115+0000","last_fullsized":"2024-04-26T23:48:13.263115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466845+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:13.466845+0000","last_peered":"2024-04-26T23:48:13.466845+0000","last_clean":"2024-04-26T23:48:13.466845+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:13.466845+0000","last_undegraded":"2024-04-26T23:48:13.466845+0000","last_fullsized":"2024-04-26T23:48:13.466845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":239037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":239977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":239003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":598016,"data_stored":239999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":822742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:18.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:18.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.658+0000 7f948fa00640 1 Processor -- start 2024-04-26T23:48:18.665 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.658+0000 7f948fa00640 1 -- start start 2024-04-26T23:48:18.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.658+0000 7f948fa00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f948815f810 0x7f94880cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.658+0000 7f948fa00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94880ce140 0x7f948806e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.658+0000 7f948fa00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f948815fe60 con 0x7f94881599e0 2024-04-26T23:48:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.658+0000 7f948fa00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f948806df90 con 0x7f94880ce140 2024-04-26T23:48:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.658+0000 7f948fa00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f94880ce570 con 0x7f948815f810 2024-04-26T23:48:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94880ce140 0x7f948806e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f94880ce140 0x7f948806e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44128/0 (socket says 172.21.15.47:44128) 2024-04-26T23:48:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 -- 172.21.15.47:0/2589284181 learned_addr learned my addr 172.21.15.47:0/2589284181 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:18.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f947fe00640 1 --2- 172.21.15.47:0/2589284181 >> v2:172.21.15.203:3300/0 conn(0x7f948815f810 0x7f94880cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 -- 172.21.15.47:0/2589284181 >> v2:172.21.15.203:3300/0 conn(0x7f948815f810 msgr2=0x7f94880cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 --2- 172.21.15.47:0/2589284181 >> v2:172.21.15.203:3300/0 conn(0x7f948815f810 0x7f94880cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 -- 172.21.15.47:0/2589284181 >> v1:172.21.15.203:6789/0 conn(0x7f94881599e0 legacy=0x7f948806fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 -- 172.21.15.47:0/2589284181 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9488160140 con 0x7f94880ce140 2024-04-26T23:48:18.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f947fe00640 1 --2- 172.21.15.47:0/2589284181 >> v2:172.21.15.203:3300/0 conn(0x7f948815f810 0x7f94880cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:18.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f948da00640 1 --2- 172.21.15.47:0/2589284181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94880ce140 0x7f948806e420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f94880739d0 tx=0x7f948001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc81f6c79edcce6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f9487e00640 1 -- 172.21.15.47:0/2589284181 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94800a56c0 con 0x7f94880ce140 2024-04-26T23:48:18.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f9487e00640 1 -- 172.21.15.47:0/2589284181 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94800a5860 con 0x7f94880ce140 2024-04-26T23:48:18.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.662+0000 7f9487e00640 1 -- 172.21.15.47:0/2589284181 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94800a5c30 con 0x7f94880ce140 2024-04-26T23:48:18.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- 172.21.15.47:0/2589284181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94880ce140 msgr2=0x7f948806e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.670 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 --2- 172.21.15.47:0/2589284181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94880ce140 0x7f948806e420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f94880739d0 tx=0x7f948001c9f0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- 172.21.15.47:0/2589284181 shutdown_connections 2024-04-26T23:48:18.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 --2- 172.21.15.47:0/2589284181 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f94880ce140 0x7f948806e420 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 --2- 172.21.15.47:0/2589284181 >> v2:172.21.15.203:3300/0 conn(0x7f948815f810 0x7f94880cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- 172.21.15.47:0/2589284181 >> 172.21.15.47:0/2589284181 conn(0x7f948806c800 msgr2=0x7f948806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:18.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- 172.21.15.47:0/2589284181 shutdown_connections 2024-04-26T23:48:18.671 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- 172.21.15.47:0/2589284181 wait complete. 2024-04-26T23:48:18.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 Processor -- start 2024-04-26T23:48:18.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- start start 2024-04-26T23:48:18.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f94880ce140 0x7f948814b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94881599e0 0x7f948814f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948815f810 0x7f948814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f948816bfd0 con 0x7f948815f810 2024-04-26T23:48:18.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f948816be50 con 0x7f94881599e0 2024-04-26T23:48:18.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948fa00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f948816c150 con 0x7f94880ce140 2024-04-26T23:48:18.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948815f810 0x7f948814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948815f810 0x7f948814f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44140/0 (socket says 172.21.15.47:44140) 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 -- 172.21.15.47:0/3231808061 learned_addr learned my addr 172.21.15.47:0/3231808061 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948d000640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f94880ce140 0x7f948814b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f947fe00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94881599e0 0x7f948814f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 -- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f94880ce140 msgr2=0x7f948814b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f94880ce140 0x7f948814b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 -- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94881599e0 msgr2=0x7f948814f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94881599e0 0x7f948814f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.666+0000 7f948da00640 1 -- 172.21.15.47:0/3231808061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948814c3f0 con 0x7f948815f810 2024-04-26T23:48:18.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f948da00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948815f810 0x7f948814f5a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f94800af040 tx=0x7f9480019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f9485600640 1 -- 172.21.15.47:0/3231808061 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94800bc020 con 0x7f948815f810 2024-04-26T23:48:18.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f9485600640 1 -- 172.21.15.47:0/3231808061 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94800b8670 con 0x7f948815f810 2024-04-26T23:48:18.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948814c6d0 con 0x7f948815f810 2024-04-26T23:48:18.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f9485600640 1 -- 172.21.15.47:0/3231808061 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94800b8a60 con 0x7f948815f810 2024-04-26T23:48:18.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948814cc90 con 0x7f948815f810 2024-04-26T23:48:18.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9488069700 con 0x7f948815f810 2024-04-26T23:48:18.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f9485600640 1 -- 172.21.15.47:0/3231808061 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f94800bf020 con 0x7f948815f810 2024-04-26T23:48:18.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f9485600640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9464068680 0x7f946406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:18.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f9485600640 1 -- 172.21.15.47:0/3231808061 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f9480121570 con 0x7f948815f810 2024-04-26T23:48:18.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.670+0000 7f948d000640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9464068680 0x7f946406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:18.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.674+0000 7f948d000640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9464068680 0x7f946406ab40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f94880b1a40 tx=0x7f9478009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:18.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.674+0000 7f9485600640 1 -- 172.21.15.47:0/3231808061 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f94800c7020 con 0x7f948815f810 2024-04-26T23:48:18.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.834+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94880cdc70 con 0x7f9464068680 2024-04-26T23:48:18.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.842+0000 7f9485600640 1 -- 172.21.15.47:0/3231808061 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251829 (secure 0 0 0) 0x7f94880cdc70 con 0x7f9464068680 2024-04-26T23:48:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:18.853 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9464068680 msgr2=0x7f946406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9464068680 0x7f946406ab40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f94880b1a40 tx=0x7f9478009040 comp rx=0 tx=0).stop 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948815f810 msgr2=0x7f948814f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948815f810 0x7f948814f5a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f94800af040 tx=0x7f9480019790 comp rx=0 tx=0).stop 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 shutdown_connections 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9464068680 0x7f946406ab40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f948815f810 0x7f948814f5a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94881599e0 0x7f948814f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 --2- 172.21.15.47:0/3231808061 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f94880ce140 0x7f948814b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:18.854 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 >> 172.21.15.47:0/3231808061 conn(0x7f948806c800 msgr2=0x7f948806cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:18.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 shutdown_connections 2024-04-26T23:48:18.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:18.846+0000 7f948fa00640 1 -- 172.21.15.47:0/3231808061 wait complete. 2024-04-26T23:48:18.872 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-04-26T23:48:18.193192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238556,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736164,"statfs":{"total":773094113280,"available":772849831936,"internally_reserved":0,"allocated":5894144,"data_stored":3086451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002182"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467224+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:13.467224+0000","last_peered":"2024-04-26T23:48:13.467224+0000","last_clean":"2024-04-26T23:48:13.467224+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:13.467224+0000","last_undegraded":"2024-04-26T23:48:13.467224+0000","last_fullsized":"2024-04-26T23:48:13.467224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261817+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:13.261817+0000","last_peered":"2024-04-26T23:48:13.261817+0000","last_clean":"2024-04-26T23:48:13.261817+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:13.261817+0000","last_undegraded":"2024-04-26T23:48:13.261817+0000","last_fullsized":"2024-04-26T23:48:13.261817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665408+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:06.665408+0000","last_peered":"2024-04-26T23:48:06.665408+0000","last_clean":"2024-04-26T23:48:06.665408+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:06.665408+0000","last_undegraded":"2024-04-26T23:48:06.665408+0000","last_fullsized":"2024-04-26T23:48:06.665408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262483+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:13.262483+0000","last_peered":"2024-04-26T23:48:13.262483+0000","last_clean":"2024-04-26T23:48:13.262483+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:13.262483+0000","last_undegraded":"2024-04-26T23:48:13.262483+0000","last_fullsized":"2024-04-26T23:48:13.262483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465420+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:13.465420+0000","last_peered":"2024-04-26T23:48:13.465420+0000","last_clean":"2024-04-26T23:48:13.465420+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:13.465420+0000","last_undegraded":"2024-04-26T23:48:13.465420+0000","last_fullsized":"2024-04-26T23:48:13.465420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466901+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:13.466901+0000","last_peered":"2024-04-26T23:48:13.466901+0000","last_clean":"2024-04-26T23:48:13.466901+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:13.466901+0000","last_undegraded":"2024-04-26T23:48:13.466901+0000","last_fullsized":"2024-04-26T23:48:13.466901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664211+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:06.664211+0000","last_peered":"2024-04-26T23:48:06.664211+0000","last_clean":"2024-04-26T23:48:06.664211+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:06.664211+0000","last_undegraded":"2024-04-26T23:48:06.664211+0000","last_fullsized":"2024-04-26T23:48:06.664211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665384+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:06.665384+0000","last_peered":"2024-04-26T23:48:06.665384+0000","last_clean":"2024-04-26T23:48:06.665384+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:06.665384+0000","last_undegraded":"2024-04-26T23:48:06.665384+0000","last_fullsized":"2024-04-26T23:48:06.665384+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665422+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:06.665422+0000","last_peered":"2024-04-26T23:48:06.665422+0000","last_clean":"2024-04-26T23:48:06.665422+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:06.665422+0000","last_undegraded":"2024-04-26T23:48:06.665422+0000","last_fullsized":"2024-04-26T23:48:06.665422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665483+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:06.665483+0000","last_peered":"2024-04-26T23:48:06.665483+0000","last_clean":"2024-04-26T23:48:06.665483+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:06.665483+0000","last_undegraded":"2024-04-26T23:48:06.665483+0000","last_fullsized":"2024-04-26T23:48:06.665483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262670+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:13.262670+0000","last_peered":"2024-04-26T23:48:13.262670+0000","last_clean":"2024-04-26T23:48:13.262670+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:13.262670+0000","last_undegraded":"2024-04-26T23:48:13.262670+0000","last_fullsized":"2024-04-26T23:48:13.262670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465049+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:13.465049+0000","last_peered":"2024-04-26T23:48:13.465049+0000","last_clean":"2024-04-26T23:48:13.465049+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:13.465049+0000","last_undegraded":"2024-04-26T23:48:13.465049+0000","last_fullsized":"2024-04-26T23:48:13.465049+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664798+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:06.664798+0000","last_peered":"2024-04-26T23:48:06.664798+0000","last_clean":"2024-04-26T23:48:06.664798+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:06.664798+0000","last_undegraded":"2024-04-26T23:48:06.664798+0000","last_fullsized":"2024-04-26T23:48:06.664798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465009+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:13.465009+0000","last_peered":"2024-04-26T23:48:13.465009+0000","last_clean":"2024-04-26T23:48:13.465009+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:13.465009+0000","last_undegraded":"2024-04-26T23:48:13.465009+0000","last_fullsized":"2024-04-26T23:48:13.465009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265153+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:13.265153+0000","last_peered":"2024-04-26T23:48:13.265153+0000","last_clean":"2024-04-26T23:48:13.265153+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:13.265153+0000","last_undegraded":"2024-04-26T23:48:13.265153+0000","last_fullsized":"2024-04-26T23:48:13.265153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261987+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:13.261987+0000","last_peered":"2024-04-26T23:48:13.261987+0000","last_clean":"2024-04-26T23:48:13.261987+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:13.261987+0000","last_undegraded":"2024-04-26T23:48:13.261987+0000","last_fullsized":"2024-04-26T23:48:13.261987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262037+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:13.262037+0000","last_peered":"2024-04-26T23:48:13.262037+0000","last_clean":"2024-04-26T23:48:13.262037+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:13.262037+0000","last_undegraded":"2024-04-26T23:48:13.262037+0000","last_fullsized":"2024-04-26T23:48:13.262037+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265949+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:13.265949+0000","last_peered":"2024-04-26T23:48:13.265949+0000","last_clean":"2024-04-26T23:48:13.265949+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:13.265949+0000","last_undegraded":"2024-04-26T23:48:13.265949+0000","last_fullsized":"2024-04-26T23:48:13.265949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465359+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:13.465359+0000","last_peered":"2024-04-26T23:48:13.465359+0000","last_clean":"2024-04-26T23:48:13.465359+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:13.465359+0000","last_undegraded":"2024-04-26T23:48:13.465359+0000","last_fullsized":"2024-04-26T23:48:13.465359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465567+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:13.465567+0000","last_peered":"2024-04-26T23:48:13.465567+0000","last_clean":"2024-04-26T23:48:13.465567+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:13.465567+0000","last_undegraded":"2024-04-26T23:48:13.465567+0000","last_fullsized":"2024-04-26T23:48:13.465567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665008+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:06.665008+0000","last_peered":"2024-04-26T23:48:06.665008+0000","last_clean":"2024-04-26T23:48:06.665008+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:06.665008+0000","last_undegraded":"2024-04-26T23:48:06.665008+0000","last_fullsized":"2024-04-26T23:48:06.665008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265223+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:13.265223+0000","last_peered":"2024-04-26T23:48:13.265223+0000","last_clean":"2024-04-26T23:48:13.265223+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:13.265223+0000","last_undegraded":"2024-04-26T23:48:13.265223+0000","last_fullsized":"2024-04-26T23:48:13.265223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265180+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:13.265180+0000","last_peered":"2024-04-26T23:48:13.265180+0000","last_clean":"2024-04-26T23:48:13.265180+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:13.265180+0000","last_undegraded":"2024-04-26T23:48:13.265180+0000","last_fullsized":"2024-04-26T23:48:13.265180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265900+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:13.265900+0000","last_peered":"2024-04-26T23:48:13.265900+0000","last_clean":"2024-04-26T23:48:13.265900+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:13.265900+0000","last_undegraded":"2024-04-26T23:48:13.265900+0000","last_fullsized":"2024-04-26T23:48:13.265900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465065+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:13.465065+0000","last_peered":"2024-04-26T23:48:13.465065+0000","last_clean":"2024-04-26T23:48:13.465065+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:13.465065+0000","last_undegraded":"2024-04-26T23:48:13.465065+0000","last_fullsized":"2024-04-26T23:48:13.465065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261872+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:13.261872+0000","last_peered":"2024-04-26T23:48:13.261872+0000","last_clean":"2024-04-26T23:48:13.261872+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:13.261872+0000","last_undegraded":"2024-04-26T23:48:13.261872+0000","last_fullsized":"2024-04-26T23:48:13.261872+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262762+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:13.262762+0000","last_peered":"2024-04-26T23:48:13.262762+0000","last_clean":"2024-04-26T23:48:13.262762+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:13.262762+0000","last_undegraded":"2024-04-26T23:48:13.262762+0000","last_fullsized":"2024-04-26T23:48:13.262762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265301+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:13.265301+0000","last_peered":"2024-04-26T23:48:13.265301+0000","last_clean":"2024-04-26T23:48:13.265301+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:13.265301+0000","last_undegraded":"2024-04-26T23:48:13.265301+0000","last_fullsized":"2024-04-26T23:48:13.265301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261496+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:13.261496+0000","last_peered":"2024-04-26T23:48:13.261496+0000","last_clean":"2024-04-26T23:48:13.261496+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:13.261496+0000","last_undegraded":"2024-04-26T23:48:13.261496+0000","last_fullsized":"2024-04-26T23:48:13.261496+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465121+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:13.465121+0000","last_peered":"2024-04-26T23:48:13.465121+0000","last_clean":"2024-04-26T23:48:13.465121+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:13.465121+0000","last_undegraded":"2024-04-26T23:48:13.465121+0000","last_fullsized":"2024-04-26T23:48:13.465121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464975+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:13.464975+0000","last_peered":"2024-04-26T23:48:13.464975+0000","last_clean":"2024-04-26T23:48:13.464975+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:13.464975+0000","last_undegraded":"2024-04-26T23:48:13.464975+0000","last_fullsized":"2024-04-26T23:48:13.464975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264054+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:13.264054+0000","last_peered":"2024-04-26T23:48:13.264054+0000","last_clean":"2024-04-26T23:48:13.264054+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:13.264054+0000","last_undegraded":"2024-04-26T23:48:13.264054+0000","last_fullsized":"2024-04-26T23:48:13.264054+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465930+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:13.465930+0000","last_peered":"2024-04-26T23:48:13.465930+0000","last_clean":"2024-04-26T23:48:13.465930+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:13.465930+0000","last_undegraded":"2024-04-26T23:48:13.465930+0000","last_fullsized":"2024-04-26T23:48:13.465930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265798+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:13.265798+0000","last_peered":"2024-04-26T23:48:13.265798+0000","last_clean":"2024-04-26T23:48:13.265798+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:13.265798+0000","last_undegraded":"2024-04-26T23:48:13.265798+0000","last_fullsized":"2024-04-26T23:48:13.265798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262239+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:13.262239+0000","last_peered":"2024-04-26T23:48:13.262239+0000","last_clean":"2024-04-26T23:48:13.262239+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:13.262239+0000","last_undegraded":"2024-04-26T23:48:13.262239+0000","last_fullsized":"2024-04-26T23:48:13.262239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262764+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:13.262764+0000","last_peered":"2024-04-26T23:48:13.262764+0000","last_clean":"2024-04-26T23:48:13.262764+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:13.262764+0000","last_undegraded":"2024-04-26T23:48:13.262764+0000","last_fullsized":"2024-04-26T23:48:13.262764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264321+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:13.264321+0000","last_peered":"2024-04-26T23:48:13.264321+0000","last_clean":"2024-04-26T23:48:13.264321+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:13.264321+0000","last_undegraded":"2024-04-26T23:48:13.264321+0000","last_fullsized":"2024-04-26T23:48:13.264321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264217+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:13.264217+0000","last_peered":"2024-04-26T23:48:13.264217+0000","last_clean":"2024-04-26T23:48:13.264217+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:13.264217+0000","last_undegraded":"2024-04-26T23:48:13.264217+0000","last_fullsized":"2024-04-26T23:48:13.264217+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467039+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:13.467039+0000","last_peered":"2024-04-26T23:48:13.467039+0000","last_clean":"2024-04-26T23:48:13.467039+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:13.467039+0000","last_undegraded":"2024-04-26T23:48:13.467039+0000","last_fullsized":"2024-04-26T23:48:13.467039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261650+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:13.261650+0000","last_peered":"2024-04-26T23:48:13.261650+0000","last_clean":"2024-04-26T23:48:13.261650+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:13.261650+0000","last_undegraded":"2024-04-26T23:48:13.261650+0000","last_fullsized":"2024-04-26T23:48:13.261650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465723+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:13.465723+0000","last_peered":"2024-04-26T23:48:13.465723+0000","last_clean":"2024-04-26T23:48:13.465723+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:13.465723+0000","last_undegraded":"2024-04-26T23:48:13.465723+0000","last_fullsized":"2024-04-26T23:48:13.465723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665133+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:06.665133+0000","last_peered":"2024-04-26T23:48:06.665133+0000","last_clean":"2024-04-26T23:48:06.665133+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:06.665133+0000","last_undegraded":"2024-04-26T23:48:06.665133+0000","last_fullsized":"2024-04-26T23:48:06.665133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261734+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:13.261734+0000","last_peered":"2024-04-26T23:48:13.261734+0000","last_clean":"2024-04-26T23:48:13.261734+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:13.261734+0000","last_undegraded":"2024-04-26T23:48:13.261734+0000","last_fullsized":"2024-04-26T23:48:13.261734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664470+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:06.664470+0000","last_peered":"2024-04-26T23:48:06.664470+0000","last_clean":"2024-04-26T23:48:06.664470+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:06.664470+0000","last_undegraded":"2024-04-26T23:48:06.664470+0000","last_fullsized":"2024-04-26T23:48:06.664470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262066+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:13.262066+0000","last_peered":"2024-04-26T23:48:13.262066+0000","last_clean":"2024-04-26T23:48:13.262066+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:13.262066+0000","last_undegraded":"2024-04-26T23:48:13.262066+0000","last_fullsized":"2024-04-26T23:48:13.262066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265173+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:13.265173+0000","last_peered":"2024-04-26T23:48:13.265173+0000","last_clean":"2024-04-26T23:48:13.265173+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:13.265173+0000","last_undegraded":"2024-04-26T23:48:13.265173+0000","last_fullsized":"2024-04-26T23:48:13.265173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664523+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:06.664523+0000","last_peered":"2024-04-26T23:48:06.664523+0000","last_clean":"2024-04-26T23:48:06.664523+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:06.664523+0000","last_undegraded":"2024-04-26T23:48:06.664523+0000","last_fullsized":"2024-04-26T23:48:06.664523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262137+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:13.262137+0000","last_peered":"2024-04-26T23:48:13.262137+0000","last_clean":"2024-04-26T23:48:13.262137+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:13.262137+0000","last_undegraded":"2024-04-26T23:48:13.262137+0000","last_fullsized":"2024-04-26T23:48:13.262137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262297+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:13.262297+0000","last_peered":"2024-04-26T23:48:13.262297+0000","last_clean":"2024-04-26T23:48:13.262297+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:13.262297+0000","last_undegraded":"2024-04-26T23:48:13.262297+0000","last_fullsized":"2024-04-26T23:48:13.262297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467273+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:13.467273+0000","last_peered":"2024-04-26T23:48:13.467273+0000","last_clean":"2024-04-26T23:48:13.467273+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:13.467273+0000","last_undegraded":"2024-04-26T23:48:13.467273+0000","last_fullsized":"2024-04-26T23:48:13.467273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665469+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:06.665469+0000","last_peered":"2024-04-26T23:48:06.665469+0000","last_clean":"2024-04-26T23:48:06.665469+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:06.665469+0000","last_undegraded":"2024-04-26T23:48:06.665469+0000","last_fullsized":"2024-04-26T23:48:06.665469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465548+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:13.465548+0000","last_peered":"2024-04-26T23:48:13.465548+0000","last_clean":"2024-04-26T23:48:13.465548+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:13.465548+0000","last_undegraded":"2024-04-26T23:48:13.465548+0000","last_fullsized":"2024-04-26T23:48:13.465548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467210+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:13.467210+0000","last_peered":"2024-04-26T23:48:13.467210+0000","last_clean":"2024-04-26T23:48:13.467210+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:13.467210+0000","last_undegraded":"2024-04-26T23:48:13.467210+0000","last_fullsized":"2024-04-26T23:48:13.467210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467087+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:13.467087+0000","last_peered":"2024-04-26T23:48:13.467087+0000","last_clean":"2024-04-26T23:48:13.467087+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:13.467087+0000","last_undegraded":"2024-04-26T23:48:13.467087+0000","last_fullsized":"2024-04-26T23:48:13.467087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465415+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:13.465415+0000","last_peered":"2024-04-26T23:48:13.465415+0000","last_clean":"2024-04-26T23:48:13.465415+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:13.465415+0000","last_undegraded":"2024-04-26T23:48:13.465415+0000","last_fullsized":"2024-04-26T23:48:13.465415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"peering","last_fresh":"2024-04-26T23:48:06.666012+0000","last_change":"2024-04-26T23:48:13.265524+0000","last_active":"2024-04-26T23:48:13.265524+0000","last_peered":"2024-04-26T23:48:06.666012+0000","last_clean":"2024-04-26T23:48:06.666012+0000","last_became_active":"2024-04-26T23:48:05.241549+0000","last_became_peered":"2024-04-26T23:48:05.241549+0000","last_unstale":"2024-04-26T23:48:06.666012+0000","last_undegraded":"2024-04-26T23:48:06.666012+0000","last_fullsized":"2024-04-26T23:48:06.666012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465895+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:13.465895+0000","last_peered":"2024-04-26T23:48:13.465895+0000","last_clean":"2024-04-26T23:48:13.465895+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:13.465895+0000","last_undegraded":"2024-04-26T23:48:13.465895+0000","last_fullsized":"2024-04-26T23:48:13.465895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665347+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:06.665347+0000","last_peered":"2024-04-26T23:48:06.665347+0000","last_clean":"2024-04-26T23:48:06.665347+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:06.665347+0000","last_undegraded":"2024-04-26T23:48:06.665347+0000","last_fullsized":"2024-04-26T23:48:06.665347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467069+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:13.467069+0000","last_peered":"2024-04-26T23:48:13.467069+0000","last_clean":"2024-04-26T23:48:13.467069+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:13.467069+0000","last_undegraded":"2024-04-26T23:48:13.467069+0000","last_fullsized":"2024-04-26T23:48:13.467069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464910+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:13.464910+0000","last_peered":"2024-04-26T23:48:13.464910+0000","last_clean":"2024-04-26T23:48:13.464910+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:13.464910+0000","last_undegraded":"2024-04-26T23:48:13.464910+0000","last_fullsized":"2024-04-26T23:48:13.464910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465285+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:13.465285+0000","last_peered":"2024-04-26T23:48:13.465285+0000","last_clean":"2024-04-26T23:48:13.465285+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:13.465285+0000","last_undegraded":"2024-04-26T23:48:13.465285+0000","last_fullsized":"2024-04-26T23:48:13.465285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466990+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:13.466990+0000","last_peered":"2024-04-26T23:48:13.466990+0000","last_clean":"2024-04-26T23:48:13.466990+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:13.466990+0000","last_undegraded":"2024-04-26T23:48:13.466990+0000","last_fullsized":"2024-04-26T23:48:13.466990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664615+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:06.664615+0000","last_peered":"2024-04-26T23:48:06.664615+0000","last_clean":"2024-04-26T23:48:06.664615+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:06.664615+0000","last_undegraded":"2024-04-26T23:48:06.664615+0000","last_fullsized":"2024-04-26T23:48:06.664615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465317+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:13.465317+0000","last_peered":"2024-04-26T23:48:13.465317+0000","last_clean":"2024-04-26T23:48:13.465317+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:13.465317+0000","last_undegraded":"2024-04-26T23:48:13.465317+0000","last_fullsized":"2024-04-26T23:48:13.465317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465169+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:13.465169+0000","last_peered":"2024-04-26T23:48:13.465169+0000","last_clean":"2024-04-26T23:48:13.465169+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:13.465169+0000","last_undegraded":"2024-04-26T23:48:13.465169+0000","last_fullsized":"2024-04-26T23:48:13.465169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665484+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:06.665484+0000","last_peered":"2024-04-26T23:48:06.665484+0000","last_clean":"2024-04-26T23:48:06.665484+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:06.665484+0000","last_undegraded":"2024-04-26T23:48:06.665484+0000","last_fullsized":"2024-04-26T23:48:06.665484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262363+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:13.262363+0000","last_peered":"2024-04-26T23:48:13.262363+0000","last_clean":"2024-04-26T23:48:13.262363+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:13.262363+0000","last_undegraded":"2024-04-26T23:48:13.262363+0000","last_fullsized":"2024-04-26T23:48:13.262363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265616+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:13.265616+0000","last_peered":"2024-04-26T23:48:13.265616+0000","last_clean":"2024-04-26T23:48:13.265616+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:13.265616+0000","last_undegraded":"2024-04-26T23:48:13.265616+0000","last_fullsized":"2024-04-26T23:48:13.265616+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265773+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:13.265773+0000","last_peered":"2024-04-26T23:48:13.265773+0000","last_clean":"2024-04-26T23:48:13.265773+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:13.265773+0000","last_undegraded":"2024-04-26T23:48:13.265773+0000","last_fullsized":"2024-04-26T23:48:13.265773+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465668+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:13.465668+0000","last_peered":"2024-04-26T23:48:13.465668+0000","last_clean":"2024-04-26T23:48:13.465668+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:13.465668+0000","last_undegraded":"2024-04-26T23:48:13.465668+0000","last_fullsized":"2024-04-26T23:48:13.465668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465471+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:13.465471+0000","last_peered":"2024-04-26T23:48:13.465471+0000","last_clean":"2024-04-26T23:48:13.465471+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:13.465471+0000","last_undegraded":"2024-04-26T23:48:13.465471+0000","last_fullsized":"2024-04-26T23:48:13.465471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466010+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:13.466010+0000","last_peered":"2024-04-26T23:48:13.466010+0000","last_clean":"2024-04-26T23:48:13.466010+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:13.466010+0000","last_undegraded":"2024-04-26T23:48:13.466010+0000","last_fullsized":"2024-04-26T23:48:13.466010+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263881+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:13.263881+0000","last_peered":"2024-04-26T23:48:13.263881+0000","last_clean":"2024-04-26T23:48:13.263881+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:13.263881+0000","last_undegraded":"2024-04-26T23:48:13.263881+0000","last_fullsized":"2024-04-26T23:48:13.263881+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262263+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:13.262263+0000","last_peered":"2024-04-26T23:48:13.262263+0000","last_clean":"2024-04-26T23:48:13.262263+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:13.262263+0000","last_undegraded":"2024-04-26T23:48:13.262263+0000","last_fullsized":"2024-04-26T23:48:13.262263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465110+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:13.465110+0000","last_peered":"2024-04-26T23:48:13.465110+0000","last_clean":"2024-04-26T23:48:13.465110+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:13.465110+0000","last_undegraded":"2024-04-26T23:48:13.465110+0000","last_fullsized":"2024-04-26T23:48:13.465110+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664652+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:06.664652+0000","last_peered":"2024-04-26T23:48:06.664652+0000","last_clean":"2024-04-26T23:48:06.664652+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:06.664652+0000","last_undegraded":"2024-04-26T23:48:06.664652+0000","last_fullsized":"2024-04-26T23:48:06.664652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":2,"reported_epoch":50,"state":"peering","last_fresh":"2024-04-26T23:48:08.229566+0000","last_change":"2024-04-26T23:48:14.233851+0000","last_active":"2024-04-26T23:48:14.233851+0000","last_peered":"2024-04-26T23:48:08.229566+0000","last_clean":"2024-04-26T23:48:08.229566+0000","last_became_active":"2024-04-26T23:48:05.234135+0000","last_became_peered":"2024-04-26T23:48:05.234135+0000","last_unstale":"2024-04-26T23:48:08.229566+0000","last_undegraded":"2024-04-26T23:48:08.229566+0000","last_fullsized":"2024-04-26T23:48:08.229566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466803+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:13.466803+0000","last_peered":"2024-04-26T23:48:13.466803+0000","last_clean":"2024-04-26T23:48:13.466803+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:13.466803+0000","last_undegraded":"2024-04-26T23:48:13.466803+0000","last_fullsized":"2024-04-26T23:48:13.466803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.266233+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:13.266233+0000","last_peered":"2024-04-26T23:48:13.266233+0000","last_clean":"2024-04-26T23:48:13.266233+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:13.266233+0000","last_undegraded":"2024-04-26T23:48:13.266233+0000","last_fullsized":"2024-04-26T23:48:13.266233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465822+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:13.465822+0000","last_peered":"2024-04-26T23:48:13.465822+0000","last_clean":"2024-04-26T23:48:13.465822+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:13.465822+0000","last_undegraded":"2024-04-26T23:48:13.465822+0000","last_fullsized":"2024-04-26T23:48:13.465822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665535+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:06.665535+0000","last_peered":"2024-04-26T23:48:06.665535+0000","last_clean":"2024-04-26T23:48:06.665535+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:06.665535+0000","last_undegraded":"2024-04-26T23:48:06.665535+0000","last_fullsized":"2024-04-26T23:48:06.665535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467308+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:13.467308+0000","last_peered":"2024-04-26T23:48:13.467308+0000","last_clean":"2024-04-26T23:48:13.467308+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:13.467308+0000","last_undegraded":"2024-04-26T23:48:13.467308+0000","last_fullsized":"2024-04-26T23:48:13.467308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467160+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:13.467160+0000","last_peered":"2024-04-26T23:48:13.467160+0000","last_clean":"2024-04-26T23:48:13.467160+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:13.467160+0000","last_undegraded":"2024-04-26T23:48:13.467160+0000","last_fullsized":"2024-04-26T23:48:13.467160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263889+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:13.263889+0000","last_peered":"2024-04-26T23:48:13.263889+0000","last_clean":"2024-04-26T23:48:13.263889+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:13.263889+0000","last_undegraded":"2024-04-26T23:48:13.263889+0000","last_fullsized":"2024-04-26T23:48:13.263889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465536+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:13.465536+0000","last_peered":"2024-04-26T23:48:13.465536+0000","last_clean":"2024-04-26T23:48:13.465536+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:13.465536+0000","last_undegraded":"2024-04-26T23:48:13.465536+0000","last_fullsized":"2024-04-26T23:48:13.465536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467161+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:13.467161+0000","last_peered":"2024-04-26T23:48:13.467161+0000","last_clean":"2024-04-26T23:48:13.467161+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:13.467161+0000","last_undegraded":"2024-04-26T23:48:13.467161+0000","last_fullsized":"2024-04-26T23:48:13.467161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465769+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:13.465769+0000","last_peered":"2024-04-26T23:48:13.465769+0000","last_clean":"2024-04-26T23:48:13.465769+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:13.465769+0000","last_undegraded":"2024-04-26T23:48:13.465769+0000","last_fullsized":"2024-04-26T23:48:13.465769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261840+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:13.261840+0000","last_peered":"2024-04-26T23:48:13.261840+0000","last_clean":"2024-04-26T23:48:13.261840+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:13.261840+0000","last_undegraded":"2024-04-26T23:48:13.261840+0000","last_fullsized":"2024-04-26T23:48:13.261840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261873+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:13.261873+0000","last_peered":"2024-04-26T23:48:13.261873+0000","last_clean":"2024-04-26T23:48:13.261873+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:13.261873+0000","last_undegraded":"2024-04-26T23:48:13.261873+0000","last_fullsized":"2024-04-26T23:48:13.261873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264422+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:13.264422+0000","last_peered":"2024-04-26T23:48:13.264422+0000","last_clean":"2024-04-26T23:48:13.264422+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:13.264422+0000","last_undegraded":"2024-04-26T23:48:13.264422+0000","last_fullsized":"2024-04-26T23:48:13.264422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261503+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:13.261503+0000","last_peered":"2024-04-26T23:48:13.261503+0000","last_clean":"2024-04-26T23:48:13.261503+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:13.261503+0000","last_undegraded":"2024-04-26T23:48:13.261503+0000","last_fullsized":"2024-04-26T23:48:13.261503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664749+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:06.664749+0000","last_peered":"2024-04-26T23:48:06.664749+0000","last_clean":"2024-04-26T23:48:06.664749+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:06.664749+0000","last_undegraded":"2024-04-26T23:48:06.664749+0000","last_fullsized":"2024-04-26T23:48:06.664749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665417+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:06.665417+0000","last_peered":"2024-04-26T23:48:06.665417+0000","last_clean":"2024-04-26T23:48:06.665417+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:06.665417+0000","last_undegraded":"2024-04-26T23:48:06.665417+0000","last_fullsized":"2024-04-26T23:48:06.665417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263115+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:13.263115+0000","last_peered":"2024-04-26T23:48:13.263115+0000","last_clean":"2024-04-26T23:48:13.263115+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:13.263115+0000","last_undegraded":"2024-04-26T23:48:13.263115+0000","last_fullsized":"2024-04-26T23:48:13.263115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466845+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:13.466845+0000","last_peered":"2024-04-26T23:48:13.466845+0000","last_clean":"2024-04-26T23:48:13.466845+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:13.466845+0000","last_undegraded":"2024-04-26T23:48:13.466845+0000","last_fullsized":"2024-04-26T23:48:13.466845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":239037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":239977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":239003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":598016,"data_stored":239999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":822742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:18.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.050+0000 7f2a6ce00640 1 Processor -- start 2024-04-26T23:48:19.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.050+0000 7f2a6ce00640 1 -- start start 2024-04-26T23:48:19.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a6ce00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2a6806fcd0 0x7f2a6815cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a6ce00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6815fc50 con 0x7f2a680ce310 2024-04-26T23:48:19.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a6ce00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a6815ff30 con 0x7f2a6815c100 2024-04-26T23:48:19.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a6ce00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2a68160860 con 0x7f2a6806fcd0 2024-04-26T23:48:19.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a5d400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2a680ce310 0x7f2a680b4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35766/0 (socket says 172.21.15.47:35766) 2024-04-26T23:48:19.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a5d400640 1 -- 172.21.15.47:0/970259295 learned_addr learned my addr 172.21.15.47:0/970259295 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a66800640 1 --2- 172.21.15.47:0/970259295 >> v2:172.21.15.203:3300/0 conn(0x7f2a6806fcd0 0x7f2a6815cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4257365940 0 0) 0x7f2a6815fc50 con 0x7f2a680ce310 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a4c005740 con 0x7f2a680ce310 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187609754 0 0) 0x7f2a6815ff30 con 0x7f2a6815c100 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a6815fc50 con 0x7f2a6815c100 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1205043121 0 0) 0x7f2a4c005740 con 0x7f2a680ce310 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 >> v2:172.21.15.203:3300/0 conn(0x7f2a6806fcd0 msgr2=0x7f2a6815cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 --2- 172.21.15.47:0/970259295 >> v2:172.21.15.203:3300/0 conn(0x7f2a6806fcd0 0x7f2a6815cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 >> v1:172.21.15.203:6789/0 conn(0x7f2a6815c100 legacy=0x7f2a680cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a68160210 con 0x7f2a680ce310 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f2a50001780 con 0x7f2a680ce310 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 >> v1:172.21.15.47:6789/0 conn(0x7f2a680ce310 legacy=0x7f2a680b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c005d60 0x7f2a4c006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c006a20 0x7f2a4c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a4c0073e0 0x7f2a4c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a68160860 con 0x7f2a4c0073e0 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c00e260 con 0x7f2a4c005d60 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a4c00e460 con 0x7f2a4c006a20 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a66800640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a4c0073e0 0x7f2a4c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a65e00640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c005d60 0x7f2a4c006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a5d400640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c006a20 0x7f2a4c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a66800640 1 -- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c006a20 msgr2=0x7f2a4c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a66800640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a4c006a20 0x7f2a4c006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a66800640 1 -- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c005d60 msgr2=0x7f2a4c006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a66800640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c005d60 0x7f2a4c006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.054+0000 7f2a66800640 1 -- 172.21.15.47:0/970259295 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c005740 con 0x7f2a4c0073e0 2024-04-26T23:48:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a66800640 1 -- 172.21.15.47:0/970259295 reap_dead start 2024-04-26T23:48:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a66800640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a4c0073e0 0x7f2a4c00dbe0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009fc0 tx=0x7f2a6001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee47d92624e6fd89 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60009c10 con 0x7f2a4c0073e0 2024-04-26T23:48:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a60003be0 con 0x7f2a4c0073e0 2024-04-26T23:48:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a65400640 1 -- 172.21.15.47:0/970259295 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a600a58f0 con 0x7f2a4c0073e0 2024-04-26T23:48:19.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a6ce00640 1 -- 172.21.15.47:0/970259295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a4c0073e0 msgr2=0x7f2a4c00dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a4c0073e0 0x7f2a4c00dbe0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009fc0 tx=0x7f2a6001cae0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a6ce00640 1 -- 172.21.15.47:0/970259295 shutdown_connections 2024-04-26T23:48:19.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/970259295 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a4c0073e0 0x7f2a4c00dbe0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a6ce00640 1 -- 172.21.15.47:0/970259295 >> 172.21.15.47:0/970259295 conn(0x7f2a6806c800 msgr2=0x7f2a6806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a6ce00640 1 -- 172.21.15.47:0/970259295 shutdown_connections 2024-04-26T23:48:19.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.058+0000 7f2a6ce00640 1 -- 172.21.15.47:0/970259295 wait complete. 2024-04-26T23:48:19.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 Processor -- start 2024-04-26T23:48:19.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 -- start start 2024-04-26T23:48:19.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0073e0 0x7f2a68157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a680c63c0 0x7f2a6809c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a6809c9b0 0x7f2a6809d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6815cf60 con 0x7f2a6809c9b0 2024-04-26T23:48:19.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6815fab0 con 0x7f2a4c0073e0 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6815d0e0 con 0x7f2a680c63c0 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a6809c9b0 0x7f2a6809d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a6809c9b0 0x7f2a6809d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38700/0 (socket says 172.21.15.47:38700) 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 -- 172.21.15.47:0/3077718123 learned_addr learned my addr 172.21.15.47:0/3077718123 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 -- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a680c63c0 msgr2=0x7f2a6809c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a680c63c0 0x7f2a6809c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 -- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0073e0 msgr2=0x7f2a68157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0073e0 0x7f2a68157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 -- 172.21.15.47:0/3077718123 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a680b0a00 con 0x7f2a6809c9b0 2024-04-26T23:48:19.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a66800640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a6809c9b0 0x7f2a6809d300 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2a6001c550 tx=0x7f2a60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a5ea00640 1 -- 172.21.15.47:0/3077718123 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a60009c10 con 0x7f2a6809c9b0 2024-04-26T23:48:19.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a5ea00640 1 -- 172.21.15.47:0/3077718123 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a600be070 con 0x7f2a6809c9b0 2024-04-26T23:48:19.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a5ea00640 1 -- 172.21.15.47:0/3077718123 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a600b8690 con 0x7f2a6809c9b0 2024-04-26T23:48:19.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a680b0ce0 con 0x7f2a6809c9b0 2024-04-26T23:48:19.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a680b12a0 con 0x7f2a6809c9b0 2024-04-26T23:48:19.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.062+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a68069700 con 0x7f2a6809c9b0 2024-04-26T23:48:19.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.066+0000 7f2a5ea00640 1 -- 172.21.15.47:0/3077718123 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f2a600b8830 con 0x7f2a6809c9b0 2024-04-26T23:48:19.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.066+0000 7f2a5ea00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2a44068680 0x7f2a4406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.066+0000 7f2a5ea00640 1 -- 172.21.15.47:0/3077718123 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f2a60121f50 con 0x7f2a6809c9b0 2024-04-26T23:48:19.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.066+0000 7f2a65e00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2a44068680 0x7f2a4406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.066+0000 7f2a65e00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2a44068680 0x7f2a4406ab40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a58007fd0 tx=0x7f2a58009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.070+0000 7f2a5ea00640 1 -- 172.21.15.47:0/3077718123 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2a50007e20 con 0x7f2a6809c9b0 2024-04-26T23:48:19.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.234+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a680d08b0 con 0x7f2a44068680 2024-04-26T23:48:19.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a5ea00640 1 -- 172.21.15.47:0/3077718123 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251829 (secure 0 0 0) 0x7f2a680d08b0 con 0x7f2a44068680 2024-04-26T23:48:19.249 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:19.250 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:19.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2a44068680 msgr2=0x7f2a4406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2a44068680 0x7f2a4406ab40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2a58007fd0 tx=0x7f2a58009040 comp rx=0 tx=0).stop 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a6809c9b0 msgr2=0x7f2a6809d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a6809c9b0 0x7f2a6809d300 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2a6001c550 tx=0x7f2a60009750 comp rx=0 tx=0).stop 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 shutdown_connections 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2a44068680 0x7f2a4406ab40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2a6809c9b0 0x7f2a6809d300 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2a680c63c0 0x7f2a6809c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 --2- 172.21.15.47:0/3077718123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c0073e0 0x7f2a68157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 >> 172.21.15.47:0/3077718123 conn(0x7f2a6806c800 msgr2=0x7f2a6815b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 shutdown_connections 2024-04-26T23:48:19.252 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.242+0000 7f2a6ce00640 1 -- 172.21.15.47:0/3077718123 wait complete. 2024-04-26T23:48:19.270 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-04-26T23:48:18.193192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238556,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736164,"statfs":{"total":773094113280,"available":772849831936,"internally_reserved":0,"allocated":5894144,"data_stored":3086451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002182"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467224+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:13.467224+0000","last_peered":"2024-04-26T23:48:13.467224+0000","last_clean":"2024-04-26T23:48:13.467224+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:13.467224+0000","last_undegraded":"2024-04-26T23:48:13.467224+0000","last_fullsized":"2024-04-26T23:48:13.467224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261817+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:13.261817+0000","last_peered":"2024-04-26T23:48:13.261817+0000","last_clean":"2024-04-26T23:48:13.261817+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:13.261817+0000","last_undegraded":"2024-04-26T23:48:13.261817+0000","last_fullsized":"2024-04-26T23:48:13.261817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665408+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:06.665408+0000","last_peered":"2024-04-26T23:48:06.665408+0000","last_clean":"2024-04-26T23:48:06.665408+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:06.665408+0000","last_undegraded":"2024-04-26T23:48:06.665408+0000","last_fullsized":"2024-04-26T23:48:06.665408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262483+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:13.262483+0000","last_peered":"2024-04-26T23:48:13.262483+0000","last_clean":"2024-04-26T23:48:13.262483+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:13.262483+0000","last_undegraded":"2024-04-26T23:48:13.262483+0000","last_fullsized":"2024-04-26T23:48:13.262483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465420+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:13.465420+0000","last_peered":"2024-04-26T23:48:13.465420+0000","last_clean":"2024-04-26T23:48:13.465420+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:13.465420+0000","last_undegraded":"2024-04-26T23:48:13.465420+0000","last_fullsized":"2024-04-26T23:48:13.465420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466901+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:13.466901+0000","last_peered":"2024-04-26T23:48:13.466901+0000","last_clean":"2024-04-26T23:48:13.466901+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:13.466901+0000","last_undegraded":"2024-04-26T23:48:13.466901+0000","last_fullsized":"2024-04-26T23:48:13.466901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664211+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:06.664211+0000","last_peered":"2024-04-26T23:48:06.664211+0000","last_clean":"2024-04-26T23:48:06.664211+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:06.664211+0000","last_undegraded":"2024-04-26T23:48:06.664211+0000","last_fullsized":"2024-04-26T23:48:06.664211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665384+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:06.665384+0000","last_peered":"2024-04-26T23:48:06.665384+0000","last_clean":"2024-04-26T23:48:06.665384+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:06.665384+0000","last_undegraded":"2024-04-26T23:48:06.665384+0000","last_fullsized":"2024-04-26T23:48:06.665384+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665422+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:06.665422+0000","last_peered":"2024-04-26T23:48:06.665422+0000","last_clean":"2024-04-26T23:48:06.665422+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:06.665422+0000","last_undegraded":"2024-04-26T23:48:06.665422+0000","last_fullsized":"2024-04-26T23:48:06.665422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665483+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:06.665483+0000","last_peered":"2024-04-26T23:48:06.665483+0000","last_clean":"2024-04-26T23:48:06.665483+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:06.665483+0000","last_undegraded":"2024-04-26T23:48:06.665483+0000","last_fullsized":"2024-04-26T23:48:06.665483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262670+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:13.262670+0000","last_peered":"2024-04-26T23:48:13.262670+0000","last_clean":"2024-04-26T23:48:13.262670+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:13.262670+0000","last_undegraded":"2024-04-26T23:48:13.262670+0000","last_fullsized":"2024-04-26T23:48:13.262670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465049+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:13.465049+0000","last_peered":"2024-04-26T23:48:13.465049+0000","last_clean":"2024-04-26T23:48:13.465049+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:13.465049+0000","last_undegraded":"2024-04-26T23:48:13.465049+0000","last_fullsized":"2024-04-26T23:48:13.465049+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664798+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:06.664798+0000","last_peered":"2024-04-26T23:48:06.664798+0000","last_clean":"2024-04-26T23:48:06.664798+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:06.664798+0000","last_undegraded":"2024-04-26T23:48:06.664798+0000","last_fullsized":"2024-04-26T23:48:06.664798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465009+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:13.465009+0000","last_peered":"2024-04-26T23:48:13.465009+0000","last_clean":"2024-04-26T23:48:13.465009+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:13.465009+0000","last_undegraded":"2024-04-26T23:48:13.465009+0000","last_fullsized":"2024-04-26T23:48:13.465009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265153+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:13.265153+0000","last_peered":"2024-04-26T23:48:13.265153+0000","last_clean":"2024-04-26T23:48:13.265153+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:13.265153+0000","last_undegraded":"2024-04-26T23:48:13.265153+0000","last_fullsized":"2024-04-26T23:48:13.265153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261987+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:13.261987+0000","last_peered":"2024-04-26T23:48:13.261987+0000","last_clean":"2024-04-26T23:48:13.261987+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:13.261987+0000","last_undegraded":"2024-04-26T23:48:13.261987+0000","last_fullsized":"2024-04-26T23:48:13.261987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262037+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:13.262037+0000","last_peered":"2024-04-26T23:48:13.262037+0000","last_clean":"2024-04-26T23:48:13.262037+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:13.262037+0000","last_undegraded":"2024-04-26T23:48:13.262037+0000","last_fullsized":"2024-04-26T23:48:13.262037+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265949+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:13.265949+0000","last_peered":"2024-04-26T23:48:13.265949+0000","last_clean":"2024-04-26T23:48:13.265949+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:13.265949+0000","last_undegraded":"2024-04-26T23:48:13.265949+0000","last_fullsized":"2024-04-26T23:48:13.265949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465359+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:13.465359+0000","last_peered":"2024-04-26T23:48:13.465359+0000","last_clean":"2024-04-26T23:48:13.465359+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:13.465359+0000","last_undegraded":"2024-04-26T23:48:13.465359+0000","last_fullsized":"2024-04-26T23:48:13.465359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465567+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:13.465567+0000","last_peered":"2024-04-26T23:48:13.465567+0000","last_clean":"2024-04-26T23:48:13.465567+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:13.465567+0000","last_undegraded":"2024-04-26T23:48:13.465567+0000","last_fullsized":"2024-04-26T23:48:13.465567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665008+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:06.665008+0000","last_peered":"2024-04-26T23:48:06.665008+0000","last_clean":"2024-04-26T23:48:06.665008+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:06.665008+0000","last_undegraded":"2024-04-26T23:48:06.665008+0000","last_fullsized":"2024-04-26T23:48:06.665008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265223+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:13.265223+0000","last_peered":"2024-04-26T23:48:13.265223+0000","last_clean":"2024-04-26T23:48:13.265223+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:13.265223+0000","last_undegraded":"2024-04-26T23:48:13.265223+0000","last_fullsized":"2024-04-26T23:48:13.265223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265180+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:13.265180+0000","last_peered":"2024-04-26T23:48:13.265180+0000","last_clean":"2024-04-26T23:48:13.265180+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:13.265180+0000","last_undegraded":"2024-04-26T23:48:13.265180+0000","last_fullsized":"2024-04-26T23:48:13.265180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265900+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:13.265900+0000","last_peered":"2024-04-26T23:48:13.265900+0000","last_clean":"2024-04-26T23:48:13.265900+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:13.265900+0000","last_undegraded":"2024-04-26T23:48:13.265900+0000","last_fullsized":"2024-04-26T23:48:13.265900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465065+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:13.465065+0000","last_peered":"2024-04-26T23:48:13.465065+0000","last_clean":"2024-04-26T23:48:13.465065+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:13.465065+0000","last_undegraded":"2024-04-26T23:48:13.465065+0000","last_fullsized":"2024-04-26T23:48:13.465065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261872+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:13.261872+0000","last_peered":"2024-04-26T23:48:13.261872+0000","last_clean":"2024-04-26T23:48:13.261872+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:13.261872+0000","last_undegraded":"2024-04-26T23:48:13.261872+0000","last_fullsized":"2024-04-26T23:48:13.261872+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262762+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:13.262762+0000","last_peered":"2024-04-26T23:48:13.262762+0000","last_clean":"2024-04-26T23:48:13.262762+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:13.262762+0000","last_undegraded":"2024-04-26T23:48:13.262762+0000","last_fullsized":"2024-04-26T23:48:13.262762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265301+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:13.265301+0000","last_peered":"2024-04-26T23:48:13.265301+0000","last_clean":"2024-04-26T23:48:13.265301+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:13.265301+0000","last_undegraded":"2024-04-26T23:48:13.265301+0000","last_fullsized":"2024-04-26T23:48:13.265301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261496+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:13.261496+0000","last_peered":"2024-04-26T23:48:13.261496+0000","last_clean":"2024-04-26T23:48:13.261496+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:13.261496+0000","last_undegraded":"2024-04-26T23:48:13.261496+0000","last_fullsized":"2024-04-26T23:48:13.261496+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465121+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:13.465121+0000","last_peered":"2024-04-26T23:48:13.465121+0000","last_clean":"2024-04-26T23:48:13.465121+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:13.465121+0000","last_undegraded":"2024-04-26T23:48:13.465121+0000","last_fullsized":"2024-04-26T23:48:13.465121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464975+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:13.464975+0000","last_peered":"2024-04-26T23:48:13.464975+0000","last_clean":"2024-04-26T23:48:13.464975+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:13.464975+0000","last_undegraded":"2024-04-26T23:48:13.464975+0000","last_fullsized":"2024-04-26T23:48:13.464975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264054+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:13.264054+0000","last_peered":"2024-04-26T23:48:13.264054+0000","last_clean":"2024-04-26T23:48:13.264054+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:13.264054+0000","last_undegraded":"2024-04-26T23:48:13.264054+0000","last_fullsized":"2024-04-26T23:48:13.264054+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465930+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:13.465930+0000","last_peered":"2024-04-26T23:48:13.465930+0000","last_clean":"2024-04-26T23:48:13.465930+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:13.465930+0000","last_undegraded":"2024-04-26T23:48:13.465930+0000","last_fullsized":"2024-04-26T23:48:13.465930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265798+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:13.265798+0000","last_peered":"2024-04-26T23:48:13.265798+0000","last_clean":"2024-04-26T23:48:13.265798+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:13.265798+0000","last_undegraded":"2024-04-26T23:48:13.265798+0000","last_fullsized":"2024-04-26T23:48:13.265798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262239+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:13.262239+0000","last_peered":"2024-04-26T23:48:13.262239+0000","last_clean":"2024-04-26T23:48:13.262239+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:13.262239+0000","last_undegraded":"2024-04-26T23:48:13.262239+0000","last_fullsized":"2024-04-26T23:48:13.262239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262764+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:13.262764+0000","last_peered":"2024-04-26T23:48:13.262764+0000","last_clean":"2024-04-26T23:48:13.262764+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:13.262764+0000","last_undegraded":"2024-04-26T23:48:13.262764+0000","last_fullsized":"2024-04-26T23:48:13.262764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264321+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:13.264321+0000","last_peered":"2024-04-26T23:48:13.264321+0000","last_clean":"2024-04-26T23:48:13.264321+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:13.264321+0000","last_undegraded":"2024-04-26T23:48:13.264321+0000","last_fullsized":"2024-04-26T23:48:13.264321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264217+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:13.264217+0000","last_peered":"2024-04-26T23:48:13.264217+0000","last_clean":"2024-04-26T23:48:13.264217+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:13.264217+0000","last_undegraded":"2024-04-26T23:48:13.264217+0000","last_fullsized":"2024-04-26T23:48:13.264217+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467039+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:13.467039+0000","last_peered":"2024-04-26T23:48:13.467039+0000","last_clean":"2024-04-26T23:48:13.467039+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:13.467039+0000","last_undegraded":"2024-04-26T23:48:13.467039+0000","last_fullsized":"2024-04-26T23:48:13.467039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261650+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:13.261650+0000","last_peered":"2024-04-26T23:48:13.261650+0000","last_clean":"2024-04-26T23:48:13.261650+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:13.261650+0000","last_undegraded":"2024-04-26T23:48:13.261650+0000","last_fullsized":"2024-04-26T23:48:13.261650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465723+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:13.465723+0000","last_peered":"2024-04-26T23:48:13.465723+0000","last_clean":"2024-04-26T23:48:13.465723+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:13.465723+0000","last_undegraded":"2024-04-26T23:48:13.465723+0000","last_fullsized":"2024-04-26T23:48:13.465723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665133+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:06.665133+0000","last_peered":"2024-04-26T23:48:06.665133+0000","last_clean":"2024-04-26T23:48:06.665133+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:06.665133+0000","last_undegraded":"2024-04-26T23:48:06.665133+0000","last_fullsized":"2024-04-26T23:48:06.665133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261734+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:13.261734+0000","last_peered":"2024-04-26T23:48:13.261734+0000","last_clean":"2024-04-26T23:48:13.261734+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:13.261734+0000","last_undegraded":"2024-04-26T23:48:13.261734+0000","last_fullsized":"2024-04-26T23:48:13.261734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664470+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:06.664470+0000","last_peered":"2024-04-26T23:48:06.664470+0000","last_clean":"2024-04-26T23:48:06.664470+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:06.664470+0000","last_undegraded":"2024-04-26T23:48:06.664470+0000","last_fullsized":"2024-04-26T23:48:06.664470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262066+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:13.262066+0000","last_peered":"2024-04-26T23:48:13.262066+0000","last_clean":"2024-04-26T23:48:13.262066+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:13.262066+0000","last_undegraded":"2024-04-26T23:48:13.262066+0000","last_fullsized":"2024-04-26T23:48:13.262066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265173+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:13.265173+0000","last_peered":"2024-04-26T23:48:13.265173+0000","last_clean":"2024-04-26T23:48:13.265173+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:13.265173+0000","last_undegraded":"2024-04-26T23:48:13.265173+0000","last_fullsized":"2024-04-26T23:48:13.265173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664523+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:06.664523+0000","last_peered":"2024-04-26T23:48:06.664523+0000","last_clean":"2024-04-26T23:48:06.664523+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:06.664523+0000","last_undegraded":"2024-04-26T23:48:06.664523+0000","last_fullsized":"2024-04-26T23:48:06.664523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262137+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:13.262137+0000","last_peered":"2024-04-26T23:48:13.262137+0000","last_clean":"2024-04-26T23:48:13.262137+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:13.262137+0000","last_undegraded":"2024-04-26T23:48:13.262137+0000","last_fullsized":"2024-04-26T23:48:13.262137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262297+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:13.262297+0000","last_peered":"2024-04-26T23:48:13.262297+0000","last_clean":"2024-04-26T23:48:13.262297+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:13.262297+0000","last_undegraded":"2024-04-26T23:48:13.262297+0000","last_fullsized":"2024-04-26T23:48:13.262297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467273+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:13.467273+0000","last_peered":"2024-04-26T23:48:13.467273+0000","last_clean":"2024-04-26T23:48:13.467273+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:13.467273+0000","last_undegraded":"2024-04-26T23:48:13.467273+0000","last_fullsized":"2024-04-26T23:48:13.467273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665469+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:06.665469+0000","last_peered":"2024-04-26T23:48:06.665469+0000","last_clean":"2024-04-26T23:48:06.665469+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:06.665469+0000","last_undegraded":"2024-04-26T23:48:06.665469+0000","last_fullsized":"2024-04-26T23:48:06.665469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465548+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:13.465548+0000","last_peered":"2024-04-26T23:48:13.465548+0000","last_clean":"2024-04-26T23:48:13.465548+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:13.465548+0000","last_undegraded":"2024-04-26T23:48:13.465548+0000","last_fullsized":"2024-04-26T23:48:13.465548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467210+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:13.467210+0000","last_peered":"2024-04-26T23:48:13.467210+0000","last_clean":"2024-04-26T23:48:13.467210+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:13.467210+0000","last_undegraded":"2024-04-26T23:48:13.467210+0000","last_fullsized":"2024-04-26T23:48:13.467210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467087+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:13.467087+0000","last_peered":"2024-04-26T23:48:13.467087+0000","last_clean":"2024-04-26T23:48:13.467087+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:13.467087+0000","last_undegraded":"2024-04-26T23:48:13.467087+0000","last_fullsized":"2024-04-26T23:48:13.467087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465415+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:13.465415+0000","last_peered":"2024-04-26T23:48:13.465415+0000","last_clean":"2024-04-26T23:48:13.465415+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:13.465415+0000","last_undegraded":"2024-04-26T23:48:13.465415+0000","last_fullsized":"2024-04-26T23:48:13.465415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"peering","last_fresh":"2024-04-26T23:48:06.666012+0000","last_change":"2024-04-26T23:48:13.265524+0000","last_active":"2024-04-26T23:48:13.265524+0000","last_peered":"2024-04-26T23:48:06.666012+0000","last_clean":"2024-04-26T23:48:06.666012+0000","last_became_active":"2024-04-26T23:48:05.241549+0000","last_became_peered":"2024-04-26T23:48:05.241549+0000","last_unstale":"2024-04-26T23:48:06.666012+0000","last_undegraded":"2024-04-26T23:48:06.666012+0000","last_fullsized":"2024-04-26T23:48:06.666012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465895+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:13.465895+0000","last_peered":"2024-04-26T23:48:13.465895+0000","last_clean":"2024-04-26T23:48:13.465895+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:13.465895+0000","last_undegraded":"2024-04-26T23:48:13.465895+0000","last_fullsized":"2024-04-26T23:48:13.465895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665347+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:06.665347+0000","last_peered":"2024-04-26T23:48:06.665347+0000","last_clean":"2024-04-26T23:48:06.665347+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:06.665347+0000","last_undegraded":"2024-04-26T23:48:06.665347+0000","last_fullsized":"2024-04-26T23:48:06.665347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467069+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:13.467069+0000","last_peered":"2024-04-26T23:48:13.467069+0000","last_clean":"2024-04-26T23:48:13.467069+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:13.467069+0000","last_undegraded":"2024-04-26T23:48:13.467069+0000","last_fullsized":"2024-04-26T23:48:13.467069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464910+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:13.464910+0000","last_peered":"2024-04-26T23:48:13.464910+0000","last_clean":"2024-04-26T23:48:13.464910+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:13.464910+0000","last_undegraded":"2024-04-26T23:48:13.464910+0000","last_fullsized":"2024-04-26T23:48:13.464910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465285+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:13.465285+0000","last_peered":"2024-04-26T23:48:13.465285+0000","last_clean":"2024-04-26T23:48:13.465285+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:13.465285+0000","last_undegraded":"2024-04-26T23:48:13.465285+0000","last_fullsized":"2024-04-26T23:48:13.465285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466990+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:13.466990+0000","last_peered":"2024-04-26T23:48:13.466990+0000","last_clean":"2024-04-26T23:48:13.466990+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:13.466990+0000","last_undegraded":"2024-04-26T23:48:13.466990+0000","last_fullsized":"2024-04-26T23:48:13.466990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664615+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:06.664615+0000","last_peered":"2024-04-26T23:48:06.664615+0000","last_clean":"2024-04-26T23:48:06.664615+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:06.664615+0000","last_undegraded":"2024-04-26T23:48:06.664615+0000","last_fullsized":"2024-04-26T23:48:06.664615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465317+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:13.465317+0000","last_peered":"2024-04-26T23:48:13.465317+0000","last_clean":"2024-04-26T23:48:13.465317+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:13.465317+0000","last_undegraded":"2024-04-26T23:48:13.465317+0000","last_fullsized":"2024-04-26T23:48:13.465317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465169+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:13.465169+0000","last_peered":"2024-04-26T23:48:13.465169+0000","last_clean":"2024-04-26T23:48:13.465169+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:13.465169+0000","last_undegraded":"2024-04-26T23:48:13.465169+0000","last_fullsized":"2024-04-26T23:48:13.465169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665484+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:06.665484+0000","last_peered":"2024-04-26T23:48:06.665484+0000","last_clean":"2024-04-26T23:48:06.665484+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:06.665484+0000","last_undegraded":"2024-04-26T23:48:06.665484+0000","last_fullsized":"2024-04-26T23:48:06.665484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262363+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:13.262363+0000","last_peered":"2024-04-26T23:48:13.262363+0000","last_clean":"2024-04-26T23:48:13.262363+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:13.262363+0000","last_undegraded":"2024-04-26T23:48:13.262363+0000","last_fullsized":"2024-04-26T23:48:13.262363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265616+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:13.265616+0000","last_peered":"2024-04-26T23:48:13.265616+0000","last_clean":"2024-04-26T23:48:13.265616+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:13.265616+0000","last_undegraded":"2024-04-26T23:48:13.265616+0000","last_fullsized":"2024-04-26T23:48:13.265616+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265773+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:13.265773+0000","last_peered":"2024-04-26T23:48:13.265773+0000","last_clean":"2024-04-26T23:48:13.265773+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:13.265773+0000","last_undegraded":"2024-04-26T23:48:13.265773+0000","last_fullsized":"2024-04-26T23:48:13.265773+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465668+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:13.465668+0000","last_peered":"2024-04-26T23:48:13.465668+0000","last_clean":"2024-04-26T23:48:13.465668+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:13.465668+0000","last_undegraded":"2024-04-26T23:48:13.465668+0000","last_fullsized":"2024-04-26T23:48:13.465668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465471+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:13.465471+0000","last_peered":"2024-04-26T23:48:13.465471+0000","last_clean":"2024-04-26T23:48:13.465471+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:13.465471+0000","last_undegraded":"2024-04-26T23:48:13.465471+0000","last_fullsized":"2024-04-26T23:48:13.465471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466010+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:13.466010+0000","last_peered":"2024-04-26T23:48:13.466010+0000","last_clean":"2024-04-26T23:48:13.466010+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:13.466010+0000","last_undegraded":"2024-04-26T23:48:13.466010+0000","last_fullsized":"2024-04-26T23:48:13.466010+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263881+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:13.263881+0000","last_peered":"2024-04-26T23:48:13.263881+0000","last_clean":"2024-04-26T23:48:13.263881+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:13.263881+0000","last_undegraded":"2024-04-26T23:48:13.263881+0000","last_fullsized":"2024-04-26T23:48:13.263881+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262263+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:13.262263+0000","last_peered":"2024-04-26T23:48:13.262263+0000","last_clean":"2024-04-26T23:48:13.262263+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:13.262263+0000","last_undegraded":"2024-04-26T23:48:13.262263+0000","last_fullsized":"2024-04-26T23:48:13.262263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465110+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:13.465110+0000","last_peered":"2024-04-26T23:48:13.465110+0000","last_clean":"2024-04-26T23:48:13.465110+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:13.465110+0000","last_undegraded":"2024-04-26T23:48:13.465110+0000","last_fullsized":"2024-04-26T23:48:13.465110+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664652+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:06.664652+0000","last_peered":"2024-04-26T23:48:06.664652+0000","last_clean":"2024-04-26T23:48:06.664652+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:06.664652+0000","last_undegraded":"2024-04-26T23:48:06.664652+0000","last_fullsized":"2024-04-26T23:48:06.664652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":2,"reported_epoch":50,"state":"peering","last_fresh":"2024-04-26T23:48:08.229566+0000","last_change":"2024-04-26T23:48:14.233851+0000","last_active":"2024-04-26T23:48:14.233851+0000","last_peered":"2024-04-26T23:48:08.229566+0000","last_clean":"2024-04-26T23:48:08.229566+0000","last_became_active":"2024-04-26T23:48:05.234135+0000","last_became_peered":"2024-04-26T23:48:05.234135+0000","last_unstale":"2024-04-26T23:48:08.229566+0000","last_undegraded":"2024-04-26T23:48:08.229566+0000","last_fullsized":"2024-04-26T23:48:08.229566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466803+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:13.466803+0000","last_peered":"2024-04-26T23:48:13.466803+0000","last_clean":"2024-04-26T23:48:13.466803+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:13.466803+0000","last_undegraded":"2024-04-26T23:48:13.466803+0000","last_fullsized":"2024-04-26T23:48:13.466803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.266233+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:13.266233+0000","last_peered":"2024-04-26T23:48:13.266233+0000","last_clean":"2024-04-26T23:48:13.266233+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:13.266233+0000","last_undegraded":"2024-04-26T23:48:13.266233+0000","last_fullsized":"2024-04-26T23:48:13.266233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465822+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:13.465822+0000","last_peered":"2024-04-26T23:48:13.465822+0000","last_clean":"2024-04-26T23:48:13.465822+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:13.465822+0000","last_undegraded":"2024-04-26T23:48:13.465822+0000","last_fullsized":"2024-04-26T23:48:13.465822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665535+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:06.665535+0000","last_peered":"2024-04-26T23:48:06.665535+0000","last_clean":"2024-04-26T23:48:06.665535+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:06.665535+0000","last_undegraded":"2024-04-26T23:48:06.665535+0000","last_fullsized":"2024-04-26T23:48:06.665535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467308+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:13.467308+0000","last_peered":"2024-04-26T23:48:13.467308+0000","last_clean":"2024-04-26T23:48:13.467308+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:13.467308+0000","last_undegraded":"2024-04-26T23:48:13.467308+0000","last_fullsized":"2024-04-26T23:48:13.467308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467160+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:13.467160+0000","last_peered":"2024-04-26T23:48:13.467160+0000","last_clean":"2024-04-26T23:48:13.467160+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:13.467160+0000","last_undegraded":"2024-04-26T23:48:13.467160+0000","last_fullsized":"2024-04-26T23:48:13.467160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263889+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:13.263889+0000","last_peered":"2024-04-26T23:48:13.263889+0000","last_clean":"2024-04-26T23:48:13.263889+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:13.263889+0000","last_undegraded":"2024-04-26T23:48:13.263889+0000","last_fullsized":"2024-04-26T23:48:13.263889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465536+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:13.465536+0000","last_peered":"2024-04-26T23:48:13.465536+0000","last_clean":"2024-04-26T23:48:13.465536+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:13.465536+0000","last_undegraded":"2024-04-26T23:48:13.465536+0000","last_fullsized":"2024-04-26T23:48:13.465536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467161+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:13.467161+0000","last_peered":"2024-04-26T23:48:13.467161+0000","last_clean":"2024-04-26T23:48:13.467161+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:13.467161+0000","last_undegraded":"2024-04-26T23:48:13.467161+0000","last_fullsized":"2024-04-26T23:48:13.467161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465769+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:13.465769+0000","last_peered":"2024-04-26T23:48:13.465769+0000","last_clean":"2024-04-26T23:48:13.465769+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:13.465769+0000","last_undegraded":"2024-04-26T23:48:13.465769+0000","last_fullsized":"2024-04-26T23:48:13.465769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261840+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:13.261840+0000","last_peered":"2024-04-26T23:48:13.261840+0000","last_clean":"2024-04-26T23:48:13.261840+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:13.261840+0000","last_undegraded":"2024-04-26T23:48:13.261840+0000","last_fullsized":"2024-04-26T23:48:13.261840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261873+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:13.261873+0000","last_peered":"2024-04-26T23:48:13.261873+0000","last_clean":"2024-04-26T23:48:13.261873+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:13.261873+0000","last_undegraded":"2024-04-26T23:48:13.261873+0000","last_fullsized":"2024-04-26T23:48:13.261873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264422+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:13.264422+0000","last_peered":"2024-04-26T23:48:13.264422+0000","last_clean":"2024-04-26T23:48:13.264422+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:13.264422+0000","last_undegraded":"2024-04-26T23:48:13.264422+0000","last_fullsized":"2024-04-26T23:48:13.264422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261503+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:13.261503+0000","last_peered":"2024-04-26T23:48:13.261503+0000","last_clean":"2024-04-26T23:48:13.261503+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:13.261503+0000","last_undegraded":"2024-04-26T23:48:13.261503+0000","last_fullsized":"2024-04-26T23:48:13.261503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664749+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:06.664749+0000","last_peered":"2024-04-26T23:48:06.664749+0000","last_clean":"2024-04-26T23:48:06.664749+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:06.664749+0000","last_undegraded":"2024-04-26T23:48:06.664749+0000","last_fullsized":"2024-04-26T23:48:06.664749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665417+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:06.665417+0000","last_peered":"2024-04-26T23:48:06.665417+0000","last_clean":"2024-04-26T23:48:06.665417+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:06.665417+0000","last_undegraded":"2024-04-26T23:48:06.665417+0000","last_fullsized":"2024-04-26T23:48:06.665417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263115+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:13.263115+0000","last_peered":"2024-04-26T23:48:13.263115+0000","last_clean":"2024-04-26T23:48:13.263115+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:13.263115+0000","last_undegraded":"2024-04-26T23:48:13.263115+0000","last_fullsized":"2024-04-26T23:48:13.263115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466845+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:13.466845+0000","last_peered":"2024-04-26T23:48:13.466845+0000","last_clean":"2024-04-26T23:48:13.466845+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:13.466845+0000","last_undegraded":"2024-04-26T23:48:13.466845+0000","last_fullsized":"2024-04-26T23:48:13.466845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":239037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":239977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":239003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":598016,"data_stored":239999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":822742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:19.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-26T23:48:19.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 13, 'reported_epoch': 49, 'state': 'peering', 'last_fresh': '2024-04-26T23:48:06.666012+0000', 'last_change': '2024-04-26T23:48:13.265524+0000', 'last_active': '2024-04-26T23:48:13.265524+0000', 'last_peered': '2024-04-26T23:48:06.666012+0000', 'last_clean': '2024-04-26T23:48:06.666012+0000', 'last_became_active': '2024-04-26T23:48:05.241549+0000', 'last_became_peered': '2024-04-26T23:48:05.241549+0000', 'last_unstale': '2024-04-26T23:48:06.666012+0000', 'last_undegraded': '2024-04-26T23:48:06.666012+0000', 'last_fullsized': '2024-04-26T23:48:06.666012+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0, 5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-26T23:48:19.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-26T23:48:19.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 2, 'reported_epoch': 50, 'state': 'peering', 'last_fresh': '2024-04-26T23:48:08.229566+0000', 'last_change': '2024-04-26T23:48:14.233851+0000', 'last_active': '2024-04-26T23:48:14.233851+0000', 'last_peered': '2024-04-26T23:48:08.229566+0000', 'last_clean': '2024-04-26T23:48:08.229566+0000', 'last_became_active': '2024-04-26T23:48:05.234135+0000', 'last_became_peered': '2024-04-26T23:48:05.234135+0000', 'last_unstale': '2024-04-26T23:48:08.229566+0000', 'last_undegraded': '2024-04-26T23:48:08.229566+0000', 'last_fullsized': '2024-04-26T23:48:08.229566+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 48, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'last_clean_scrub_stamp': '2024-04-26T23:48:04.193819+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-26T23:48:19.274 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T23:48:19.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.450+0000 7f3849400640 1 Processor -- start 2024-04-26T23:48:19.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.450+0000 7f3849400640 1 -- start start 2024-04-26T23:48:19.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.450+0000 7f3849400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38440b4360 0x7f38440cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.450+0000 7f3849400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f38440ce310 0x7f384415da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.450+0000 7f3849400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f384415e050 con 0x7f384415d5b0 2024-04-26T23:48:19.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3849400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f384415e330 con 0x7f38440ce310 2024-04-26T23:48:19.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3849400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f38440ceda0 con 0x7f38440b4360 2024-04-26T23:48:19.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3839e00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f384415d5b0 0x7f38440cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:50942/0 (socket says 172.21.15.47:50942) 2024-04-26T23:48:19.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3839e00640 1 -- 172.21.15.47:0/973312906 learned_addr learned my addr 172.21.15.47:0/973312906 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:19.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3842800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38440b4360 0x7f38440cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3843200640 1 --2- 172.21.15.47:0/973312906 >> v2:172.21.15.203:3300/0 conn(0x7f38440ce310 0x7f384415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3841e00640 1 -- 172.21.15.47:0/973312906 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283826047 0 0) 0x7f384415e050 con 0x7f384415d5b0 2024-04-26T23:48:19.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3841e00640 1 -- 172.21.15.47:0/973312906 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3828003530 con 0x7f384415d5b0 2024-04-26T23:48:19.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3842800640 1 -- 172.21.15.47:0/973312906 >> v2:172.21.15.203:3300/0 conn(0x7f38440ce310 msgr2=0x7f384415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3842800640 1 --2- 172.21.15.47:0/973312906 >> v2:172.21.15.203:3300/0 conn(0x7f38440ce310 0x7f384415da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3842800640 1 -- 172.21.15.47:0/973312906 >> v1:172.21.15.203:6789/0 conn(0x7f384415d5b0 legacy=0x7f38440cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3842800640 1 -- 172.21.15.47:0/973312906 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38440cf080 con 0x7f38440b4360 2024-04-26T23:48:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.454+0000 7f3842800640 1 --2- 172.21.15.47:0/973312906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38440b4360 0x7f38440cf5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38340097c0 tx=0x7f383401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9918ded9fb9f1d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3841e00640 1 -- 172.21.15.47:0/973312906 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b1070 con 0x7f38440b4360 2024-04-26T23:48:19.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3841e00640 1 -- 172.21.15.47:0/973312906 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38340ac410 con 0x7f38440b4360 2024-04-26T23:48:19.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3841e00640 1 -- 172.21.15.47:0/973312906 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340ac7e0 con 0x7f38440b4360 2024-04-26T23:48:19.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- 172.21.15.47:0/973312906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38440b4360 msgr2=0x7f38440cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 --2- 172.21.15.47:0/973312906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38440b4360 0x7f38440cf5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38340097c0 tx=0x7f383401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- 172.21.15.47:0/973312906 shutdown_connections 2024-04-26T23:48:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 --2- 172.21.15.47:0/973312906 >> v2:172.21.15.203:3300/0 conn(0x7f38440ce310 0x7f384415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 --2- 172.21.15.47:0/973312906 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f38440b4360 0x7f38440cf5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- 172.21.15.47:0/973312906 >> 172.21.15.47:0/973312906 conn(0x7f384406c800 msgr2=0x7f384406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- 172.21.15.47:0/973312906 shutdown_connections 2024-04-26T23:48:19.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- 172.21.15.47:0/973312906 wait complete. 2024-04-26T23:48:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 Processor -- start 2024-04-26T23:48:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- start start 2024-04-26T23:48:19.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38440b4360 0x7f384414a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38440ce310 0x7f384409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f384415d5b0 0x7f384409d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f384415f100 con 0x7f38440b4360 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f384415ef80 con 0x7f38440ce310 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3849400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f384415f280 con 0x7f384415d5b0 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3842800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38440b4360 0x7f384414a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3842800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38440b4360 0x7f384414a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38714/0 (socket says 172.21.15.47:38714) 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.458+0000 7f3842800640 1 -- 172.21.15.47:0/861317377 learned_addr learned my addr 172.21.15.47:0/861317377 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3839e00640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38440ce310 0x7f384409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3843200640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f384415d5b0 0x7f384409d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3842800640 1 -- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f384415d5b0 msgr2=0x7f384409d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3842800640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f384415d5b0 0x7f384409d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3842800640 1 -- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38440ce310 msgr2=0x7f384409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3842800640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38440ce310 0x7f384409ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3842800640 1 -- 172.21.15.47:0/861317377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384414aa00 con 0x7f38440b4360 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3842800640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38440b4360 0x7f384414a4c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f383401a0d0 tx=0x7f3834019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f383b400640 1 -- 172.21.15.47:0/861317377 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b1040 con 0x7f38440b4360 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f383b400640 1 -- 172.21.15.47:0/861317377 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38340bb070 con 0x7f38440b4360 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f383b400640 1 -- 172.21.15.47:0/861317377 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38340b5410 con 0x7f38440b4360 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384409c290 con 0x7f38440b4360 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f384409c850 con 0x7f38440b4360 2024-04-26T23:48:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3844069700 con 0x7f38440b4360 2024-04-26T23:48:19.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.462+0000 7f383b400640 1 -- 172.21.15.47:0/861317377 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f38340b55b0 con 0x7f38440b4360 2024-04-26T23:48:19.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.466+0000 7f383b400640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3820068650 0x7f382006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.466+0000 7f383b400640 1 -- 172.21.15.47:0/861317377 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f3834120840 con 0x7f38440b4360 2024-04-26T23:48:19.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.466+0000 7f3839e00640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3820068650 0x7f382006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.466+0000 7f3839e00640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3820068650 0x7f382006ab10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f38441510b0 tx=0x7f382c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.470+0000 7f383b400640 1 -- 172.21.15.47:0/861317377 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3834016090 con 0x7f38440b4360 2024-04-26T23:48:19.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.694+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f38440b34c0 con 0x7f38440b4360 2024-04-26T23:48:19.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f383b400640 1 -- 172.21.15.47:0/861317377 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1026 (secure 0 0 0) 0x7f38340f0310 con 0x7f38440b4360 2024-04-26T23:48:19.703 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:19.703 INFO:teuthology.orchestra.run.smithi047.stdout:{"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":192,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1714175118,"num_in_osds":8,"osd_in_since":1714175109,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"peering","count":2}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":244281344,"bytes_avail":772849831936,"bytes_total":773094113280,"inactive_pgs_ratio":0.020618556067347527},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5913}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-04-26T23:47:40.184970+0000","services":{}},"progress_events":{}} 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3820068650 msgr2=0x7f382006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3820068650 0x7f382006ab10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f38441510b0 tx=0x7f382c009040 comp rx=0 tx=0).stop 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38440b4360 msgr2=0x7f384414a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38440b4360 0x7f384414a4c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f383401a0d0 tx=0x7f3834019240 comp rx=0 tx=0).stop 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 shutdown_connections 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3820068650 0x7f382006ab10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f384415d5b0 0x7f384409d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38440ce310 0x7f384409ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 --2- 172.21.15.47:0/861317377 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38440b4360 0x7f384414a4c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 >> 172.21.15.47:0/861317377 conn(0x7f384406c800 msgr2=0x7f384406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 shutdown_connections 2024-04-26T23:48:19.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.698+0000 7f3849400640 1 -- 172.21.15.47:0/861317377 wait complete. 2024-04-26T23:48:19.725 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T23:48:19.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.858+0000 7f9033200640 1 Processor -- start 2024-04-26T23:48:19.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.858+0000 7f9033200640 1 -- start start 2024-04-26T23:48:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9033200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f902c15c100 0x7f902c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9033200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 0x7f902c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9033200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902c15fc50 con 0x7f902c0ce140 2024-04-26T23:48:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9033200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f902c160860 con 0x7f902c15c100 2024-04-26T23:48:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9033200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f902c15d4a0 con 0x7f902c06fcd0 2024-04-26T23:48:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9031200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f902c0ce140 0x7f902c06ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35772/0 (socket says 172.21.15.47:35772) 2024-04-26T23:48:19.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9031200640 1 -- 172.21.15.47:0/2206065474 learned_addr learned my addr 172.21.15.47:0/2206065474 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992705853 0 0) 0x7f902c15fc50 con 0x7f902c0ce140 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9023400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 0x7f902c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902be00640 1 --2- 172.21.15.47:0/2206065474 >> v2:172.21.15.203:3300/0 conn(0x7f902c15c100 0x7f902c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9010003530 con 0x7f902c0ce140 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1073894975 0 0) 0x7f9010003530 con 0x7f902c0ce140 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 msgr2=0x7f902c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 0x7f902c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 >> v2:172.21.15.203:3300/0 conn(0x7f902c15c100 msgr2=0x7f902c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 --2- 172.21.15.47:0/2206065474 >> v2:172.21.15.203:3300/0 conn(0x7f902c15c100 0x7f902c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c15ff30 con 0x7f902c0ce140 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f9024001a00 con 0x7f902c0ce140 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 >> v1:172.21.15.47:6789/0 conn(0x7f902c0ce140 legacy=0x7f902c06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 0x7f90100039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9010003f40 0x7f9010004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9010004d50 0x7f90100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f902c160860 con 0x7f9010003f40 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f902c15d4a0 con 0x7f9010004d50 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f901000b9d0 con 0x7f902c06fcd0 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f902be00640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 0x7f90100039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9023400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9010003f40 0x7f9010004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9031200640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9010004d50 0x7f90100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9023400640 1 -- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 msgr2=0x7f90100039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9023400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f902c06fcd0 0x7f90100039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9023400640 1 -- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9010004d50 msgr2=0x7f90100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:19.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9023400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9010004d50 0x7f90100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.862+0000 7f9023400640 1 -- 172.21.15.47:0/2206065474 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9010003530 con 0x7f9010003f40 2024-04-26T23:48:19.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9023400640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9010003f40 0x7f9010004810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9014009ac0 tx=0x7f901401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19ea3eb85bfa7f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014009690 con 0x7f9010003f40 2024-04-26T23:48:19.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90140059a0 con 0x7f9010003f40 2024-04-26T23:48:19.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f902b400640 1 -- 172.21.15.47:0/2206065474 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014005d90 con 0x7f9010003f40 2024-04-26T23:48:19.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 -- 172.21.15.47:0/2206065474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9010003f40 msgr2=0x7f9010004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 --2- 172.21.15.47:0/2206065474 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9010003f40 0x7f9010004810 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9014009ac0 tx=0x7f901401c9f0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9031200640 1 -- 172.21.15.47:0/2206065474 reap_dead start 2024-04-26T23:48:19.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 -- 172.21.15.47:0/2206065474 shutdown_connections 2024-04-26T23:48:19.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 -- 172.21.15.47:0/2206065474 >> 172.21.15.47:0/2206065474 conn(0x7f902c06c800 msgr2=0x7f902c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:19.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 -- 172.21.15.47:0/2206065474 shutdown_connections 2024-04-26T23:48:19.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 -- 172.21.15.47:0/2206065474 wait complete. 2024-04-26T23:48:19.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 Processor -- start 2024-04-26T23:48:19.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.866+0000 7f9033200640 1 -- start start 2024-04-26T23:48:19.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9010003f40 0x7f902c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f902c09ba60 0x7f902c15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f902c0ca130 0x7f902c15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0b5e20 con 0x7f902c0ca130 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1604f0 con 0x7f902c09ba60 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f902c0b5fa0 con 0x7f9010003f40 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f902c0ca130 0x7f902c15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f902c0ca130 0x7f902c15ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38726/0 (socket says 172.21.15.47:38726) 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 -- 172.21.15.47:0/3877658081 learned_addr learned my addr 172.21.15.47:0/3877658081 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f902be00640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9010003f40 0x7f902c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9023400640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f902c09ba60 0x7f902c15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 -- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9010003f40 msgr2=0x7f902c14d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9010003f40 0x7f902c14d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 -- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f902c09ba60 msgr2=0x7f902c15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f902c09ba60 0x7f902c15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 -- 172.21.15.47:0/3877658081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c0ca6a0 con 0x7f902c0ca130 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9031200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f902c0ca130 0x7f902c15ca20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f902c0b0270 tx=0x7f90240115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9028c00640 1 -- 172.21.15.47:0/3877658081 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902401c070 con 0x7f902c0ca130 2024-04-26T23:48:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9028c00640 1 -- 172.21.15.47:0/3877658081 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024011e20 con 0x7f902c0ca130 2024-04-26T23:48:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9028c00640 1 -- 172.21.15.47:0/3877658081 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024010040 con 0x7f902c0ca130 2024-04-26T23:48:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c0ca980 con 0x7f902c0ca130 2024-04-26T23:48:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c155340 con 0x7f902c0ca130 2024-04-26T23:48:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.870+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902c069700 con 0x7f902c0ca130 2024-04-26T23:48:19.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.874+0000 7f9028c00640 1 -- 172.21.15.47:0/3877658081 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f902401f070 con 0x7f902c0ca130 2024-04-26T23:48:19.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.874+0000 7f9028c00640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90080685f0 0x7f900806aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:19.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.874+0000 7f9028c00640 1 -- 172.21.15.47:0/3877658081 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f9024089bd0 con 0x7f902c0ca130 2024-04-26T23:48:19.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.874+0000 7f902be00640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90080685f0 0x7f900806aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:19.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.874+0000 7f902be00640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90080685f0 0x7f900806aab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f901c009ba0 tx=0x7f901c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:19.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:19.878+0000 7f9028c00640 1 -- 172.21.15.47:0/3877658081 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9024059e50 con 0x7f902c0ca130 2024-04-26T23:48:20.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.038+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f902c074280 con 0x7f90080685f0 2024-04-26T23:48:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.046+0000 7f9028c00640 1 -- 172.21.15.47:0/3877658081 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251829 (secure 0 0 0) 0x7f902c074280 con 0x7f90080685f0 2024-04-26T23:48:20.053 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:20.055 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.046+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90080685f0 msgr2=0x7f900806aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.046+0000 7f9033200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90080685f0 0x7f900806aab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f901c009ba0 tx=0x7f901c008040 comp rx=0 tx=0).stop 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.046+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f902c0ca130 msgr2=0x7f902c15ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.046+0000 7f9033200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f902c0ca130 0x7f902c15ca20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f902c0b0270 tx=0x7f90240115c0 comp rx=0 tx=0).stop 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 shutdown_connections 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f90080685f0 0x7f900806aab0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f902c0ca130 0x7f902c15ca20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f902c09ba60 0x7f902c15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:20.056 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 --2- 172.21.15.47:0/3877658081 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9010003f40 0x7f902c14d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:20.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 >> 172.21.15.47:0/3877658081 conn(0x7f902c06c800 msgr2=0x7f902c073480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:20.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 shutdown_connections 2024-04-26T23:48:20.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:20.050+0000 7f9033200640 1 -- 172.21.15.47:0/3877658081 wait complete. 2024-04-26T23:48:20.074 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-04-26T23:48:18.193192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238556,"kb_used_data":5756,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736164,"statfs":{"total":773094113280,"available":772849831936,"internally_reserved":0,"allocated":5894144,"data_stored":3086451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002182"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467224+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:13.467224+0000","last_peered":"2024-04-26T23:48:13.467224+0000","last_clean":"2024-04-26T23:48:13.467224+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:13.467224+0000","last_undegraded":"2024-04-26T23:48:13.467224+0000","last_fullsized":"2024-04-26T23:48:13.467224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261817+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:13.261817+0000","last_peered":"2024-04-26T23:48:13.261817+0000","last_clean":"2024-04-26T23:48:13.261817+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:13.261817+0000","last_undegraded":"2024-04-26T23:48:13.261817+0000","last_fullsized":"2024-04-26T23:48:13.261817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665408+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:06.665408+0000","last_peered":"2024-04-26T23:48:06.665408+0000","last_clean":"2024-04-26T23:48:06.665408+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:06.665408+0000","last_undegraded":"2024-04-26T23:48:06.665408+0000","last_fullsized":"2024-04-26T23:48:06.665408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262483+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:13.262483+0000","last_peered":"2024-04-26T23:48:13.262483+0000","last_clean":"2024-04-26T23:48:13.262483+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:13.262483+0000","last_undegraded":"2024-04-26T23:48:13.262483+0000","last_fullsized":"2024-04-26T23:48:13.262483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465420+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:13.465420+0000","last_peered":"2024-04-26T23:48:13.465420+0000","last_clean":"2024-04-26T23:48:13.465420+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:13.465420+0000","last_undegraded":"2024-04-26T23:48:13.465420+0000","last_fullsized":"2024-04-26T23:48:13.465420+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466901+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:13.466901+0000","last_peered":"2024-04-26T23:48:13.466901+0000","last_clean":"2024-04-26T23:48:13.466901+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:13.466901+0000","last_undegraded":"2024-04-26T23:48:13.466901+0000","last_fullsized":"2024-04-26T23:48:13.466901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664211+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:06.664211+0000","last_peered":"2024-04-26T23:48:06.664211+0000","last_clean":"2024-04-26T23:48:06.664211+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:06.664211+0000","last_undegraded":"2024-04-26T23:48:06.664211+0000","last_fullsized":"2024-04-26T23:48:06.664211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665384+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:06.665384+0000","last_peered":"2024-04-26T23:48:06.665384+0000","last_clean":"2024-04-26T23:48:06.665384+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:06.665384+0000","last_undegraded":"2024-04-26T23:48:06.665384+0000","last_fullsized":"2024-04-26T23:48:06.665384+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665422+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:06.665422+0000","last_peered":"2024-04-26T23:48:06.665422+0000","last_clean":"2024-04-26T23:48:06.665422+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:06.665422+0000","last_undegraded":"2024-04-26T23:48:06.665422+0000","last_fullsized":"2024-04-26T23:48:06.665422+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665483+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:06.665483+0000","last_peered":"2024-04-26T23:48:06.665483+0000","last_clean":"2024-04-26T23:48:06.665483+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:06.665483+0000","last_undegraded":"2024-04-26T23:48:06.665483+0000","last_fullsized":"2024-04-26T23:48:06.665483+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262670+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:13.262670+0000","last_peered":"2024-04-26T23:48:13.262670+0000","last_clean":"2024-04-26T23:48:13.262670+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:13.262670+0000","last_undegraded":"2024-04-26T23:48:13.262670+0000","last_fullsized":"2024-04-26T23:48:13.262670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465049+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:13.465049+0000","last_peered":"2024-04-26T23:48:13.465049+0000","last_clean":"2024-04-26T23:48:13.465049+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:13.465049+0000","last_undegraded":"2024-04-26T23:48:13.465049+0000","last_fullsized":"2024-04-26T23:48:13.465049+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664798+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:06.664798+0000","last_peered":"2024-04-26T23:48:06.664798+0000","last_clean":"2024-04-26T23:48:06.664798+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:06.664798+0000","last_undegraded":"2024-04-26T23:48:06.664798+0000","last_fullsized":"2024-04-26T23:48:06.664798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465009+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:13.465009+0000","last_peered":"2024-04-26T23:48:13.465009+0000","last_clean":"2024-04-26T23:48:13.465009+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:13.465009+0000","last_undegraded":"2024-04-26T23:48:13.465009+0000","last_fullsized":"2024-04-26T23:48:13.465009+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265153+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:13.265153+0000","last_peered":"2024-04-26T23:48:13.265153+0000","last_clean":"2024-04-26T23:48:13.265153+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:13.265153+0000","last_undegraded":"2024-04-26T23:48:13.265153+0000","last_fullsized":"2024-04-26T23:48:13.265153+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261987+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:13.261987+0000","last_peered":"2024-04-26T23:48:13.261987+0000","last_clean":"2024-04-26T23:48:13.261987+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:13.261987+0000","last_undegraded":"2024-04-26T23:48:13.261987+0000","last_fullsized":"2024-04-26T23:48:13.261987+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262037+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:13.262037+0000","last_peered":"2024-04-26T23:48:13.262037+0000","last_clean":"2024-04-26T23:48:13.262037+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:13.262037+0000","last_undegraded":"2024-04-26T23:48:13.262037+0000","last_fullsized":"2024-04-26T23:48:13.262037+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265949+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:13.265949+0000","last_peered":"2024-04-26T23:48:13.265949+0000","last_clean":"2024-04-26T23:48:13.265949+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:13.265949+0000","last_undegraded":"2024-04-26T23:48:13.265949+0000","last_fullsized":"2024-04-26T23:48:13.265949+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465359+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:13.465359+0000","last_peered":"2024-04-26T23:48:13.465359+0000","last_clean":"2024-04-26T23:48:13.465359+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:13.465359+0000","last_undegraded":"2024-04-26T23:48:13.465359+0000","last_fullsized":"2024-04-26T23:48:13.465359+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465567+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:13.465567+0000","last_peered":"2024-04-26T23:48:13.465567+0000","last_clean":"2024-04-26T23:48:13.465567+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:13.465567+0000","last_undegraded":"2024-04-26T23:48:13.465567+0000","last_fullsized":"2024-04-26T23:48:13.465567+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665008+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:06.665008+0000","last_peered":"2024-04-26T23:48:06.665008+0000","last_clean":"2024-04-26T23:48:06.665008+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:06.665008+0000","last_undegraded":"2024-04-26T23:48:06.665008+0000","last_fullsized":"2024-04-26T23:48:06.665008+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265223+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:13.265223+0000","last_peered":"2024-04-26T23:48:13.265223+0000","last_clean":"2024-04-26T23:48:13.265223+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:13.265223+0000","last_undegraded":"2024-04-26T23:48:13.265223+0000","last_fullsized":"2024-04-26T23:48:13.265223+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265180+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:13.265180+0000","last_peered":"2024-04-26T23:48:13.265180+0000","last_clean":"2024-04-26T23:48:13.265180+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:13.265180+0000","last_undegraded":"2024-04-26T23:48:13.265180+0000","last_fullsized":"2024-04-26T23:48:13.265180+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265900+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:13.265900+0000","last_peered":"2024-04-26T23:48:13.265900+0000","last_clean":"2024-04-26T23:48:13.265900+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:13.265900+0000","last_undegraded":"2024-04-26T23:48:13.265900+0000","last_fullsized":"2024-04-26T23:48:13.265900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465065+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:13.465065+0000","last_peered":"2024-04-26T23:48:13.465065+0000","last_clean":"2024-04-26T23:48:13.465065+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:13.465065+0000","last_undegraded":"2024-04-26T23:48:13.465065+0000","last_fullsized":"2024-04-26T23:48:13.465065+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261872+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:13.261872+0000","last_peered":"2024-04-26T23:48:13.261872+0000","last_clean":"2024-04-26T23:48:13.261872+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:13.261872+0000","last_undegraded":"2024-04-26T23:48:13.261872+0000","last_fullsized":"2024-04-26T23:48:13.261872+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262762+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:13.262762+0000","last_peered":"2024-04-26T23:48:13.262762+0000","last_clean":"2024-04-26T23:48:13.262762+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:13.262762+0000","last_undegraded":"2024-04-26T23:48:13.262762+0000","last_fullsized":"2024-04-26T23:48:13.262762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265301+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:13.265301+0000","last_peered":"2024-04-26T23:48:13.265301+0000","last_clean":"2024-04-26T23:48:13.265301+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:13.265301+0000","last_undegraded":"2024-04-26T23:48:13.265301+0000","last_fullsized":"2024-04-26T23:48:13.265301+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261496+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:13.261496+0000","last_peered":"2024-04-26T23:48:13.261496+0000","last_clean":"2024-04-26T23:48:13.261496+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:13.261496+0000","last_undegraded":"2024-04-26T23:48:13.261496+0000","last_fullsized":"2024-04-26T23:48:13.261496+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465121+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:13.465121+0000","last_peered":"2024-04-26T23:48:13.465121+0000","last_clean":"2024-04-26T23:48:13.465121+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:13.465121+0000","last_undegraded":"2024-04-26T23:48:13.465121+0000","last_fullsized":"2024-04-26T23:48:13.465121+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464975+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:13.464975+0000","last_peered":"2024-04-26T23:48:13.464975+0000","last_clean":"2024-04-26T23:48:13.464975+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:13.464975+0000","last_undegraded":"2024-04-26T23:48:13.464975+0000","last_fullsized":"2024-04-26T23:48:13.464975+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264054+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:13.264054+0000","last_peered":"2024-04-26T23:48:13.264054+0000","last_clean":"2024-04-26T23:48:13.264054+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:13.264054+0000","last_undegraded":"2024-04-26T23:48:13.264054+0000","last_fullsized":"2024-04-26T23:48:13.264054+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":20,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465930+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:13.465930+0000","last_peered":"2024-04-26T23:48:13.465930+0000","last_clean":"2024-04-26T23:48:13.465930+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:13.465930+0000","last_undegraded":"2024-04-26T23:48:13.465930+0000","last_fullsized":"2024-04-26T23:48:13.465930+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265798+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:13.265798+0000","last_peered":"2024-04-26T23:48:13.265798+0000","last_clean":"2024-04-26T23:48:13.265798+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:13.265798+0000","last_undegraded":"2024-04-26T23:48:13.265798+0000","last_fullsized":"2024-04-26T23:48:13.265798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262239+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:13.262239+0000","last_peered":"2024-04-26T23:48:13.262239+0000","last_clean":"2024-04-26T23:48:13.262239+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:13.262239+0000","last_undegraded":"2024-04-26T23:48:13.262239+0000","last_fullsized":"2024-04-26T23:48:13.262239+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262764+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:13.262764+0000","last_peered":"2024-04-26T23:48:13.262764+0000","last_clean":"2024-04-26T23:48:13.262764+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:13.262764+0000","last_undegraded":"2024-04-26T23:48:13.262764+0000","last_fullsized":"2024-04-26T23:48:13.262764+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264321+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:13.264321+0000","last_peered":"2024-04-26T23:48:13.264321+0000","last_clean":"2024-04-26T23:48:13.264321+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:13.264321+0000","last_undegraded":"2024-04-26T23:48:13.264321+0000","last_fullsized":"2024-04-26T23:48:13.264321+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264217+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:13.264217+0000","last_peered":"2024-04-26T23:48:13.264217+0000","last_clean":"2024-04-26T23:48:13.264217+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:13.264217+0000","last_undegraded":"2024-04-26T23:48:13.264217+0000","last_fullsized":"2024-04-26T23:48:13.264217+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467039+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:13.467039+0000","last_peered":"2024-04-26T23:48:13.467039+0000","last_clean":"2024-04-26T23:48:13.467039+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:13.467039+0000","last_undegraded":"2024-04-26T23:48:13.467039+0000","last_fullsized":"2024-04-26T23:48:13.467039+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261650+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:13.261650+0000","last_peered":"2024-04-26T23:48:13.261650+0000","last_clean":"2024-04-26T23:48:13.261650+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:13.261650+0000","last_undegraded":"2024-04-26T23:48:13.261650+0000","last_fullsized":"2024-04-26T23:48:13.261650+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465723+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:13.465723+0000","last_peered":"2024-04-26T23:48:13.465723+0000","last_clean":"2024-04-26T23:48:13.465723+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:13.465723+0000","last_undegraded":"2024-04-26T23:48:13.465723+0000","last_fullsized":"2024-04-26T23:48:13.465723+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665133+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:06.665133+0000","last_peered":"2024-04-26T23:48:06.665133+0000","last_clean":"2024-04-26T23:48:06.665133+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:06.665133+0000","last_undegraded":"2024-04-26T23:48:06.665133+0000","last_fullsized":"2024-04-26T23:48:06.665133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261734+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:13.261734+0000","last_peered":"2024-04-26T23:48:13.261734+0000","last_clean":"2024-04-26T23:48:13.261734+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:13.261734+0000","last_undegraded":"2024-04-26T23:48:13.261734+0000","last_fullsized":"2024-04-26T23:48:13.261734+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664470+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:06.664470+0000","last_peered":"2024-04-26T23:48:06.664470+0000","last_clean":"2024-04-26T23:48:06.664470+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:06.664470+0000","last_undegraded":"2024-04-26T23:48:06.664470+0000","last_fullsized":"2024-04-26T23:48:06.664470+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262066+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:13.262066+0000","last_peered":"2024-04-26T23:48:13.262066+0000","last_clean":"2024-04-26T23:48:13.262066+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:13.262066+0000","last_undegraded":"2024-04-26T23:48:13.262066+0000","last_fullsized":"2024-04-26T23:48:13.262066+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265173+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:13.265173+0000","last_peered":"2024-04-26T23:48:13.265173+0000","last_clean":"2024-04-26T23:48:13.265173+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:13.265173+0000","last_undegraded":"2024-04-26T23:48:13.265173+0000","last_fullsized":"2024-04-26T23:48:13.265173+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664523+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:06.664523+0000","last_peered":"2024-04-26T23:48:06.664523+0000","last_clean":"2024-04-26T23:48:06.664523+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:06.664523+0000","last_undegraded":"2024-04-26T23:48:06.664523+0000","last_fullsized":"2024-04-26T23:48:06.664523+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262137+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:13.262137+0000","last_peered":"2024-04-26T23:48:13.262137+0000","last_clean":"2024-04-26T23:48:13.262137+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:13.262137+0000","last_undegraded":"2024-04-26T23:48:13.262137+0000","last_fullsized":"2024-04-26T23:48:13.262137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262297+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:13.262297+0000","last_peered":"2024-04-26T23:48:13.262297+0000","last_clean":"2024-04-26T23:48:13.262297+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:13.262297+0000","last_undegraded":"2024-04-26T23:48:13.262297+0000","last_fullsized":"2024-04-26T23:48:13.262297+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467273+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:13.467273+0000","last_peered":"2024-04-26T23:48:13.467273+0000","last_clean":"2024-04-26T23:48:13.467273+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:13.467273+0000","last_undegraded":"2024-04-26T23:48:13.467273+0000","last_fullsized":"2024-04-26T23:48:13.467273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665469+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:06.665469+0000","last_peered":"2024-04-26T23:48:06.665469+0000","last_clean":"2024-04-26T23:48:06.665469+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:06.665469+0000","last_undegraded":"2024-04-26T23:48:06.665469+0000","last_fullsized":"2024-04-26T23:48:06.665469+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465548+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:13.465548+0000","last_peered":"2024-04-26T23:48:13.465548+0000","last_clean":"2024-04-26T23:48:13.465548+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:13.465548+0000","last_undegraded":"2024-04-26T23:48:13.465548+0000","last_fullsized":"2024-04-26T23:48:13.465548+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":19,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467210+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:13.467210+0000","last_peered":"2024-04-26T23:48:13.467210+0000","last_clean":"2024-04-26T23:48:13.467210+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:13.467210+0000","last_undegraded":"2024-04-26T23:48:13.467210+0000","last_fullsized":"2024-04-26T23:48:13.467210+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467087+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:13.467087+0000","last_peered":"2024-04-26T23:48:13.467087+0000","last_clean":"2024-04-26T23:48:13.467087+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:13.467087+0000","last_undegraded":"2024-04-26T23:48:13.467087+0000","last_fullsized":"2024-04-26T23:48:13.467087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":22,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465415+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:13.465415+0000","last_peered":"2024-04-26T23:48:13.465415+0000","last_clean":"2024-04-26T23:48:13.465415+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:13.465415+0000","last_undegraded":"2024-04-26T23:48:13.465415+0000","last_fullsized":"2024-04-26T23:48:13.465415+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":49,"state":"peering","last_fresh":"2024-04-26T23:48:06.666012+0000","last_change":"2024-04-26T23:48:13.265524+0000","last_active":"2024-04-26T23:48:13.265524+0000","last_peered":"2024-04-26T23:48:06.666012+0000","last_clean":"2024-04-26T23:48:06.666012+0000","last_became_active":"2024-04-26T23:48:05.241549+0000","last_became_peered":"2024-04-26T23:48:05.241549+0000","last_unstale":"2024-04-26T23:48:06.666012+0000","last_undegraded":"2024-04-26T23:48:06.666012+0000","last_fullsized":"2024-04-26T23:48:06.666012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465895+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:13.465895+0000","last_peered":"2024-04-26T23:48:13.465895+0000","last_clean":"2024-04-26T23:48:13.465895+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:13.465895+0000","last_undegraded":"2024-04-26T23:48:13.465895+0000","last_fullsized":"2024-04-26T23:48:13.465895+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665347+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:06.665347+0000","last_peered":"2024-04-26T23:48:06.665347+0000","last_clean":"2024-04-26T23:48:06.665347+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:06.665347+0000","last_undegraded":"2024-04-26T23:48:06.665347+0000","last_fullsized":"2024-04-26T23:48:06.665347+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467069+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:13.467069+0000","last_peered":"2024-04-26T23:48:13.467069+0000","last_clean":"2024-04-26T23:48:13.467069+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:13.467069+0000","last_undegraded":"2024-04-26T23:48:13.467069+0000","last_fullsized":"2024-04-26T23:48:13.467069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.464910+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:13.464910+0000","last_peered":"2024-04-26T23:48:13.464910+0000","last_clean":"2024-04-26T23:48:13.464910+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:13.464910+0000","last_undegraded":"2024-04-26T23:48:13.464910+0000","last_fullsized":"2024-04-26T23:48:13.464910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465285+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:13.465285+0000","last_peered":"2024-04-26T23:48:13.465285+0000","last_clean":"2024-04-26T23:48:13.465285+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:13.465285+0000","last_undegraded":"2024-04-26T23:48:13.465285+0000","last_fullsized":"2024-04-26T23:48:13.465285+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466990+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:13.466990+0000","last_peered":"2024-04-26T23:48:13.466990+0000","last_clean":"2024-04-26T23:48:13.466990+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:13.466990+0000","last_undegraded":"2024-04-26T23:48:13.466990+0000","last_fullsized":"2024-04-26T23:48:13.466990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":22,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664615+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:06.664615+0000","last_peered":"2024-04-26T23:48:06.664615+0000","last_clean":"2024-04-26T23:48:06.664615+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:06.664615+0000","last_undegraded":"2024-04-26T23:48:06.664615+0000","last_fullsized":"2024-04-26T23:48:06.664615+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465317+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:13.465317+0000","last_peered":"2024-04-26T23:48:13.465317+0000","last_clean":"2024-04-26T23:48:13.465317+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:13.465317+0000","last_undegraded":"2024-04-26T23:48:13.465317+0000","last_fullsized":"2024-04-26T23:48:13.465317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465169+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:13.465169+0000","last_peered":"2024-04-26T23:48:13.465169+0000","last_clean":"2024-04-26T23:48:13.465169+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:13.465169+0000","last_undegraded":"2024-04-26T23:48:13.465169+0000","last_fullsized":"2024-04-26T23:48:13.465169+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665484+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:06.665484+0000","last_peered":"2024-04-26T23:48:06.665484+0000","last_clean":"2024-04-26T23:48:06.665484+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:06.665484+0000","last_undegraded":"2024-04-26T23:48:06.665484+0000","last_fullsized":"2024-04-26T23:48:06.665484+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262363+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:13.262363+0000","last_peered":"2024-04-26T23:48:13.262363+0000","last_clean":"2024-04-26T23:48:13.262363+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:13.262363+0000","last_undegraded":"2024-04-26T23:48:13.262363+0000","last_fullsized":"2024-04-26T23:48:13.262363+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265616+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:13.265616+0000","last_peered":"2024-04-26T23:48:13.265616+0000","last_clean":"2024-04-26T23:48:13.265616+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:13.265616+0000","last_undegraded":"2024-04-26T23:48:13.265616+0000","last_fullsized":"2024-04-26T23:48:13.265616+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263055+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:13.263055+0000","last_peered":"2024-04-26T23:48:13.263055+0000","last_clean":"2024-04-26T23:48:13.263055+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:13.263055+0000","last_undegraded":"2024-04-26T23:48:13.263055+0000","last_fullsized":"2024-04-26T23:48:13.263055+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.265773+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:13.265773+0000","last_peered":"2024-04-26T23:48:13.265773+0000","last_clean":"2024-04-26T23:48:13.265773+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:13.265773+0000","last_undegraded":"2024-04-26T23:48:13.265773+0000","last_fullsized":"2024-04-26T23:48:13.265773+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465668+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:13.465668+0000","last_peered":"2024-04-26T23:48:13.465668+0000","last_clean":"2024-04-26T23:48:13.465668+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:13.465668+0000","last_undegraded":"2024-04-26T23:48:13.465668+0000","last_fullsized":"2024-04-26T23:48:13.465668+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465471+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:13.465471+0000","last_peered":"2024-04-26T23:48:13.465471+0000","last_clean":"2024-04-26T23:48:13.465471+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:13.465471+0000","last_undegraded":"2024-04-26T23:48:13.465471+0000","last_fullsized":"2024-04-26T23:48:13.465471+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466010+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:13.466010+0000","last_peered":"2024-04-26T23:48:13.466010+0000","last_clean":"2024-04-26T23:48:13.466010+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:13.466010+0000","last_undegraded":"2024-04-26T23:48:13.466010+0000","last_fullsized":"2024-04-26T23:48:13.466010+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263881+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:13.263881+0000","last_peered":"2024-04-26T23:48:13.263881+0000","last_clean":"2024-04-26T23:48:13.263881+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:13.263881+0000","last_undegraded":"2024-04-26T23:48:13.263881+0000","last_fullsized":"2024-04-26T23:48:13.263881+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.262263+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:13.262263+0000","last_peered":"2024-04-26T23:48:13.262263+0000","last_clean":"2024-04-26T23:48:13.262263+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:13.262263+0000","last_undegraded":"2024-04-26T23:48:13.262263+0000","last_fullsized":"2024-04-26T23:48:13.262263+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465110+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:13.465110+0000","last_peered":"2024-04-26T23:48:13.465110+0000","last_clean":"2024-04-26T23:48:13.465110+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:13.465110+0000","last_undegraded":"2024-04-26T23:48:13.465110+0000","last_fullsized":"2024-04-26T23:48:13.465110+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664652+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:06.664652+0000","last_peered":"2024-04-26T23:48:06.664652+0000","last_clean":"2024-04-26T23:48:06.664652+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:06.664652+0000","last_undegraded":"2024-04-26T23:48:06.664652+0000","last_fullsized":"2024-04-26T23:48:06.664652+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":2,"reported_epoch":50,"state":"peering","last_fresh":"2024-04-26T23:48:08.229566+0000","last_change":"2024-04-26T23:48:14.233851+0000","last_active":"2024-04-26T23:48:14.233851+0000","last_peered":"2024-04-26T23:48:08.229566+0000","last_clean":"2024-04-26T23:48:08.229566+0000","last_became_active":"2024-04-26T23:48:05.234135+0000","last_became_peered":"2024-04-26T23:48:05.234135+0000","last_unstale":"2024-04-26T23:48:08.229566+0000","last_undegraded":"2024-04-26T23:48:08.229566+0000","last_fullsized":"2024-04-26T23:48:08.229566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466803+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:13.466803+0000","last_peered":"2024-04-26T23:48:13.466803+0000","last_clean":"2024-04-26T23:48:13.466803+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:13.466803+0000","last_undegraded":"2024-04-26T23:48:13.466803+0000","last_fullsized":"2024-04-26T23:48:13.466803+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.266233+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:13.266233+0000","last_peered":"2024-04-26T23:48:13.266233+0000","last_clean":"2024-04-26T23:48:13.266233+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:13.266233+0000","last_undegraded":"2024-04-26T23:48:13.266233+0000","last_fullsized":"2024-04-26T23:48:13.266233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465822+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:13.465822+0000","last_peered":"2024-04-26T23:48:13.465822+0000","last_clean":"2024-04-26T23:48:13.465822+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:13.465822+0000","last_undegraded":"2024-04-26T23:48:13.465822+0000","last_fullsized":"2024-04-26T23:48:13.465822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665535+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:06.665535+0000","last_peered":"2024-04-26T23:48:06.665535+0000","last_clean":"2024-04-26T23:48:06.665535+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:06.665535+0000","last_undegraded":"2024-04-26T23:48:06.665535+0000","last_fullsized":"2024-04-26T23:48:06.665535+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467308+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:13.467308+0000","last_peered":"2024-04-26T23:48:13.467308+0000","last_clean":"2024-04-26T23:48:13.467308+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:13.467308+0000","last_undegraded":"2024-04-26T23:48:13.467308+0000","last_fullsized":"2024-04-26T23:48:13.467308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467160+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:13.467160+0000","last_peered":"2024-04-26T23:48:13.467160+0000","last_clean":"2024-04-26T23:48:13.467160+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:13.467160+0000","last_undegraded":"2024-04-26T23:48:13.467160+0000","last_fullsized":"2024-04-26T23:48:13.467160+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263889+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:13.263889+0000","last_peered":"2024-04-26T23:48:13.263889+0000","last_clean":"2024-04-26T23:48:13.263889+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:13.263889+0000","last_undegraded":"2024-04-26T23:48:13.263889+0000","last_fullsized":"2024-04-26T23:48:13.263889+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465536+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:13.465536+0000","last_peered":"2024-04-26T23:48:13.465536+0000","last_clean":"2024-04-26T23:48:13.465536+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:13.465536+0000","last_undegraded":"2024-04-26T23:48:13.465536+0000","last_fullsized":"2024-04-26T23:48:13.465536+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.467161+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:13.467161+0000","last_peered":"2024-04-26T23:48:13.467161+0000","last_clean":"2024-04-26T23:48:13.467161+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:13.467161+0000","last_undegraded":"2024-04-26T23:48:13.467161+0000","last_fullsized":"2024-04-26T23:48:13.467161+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.465769+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:13.465769+0000","last_peered":"2024-04-26T23:48:13.465769+0000","last_clean":"2024-04-26T23:48:13.465769+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:13.465769+0000","last_undegraded":"2024-04-26T23:48:13.465769+0000","last_fullsized":"2024-04-26T23:48:13.465769+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261840+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:13.261840+0000","last_peered":"2024-04-26T23:48:13.261840+0000","last_clean":"2024-04-26T23:48:13.261840+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:13.261840+0000","last_undegraded":"2024-04-26T23:48:13.261840+0000","last_fullsized":"2024-04-26T23:48:13.261840+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261873+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:13.261873+0000","last_peered":"2024-04-26T23:48:13.261873+0000","last_clean":"2024-04-26T23:48:13.261873+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:13.261873+0000","last_undegraded":"2024-04-26T23:48:13.261873+0000","last_fullsized":"2024-04-26T23:48:13.261873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.264422+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:13.264422+0000","last_peered":"2024-04-26T23:48:13.264422+0000","last_clean":"2024-04-26T23:48:13.264422+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:13.264422+0000","last_undegraded":"2024-04-26T23:48:13.264422+0000","last_fullsized":"2024-04-26T23:48:13.264422+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.261503+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:13.261503+0000","last_peered":"2024-04-26T23:48:13.261503+0000","last_clean":"2024-04-26T23:48:13.261503+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:13.261503+0000","last_undegraded":"2024-04-26T23:48:13.261503+0000","last_fullsized":"2024-04-26T23:48:13.261503+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.664749+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:06.664749+0000","last_peered":"2024-04-26T23:48:06.664749+0000","last_clean":"2024-04-26T23:48:06.664749+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:06.664749+0000","last_undegraded":"2024-04-26T23:48:06.664749+0000","last_fullsized":"2024-04-26T23:48:06.664749+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-04-26T23:48:06.665417+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:06.665417+0000","last_peered":"2024-04-26T23:48:06.665417+0000","last_clean":"2024-04-26T23:48:06.665417+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:06.665417+0000","last_undegraded":"2024-04-26T23:48:06.665417+0000","last_fullsized":"2024-04-26T23:48:06.665417+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":18,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.263115+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:13.263115+0000","last_peered":"2024-04-26T23:48:13.263115+0000","last_clean":"2024-04-26T23:48:13.263115+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:13.263115+0000","last_undegraded":"2024-04-26T23:48:13.263115+0000","last_fullsized":"2024-04-26T23:48:13.263115+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":219,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-04-26T23:48:13.466845+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:13.466845+0000","last_peered":"2024-04-26T23:48:13.466845+0000","last_clean":"2024-04-26T23:48:13.466845+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:13.466845+0000","last_undegraded":"2024-04-26T23:48:13.466845+0000","last_fullsized":"2024-04-26T23:48:13.466845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":828823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27596,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":589824,"data_stored":239037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509478,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27600,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344240,"statfs":{"total":96636764160,"available":96608501760,"internally_reserved":0,"allocated":593920,"data_stored":239977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":593920,"data_stored":239003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31764,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":598016,"data_stored":239999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":238435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542183,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":822742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:23.079 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:48:23.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff50d200640 1 Processor -- start 2024-04-26T23:48:23.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff50d200640 1 -- start start 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff50d200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff50815c630 0x7ff50815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff50d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 0x7ff5080afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff50d200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50806f6e0 con 0x7ff50815c250 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff50d200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff50815d5b0 con 0x7ff50815c630 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff50d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff5080aefb0 con 0x7ff5080afa90 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff50815c250 0x7ff508073c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35778/0 (socket says 172.21.15.47:35778) 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505e00640 1 -- 172.21.15.47:0/284214639 learned_addr learned my addr 172.21.15.47:0/284214639 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff506800640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 0x7ff5080afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff4fd400640 1 --2- 172.21.15.47:0/284214639 >> v2:172.21.15.203:3300/0 conn(0x7ff50815c630 0x7ff50815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964644649 0 0) 0x7ff50806f6e0 con 0x7ff50815c250 2024-04-26T23:48:23.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4ec003530 con 0x7ff50815c250 2024-04-26T23:48:23.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 703204692 0 0) 0x7ff4ec003530 con 0x7ff50815c250 2024-04-26T23:48:23.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 msgr2=0x7ff5080afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 0x7ff5080afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 >> v2:172.21.15.203:3300/0 conn(0x7ff50815c630 msgr2=0x7ff50815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 --2- 172.21.15.47:0/284214639 >> v2:172.21.15.203:3300/0 conn(0x7ff50815c630 0x7ff50815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.226+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080af290 con 0x7ff50815c250 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7ff4f8001680 con 0x7ff50815c250 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 >> v1:172.21.15.47:6789/0 conn(0x7ff50815c250 legacy=0x7ff508073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec0039c0 0x7ff4ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 0x7ff4ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec004d50 0x7ff4ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff50815d5b0 con 0x7ff4ec0039c0 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5080aefb0 con 0x7ff4ec004d50 2024-04-26T23:48:23.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff4ec00b9d0 con 0x7ff5080afa90 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505e00640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec0039c0 0x7ff4ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff506800640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec004d50 0x7ff4ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff4fd400640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 0x7ff4ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505e00640 1 -- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 msgr2=0x7ff4ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505e00640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5080afa90 0x7ff4ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505e00640 1 -- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec004d50 msgr2=0x7ff4ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505e00640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4ec004d50 0x7ff4ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505e00640 1 -- 172.21.15.47:0/284214639 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec003530 con 0x7ff4ec0039c0 2024-04-26T23:48:23.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.230+0000 7ff505e00640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec0039c0 0x7ff4ec003de0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c210 tx=0x7ff4f801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22747d6711d89b6a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8007d60 con 0x7ff4ec0039c0 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f80a9020 con 0x7ff4ec0039c0 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff505400640 1 -- 172.21.15.47:0/284214639 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80a5b70 con 0x7ff4ec0039c0 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- 172.21.15.47:0/284214639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec0039c0 msgr2=0x7ff4ec003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 --2- 172.21.15.47:0/284214639 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4ec0039c0 0x7ff4ec003de0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800c210 tx=0x7ff4f801cc70 comp rx=0 tx=0).stop 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff506800640 1 -- 172.21.15.47:0/284214639 reap_dead start 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- 172.21.15.47:0/284214639 shutdown_connections 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- 172.21.15.47:0/284214639 >> 172.21.15.47:0/284214639 conn(0x7ff5080d1df0 msgr2=0x7ff5080d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- 172.21.15.47:0/284214639 shutdown_connections 2024-04-26T23:48:23.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- 172.21.15.47:0/284214639 wait complete. 2024-04-26T23:48:23.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 Processor -- start 2024-04-26T23:48:23.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- start start 2024-04-26T23:48:23.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5081f5410 0x7ff5081f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5080b5a90 0x7ff50815d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff50815dc70 0x7ff508145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff50806f410 con 0x7ff50815dc70 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff50806f290 con 0x7ff5080b5a90 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff50d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff5080b06b0 con 0x7ff5081f5410 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff506800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff50815dc70 0x7ff508145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff506800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff50815dc70 0x7ff508145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38740/0 (socket says 172.21.15.47:38740) 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff506800640 1 -- 172.21.15.47:0/2257587000 learned_addr learned my addr 172.21.15.47:0/2257587000 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff505e00640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5081f5410 0x7ff5081f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.234+0000 7ff4fd400640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5080b5a90 0x7ff50815d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff506800640 1 -- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5081f5410 msgr2=0x7ff5081f8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff506800640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5081f5410 0x7ff5081f8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff506800640 1 -- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5080b5a90 msgr2=0x7ff50815d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff506800640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5080b5a90 0x7ff50815d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff506800640 1 -- 172.21.15.47:0/2257587000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080b6310 con 0x7ff50815dc70 2024-04-26T23:48:23.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff506800640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff50815dc70 0x7ff508145500 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff50806e620 tx=0x7ff50000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:23.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff4fea00640 1 -- 172.21.15.47:0/2257587000 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50000fd10 con 0x7ff50815dc70 2024-04-26T23:48:23.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff4fea00640 1 -- 172.21.15.47:0/2257587000 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50001d070 con 0x7ff50815dc70 2024-04-26T23:48:23.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5080b65f0 con 0x7ff50815dc70 2024-04-26T23:48:23.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff4fea00640 1 -- 172.21.15.47:0/2257587000 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500015670 con 0x7ff50815dc70 2024-04-26T23:48:23.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5081f57f0 con 0x7ff50815dc70 2024-04-26T23:48:23.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff508069700 con 0x7ff50815dc70 2024-04-26T23:48:23.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff4fea00640 1 -- 172.21.15.47:0/2257587000 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff500015810 con 0x7ff50815dc70 2024-04-26T23:48:23.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff4fea00640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068620 0x7ff4e406aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.238+0000 7ff4fea00640 1 -- 172.21.15.47:0/2257587000 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7ff500087760 con 0x7ff50815dc70 2024-04-26T23:48:23.246 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.242+0000 7ff505e00640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068620 0x7ff4e406aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.242+0000 7ff505e00640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068620 0x7ff4e406aae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80aa000 tx=0x7ff4f8000ff0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:23.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.246+0000 7ff4fea00640 1 -- 172.21.15.47:0/2257587000 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff500010040 con 0x7ff50815dc70 2024-04-26T23:48:23.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.406+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5080b6b10 con 0x7ff4e4068620 2024-04-26T23:48:23.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.414+0000 7ff4fea00640 1 -- 172.21.15.47:0/2257587000 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251887 (secure 0 0 0) 0x7ff5080b6b10 con 0x7ff4e4068620 2024-04-26T23:48:23.422 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:23.423 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:48:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.414+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068620 msgr2=0x7ff4e406aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068620 0x7ff4e406aae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80aa000 tx=0x7ff4f8000ff0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff50815dc70 msgr2=0x7ff508145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff50815dc70 0x7ff508145500 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff50806e620 tx=0x7ff50000f1b0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 shutdown_connections 2024-04-26T23:48:23.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff4e4068620 0x7ff4e406aae0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff50815dc70 0x7ff508145500 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff5080b5a90 0x7ff50815d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 --2- 172.21.15.47:0/2257587000 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff5081f5410 0x7ff5081f8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 >> 172.21.15.47:0/2257587000 conn(0x7ff5080d1df0 msgr2=0x7ff5081568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:23.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 shutdown_connections 2024-04-26T23:48:23.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.418+0000 7ff50d200640 1 -- 172.21.15.47:0/2257587000 wait complete. 2024-04-26T23:48:23.442 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-04-26T23:48:22.194255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238696,"kb_used_data":5864,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736024,"statfs":{"total":773094113280,"available":772849688576,"internally_reserved":0,"allocated":6004736,"data_stored":3140340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.934431"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382638+0000","last_change":"2024-04-26T23:48:05.227481+0000","last_active":"2024-04-26T23:48:14.382638+0000","last_peered":"2024-04-26T23:48:14.382638+0000","last_clean":"2024-04-26T23:48:14.382638+0000","last_became_active":"2024-04-26T23:48:05.227202+0000","last_became_peered":"2024-04-26T23:48:05.227202+0000","last_unstale":"2024-04-26T23:48:14.382638+0000","last_undegraded":"2024-04-26T23:48:14.382638+0000","last_fullsized":"2024-04-26T23:48:14.382638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:03:55.276196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273289+0000","last_change":"2024-04-26T23:48:05.238531+0000","last_active":"2024-04-26T23:48:14.273289+0000","last_peered":"2024-04-26T23:48:14.273289+0000","last_clean":"2024-04-26T23:48:14.273289+0000","last_became_active":"2024-04-26T23:48:05.237818+0000","last_became_peered":"2024-04-26T23:48:05.237818+0000","last_unstale":"2024-04-26T23:48:14.273289+0000","last_undegraded":"2024-04-26T23:48:14.273289+0000","last_fullsized":"2024-04-26T23:48:14.273289+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274325+0000","last_change":"2024-04-26T23:48:05.228146+0000","last_active":"2024-04-26T23:48:14.274325+0000","last_peered":"2024-04-26T23:48:14.274325+0000","last_clean":"2024-04-26T23:48:14.274325+0000","last_became_active":"2024-04-26T23:48:05.227863+0000","last_became_peered":"2024-04-26T23:48:05.227863+0000","last_unstale":"2024-04-26T23:48:14.274325+0000","last_undegraded":"2024-04-26T23:48:14.274325+0000","last_fullsized":"2024-04-26T23:48:14.274325+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:27.698873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381874+0000","last_change":"2024-04-26T23:48:05.238478+0000","last_active":"2024-04-26T23:48:14.381874+0000","last_peered":"2024-04-26T23:48:14.381874+0000","last_clean":"2024-04-26T23:48:14.381874+0000","last_became_active":"2024-04-26T23:48:05.238157+0000","last_became_peered":"2024-04-26T23:48:05.238157+0000","last_unstale":"2024-04-26T23:48:14.381874+0000","last_undegraded":"2024-04-26T23:48:14.381874+0000","last_fullsized":"2024-04-26T23:48:14.381874+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:18:21.105523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273770+0000","last_change":"2024-04-26T23:48:05.243782+0000","last_active":"2024-04-26T23:48:14.273770+0000","last_peered":"2024-04-26T23:48:14.273770+0000","last_clean":"2024-04-26T23:48:14.273770+0000","last_became_active":"2024-04-26T23:48:05.243306+0000","last_became_peered":"2024-04-26T23:48:05.243306+0000","last_unstale":"2024-04-26T23:48:14.273770+0000","last_undegraded":"2024-04-26T23:48:14.273770+0000","last_fullsized":"2024-04-26T23:48:14.273770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:53.992275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270236+0000","last_change":"2024-04-26T23:48:05.219763+0000","last_active":"2024-04-26T23:48:14.270236+0000","last_peered":"2024-04-26T23:48:14.270236+0000","last_clean":"2024-04-26T23:48:14.270236+0000","last_became_active":"2024-04-26T23:48:05.219094+0000","last_became_peered":"2024-04-26T23:48:05.219094+0000","last_unstale":"2024-04-26T23:48:14.270236+0000","last_undegraded":"2024-04-26T23:48:14.270236+0000","last_fullsized":"2024-04-26T23:48:14.270236+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:39:47.381796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382317+0000","last_change":"2024-04-26T23:48:05.218190+0000","last_active":"2024-04-26T23:48:14.382317+0000","last_peered":"2024-04-26T23:48:14.382317+0000","last_clean":"2024-04-26T23:48:14.382317+0000","last_became_active":"2024-04-26T23:48:05.217081+0000","last_became_peered":"2024-04-26T23:48:05.217081+0000","last_unstale":"2024-04-26T23:48:14.382317+0000","last_undegraded":"2024-04-26T23:48:14.382317+0000","last_fullsized":"2024-04-26T23:48:14.382317+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:44.593568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380726+0000","last_change":"2024-04-26T23:48:05.237809+0000","last_active":"2024-04-26T23:48:14.380726+0000","last_peered":"2024-04-26T23:48:14.380726+0000","last_clean":"2024-04-26T23:48:14.380726+0000","last_became_active":"2024-04-26T23:48:05.235824+0000","last_became_peered":"2024-04-26T23:48:05.235824+0000","last_unstale":"2024-04-26T23:48:14.380726+0000","last_undegraded":"2024-04-26T23:48:14.380726+0000","last_fullsized":"2024-04-26T23:48:14.380726+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:44.482951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382118+0000","last_change":"2024-04-26T23:48:05.236600+0000","last_active":"2024-04-26T23:48:14.382118+0000","last_peered":"2024-04-26T23:48:14.382118+0000","last_clean":"2024-04-26T23:48:14.382118+0000","last_became_active":"2024-04-26T23:48:05.234602+0000","last_became_peered":"2024-04-26T23:48:05.234602+0000","last_unstale":"2024-04-26T23:48:14.382118+0000","last_undegraded":"2024-04-26T23:48:14.382118+0000","last_fullsized":"2024-04-26T23:48:14.382118+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:17.602244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382098+0000","last_change":"2024-04-26T23:48:05.237260+0000","last_active":"2024-04-26T23:48:14.382098+0000","last_peered":"2024-04-26T23:48:14.382098+0000","last_clean":"2024-04-26T23:48:14.382098+0000","last_became_active":"2024-04-26T23:48:05.236817+0000","last_became_peered":"2024-04-26T23:48:05.236817+0000","last_unstale":"2024-04-26T23:48:14.382098+0000","last_undegraded":"2024-04-26T23:48:14.382098+0000","last_fullsized":"2024-04-26T23:48:14.382098+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:31:03.229115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381934+0000","last_change":"2024-04-26T23:48:05.239775+0000","last_active":"2024-04-26T23:48:14.381934+0000","last_peered":"2024-04-26T23:48:14.381934+0000","last_clean":"2024-04-26T23:48:14.381934+0000","last_became_active":"2024-04-26T23:48:05.238800+0000","last_became_peered":"2024-04-26T23:48:05.238800+0000","last_unstale":"2024-04-26T23:48:14.381934+0000","last_undegraded":"2024-04-26T23:48:14.381934+0000","last_fullsized":"2024-04-26T23:48:14.381934+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:39:35.023483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273498+0000","last_change":"2024-04-26T23:48:05.232808+0000","last_active":"2024-04-26T23:48:14.273498+0000","last_peered":"2024-04-26T23:48:14.273498+0000","last_clean":"2024-04-26T23:48:14.273498+0000","last_became_active":"2024-04-26T23:48:05.232345+0000","last_became_peered":"2024-04-26T23:48:05.232345+0000","last_unstale":"2024-04-26T23:48:14.273498+0000","last_undegraded":"2024-04-26T23:48:14.273498+0000","last_fullsized":"2024-04-26T23:48:14.273498+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380617+0000","last_change":"2024-04-26T23:48:05.235016+0000","last_active":"2024-04-26T23:48:14.380617+0000","last_peered":"2024-04-26T23:48:14.380617+0000","last_clean":"2024-04-26T23:48:14.380617+0000","last_became_active":"2024-04-26T23:48:05.234745+0000","last_became_peered":"2024-04-26T23:48:05.234745+0000","last_unstale":"2024-04-26T23:48:14.380617+0000","last_undegraded":"2024-04-26T23:48:14.380617+0000","last_fullsized":"2024-04-26T23:48:14.380617+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381716+0000","last_change":"2024-04-26T23:48:05.240015+0000","last_active":"2024-04-26T23:48:14.381716+0000","last_peered":"2024-04-26T23:48:14.381716+0000","last_clean":"2024-04-26T23:48:14.381716+0000","last_became_active":"2024-04-26T23:48:05.238785+0000","last_became_peered":"2024-04-26T23:48:05.238785+0000","last_unstale":"2024-04-26T23:48:14.381716+0000","last_undegraded":"2024-04-26T23:48:14.381716+0000","last_fullsized":"2024-04-26T23:48:14.381716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:50:20.116958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270224+0000","last_change":"2024-04-26T23:48:05.234990+0000","last_active":"2024-04-26T23:48:14.270224+0000","last_peered":"2024-04-26T23:48:14.270224+0000","last_clean":"2024-04-26T23:48:14.270224+0000","last_became_active":"2024-04-26T23:48:05.234708+0000","last_became_peered":"2024-04-26T23:48:05.234708+0000","last_unstale":"2024-04-26T23:48:14.270224+0000","last_undegraded":"2024-04-26T23:48:14.270224+0000","last_fullsized":"2024-04-26T23:48:14.270224+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:01:47.496282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275062+0000","last_change":"2024-04-26T23:48:05.241679+0000","last_active":"2024-04-26T23:48:14.275062+0000","last_peered":"2024-04-26T23:48:14.275062+0000","last_clean":"2024-04-26T23:48:14.275062+0000","last_became_active":"2024-04-26T23:48:05.241280+0000","last_became_peered":"2024-04-26T23:48:05.241280+0000","last_unstale":"2024-04-26T23:48:14.275062+0000","last_undegraded":"2024-04-26T23:48:14.275062+0000","last_fullsized":"2024-04-26T23:48:14.275062+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:52.306310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274211+0000","last_change":"2024-04-26T23:48:05.232615+0000","last_active":"2024-04-26T23:48:14.274211+0000","last_peered":"2024-04-26T23:48:14.274211+0000","last_clean":"2024-04-26T23:48:14.274211+0000","last_became_active":"2024-04-26T23:48:05.232348+0000","last_became_peered":"2024-04-26T23:48:05.232348+0000","last_unstale":"2024-04-26T23:48:14.274211+0000","last_undegraded":"2024-04-26T23:48:14.274211+0000","last_fullsized":"2024-04-26T23:48:14.274211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:38.730066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274530+0000","last_change":"2024-04-26T23:48:05.241862+0000","last_active":"2024-04-26T23:48:14.274530+0000","last_peered":"2024-04-26T23:48:14.274530+0000","last_clean":"2024-04-26T23:48:14.274530+0000","last_became_active":"2024-04-26T23:48:05.241560+0000","last_became_peered":"2024-04-26T23:48:05.241560+0000","last_unstale":"2024-04-26T23:48:14.274530+0000","last_undegraded":"2024-04-26T23:48:14.274530+0000","last_fullsized":"2024-04-26T23:48:14.274530+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:07.462560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275588+0000","last_change":"2024-04-26T23:48:05.241763+0000","last_active":"2024-04-26T23:48:14.275588+0000","last_peered":"2024-04-26T23:48:14.275588+0000","last_clean":"2024-04-26T23:48:14.275588+0000","last_became_active":"2024-04-26T23:48:05.241392+0000","last_became_peered":"2024-04-26T23:48:05.241392+0000","last_unstale":"2024-04-26T23:48:14.275588+0000","last_undegraded":"2024-04-26T23:48:14.275588+0000","last_fullsized":"2024-04-26T23:48:14.275588+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:14.876447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380924+0000","last_change":"2024-04-26T23:48:05.246999+0000","last_active":"2024-04-26T23:48:14.380924+0000","last_peered":"2024-04-26T23:48:14.380924+0000","last_clean":"2024-04-26T23:48:14.380924+0000","last_became_active":"2024-04-26T23:48:05.246687+0000","last_became_peered":"2024-04-26T23:48:05.246687+0000","last_unstale":"2024-04-26T23:48:14.380924+0000","last_undegraded":"2024-04-26T23:48:14.380924+0000","last_fullsized":"2024-04-26T23:48:14.380924+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270435+0000","last_change":"2024-04-26T23:48:05.223952+0000","last_active":"2024-04-26T23:48:14.270435+0000","last_peered":"2024-04-26T23:48:14.270435+0000","last_clean":"2024-04-26T23:48:14.270435+0000","last_became_active":"2024-04-26T23:48:05.223664+0000","last_became_peered":"2024-04-26T23:48:05.223664+0000","last_unstale":"2024-04-26T23:48:14.270435+0000","last_undegraded":"2024-04-26T23:48:14.270435+0000","last_fullsized":"2024-04-26T23:48:14.270435+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:31:37.136763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381720+0000","last_change":"2024-04-26T23:48:05.231593+0000","last_active":"2024-04-26T23:48:14.381720+0000","last_peered":"2024-04-26T23:48:14.381720+0000","last_clean":"2024-04-26T23:48:14.381720+0000","last_became_active":"2024-04-26T23:48:05.231325+0000","last_became_peered":"2024-04-26T23:48:05.231325+0000","last_unstale":"2024-04-26T23:48:14.381720+0000","last_undegraded":"2024-04-26T23:48:14.381720+0000","last_fullsized":"2024-04-26T23:48:14.381720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:40:51.248058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275083+0000","last_change":"2024-04-26T23:48:05.219380+0000","last_active":"2024-04-26T23:48:14.275083+0000","last_peered":"2024-04-26T23:48:14.275083+0000","last_clean":"2024-04-26T23:48:14.275083+0000","last_became_active":"2024-04-26T23:48:05.219063+0000","last_became_peered":"2024-04-26T23:48:05.219063+0000","last_unstale":"2024-04-26T23:48:14.275083+0000","last_undegraded":"2024-04-26T23:48:14.275083+0000","last_fullsized":"2024-04-26T23:48:14.275083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:26:01.816256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275072+0000","last_change":"2024-04-26T23:48:05.220307+0000","last_active":"2024-04-26T23:48:14.275072+0000","last_peered":"2024-04-26T23:48:14.275072+0000","last_clean":"2024-04-26T23:48:14.275072+0000","last_became_active":"2024-04-26T23:48:05.220009+0000","last_became_peered":"2024-04-26T23:48:05.220009+0000","last_unstale":"2024-04-26T23:48:14.275072+0000","last_undegraded":"2024-04-26T23:48:14.275072+0000","last_fullsized":"2024-04-26T23:48:14.275072+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:55.981690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275449+0000","last_change":"2024-04-26T23:48:05.221404+0000","last_active":"2024-04-26T23:48:14.275449+0000","last_peered":"2024-04-26T23:48:14.275449+0000","last_clean":"2024-04-26T23:48:14.275449+0000","last_became_active":"2024-04-26T23:48:05.220745+0000","last_became_peered":"2024-04-26T23:48:05.220745+0000","last_unstale":"2024-04-26T23:48:14.275449+0000","last_undegraded":"2024-04-26T23:48:14.275449+0000","last_fullsized":"2024-04-26T23:48:14.275449+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:09.874138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380972+0000","last_change":"2024-04-26T23:48:05.234294+0000","last_active":"2024-04-26T23:48:14.380972+0000","last_peered":"2024-04-26T23:48:14.380972+0000","last_clean":"2024-04-26T23:48:14.380972+0000","last_became_active":"2024-04-26T23:48:05.233993+0000","last_became_peered":"2024-04-26T23:48:05.233993+0000","last_unstale":"2024-04-26T23:48:14.380972+0000","last_undegraded":"2024-04-26T23:48:14.380972+0000","last_fullsized":"2024-04-26T23:48:14.380972+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:57:13.076859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274429+0000","last_change":"2024-04-26T23:48:05.234315+0000","last_active":"2024-04-26T23:48:14.274429+0000","last_peered":"2024-04-26T23:48:14.274429+0000","last_clean":"2024-04-26T23:48:14.274429+0000","last_became_active":"2024-04-26T23:48:05.234002+0000","last_became_peered":"2024-04-26T23:48:05.234002+0000","last_unstale":"2024-04-26T23:48:14.274429+0000","last_undegraded":"2024-04-26T23:48:14.274429+0000","last_fullsized":"2024-04-26T23:48:14.274429+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:31.456528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273591+0000","last_change":"2024-04-26T23:48:05.232589+0000","last_active":"2024-04-26T23:48:14.273591+0000","last_peered":"2024-04-26T23:48:14.273591+0000","last_clean":"2024-04-26T23:48:14.273591+0000","last_became_active":"2024-04-26T23:48:05.232029+0000","last_became_peered":"2024-04-26T23:48:05.232029+0000","last_unstale":"2024-04-26T23:48:14.273591+0000","last_undegraded":"2024-04-26T23:48:14.273591+0000","last_fullsized":"2024-04-26T23:48:14.273591+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:56.481077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275269+0000","last_change":"2024-04-26T23:48:05.220072+0000","last_active":"2024-04-26T23:48:14.275269+0000","last_peered":"2024-04-26T23:48:14.275269+0000","last_clean":"2024-04-26T23:48:14.275269+0000","last_became_active":"2024-04-26T23:48:05.219802+0000","last_became_peered":"2024-04-26T23:48:05.219802+0000","last_unstale":"2024-04-26T23:48:14.275269+0000","last_undegraded":"2024-04-26T23:48:14.275269+0000","last_fullsized":"2024-04-26T23:48:14.275269+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273961+0000","last_change":"2024-04-26T23:48:05.235322+0000","last_active":"2024-04-26T23:48:14.273961+0000","last_peered":"2024-04-26T23:48:14.273961+0000","last_clean":"2024-04-26T23:48:14.273961+0000","last_became_active":"2024-04-26T23:48:05.235054+0000","last_became_peered":"2024-04-26T23:48:05.235054+0000","last_unstale":"2024-04-26T23:48:14.273961+0000","last_undegraded":"2024-04-26T23:48:14.273961+0000","last_fullsized":"2024-04-26T23:48:14.273961+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:00:54.062730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270278+0000","last_change":"2024-04-26T23:48:05.224087+0000","last_active":"2024-04-26T23:48:14.270278+0000","last_peered":"2024-04-26T23:48:14.270278+0000","last_clean":"2024-04-26T23:48:14.270278+0000","last_became_active":"2024-04-26T23:48:05.223829+0000","last_became_peered":"2024-04-26T23:48:05.223829+0000","last_unstale":"2024-04-26T23:48:14.270278+0000","last_undegraded":"2024-04-26T23:48:14.270278+0000","last_fullsized":"2024-04-26T23:48:14.270278+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:52:20.678835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380562+0000","last_change":"2024-04-26T23:48:05.226818+0000","last_active":"2024-04-26T23:48:14.380562+0000","last_peered":"2024-04-26T23:48:14.380562+0000","last_clean":"2024-04-26T23:48:14.380562+0000","last_became_active":"2024-04-26T23:48:05.226390+0000","last_became_peered":"2024-04-26T23:48:05.226390+0000","last_unstale":"2024-04-26T23:48:14.380562+0000","last_undegraded":"2024-04-26T23:48:14.380562+0000","last_fullsized":"2024-04-26T23:48:14.380562+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:28:07.486732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380251+0000","last_change":"2024-04-26T23:48:05.229731+0000","last_active":"2024-04-26T23:48:14.380251+0000","last_peered":"2024-04-26T23:48:14.380251+0000","last_clean":"2024-04-26T23:48:14.380251+0000","last_became_active":"2024-04-26T23:48:05.229478+0000","last_became_peered":"2024-04-26T23:48:05.229478+0000","last_unstale":"2024-04-26T23:48:14.380251+0000","last_undegraded":"2024-04-26T23:48:14.380251+0000","last_fullsized":"2024-04-26T23:48:14.380251+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270756+0000","last_change":"2024-04-26T23:48:04.230923+0000","last_active":"2024-04-26T23:48:14.270756+0000","last_peered":"2024-04-26T23:48:14.270756+0000","last_clean":"2024-04-26T23:48:14.270756+0000","last_became_active":"2024-04-26T23:48:04.230483+0000","last_became_peered":"2024-04-26T23:48:04.230483+0000","last_unstale":"2024-04-26T23:48:14.270756+0000","last_undegraded":"2024-04-26T23:48:14.270756+0000","last_fullsized":"2024-04-26T23:48:14.270756+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:55.363522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275518+0000","last_change":"2024-04-26T23:48:05.226491+0000","last_active":"2024-04-26T23:48:14.275518+0000","last_peered":"2024-04-26T23:48:14.275518+0000","last_clean":"2024-04-26T23:48:14.275518+0000","last_became_active":"2024-04-26T23:48:05.226261+0000","last_became_peered":"2024-04-26T23:48:05.226261+0000","last_unstale":"2024-04-26T23:48:14.275518+0000","last_undegraded":"2024-04-26T23:48:14.275518+0000","last_fullsized":"2024-04-26T23:48:14.275518+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:01:32.392015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274607+0000","last_change":"2024-04-26T23:48:04.222435+0000","last_active":"2024-04-26T23:48:14.274607+0000","last_peered":"2024-04-26T23:48:14.274607+0000","last_clean":"2024-04-26T23:48:14.274607+0000","last_became_active":"2024-04-26T23:48:04.222148+0000","last_became_peered":"2024-04-26T23:48:04.222148+0000","last_unstale":"2024-04-26T23:48:14.274607+0000","last_undegraded":"2024-04-26T23:48:14.274607+0000","last_fullsized":"2024-04-26T23:48:14.274607+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:29.004599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273677+0000","last_change":"2024-04-26T23:48:05.235544+0000","last_active":"2024-04-26T23:48:14.273677+0000","last_peered":"2024-04-26T23:48:14.273677+0000","last_clean":"2024-04-26T23:48:14.273677+0000","last_became_active":"2024-04-26T23:48:05.235286+0000","last_became_peered":"2024-04-26T23:48:05.235286+0000","last_unstale":"2024-04-26T23:48:14.273677+0000","last_undegraded":"2024-04-26T23:48:14.273677+0000","last_fullsized":"2024-04-26T23:48:14.273677+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:43:32.583078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380806+0000","last_change":"2024-04-26T23:48:04.215883+0000","last_active":"2024-04-26T23:48:14.380806+0000","last_peered":"2024-04-26T23:48:14.380806+0000","last_clean":"2024-04-26T23:48:14.380806+0000","last_became_active":"2024-04-26T23:48:04.215231+0000","last_became_peered":"2024-04-26T23:48:04.215231+0000","last_unstale":"2024-04-26T23:48:14.380806+0000","last_undegraded":"2024-04-26T23:48:14.380806+0000","last_fullsized":"2024-04-26T23:48:14.380806+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380717+0000","last_change":"2024-04-26T23:48:05.217751+0000","last_active":"2024-04-26T23:48:14.380717+0000","last_peered":"2024-04-26T23:48:14.380717+0000","last_clean":"2024-04-26T23:48:14.380717+0000","last_became_active":"2024-04-26T23:48:05.217502+0000","last_became_peered":"2024-04-26T23:48:05.217502+0000","last_unstale":"2024-04-26T23:48:14.380717+0000","last_undegraded":"2024-04-26T23:48:14.380717+0000","last_fullsized":"2024-04-26T23:48:14.380717+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382381+0000","last_change":"2024-04-26T23:48:04.223044+0000","last_active":"2024-04-26T23:48:14.382381+0000","last_peered":"2024-04-26T23:48:14.382381+0000","last_clean":"2024-04-26T23:48:14.382381+0000","last_became_active":"2024-04-26T23:48:04.222718+0000","last_became_peered":"2024-04-26T23:48:04.222718+0000","last_unstale":"2024-04-26T23:48:14.382381+0000","last_undegraded":"2024-04-26T23:48:14.382381+0000","last_fullsized":"2024-04-26T23:48:14.382381+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:25:46.371586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274083+0000","last_change":"2024-04-26T23:48:05.235131+0000","last_active":"2024-04-26T23:48:14.274083+0000","last_peered":"2024-04-26T23:48:14.274083+0000","last_clean":"2024-04-26T23:48:14.274083+0000","last_became_active":"2024-04-26T23:48:05.234821+0000","last_became_peered":"2024-04-26T23:48:05.234821+0000","last_unstale":"2024-04-26T23:48:14.274083+0000","last_undegraded":"2024-04-26T23:48:14.274083+0000","last_fullsized":"2024-04-26T23:48:14.274083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:39.648425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270510+0000","last_change":"2024-04-26T23:48:04.230304+0000","last_active":"2024-04-26T23:48:14.270510+0000","last_peered":"2024-04-26T23:48:14.270510+0000","last_clean":"2024-04-26T23:48:14.270510+0000","last_became_active":"2024-04-26T23:48:04.230000+0000","last_became_peered":"2024-04-26T23:48:04.230000+0000","last_unstale":"2024-04-26T23:48:14.270510+0000","last_undegraded":"2024-04-26T23:48:14.270510+0000","last_fullsized":"2024-04-26T23:48:14.270510+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:03.686890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381850+0000","last_change":"2024-04-26T23:48:05.237813+0000","last_active":"2024-04-26T23:48:14.381850+0000","last_peered":"2024-04-26T23:48:14.381850+0000","last_clean":"2024-04-26T23:48:14.381850+0000","last_became_active":"2024-04-26T23:48:05.237510+0000","last_became_peered":"2024-04-26T23:48:05.237510+0000","last_unstale":"2024-04-26T23:48:14.381850+0000","last_undegraded":"2024-04-26T23:48:14.381850+0000","last_fullsized":"2024-04-26T23:48:14.381850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:01:13.966404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274139+0000","last_change":"2024-04-26T23:48:04.225467+0000","last_active":"2024-04-26T23:48:14.274139+0000","last_peered":"2024-04-26T23:48:14.274139+0000","last_clean":"2024-04-26T23:48:14.274139+0000","last_became_active":"2024-04-26T23:48:04.225204+0000","last_became_peered":"2024-04-26T23:48:04.225204+0000","last_unstale":"2024-04-26T23:48:14.274139+0000","last_undegraded":"2024-04-26T23:48:14.274139+0000","last_fullsized":"2024-04-26T23:48:14.274139+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381232+0000","last_change":"2024-04-26T23:48:05.232449+0000","last_active":"2024-04-26T23:48:14.381232+0000","last_peered":"2024-04-26T23:48:14.381232+0000","last_clean":"2024-04-26T23:48:14.381232+0000","last_became_active":"2024-04-26T23:48:05.231933+0000","last_became_peered":"2024-04-26T23:48:05.231933+0000","last_unstale":"2024-04-26T23:48:14.381232+0000","last_undegraded":"2024-04-26T23:48:14.381232+0000","last_fullsized":"2024-04-26T23:48:14.381232+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:15:58.108553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273539+0000","last_change":"2024-04-26T23:48:04.218059+0000","last_active":"2024-04-26T23:48:14.273539+0000","last_peered":"2024-04-26T23:48:14.273539+0000","last_clean":"2024-04-26T23:48:14.273539+0000","last_became_active":"2024-04-26T23:48:04.217787+0000","last_became_peered":"2024-04-26T23:48:04.217787+0000","last_unstale":"2024-04-26T23:48:14.273539+0000","last_undegraded":"2024-04-26T23:48:14.273539+0000","last_fullsized":"2024-04-26T23:48:14.273539+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:37.238209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275018+0000","last_change":"2024-04-26T23:48:05.219794+0000","last_active":"2024-04-26T23:48:14.275018+0000","last_peered":"2024-04-26T23:48:14.275018+0000","last_clean":"2024-04-26T23:48:14.275018+0000","last_became_active":"2024-04-26T23:48:05.219536+0000","last_became_peered":"2024-04-26T23:48:05.219536+0000","last_unstale":"2024-04-26T23:48:14.275018+0000","last_undegraded":"2024-04-26T23:48:14.275018+0000","last_fullsized":"2024-04-26T23:48:14.275018+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381228+0000","last_change":"2024-04-26T23:48:04.214739+0000","last_active":"2024-04-26T23:48:14.381228+0000","last_peered":"2024-04-26T23:48:14.381228+0000","last_clean":"2024-04-26T23:48:14.381228+0000","last_became_active":"2024-04-26T23:48:04.213157+0000","last_became_peered":"2024-04-26T23:48:04.213157+0000","last_unstale":"2024-04-26T23:48:14.381228+0000","last_undegraded":"2024-04-26T23:48:14.381228+0000","last_fullsized":"2024-04-26T23:48:14.381228+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:40.047992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274577+0000","last_change":"2024-04-26T23:48:05.238350+0000","last_active":"2024-04-26T23:48:14.274577+0000","last_peered":"2024-04-26T23:48:14.274577+0000","last_clean":"2024-04-26T23:48:14.274577+0000","last_became_active":"2024-04-26T23:48:05.238044+0000","last_became_peered":"2024-04-26T23:48:05.238044+0000","last_unstale":"2024-04-26T23:48:14.274577+0000","last_undegraded":"2024-04-26T23:48:14.274577+0000","last_fullsized":"2024-04-26T23:48:14.274577+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:55.956070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274407+0000","last_change":"2024-04-26T23:48:04.224878+0000","last_active":"2024-04-26T23:48:14.274407+0000","last_peered":"2024-04-26T23:48:14.274407+0000","last_clean":"2024-04-26T23:48:14.274407+0000","last_became_active":"2024-04-26T23:48:04.224580+0000","last_became_peered":"2024-04-26T23:48:04.224580+0000","last_unstale":"2024-04-26T23:48:14.274407+0000","last_undegraded":"2024-04-26T23:48:14.274407+0000","last_fullsized":"2024-04-26T23:48:14.274407+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:37:13.870132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382694+0000","last_change":"2024-04-26T23:48:05.227435+0000","last_active":"2024-04-26T23:48:14.382694+0000","last_peered":"2024-04-26T23:48:14.382694+0000","last_clean":"2024-04-26T23:48:14.382694+0000","last_became_active":"2024-04-26T23:48:05.227098+0000","last_became_peered":"2024-04-26T23:48:05.227098+0000","last_unstale":"2024-04-26T23:48:14.382694+0000","last_undegraded":"2024-04-26T23:48:14.382694+0000","last_fullsized":"2024-04-26T23:48:14.382694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:04.586327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382189+0000","last_change":"2024-04-26T23:48:04.223402+0000","last_active":"2024-04-26T23:48:14.382189+0000","last_peered":"2024-04-26T23:48:14.382189+0000","last_clean":"2024-04-26T23:48:14.382189+0000","last_became_active":"2024-04-26T23:48:04.223127+0000","last_became_peered":"2024-04-26T23:48:04.223127+0000","last_unstale":"2024-04-26T23:48:14.382189+0000","last_undegraded":"2024-04-26T23:48:14.382189+0000","last_fullsized":"2024-04-26T23:48:14.382189+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:20:26.296248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270657+0000","last_change":"2024-04-26T23:48:05.232454+0000","last_active":"2024-04-26T23:48:14.270657+0000","last_peered":"2024-04-26T23:48:14.270657+0000","last_clean":"2024-04-26T23:48:14.270657+0000","last_became_active":"2024-04-26T23:48:05.231204+0000","last_became_peered":"2024-04-26T23:48:05.231204+0000","last_unstale":"2024-04-26T23:48:14.270657+0000","last_undegraded":"2024-04-26T23:48:14.270657+0000","last_fullsized":"2024-04-26T23:48:14.270657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:07:16.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382560+0000","last_change":"2024-04-26T23:48:04.226164+0000","last_active":"2024-04-26T23:48:14.382560+0000","last_peered":"2024-04-26T23:48:14.382560+0000","last_clean":"2024-04-26T23:48:14.382560+0000","last_became_active":"2024-04-26T23:48:04.224572+0000","last_became_peered":"2024-04-26T23:48:04.224572+0000","last_unstale":"2024-04-26T23:48:14.382560+0000","last_undegraded":"2024-04-26T23:48:14.382560+0000","last_fullsized":"2024-04-26T23:48:14.382560+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:49:37.723751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382413+0000","last_change":"2024-04-26T23:48:05.224135+0000","last_active":"2024-04-26T23:48:14.382413+0000","last_peered":"2024-04-26T23:48:14.382413+0000","last_clean":"2024-04-26T23:48:14.382413+0000","last_became_active":"2024-04-26T23:48:05.223863+0000","last_became_peered":"2024-04-26T23:48:05.223863+0000","last_unstale":"2024-04-26T23:48:14.382413+0000","last_undegraded":"2024-04-26T23:48:14.382413+0000","last_fullsized":"2024-04-26T23:48:14.382413+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:19.837926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":24,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380979+0000","last_change":"2024-04-26T23:48:04.222988+0000","last_active":"2024-04-26T23:48:14.380979+0000","last_peered":"2024-04-26T23:48:14.380979+0000","last_clean":"2024-04-26T23:48:14.380979+0000","last_became_active":"2024-04-26T23:48:04.222664+0000","last_became_peered":"2024-04-26T23:48:04.222664+0000","last_unstale":"2024-04-26T23:48:14.380979+0000","last_undegraded":"2024-04-26T23:48:14.380979+0000","last_fullsized":"2024-04-26T23:48:14.380979+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:52:03.941150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.278057+0000","last_change":"2024-04-26T23:48:14.278057+0000","last_active":"2024-04-26T23:48:14.278057+0000","last_peered":"2024-04-26T23:48:14.278057+0000","last_clean":"2024-04-26T23:48:14.278057+0000","last_became_active":"2024-04-26T23:48:14.277637+0000","last_became_peered":"2024-04-26T23:48:14.277637+0000","last_unstale":"2024-04-26T23:48:14.278057+0000","last_undegraded":"2024-04-26T23:48:14.278057+0000","last_fullsized":"2024-04-26T23:48:14.278057+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:27:43.591188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270555+0000","last_change":"2024-04-26T23:48:04.225313+0000","last_active":"2024-04-26T23:48:14.270555+0000","last_peered":"2024-04-26T23:48:14.270555+0000","last_clean":"2024-04-26T23:48:14.270555+0000","last_became_active":"2024-04-26T23:48:04.225007+0000","last_became_peered":"2024-04-26T23:48:04.225007+0000","last_unstale":"2024-04-26T23:48:14.270555+0000","last_undegraded":"2024-04-26T23:48:14.270555+0000","last_fullsized":"2024-04-26T23:48:14.270555+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:25.427760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381922+0000","last_change":"2024-04-26T23:48:05.233451+0000","last_active":"2024-04-26T23:48:14.381922+0000","last_peered":"2024-04-26T23:48:14.381922+0000","last_clean":"2024-04-26T23:48:14.381922+0000","last_became_active":"2024-04-26T23:48:05.231831+0000","last_became_peered":"2024-04-26T23:48:05.231831+0000","last_unstale":"2024-04-26T23:48:14.381922+0000","last_undegraded":"2024-04-26T23:48:14.381922+0000","last_fullsized":"2024-04-26T23:48:14.381922+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:51:31.626342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382428+0000","last_change":"2024-04-26T23:48:04.218823+0000","last_active":"2024-04-26T23:48:14.382428+0000","last_peered":"2024-04-26T23:48:14.382428+0000","last_clean":"2024-04-26T23:48:14.382428+0000","last_became_active":"2024-04-26T23:48:04.218512+0000","last_became_peered":"2024-04-26T23:48:04.218512+0000","last_unstale":"2024-04-26T23:48:14.382428+0000","last_undegraded":"2024-04-26T23:48:14.382428+0000","last_fullsized":"2024-04-26T23:48:14.382428+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270202+0000","last_change":"2024-04-26T23:48:05.230459+0000","last_active":"2024-04-26T23:48:14.270202+0000","last_peered":"2024-04-26T23:48:14.270202+0000","last_clean":"2024-04-26T23:48:14.270202+0000","last_became_active":"2024-04-26T23:48:05.229953+0000","last_became_peered":"2024-04-26T23:48:05.229953+0000","last_unstale":"2024-04-26T23:48:14.270202+0000","last_undegraded":"2024-04-26T23:48:14.270202+0000","last_fullsized":"2024-04-26T23:48:14.270202+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:12:12.591370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270358+0000","last_change":"2024-04-26T23:48:04.228608+0000","last_active":"2024-04-26T23:48:14.270358+0000","last_peered":"2024-04-26T23:48:14.270358+0000","last_clean":"2024-04-26T23:48:14.270358+0000","last_became_active":"2024-04-26T23:48:04.228270+0000","last_became_peered":"2024-04-26T23:48:04.228270+0000","last_unstale":"2024-04-26T23:48:14.270358+0000","last_undegraded":"2024-04-26T23:48:14.270358+0000","last_fullsized":"2024-04-26T23:48:14.270358+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382419+0000","last_change":"2024-04-26T23:48:05.217090+0000","last_active":"2024-04-26T23:48:14.382419+0000","last_peered":"2024-04-26T23:48:14.382419+0000","last_clean":"2024-04-26T23:48:14.382419+0000","last_became_active":"2024-04-26T23:48:05.216790+0000","last_became_peered":"2024-04-26T23:48:05.216790+0000","last_unstale":"2024-04-26T23:48:14.382419+0000","last_undegraded":"2024-04-26T23:48:14.382419+0000","last_fullsized":"2024-04-26T23:48:14.382419+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:38:58.400174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":26,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381374+0000","last_change":"2024-04-26T23:48:04.218398+0000","last_active":"2024-04-26T23:48:14.381374+0000","last_peered":"2024-04-26T23:48:14.381374+0000","last_clean":"2024-04-26T23:48:14.381374+0000","last_became_active":"2024-04-26T23:48:04.218077+0000","last_became_peered":"2024-04-26T23:48:04.218077+0000","last_unstale":"2024-04-26T23:48:14.381374+0000","last_undegraded":"2024-04-26T23:48:14.381374+0000","last_fullsized":"2024-04-26T23:48:14.381374+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:35:33.229972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381076+0000","last_change":"2024-04-26T23:48:05.225639+0000","last_active":"2024-04-26T23:48:14.381076+0000","last_peered":"2024-04-26T23:48:14.381076+0000","last_clean":"2024-04-26T23:48:14.381076+0000","last_became_active":"2024-04-26T23:48:05.225352+0000","last_became_peered":"2024-04-26T23:48:05.225352+0000","last_unstale":"2024-04-26T23:48:14.381076+0000","last_undegraded":"2024-04-26T23:48:14.381076+0000","last_fullsized":"2024-04-26T23:48:14.381076+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:27:48.604934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380841+0000","last_change":"2024-04-26T23:48:04.226958+0000","last_active":"2024-04-26T23:48:14.380841+0000","last_peered":"2024-04-26T23:48:14.380841+0000","last_clean":"2024-04-26T23:48:14.380841+0000","last_became_active":"2024-04-26T23:48:04.225715+0000","last_became_peered":"2024-04-26T23:48:04.225715+0000","last_unstale":"2024-04-26T23:48:14.380841+0000","last_undegraded":"2024-04-26T23:48:14.380841+0000","last_fullsized":"2024-04-26T23:48:14.380841+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:27:36.823666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382195+0000","last_change":"2024-04-26T23:48:05.244250+0000","last_active":"2024-04-26T23:48:14.382195+0000","last_peered":"2024-04-26T23:48:14.382195+0000","last_clean":"2024-04-26T23:48:14.382195+0000","last_became_active":"2024-04-26T23:48:05.243940+0000","last_became_peered":"2024-04-26T23:48:05.243940+0000","last_unstale":"2024-04-26T23:48:14.382195+0000","last_undegraded":"2024-04-26T23:48:14.382195+0000","last_fullsized":"2024-04-26T23:48:14.382195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:06:12.437400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274645+0000","last_change":"2024-04-26T23:48:04.220282+0000","last_active":"2024-04-26T23:48:14.274645+0000","last_peered":"2024-04-26T23:48:14.274645+0000","last_clean":"2024-04-26T23:48:14.274645+0000","last_became_active":"2024-04-26T23:48:04.219866+0000","last_became_peered":"2024-04-26T23:48:04.219866+0000","last_unstale":"2024-04-26T23:48:14.274645+0000","last_undegraded":"2024-04-26T23:48:14.274645+0000","last_fullsized":"2024-04-26T23:48:14.274645+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:08.867822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275311+0000","last_change":"2024-04-26T23:48:05.229520+0000","last_active":"2024-04-26T23:48:14.275311+0000","last_peered":"2024-04-26T23:48:14.275311+0000","last_clean":"2024-04-26T23:48:14.275311+0000","last_became_active":"2024-04-26T23:48:05.229160+0000","last_became_peered":"2024-04-26T23:48:05.229160+0000","last_unstale":"2024-04-26T23:48:14.275311+0000","last_undegraded":"2024-04-26T23:48:14.275311+0000","last_fullsized":"2024-04-26T23:48:14.275311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:30.039470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273986+0000","last_change":"2024-04-26T23:48:04.216001+0000","last_active":"2024-04-26T23:48:14.273986+0000","last_peered":"2024-04-26T23:48:14.273986+0000","last_clean":"2024-04-26T23:48:14.273986+0000","last_became_active":"2024-04-26T23:48:04.214843+0000","last_became_peered":"2024-04-26T23:48:04.214843+0000","last_unstale":"2024-04-26T23:48:14.273986+0000","last_undegraded":"2024-04-26T23:48:14.273986+0000","last_fullsized":"2024-04-26T23:48:14.273986+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:10:54.949755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275426+0000","last_change":"2024-04-26T23:48:05.224735+0000","last_active":"2024-04-26T23:48:14.275426+0000","last_peered":"2024-04-26T23:48:14.275426+0000","last_clean":"2024-04-26T23:48:14.275426+0000","last_became_active":"2024-04-26T23:48:05.224471+0000","last_became_peered":"2024-04-26T23:48:05.224471+0000","last_unstale":"2024-04-26T23:48:14.275426+0000","last_undegraded":"2024-04-26T23:48:14.275426+0000","last_fullsized":"2024-04-26T23:48:14.275426+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:43:30.010915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270608+0000","last_change":"2024-04-26T23:48:04.227952+0000","last_active":"2024-04-26T23:48:14.270608+0000","last_peered":"2024-04-26T23:48:14.270608+0000","last_clean":"2024-04-26T23:48:14.270608+0000","last_became_active":"2024-04-26T23:48:04.227675+0000","last_became_peered":"2024-04-26T23:48:04.227675+0000","last_unstale":"2024-04-26T23:48:14.270608+0000","last_undegraded":"2024-04-26T23:48:14.270608+0000","last_fullsized":"2024-04-26T23:48:14.270608+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:04:52.985960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270260+0000","last_change":"2024-04-26T23:48:05.230217+0000","last_active":"2024-04-26T23:48:14.270260+0000","last_peered":"2024-04-26T23:48:14.270260+0000","last_clean":"2024-04-26T23:48:14.270260+0000","last_became_active":"2024-04-26T23:48:05.229634+0000","last_became_peered":"2024-04-26T23:48:05.229634+0000","last_unstale":"2024-04-26T23:48:14.270260+0000","last_undegraded":"2024-04-26T23:48:14.270260+0000","last_fullsized":"2024-04-26T23:48:14.270260+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:02:03.574834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270679+0000","last_change":"2024-04-26T23:48:04.230217+0000","last_active":"2024-04-26T23:48:14.270679+0000","last_peered":"2024-04-26T23:48:14.270679+0000","last_clean":"2024-04-26T23:48:14.270679+0000","last_became_active":"2024-04-26T23:48:04.229955+0000","last_became_peered":"2024-04-26T23:48:04.229955+0000","last_unstale":"2024-04-26T23:48:14.270679+0000","last_undegraded":"2024-04-26T23:48:14.270679+0000","last_fullsized":"2024-04-26T23:48:14.270679+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T08:03:55.474761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380272+0000","last_change":"2024-04-26T23:48:05.225763+0000","last_active":"2024-04-26T23:48:14.380272+0000","last_peered":"2024-04-26T23:48:14.380272+0000","last_clean":"2024-04-26T23:48:14.380272+0000","last_became_active":"2024-04-26T23:48:05.225476+0000","last_became_peered":"2024-04-26T23:48:05.225476+0000","last_unstale":"2024-04-26T23:48:14.380272+0000","last_undegraded":"2024-04-26T23:48:14.380272+0000","last_fullsized":"2024-04-26T23:48:14.380272+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:43:10.379973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273291+0000","last_change":"2024-04-26T23:48:04.222581+0000","last_active":"2024-04-26T23:48:14.273291+0000","last_peered":"2024-04-26T23:48:14.273291+0000","last_clean":"2024-04-26T23:48:14.273291+0000","last_became_active":"2024-04-26T23:48:04.222318+0000","last_became_peered":"2024-04-26T23:48:04.222318+0000","last_unstale":"2024-04-26T23:48:14.273291+0000","last_undegraded":"2024-04-26T23:48:14.273291+0000","last_fullsized":"2024-04-26T23:48:14.273291+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:40:26.692558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380659+0000","last_change":"2024-04-26T23:48:05.226111+0000","last_active":"2024-04-26T23:48:14.380659+0000","last_peered":"2024-04-26T23:48:14.380659+0000","last_clean":"2024-04-26T23:48:14.380659+0000","last_became_active":"2024-04-26T23:48:05.224807+0000","last_became_peered":"2024-04-26T23:48:05.224807+0000","last_unstale":"2024-04-26T23:48:14.380659+0000","last_undegraded":"2024-04-26T23:48:14.380659+0000","last_fullsized":"2024-04-26T23:48:14.380659+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:45:21.509123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381389+0000","last_change":"2024-04-26T23:48:04.223336+0000","last_active":"2024-04-26T23:48:14.381389+0000","last_peered":"2024-04-26T23:48:14.381389+0000","last_clean":"2024-04-26T23:48:14.381389+0000","last_became_active":"2024-04-26T23:48:04.222977+0000","last_became_peered":"2024-04-26T23:48:04.222977+0000","last_unstale":"2024-04-26T23:48:14.381389+0000","last_undegraded":"2024-04-26T23:48:14.381389+0000","last_fullsized":"2024-04-26T23:48:14.381389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:56:15.587314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.383899+0000","last_change":"2024-04-26T23:48:14.383899+0000","last_active":"2024-04-26T23:48:14.383899+0000","last_peered":"2024-04-26T23:48:14.383899+0000","last_clean":"2024-04-26T23:48:14.383899+0000","last_became_active":"2024-04-26T23:48:14.383652+0000","last_became_peered":"2024-04-26T23:48:14.383652+0000","last_unstale":"2024-04-26T23:48:14.383899+0000","last_undegraded":"2024-04-26T23:48:14.383899+0000","last_fullsized":"2024-04-26T23:48:14.383899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:09:26.434075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382166+0000","last_change":"2024-04-26T23:48:04.218748+0000","last_active":"2024-04-26T23:48:14.382166+0000","last_peered":"2024-04-26T23:48:14.382166+0000","last_clean":"2024-04-26T23:48:14.382166+0000","last_became_active":"2024-04-26T23:48:04.218445+0000","last_became_peered":"2024-04-26T23:48:04.218445+0000","last_unstale":"2024-04-26T23:48:14.382166+0000","last_undegraded":"2024-04-26T23:48:14.382166+0000","last_fullsized":"2024-04-26T23:48:14.382166+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.275576+0000","last_change":"2024-04-26T23:48:05.241335+0000","last_active":"2024-04-26T23:48:14.275576+0000","last_peered":"2024-04-26T23:48:14.275576+0000","last_clean":"2024-04-26T23:48:14.275576+0000","last_became_active":"2024-04-26T23:48:05.241046+0000","last_became_peered":"2024-04-26T23:48:05.241046+0000","last_unstale":"2024-04-26T23:48:14.275576+0000","last_undegraded":"2024-04-26T23:48:14.275576+0000","last_fullsized":"2024-04-26T23:48:14.275576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:13:46.660020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"49'1","reported_seq":19,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270650+0000","last_change":"2024-04-26T23:48:04.224772+0000","last_active":"2024-04-26T23:48:14.270650+0000","last_peered":"2024-04-26T23:48:14.270650+0000","last_clean":"2024-04-26T23:48:14.270650+0000","last_became_active":"2024-04-26T23:48:04.224432+0000","last_became_peered":"2024-04-26T23:48:04.224432+0000","last_unstale":"2024-04-26T23:48:14.270650+0000","last_undegraded":"2024-04-26T23:48:14.270650+0000","last_fullsized":"2024-04-26T23:48:14.270650+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:29:41.016644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381963+0000","last_change":"2024-04-26T23:48:05.236347+0000","last_active":"2024-04-26T23:48:14.381963+0000","last_peered":"2024-04-26T23:48:14.381963+0000","last_clean":"2024-04-26T23:48:14.381963+0000","last_became_active":"2024-04-26T23:48:05.235092+0000","last_became_peered":"2024-04-26T23:48:05.235092+0000","last_unstale":"2024-04-26T23:48:14.381963+0000","last_undegraded":"2024-04-26T23:48:14.381963+0000","last_fullsized":"2024-04-26T23:48:14.381963+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:03:26.337860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382617+0000","last_change":"2024-04-26T23:48:04.226180+0000","last_active":"2024-04-26T23:48:14.382617+0000","last_peered":"2024-04-26T23:48:14.382617+0000","last_clean":"2024-04-26T23:48:14.382617+0000","last_became_active":"2024-04-26T23:48:04.224649+0000","last_became_peered":"2024-04-26T23:48:04.224649+0000","last_unstale":"2024-04-26T23:48:14.382617+0000","last_undegraded":"2024-04-26T23:48:14.382617+0000","last_fullsized":"2024-04-26T23:48:14.382617+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:17:46.480502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382513+0000","last_change":"2024-04-26T23:48:05.229480+0000","last_active":"2024-04-26T23:48:14.382513+0000","last_peered":"2024-04-26T23:48:14.382513+0000","last_clean":"2024-04-26T23:48:14.382513+0000","last_became_active":"2024-04-26T23:48:05.229207+0000","last_became_peered":"2024-04-26T23:48:05.229207+0000","last_unstale":"2024-04-26T23:48:14.382513+0000","last_undegraded":"2024-04-26T23:48:14.382513+0000","last_fullsized":"2024-04-26T23:48:14.382513+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:34:25.518245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380391+0000","last_change":"2024-04-26T23:48:04.210419+0000","last_active":"2024-04-26T23:48:14.380391+0000","last_peered":"2024-04-26T23:48:14.380391+0000","last_clean":"2024-04-26T23:48:14.380391+0000","last_became_active":"2024-04-26T23:48:04.210148+0000","last_became_peered":"2024-04-26T23:48:04.210148+0000","last_unstale":"2024-04-26T23:48:14.380391+0000","last_undegraded":"2024-04-26T23:48:14.380391+0000","last_fullsized":"2024-04-26T23:48:14.380391+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:58:51.299995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270386+0000","last_change":"2024-04-26T23:48:05.229997+0000","last_active":"2024-04-26T23:48:14.270386+0000","last_peered":"2024-04-26T23:48:14.270386+0000","last_clean":"2024-04-26T23:48:14.270386+0000","last_became_active":"2024-04-26T23:48:05.229302+0000","last_became_peered":"2024-04-26T23:48:05.229302+0000","last_unstale":"2024-04-26T23:48:14.270386+0000","last_undegraded":"2024-04-26T23:48:14.270386+0000","last_fullsized":"2024-04-26T23:48:14.270386+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:14:53.443726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382466+0000","last_change":"2024-04-26T23:48:04.224753+0000","last_active":"2024-04-26T23:48:14.382466+0000","last_peered":"2024-04-26T23:48:14.382466+0000","last_clean":"2024-04-26T23:48:14.382466+0000","last_became_active":"2024-04-26T23:48:04.223031+0000","last_became_peered":"2024-04-26T23:48:04.223031+0000","last_unstale":"2024-04-26T23:48:14.382466+0000","last_undegraded":"2024-04-26T23:48:14.382466+0000","last_fullsized":"2024-04-26T23:48:14.382466+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T10:40:06.456245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.270436+0000","last_change":"2024-04-26T23:48:05.230203+0000","last_active":"2024-04-26T23:48:14.270436+0000","last_peered":"2024-04-26T23:48:14.270436+0000","last_clean":"2024-04-26T23:48:14.270436+0000","last_became_active":"2024-04-26T23:48:05.229393+0000","last_became_peered":"2024-04-26T23:48:05.229393+0000","last_unstale":"2024-04-26T23:48:14.270436+0000","last_undegraded":"2024-04-26T23:48:14.270436+0000","last_fullsized":"2024-04-26T23:48:14.270436+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:08:54.729521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274193+0000","last_change":"2024-04-26T23:48:04.227693+0000","last_active":"2024-04-26T23:48:14.274193+0000","last_peered":"2024-04-26T23:48:14.274193+0000","last_clean":"2024-04-26T23:48:14.274193+0000","last_became_active":"2024-04-26T23:48:04.227291+0000","last_became_peered":"2024-04-26T23:48:04.227291+0000","last_unstale":"2024-04-26T23:48:14.274193+0000","last_undegraded":"2024-04-26T23:48:14.274193+0000","last_fullsized":"2024-04-26T23:48:14.274193+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T09:53:29.033155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273155+0000","last_change":"2024-04-26T23:48:05.222836+0000","last_active":"2024-04-26T23:48:14.273155+0000","last_peered":"2024-04-26T23:48:14.273155+0000","last_clean":"2024-04-26T23:48:14.273155+0000","last_became_active":"2024-04-26T23:48:05.222412+0000","last_became_peered":"2024-04-26T23:48:05.222412+0000","last_unstale":"2024-04-26T23:48:14.273155+0000","last_undegraded":"2024-04-26T23:48:14.273155+0000","last_fullsized":"2024-04-26T23:48:14.273155+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:56.369838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.380329+0000","last_change":"2024-04-26T23:48:04.221994+0000","last_active":"2024-04-26T23:48:14.380329+0000","last_peered":"2024-04-26T23:48:14.380329+0000","last_clean":"2024-04-26T23:48:14.380329+0000","last_became_active":"2024-04-26T23:48:04.221660+0000","last_became_peered":"2024-04-26T23:48:04.221660+0000","last_unstale":"2024-04-26T23:48:14.380329+0000","last_undegraded":"2024-04-26T23:48:14.380329+0000","last_fullsized":"2024-04-26T23:48:14.380329+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:22:09.336526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.273345+0000","last_change":"2024-04-26T23:48:05.236457+0000","last_active":"2024-04-26T23:48:14.273345+0000","last_peered":"2024-04-26T23:48:14.273345+0000","last_clean":"2024-04-26T23:48:14.273345+0000","last_became_active":"2024-04-26T23:48:05.236197+0000","last_became_peered":"2024-04-26T23:48:05.236197+0000","last_unstale":"2024-04-26T23:48:14.273345+0000","last_undegraded":"2024-04-26T23:48:14.273345+0000","last_fullsized":"2024-04-26T23:48:14.273345+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T11:04:38.244524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.381356+0000","last_change":"2024-04-26T23:48:04.227700+0000","last_active":"2024-04-26T23:48:14.381356+0000","last_peered":"2024-04-26T23:48:14.381356+0000","last_clean":"2024-04-26T23:48:14.381356+0000","last_became_active":"2024-04-26T23:48:04.227310+0000","last_became_peered":"2024-04-26T23:48:04.227310+0000","last_unstale":"2024-04-26T23:48:14.381356+0000","last_undegraded":"2024-04-26T23:48:14.381356+0000","last_fullsized":"2024-04-26T23:48:14.381356+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:55:21.411558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382273+0000","last_change":"2024-04-26T23:48:05.232098+0000","last_active":"2024-04-26T23:48:14.382273+0000","last_peered":"2024-04-26T23:48:14.382273+0000","last_clean":"2024-04-26T23:48:14.382273+0000","last_became_active":"2024-04-26T23:48:05.231822+0000","last_became_peered":"2024-04-26T23:48:05.231822+0000","last_unstale":"2024-04-26T23:48:14.382273+0000","last_undegraded":"2024-04-26T23:48:14.382273+0000","last_fullsized":"2024-04-26T23:48:14.382273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:04.193819+0000","last_clean_scrub_stamp":"2024-04-26T23:48:04.193819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:58:00.037610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.274155+0000","last_change":"2024-04-26T23:48:04.226769+0000","last_active":"2024-04-26T23:48:14.274155+0000","last_peered":"2024-04-26T23:48:14.274155+0000","last_clean":"2024-04-26T23:48:14.274155+0000","last_became_active":"2024-04-26T23:48:04.226478+0000","last_became_peered":"2024-04-26T23:48:04.226478+0000","last_unstale":"2024-04-26T23:48:14.274155+0000","last_undegraded":"2024-04-26T23:48:14.274155+0000","last_fullsized":"2024-04-26T23:48:14.274155+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:48:03.187504+0000","last_clean_scrub_stamp":"2024-04-26T23:48:03.187504+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:27:30.450213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":221,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-26T23:48:14.382299+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:48:14.382299+0000","last_peered":"2024-04-26T23:48:14.382299+0000","last_clean":"2024-04-26T23:48:14.382299+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:48:14.382299+0000","last_undegraded":"2024-04-26T23:48:14.382299+0000","last_fullsized":"2024-04-26T23:48:14.382299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28188,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343652,"statfs":{"total":96636764160,"available":96607899648,"internally_reserved":0,"allocated":1191936,"data_stored":834806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509479,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":602112,"data_stored":245020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":244418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509479,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":245960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31776,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340064,"statfs":{"total":96636764160,"available":96604225536,"internally_reserved":0,"allocated":606208,"data_stored":244986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509479,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":610304,"data_stored":245982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31768,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340072,"statfs":{"total":96636764160,"available":96604233728,"internally_reserved":0,"allocated":598016,"data_stored":244418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1191936,"data_stored":834750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:48:23.479 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T23:48:23.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-26T23:48:23.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 Processor -- start 2024-04-26T23:48:23.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 -- start start 2024-04-26T23:48:23.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5da8148c20 0x7f5da80b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da806c400 0x7f5da81634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5da81639f0 0x7f5da806efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5da8162d40 con 0x7f5da81639f0 2024-04-26T23:48:23.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5da806cbe0 con 0x7f5da8148c20 2024-04-26T23:48:23.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.630+0000 7f5db0400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5da806cec0 con 0x7f5da806c400 2024-04-26T23:48:23.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5da81639f0 0x7f5da806efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5da81639f0 0x7f5da806efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38754/0 (socket says 172.21.15.47:38754) 2024-04-26T23:48:23.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 -- 172.21.15.47:0/4049142216 learned_addr learned my addr 172.21.15.47:0/4049142216 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dad000640 1 --2- 172.21.15.47:0/4049142216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da806c400 0x7f5da81634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dada00640 1 --2- 172.21.15.47:0/4049142216 >> v2:172.21.15.203:3300/0 conn(0x7f5da8148c20 0x7f5da80b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 -- 172.21.15.47:0/4049142216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da806c400 msgr2=0x7f5da81634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 --2- 172.21.15.47:0/4049142216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da806c400 0x7f5da81634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 -- 172.21.15.47:0/4049142216 >> v2:172.21.15.203:3300/0 conn(0x7f5da8148c20 msgr2=0x7f5da80b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 --2- 172.21.15.47:0/4049142216 >> v2:172.21.15.203:3300/0 conn(0x7f5da8148c20 0x7f5da80b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 -- 172.21.15.47:0/4049142216 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da806d1a0 con 0x7f5da81639f0 2024-04-26T23:48:23.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dada00640 1 --2- 172.21.15.47:0/4049142216 >> v2:172.21.15.203:3300/0 conn(0x7f5da8148c20 0x7f5da80b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:23.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5dae400640 1 --2- 172.21.15.47:0/4049142216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81639f0 0x7f5da806efa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5da8072f10 tx=0x7f5da001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f441429ffff8eeee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:23.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5da7e00640 1 -- 172.21.15.47:0/4049142216 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da00a56c0 con 0x7f5da81639f0 2024-04-26T23:48:23.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5da7e00640 1 -- 172.21.15.47:0/4049142216 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da00a5860 con 0x7f5da81639f0 2024-04-26T23:48:23.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.634+0000 7f5da7e00640 1 -- 172.21.15.47:0/4049142216 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da00a5c30 con 0x7f5da81639f0 2024-04-26T23:48:23.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- 172.21.15.47:0/4049142216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81639f0 msgr2=0x7f5da806efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 --2- 172.21.15.47:0/4049142216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81639f0 0x7f5da806efa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5da8072f10 tx=0x7f5da001c930 comp rx=0 tx=0).stop 2024-04-26T23:48:23.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- 172.21.15.47:0/4049142216 shutdown_connections 2024-04-26T23:48:23.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 --2- 172.21.15.47:0/4049142216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da81639f0 0x7f5da806efa0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 --2- 172.21.15.47:0/4049142216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da806c400 0x7f5da81634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 --2- 172.21.15.47:0/4049142216 >> v2:172.21.15.203:3300/0 conn(0x7f5da8148c20 0x7f5da80b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- 172.21.15.47:0/4049142216 >> 172.21.15.47:0/4049142216 conn(0x7f5da80b3b30 msgr2=0x7f5da80b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:23.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- 172.21.15.47:0/4049142216 shutdown_connections 2024-04-26T23:48:23.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- 172.21.15.47:0/4049142216 wait complete. 2024-04-26T23:48:23.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 Processor -- start 2024-04-26T23:48:23.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- start start 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da806c400 0x7f5da8141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da8148c20 0x7f5da8163ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da8164410 0x7f5da8169620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5da815fb10 con 0x7f5da806c400 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5da815f990 con 0x7f5da8148c20 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5db0400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5da815fc90 con 0x7f5da8164410 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da806c400 0x7f5da8141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da806c400 0x7f5da8141d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38762/0 (socket says 172.21.15.47:38762) 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 -- 172.21.15.47:0/3151163517 learned_addr learned my addr 172.21.15.47:0/3151163517 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:23.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dad000640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da8148c20 0x7f5da8163ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dae400640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da8164410 0x7f5da8169620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 -- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da8164410 msgr2=0x7f5da8169620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da8164410 0x7f5da8169620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 -- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da8148c20 msgr2=0x7f5da8163ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da8148c20 0x7f5da8163ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.638+0000 7f5dada00640 1 -- 172.21.15.47:0/3151163517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da8143b10 con 0x7f5da806c400 2024-04-26T23:48:23.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5dada00640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da806c400 0x7f5da8141d00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c7c0 tx=0x7f5d9c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:23.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5da5600640 1 -- 172.21.15.47:0/3151163517 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0079d0 con 0x7f5da806c400 2024-04-26T23:48:23.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5da5600640 1 -- 172.21.15.47:0/3151163517 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9c007b70 con 0x7f5da806c400 2024-04-26T23:48:23.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5da5600640 1 -- 172.21.15.47:0/3151163517 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0113f0 con 0x7f5da806c400 2024-04-26T23:48:23.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da8143df0 con 0x7f5da806c400 2024-04-26T23:48:23.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da81443b0 con 0x7f5da806c400 2024-04-26T23:48:23.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da8069700 con 0x7f5da806c400 2024-04-26T23:48:23.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5da5600640 1 -- 172.21.15.47:0/3151163517 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f5d9c011590 con 0x7f5da806c400 2024-04-26T23:48:23.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5da5600640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5d88068650 0x7f5d8806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:23.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5da5600640 1 -- 172.21.15.47:0/3151163517 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f5d9c087070 con 0x7f5da806c400 2024-04-26T23:48:23.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.642+0000 7f5dad000640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5d88068650 0x7f5d8806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:23.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.646+0000 7f5dad000640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5d88068650 0x7f5d8806ab10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5da80d1850 tx=0x7f5d94008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:23.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.646+0000 7f5da5600640 1 -- 172.21.15.47:0/3151163517 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5d9c015020 con 0x7f5da806c400 2024-04-26T23:48:23.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.878+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5da8070b00 con 0x7f5da806c400 2024-04-26T23:48:23.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.878+0000 7f5da5600640 1 -- 172.21.15.47:0/3151163517 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f5d9c056a70 con 0x7f5da806c400 2024-04-26T23:48:23.886 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-04-26T23:48:23.886 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBiPCxmSs+fMhAAi6eSRSyhcIwg3ckGbNdS9Q== 2024-04-26T23:48:23.886 INFO:teuthology.orchestra.run.smithi047.stdout: caps mds = "allow" 2024-04-26T23:48:23.886 INFO:teuthology.orchestra.run.smithi047.stdout: caps mon = "allow r" 2024-04-26T23:48:23.886 INFO:teuthology.orchestra.run.smithi047.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-26T23:48:23.886 INFO:teuthology.orchestra.run.smithi047.stderr:updated caps for client.0 2024-04-26T23:48:23.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5d88068650 msgr2=0x7f5d8806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5d88068650 0x7f5d8806ab10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5da80d1850 tx=0x7f5d94008040 comp rx=0 tx=0).stop 2024-04-26T23:48:23.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da806c400 msgr2=0x7f5da8141d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:23.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da806c400 0x7f5da8141d00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00c7c0 tx=0x7f5d9c00cc80 comp rx=0 tx=0).stop 2024-04-26T23:48:23.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 shutdown_connections 2024-04-26T23:48:23.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5d88068650 0x7f5d8806ab10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5da8164410 0x7f5da8169620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da8148c20 0x7f5da8163ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 --2- 172.21.15.47:0/3151163517 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5da806c400 0x7f5da8141d00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 >> 172.21.15.47:0/3151163517 conn(0x7f5da80b3b30 msgr2=0x7f5da806fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 shutdown_connections 2024-04-26T23:48:23.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:23.882+0000 7f5db0400640 1 -- 172.21.15.47:0/3151163517 wait complete. 2024-04-26T23:48:23.907 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:48:24.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f393d400640 1 Processor -- start 2024-04-26T23:48:24.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f393d400640 1 -- start start 2024-04-26T23:48:24.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f393d400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3938072150 0x7f39380d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f393d400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f39380d1690 0x7f39380cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f393d400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39380cd830 con 0x7f3938160810 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f393d400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3938071080 con 0x7f3938072150 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f393d400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3938071360 con 0x7f39380d1690 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f392fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3938072150 0x7f39380d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f392fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3938072150 0x7f39380d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38768/0 (socket says 172.21.15.47:38768) 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f392fe00640 1 -- 172.21.15.47:0/2798186025 learned_addr learned my addr 172.21.15.47:0/2798186025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f3937200640 1 --2- 172.21.15.47:0/2798186025 >> v2:172.21.15.203:3300/0 conn(0x7f39380d1690 0x7f39380cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f392fe00640 1 -- 172.21.15.47:0/2798186025 >> v2:172.21.15.203:3300/0 conn(0x7f39380d1690 msgr2=0x7f39380cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f392fe00640 1 --2- 172.21.15.47:0/2798186025 >> v2:172.21.15.203:3300/0 conn(0x7f39380d1690 0x7f39380cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f392fe00640 1 -- 172.21.15.47:0/2798186025 >> v1:172.21.15.203:6789/0 conn(0x7f3938160810 legacy=0x7f3938071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f392fe00640 1 -- 172.21.15.47:0/2798186025 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39380cdad0 con 0x7f3938072150 2024-04-26T23:48:24.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.042+0000 7f3937200640 1 --2- 172.21.15.47:0/2798186025 >> v2:172.21.15.203:3300/0 conn(0x7f39380d1690 0x7f39380cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:24.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f392fe00640 1 --2- 172.21.15.47:0/2798186025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380d1150 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f39380d2e00 tx=0x7f392001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c882085c81affe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f3935e00640 1 -- 172.21.15.47:0/2798186025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39200b5070 con 0x7f3938072150 2024-04-26T23:48:24.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f3935e00640 1 -- 172.21.15.47:0/2798186025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39200a8a10 con 0x7f3938072150 2024-04-26T23:48:24.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f3935e00640 1 -- 172.21.15.47:0/2798186025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39200a8de0 con 0x7f3938072150 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 -- 172.21.15.47:0/2798186025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 msgr2=0x7f39380d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 --2- 172.21.15.47:0/2798186025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380d1150 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f39380d2e00 tx=0x7f392001ed10 comp rx=0 tx=0).stop 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 -- 172.21.15.47:0/2798186025 shutdown_connections 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 --2- 172.21.15.47:0/2798186025 >> v2:172.21.15.203:3300/0 conn(0x7f39380d1690 0x7f39380cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 --2- 172.21.15.47:0/2798186025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380d1150 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 -- 172.21.15.47:0/2798186025 >> 172.21.15.47:0/2798186025 conn(0x7f39380d2e90 msgr2=0x7f39380d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 -- 172.21.15.47:0/2798186025 shutdown_connections 2024-04-26T23:48:24.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.046+0000 7f393d400640 1 -- 172.21.15.47:0/2798186025 wait complete. 2024-04-26T23:48:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 Processor -- start 2024-04-26T23:48:24.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 -- start start 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39380d1690 0x7f39381572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3938160810 0x7f393806eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3938160d70 con 0x7f3938072150 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3938160bf0 con 0x7f3938160810 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f39380ce530 con 0x7f39380d1690 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380b6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38778/0 (socket says 172.21.15.47:38778) 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 -- 172.21.15.47:0/3963927870 learned_addr learned my addr 172.21.15.47:0/3963927870 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f392fe00640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39380d1690 0x7f39381572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3937200640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3938160810 0x7f393806eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 -- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39380d1690 msgr2=0x7f39381572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39380d1690 0x7f39381572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 -- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3938160810 msgr2=0x7f393806eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3938160810 0x7f393806eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 -- 172.21.15.47:0/3963927870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39380b5b70 con 0x7f3938072150 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f3936800640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380b6930 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f392800c370 tx=0x7f392800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f392ea00640 1 -- 172.21.15.47:0/3963927870 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39280052d0 con 0x7f3938072150 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f392ea00640 1 -- 172.21.15.47:0/3963927870 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3928005470 con 0x7f3938072150 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f392ea00640 1 -- 172.21.15.47:0/3963927870 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928007260 con 0x7f3938072150 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39380b5eb0 con 0x7f3938072150 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393806f480 con 0x7f3938072150 2024-04-26T23:48:24.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.050+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3938069700 con 0x7f3938072150 2024-04-26T23:48:24.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.054+0000 7f392ea00640 1 -- 172.21.15.47:0/3963927870 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f3928007400 con 0x7f3938072150 2024-04-26T23:48:24.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.054+0000 7f392ea00640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3914068650 0x7f391406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.054+0000 7f392ea00640 1 -- 172.21.15.47:0/3963927870 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f3928086260 con 0x7f3938072150 2024-04-26T23:48:24.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.054+0000 7f392fe00640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3914068650 0x7f391406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.054+0000 7f392fe00640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3914068650 0x7f391406ab10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f39200b2000 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.058+0000 7f392ea00640 1 -- 172.21.15.47:0/3963927870 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f39380b5eb0 con 0x7f3938072150 2024-04-26T23:48:24.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f393815ecb0 con 0x7f3938072150 2024-04-26T23:48:24.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f392ea00640 1 -- 172.21.15.47:0/3963927870 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5181 (secure 0 0 0) 0x7f3928056520 con 0x7f3938072150 2024-04-26T23:48:24.267 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:48:24.267 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2875189318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2875189318},{"type":"v1","addr":"172.21.15.203:6836","nonce":2875189318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/629228023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":629228023},{"type":"v1","addr":"172.21.15.203:6837","nonce":629228023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5910,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/868771075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":868771075},{"type":"v1","addr":"172.21.15.47:6834","nonce":868771075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:48:04.603648+0000","modified":"2024-04-26T23:48:07.629516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5913},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5913":{"gid":5913,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/3889822755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3889822755},{"type":"v1","addr":"172.21.15.47:6835","nonce":3889822755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5913,"qdb_cluster":[5913]},"id":3}]} 2024-04-26T23:48:24.268 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 27 2024-04-26T23:48:24.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3914068650 msgr2=0x7f391406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3914068650 0x7f391406ab10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f39200b2000 tx=0x7f3920008040 comp rx=0 tx=0).stop 2024-04-26T23:48:24.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 msgr2=0x7f39380b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380b6930 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f392800c370 tx=0x7f392800c830 comp rx=0 tx=0).stop 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 shutdown_connections 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3914068650 0x7f391406ab10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3938160810 0x7f393806eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f39380d1690 0x7f39381572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 --2- 172.21.15.47:0/3963927870 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3938072150 0x7f39380b6930 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 >> 172.21.15.47:0/3963927870 conn(0x7f39380d2e90 msgr2=0x7f393815f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 shutdown_connections 2024-04-26T23:48:24.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.262+0000 7f393d400640 1 -- 172.21.15.47:0/3963927870 wait complete. 2024-04-26T23:48:24.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T23:48:04.603648+0000', 'modified': '2024-04-26T23:48:07.629516+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5913}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5913': {'gid': 5913, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.47:6835/3889822755', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.47:6833', 'nonce': 3889822755}, {'type': 'v1', 'addr': '172.21.15.47:6835', 'nonce': 3889822755}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5913, 'qdb_cluster': [5913]} 2024-04-26T23:48:24.691 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T23:48:24.691 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T23:48:24.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f7600e00640 1 Processor -- start 2024-04-26T23:48:24.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f7600e00640 1 -- start start 2024-04-26T23:48:24.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f7600e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc0729a0 0x7f75fc160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f7600e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75fc072d80 0x7f75fc162df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f7600e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75fc0739a0 con 0x7f75fc163330 2024-04-26T23:48:24.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f7600e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f75fc0b62e0 con 0x7f75fc072d80 2024-04-26T23:48:24.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f7600e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc1607c0 con 0x7f75fc0729a0 2024-04-26T23:48:24.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f75f1400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f75fc072d80 0x7f75fc162df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f75fa800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f75fc163330 0x7f75fc06ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35782/0 (socket says 172.21.15.47:35782) 2024-04-26T23:48:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.826+0000 7f75fa800640 1 -- 172.21.15.47:0/4060166278 learned_addr learned my addr 172.21.15.47:0/4060166278 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f9e00640 1 --2- 172.21.15.47:0/4060166278 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc0729a0 0x7f75fc160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f1400640 1 -- 172.21.15.47:0/4060166278 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc0729a0 msgr2=0x7f75fc160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f1400640 1 --2- 172.21.15.47:0/4060166278 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc0729a0 0x7f75fc160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f1400640 1 -- 172.21.15.47:0/4060166278 >> v1:172.21.15.47:6789/0 conn(0x7f75fc163330 legacy=0x7f75fc06ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f1400640 1 -- 172.21.15.47:0/4060166278 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc0b56d0 con 0x7f75fc072d80 2024-04-26T23:48:24.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f9400640 1 -- 172.21.15.47:0/4060166278 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047186676 0 0) 0x7f75fc0739a0 con 0x7f75fc163330 2024-04-26T23:48:24.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f1400640 1 --2- 172.21.15.47:0/4060166278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc072d80 0x7f75fc162df0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f75e40097c0 tx=0x7f75e401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6bdc0392c4b986 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f9400640 1 -- 172.21.15.47:0/4060166278 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40b1070 con 0x7f75fc072d80 2024-04-26T23:48:24.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f9400640 1 -- 172.21.15.47:0/4060166278 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e40a8050 con 0x7f75fc072d80 2024-04-26T23:48:24.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.830+0000 7f75f9400640 1 -- 172.21.15.47:0/4060166278 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40ac860 con 0x7f75fc072d80 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- 172.21.15.47:0/4060166278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc072d80 msgr2=0x7f75fc162df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 --2- 172.21.15.47:0/4060166278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc072d80 0x7f75fc162df0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f75e40097c0 tx=0x7f75e401c3e0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- 172.21.15.47:0/4060166278 shutdown_connections 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 --2- 172.21.15.47:0/4060166278 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc072d80 0x7f75fc162df0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 --2- 172.21.15.47:0/4060166278 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc0729a0 0x7f75fc160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- 172.21.15.47:0/4060166278 >> 172.21.15.47:0/4060166278 conn(0x7f75fc070c00 msgr2=0x7f75fc06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- 172.21.15.47:0/4060166278 shutdown_connections 2024-04-26T23:48:24.839 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- 172.21.15.47:0/4060166278 wait complete. 2024-04-26T23:48:24.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 Processor -- start 2024-04-26T23:48:24.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- start start 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc0729a0 0x7f75fc151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75fc072d80 0x7f75fc151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc163330 0x7f75fc15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0731e0 con 0x7f75fc0729a0 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc163b90 con 0x7f75fc072d80 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f7600e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc15d0b0 con 0x7f75fc163330 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc0729a0 0x7f75fc151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc0729a0 0x7f75fc151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38788/0 (socket says 172.21.15.47:38788) 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 -- 172.21.15.47:0/3454777797 learned_addr learned my addr 172.21.15.47:0/3454777797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f1400640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75fc072d80 0x7f75fc151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75fa800640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc163330 0x7f75fc15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.843 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 -- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc163330 msgr2=0x7f75fc15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc163330 0x7f75fc15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 -- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75fc072d80 msgr2=0x7f75fc151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75fc072d80 0x7f75fc151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f9e00640 1 -- 172.21.15.47:0/3454777797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc14c7a0 con 0x7f75fc0729a0 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.834+0000 7f75f1400640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75fc072d80 0x7f75fc151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc0729a0 0x7f75fc151240 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00efc0 tx=0x7f75ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f2a00640 1 -- 172.21.15.47:0/3454777797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec018020 con 0x7f75fc0729a0 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f2a00640 1 -- 172.21.15.47:0/3454777797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec014480 con 0x7f75fc0729a0 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f2a00640 1 -- 172.21.15.47:0/3454777797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec014850 con 0x7f75fc0729a0 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75fc15e2b0 con 0x7f75fc0729a0 2024-04-26T23:48:24.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75fc15e870 con 0x7f75fc0729a0 2024-04-26T23:48:24.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f2a00640 1 -- 172.21.15.47:0/3454777797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f75ec01b020 con 0x7f75fc0729a0 2024-04-26T23:48:24.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f2a00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75d8068650 0x7f75d806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f2a00640 1 -- 172.21.15.47:0/3454777797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f75ec0879e0 con 0x7f75fc0729a0 2024-04-26T23:48:24.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f7604370000 1 Processor -- start 2024-04-26T23:48:24.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.838+0000 7f75f1400640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75d8068650 0x7f75d806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- start start 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f1400640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75d8068650 0x7f75d806ab10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f75e40ae000 tx=0x7f75e40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c2641ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c25f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d0c24b0140 con 0x55d0c2641700 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d0c2445e00 con 0x55d0c2642020 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d0c23fea00 con 0x55d0c25f8740 2024-04-26T23:48:24.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c2641ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c2641ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38792/0 (socket says 172.21.15.47:38792) 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 -- 172.21.15.47:0/462937344 learned_addr learned my addr 172.21.15.47:0/462937344 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 -- 172.21.15.47:0/462937344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 msgr2=0x55d0c25f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 --2- 172.21.15.47:0/462937344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 -- 172.21.15.47:0/462937344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 msgr2=0x55d0c25f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 --2- 172.21.15.47:0/462937344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c25f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 -- 172.21.15.47:0/462937344 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c24030e0 con 0x55d0c2641700 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75f9e00640 1 --2- 172.21.15.47:0/462937344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c2641ae0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f75ec085b40 tx=0x7f75ec057c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe1ee9af46b0b68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75eaa00640 1 -- 172.21.15.47:0/462937344 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec06be60 con 0x55d0c2641700 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75eaa00640 1 -- 172.21.15.47:0/462937344 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec055750 con 0x55d0c2641700 2024-04-26T23:48:24.849 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f75eaa00640 1 -- 172.21.15.47:0/462937344 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0568a0 con 0x55d0c2641700 2024-04-26T23:48:24.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- 172.21.15.47:0/462937344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 msgr2=0x55d0c2641ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 --2- 172.21.15.47:0/462937344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c2641ae0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f75ec085b40 tx=0x7f75ec057c80 comp rx=0 tx=0).stop 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- 172.21.15.47:0/462937344 shutdown_connections 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 --2- 172.21.15.47:0/462937344 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 --2- 172.21.15.47:0/462937344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c25f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 --2- 172.21.15.47:0/462937344 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c2641ae0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- 172.21.15.47:0/462937344 >> 172.21.15.47:0/462937344 conn(0x55d0c25f46f0 msgr2=0x55d0c25f6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- 172.21.15.47:0/462937344 shutdown_connections 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- 172.21.15.47:0/462937344 wait complete. 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 -- start start 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.842+0000 7f7604370000 1 Processor -- start 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c25f8740 0x55d0c26030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c26035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2642020 0x55d0c2603b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d0c2453200 con 0x55d0c2641700 2024-04-26T23:48:24.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d0c23e9e80 con 0x55d0c25f8740 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d0c2440ae0 con 0x55d0c2642020 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 10 client.0 _ll_register_callbacks cb 0x55d0c2452da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c26035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f9e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c25f8740 0x55d0c26030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c26035e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38808/0 (socket says 172.21.15.47:38808) 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 -- 172.21.15.47:0/1701392418 learned_addr learned my addr 172.21.15.47:0/1701392418 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75fa800640 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2642020 0x55d0c2603b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 -- 172.21.15.47:0/1701392418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2642020 msgr2=0x55d0c2603b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2642020 0x55d0c2603b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 -- 172.21.15.47:0/1701392418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c25f8740 msgr2=0x55d0c26030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c25f8740 0x55d0c26030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 -- 172.21.15.47:0/1701392418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c23e54e0 con 0x55d0c2641700 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f1400640 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c26035e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c10 tx=0x7f75e4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b550c90cc3f5f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75df400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-26T23:48:24.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75df400640 1 -- 172.21.15.47:0/1701392418 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40b1040 con 0x55d0c2641700 2024-04-26T23:48:24.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ec055750 con 0x55d0c2641700 2024-04-26T23:48:24.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75df400640 1 -- 172.21.15.47:0/1701392418 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f75e40b6b70 con 0x55d0c2641700 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75df400640 1 -- 172.21.15.47:0/1701392418 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f75e40ce050 con 0x55d0c2641700 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 10 client.6132 fetch_fsmap learned FSMap version 27 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d0c23cbe80 con 0x55d0c2641700 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75df400640 1 -- 172.21.15.47:0/1701392418 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec055750 con 0x55d0c2641700 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75df400640 1 -- 172.21.15.47:0/1701392418 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f75e40d1020 con 0x55d0c2641700 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 10 client.6132 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 10 client.6132 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 20 client.6132 populate_metadata read hostname 'smithi047' 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c2604530 0x55d0c26537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 4 client.6132 mds_command: new command op to 5913 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 --> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0c23debc0 con 0x55d0c2604530 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f9e00640 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c2604530 0x55d0c26537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75f9e00640 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c2604530 0x55d0c26537b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff2a99e88f2de64 server_cookie=1fe5544192688373 in_seq=0 out_seq=0 2024-04-26T23:48:24.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.846+0000 7f75df400640 10 client.6132 ms_handle_connect on v2:172.21.15.47:6833/3889822755 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f75df400640 1 -- 172.21.15.47:0/1701392418 <== mds.0 v2:172.21.15.47:6833/3889822755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0c23debc0 con 0x55d0c2604530 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f75df400640 10 client.6132 handle_command_reply: tid=0 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 client.6132 shutdown 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 msgr2=0x55d0c26035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c26035e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c10 tx=0x7f75e4019180 comp rx=0 tx=0).stop 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 shutdown_connections 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c2604530 0x55d0c26537b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2642020 0x55d0c2603b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c26035e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f75df400640 0 client.6132 ms_handle_reset on v2:172.21.15.47:6833/3889822755 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 --2- 172.21.15.47:0/1701392418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c25f8740 0x55d0c26030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 >> 172.21.15.47:0/1701392418 conn(0x55d0c25f46f0 msgr2=0x55d0c25f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 shutdown_connections 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 1 -- 172.21.15.47:0/1701392418 wait complete. 2024-04-26T23:48:24.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.850+0000 7f7604370000 20 client.6132 trim_cache size 0 max 16384 2024-04-26T23:48:24.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 Processor -- start 2024-04-26T23:48:24.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 -- start start 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c25f7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c25f7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc203ae0 con 0x55d0c2641700 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc150150 con 0x55d0c2642020 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc14d970 con 0x55d0c25f8740 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f75f1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c25f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f75f1400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c25f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38824/0 (socket says 172.21.15.47:38824) 2024-04-26T23:48:24.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f75f1400640 1 -- 172.21.15.47:0/3445856860 learned_addr learned my addr 172.21.15.47:0/3445856860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:24.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.866+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 -- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 msgr2=0x55d0c25f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 -- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 msgr2=0x55d0c25f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c25f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 -- 172.21.15.47:0/3445856860 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c23fec50 con 0x55d0c2641700 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c25f7020 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f75e4097eb0 tx=0x7f75e40be000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897028379f025f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75ea000640 1 -- 172.21.15.47:0/3445856860 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40d6070 con 0x55d0c2641700 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75ea000640 1 -- 172.21.15.47:0/3445856860 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e40c6070 con 0x55d0c2641700 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75ea000640 1 -- 172.21.15.47:0/3445856860 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e40b1040 con 0x55d0c2641700 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- 172.21.15.47:0/3445856860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 msgr2=0x55d0c25f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c25f7020 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f75e4097eb0 tx=0x7f75e40be000 comp rx=0 tx=0).stop 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- 172.21.15.47:0/3445856860 shutdown_connections 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c25f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c2641700 0x55d0c25f7020 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 --2- 172.21.15.47:0/3445856860 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c25f8740 0x55d0c25f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- 172.21.15.47:0/3445856860 >> 172.21.15.47:0/3445856860 conn(0x55d0c25f46f0 msgr2=0x55d0c2603930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- 172.21.15.47:0/3445856860 shutdown_connections 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- 172.21.15.47:0/3445856860 wait complete. 2024-04-26T23:48:24.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- start start 2024-04-26T23:48:24.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 Processor -- start 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c25f8740 0x55d0c2655f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2641700 0x55d0c2656470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c266d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x55d0c2445110 con 0x55d0c25f8740 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d0c23db7b0 con 0x55d0c2642020 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x55d0c244a430 con 0x55d0c2641700 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f7604370000 10 client.0 _ll_register_callbacks cb 0x7f75e40af070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c25f8740 0x55d0c2655f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c25f8740 0x55d0c2655f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38834/0 (socket says 172.21.15.47:38834) 2024-04-26T23:48:24.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 -- 172.21.15.47:0/3016427630 learned_addr learned my addr 172.21.15.47:0/3016427630 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75fa800640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c266d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2641700 0x55d0c2656470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 -- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2641700 msgr2=0x55d0c2656470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2641700 0x55d0c2656470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 -- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 msgr2=0x55d0c266d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c266d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 -- 172.21.15.47:0/3016427630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c24c8160 con 0x55d0c25f8740 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75fa800640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c266d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f1400640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2641700 0x55d0c2656470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75f9e00640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c25f8740 0x55d0c2655f30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f75ec055700 tx=0x7f75ec05a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850b39b333c85fc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.870+0000 7f75df400640 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 1 -- 172.21.15.47:0/3016427630 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec073070 con 0x55d0c25f8740 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 1 -- 172.21.15.47:0/3016427630 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f75ec055750 con 0x55d0c25f8740 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75e40c6070 con 0x55d0c25f8740 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 1 -- 172.21.15.47:0/3016427630 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f75ec06be60 con 0x55d0c25f8740 2024-04-26T23:48:24.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 10 client.6138 fetch_fsmap learned FSMap version 27 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) -- 0x55d0c20ff0c0 con 0x55d0c25f8740 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 1 -- 172.21.15.47:0/3016427630 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e40c6070 con 0x55d0c25f8740 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 1 -- 172.21.15.47:0/3016427630 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 27) ==== 3494+0+0 (secure 0 0 0) 0x7f75ec087040 con 0x55d0c25f8740 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 10 client.6138 fetch_fsmap finished waiting for FSMap version 27 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 10 client.6138 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 20 client.6138 populate_metadata read hostname 'smithi047' 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c266dd00 0x55d0c26b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 4 client.6138 mds_command: new command op to 5913 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 --> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] -- command(tid 0: {"prefix": "status"}) -- 0x55d0c2453a10 con 0x55d0c266dd00 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75f1400640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c266dd00 0x55d0c26b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75f1400640 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c266dd00 0x55d0c26b87b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e520141a2592daad server_cookie=61a45e7e55df76d2 in_seq=0 out_seq=0 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 10 client.6138 ms_handle_connect on v2:172.21.15.47:6833/3889822755 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 1 -- 172.21.15.47:0/3016427630 <== mds.0 v2:172.21.15.47:6833/3889822755 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d0c2453a10 con 0x55d0c266dd00 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 10 client.6138 handle_command_reply: tid=0 2024-04-26T23:48:24.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 client.6138 shutdown 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c25f8740 msgr2=0x55d0c2655f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c25f8740 0x55d0c2655f30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f75ec055700 tx=0x7f75ec05a070 comp rx=0 tx=0).stop 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 shutdown_connections 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:6833/3889822755,v1:172.21.15.47:6835/3889822755] conn(0x55d0c266dd00 0x55d0c26b87b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0c2642020 0x55d0c266d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x55d0c2641700 0x55d0c2656470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 --2- 172.21.15.47:0/3016427630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x55d0c25f8740 0x55d0c2655f30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f75df400640 0 client.6138 ms_handle_reset on v2:172.21.15.47:6833/3889822755 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 >> 172.21.15.47:0/3016427630 conn(0x55d0c25f46f0 msgr2=0x55d0c264e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 shutdown_connections 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 1 -- 172.21.15.47:0/3016427630 wait complete. 2024-04-26T23:48:24.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7604370000 20 client.6138 trim_cache size 0 max 16384 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "b64830b3-1e32-4049-b582-6f8b5018205b", 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 5913, 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 19.674724055999999, 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 27, 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 51, 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 49, 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 24.492366508 2024-04-26T23:48:24.885 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:48:24.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75d8068650 msgr2=0x7f75d806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75d8068650 0x7f75d806ab10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f75e40ae000 tx=0x7f75e40a7000 comp rx=0 tx=0).stop 2024-04-26T23:48:24.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc0729a0 msgr2=0x7f75fc151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:24.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc0729a0 0x7f75fc151240 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00efc0 tx=0x7f75ec00c490 comp rx=0 tx=0).stop 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 shutdown_connections 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75d8068650 0x7f75d806ab10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f75fc163330 0x7f75fc15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75fc072d80 0x7f75fc151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 --2- 172.21.15.47:0/3454777797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f75fc0729a0 0x7f75fc151240 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 >> 172.21.15.47:0/3454777797 conn(0x7f75fc070c00 msgr2=0x7f75fc1614a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 shutdown_connections 2024-04-26T23:48:24.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:24.874+0000 7f7600e00640 1 -- 172.21.15.47:0/3454777797 wait complete. 2024-04-26T23:48:24.900 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:48:25.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d0b600640 1 Processor -- start 2024-04-26T23:48:25.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d0b600640 1 -- start start 2024-04-26T23:48:25.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d0b600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d04162a30 0x7f8d040d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:25.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d0b600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f8d040b1690 0x7f8d040d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:25.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d0b600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d040cf840 con 0x7f8d0406c400 2024-04-26T23:48:25.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d0b600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f8d040d1c70 con 0x7f8d040b1690 2024-04-26T23:48:25.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d0b600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d040ce830 con 0x7f8d04162a30 2024-04-26T23:48:25.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d03e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8d0406c400 0x7f8d04073260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:35794/0 (socket says 172.21.15.47:35794) 2024-04-26T23:48:25.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d03e00640 1 -- 172.21.15.47:0/1071963390 learned_addr learned my addr 172.21.15.47:0/1071963390 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:25.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d09600640 1 --2- 172.21.15.47:0/1071963390 >> v2:172.21.15.203:3300/0 conn(0x7f8d040b1690 0x7f8d040d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:25.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.034+0000 7f8d08c00640 1 --2- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d04162a30 0x7f8d040d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:25.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d03400640 1 -- 172.21.15.47:0/1071963390 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546581394 0 0) 0x7f8d040cf840 con 0x7f8d0406c400 2024-04-26T23:48:25.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d03400640 1 -- 172.21.15.47:0/1071963390 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cec003530 con 0x7f8d0406c400 2024-04-26T23:48:25.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d09600640 1 -- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d04162a30 msgr2=0x7f8d040d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:25.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d09600640 1 --2- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d04162a30 0x7f8d040d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d09600640 1 -- 172.21.15.47:0/1071963390 >> v1:172.21.15.47:6789/0 conn(0x7f8d0406c400 legacy=0x7f8d04073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:25.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d09600640 1 -- 172.21.15.47:0/1071963390 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d040cea80 con 0x7f8d040b1690 2024-04-26T23:48:25.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d09600640 1 --2- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b1690 0x7f8d040d0920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009d90 tx=0x7f8cfc01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f08f5caee5e3ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:25.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d03400640 1 -- 172.21.15.47:0/1071963390 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0b2070 con 0x7f8d040b1690 2024-04-26T23:48:25.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d03400640 1 -- 172.21.15.47:0/1071963390 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cfc0a5970 con 0x7f8d040b1690 2024-04-26T23:48:25.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.038+0000 7f8d03400640 1 -- 172.21.15.47:0/1071963390 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0a5d40 con 0x7f8d040b1690 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b1690 msgr2=0x7f8d040d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b1690 0x7f8d040d0920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009d90 tx=0x7f8cfc01c8b0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- 172.21.15.47:0/1071963390 shutdown_connections 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b1690 0x7f8d040d0920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1071963390 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d04162a30 0x7f8d040d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- 172.21.15.47:0/1071963390 >> 172.21.15.47:0/1071963390 conn(0x7f8d040d1df0 msgr2=0x7f8d040d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- 172.21.15.47:0/1071963390 shutdown_connections 2024-04-26T23:48:25.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- 172.21.15.47:0/1071963390 wait complete. 2024-04-26T23:48:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 Processor -- start 2024-04-26T23:48:25.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- start start 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d040b1690 0x7f8d041485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b2e90 0x7f8d04151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d041583c0 0x7f8d04158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f8d040b1230 con 0x7f8d040b1690 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d040b10b0 con 0x7f8d040b2e90 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d0b600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f8d0416bee0 con 0x7f8d041583c0 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d040b1690 0x7f8d041485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d040b1690 0x7f8d041485f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38838/0 (socket says 172.21.15.47:38838) 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 -- 172.21.15.47:0/1941762132 learned_addr learned my addr 172.21.15.47:0/1941762132 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d03e00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b2e90 0x7f8d04151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d09600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d041583c0 0x7f8d04158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:25.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 -- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d041583c0 msgr2=0x7f8d04158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d041583c0 0x7f8d04158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 -- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b2e90 msgr2=0x7f8d04151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b2e90 0x7f8d04151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d08c00640 1 -- 172.21.15.47:0/1941762132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d040b3370 con 0x7f8d040b1690 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.042+0000 7f8d03e00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b2e90 0x7f8d04151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d09600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d041583c0 0x7f8d04158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d08c00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d040b1690 0x7f8d041485f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800e870 tx=0x7f8cf800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d00c00640 1 -- 172.21.15.47:0/1941762132 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8017070 con 0x7f8d040b1690 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d00c00640 1 -- 172.21.15.47:0/1941762132 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf800c940 con 0x7f8d040b1690 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d040b3650 con 0x7f8d040b1690 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d00c00640 1 -- 172.21.15.47:0/1941762132 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800ccf0 con 0x7f8d040b1690 2024-04-26T23:48:25.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d040b3c10 con 0x7f8d040b1690 2024-04-26T23:48:25.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d04069700 con 0x7f8d040b1690 2024-04-26T23:48:25.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d00c00640 1 -- 172.21.15.47:0/1941762132 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f8cf801a070 con 0x7f8d040b1690 2024-04-26T23:48:25.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d00c00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8ce4068650 0x7f8ce406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:25.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d00c00640 1 -- 172.21.15.47:0/1941762132 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f8cf80870c0 con 0x7f8d040b1690 2024-04-26T23:48:25.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.046+0000 7f8d03e00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8ce4068650 0x7f8ce406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:25.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.050+0000 7f8d03e00640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8ce4068650 0x7f8ce406ab10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8d04152550 tx=0x7f8cf0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:25.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.050+0000 7f8d00c00640 1 -- 172.21.15.47:0/1941762132 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f8cf80572f0 con 0x7f8d040b1690 2024-04-26T23:48:25.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.250+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8d04161940 con 0x7f8d040b1690 2024-04-26T23:48:25.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.250+0000 7f8d00c00640 1 -- 172.21.15.47:0/1941762132 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f8cf8056bf0 con 0x7f8d040b1690 2024-04-26T23:48:25.259 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:48:25.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8ce4068650 msgr2=0x7f8ce406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8ce4068650 0x7f8ce406ab10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8d04152550 tx=0x7f8cf0009040 comp rx=0 tx=0).stop 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d040b1690 msgr2=0x7f8d041485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d040b1690 0x7f8d041485f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800e870 tx=0x7f8cf800ec70 comp rx=0 tx=0).stop 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 shutdown_connections 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f8ce4068650 0x7f8ce406ab10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f8d041583c0 0x7f8d04158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d040b2e90 0x7f8d04151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 --2- 172.21.15.47:0/1941762132 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8d040b1690 0x7f8d041485f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 >> 172.21.15.47:0/1941762132 conn(0x7f8d040d1df0 msgr2=0x7f8d04148fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 shutdown_connections 2024-04-26T23:48:25.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25.254+0000 7f8d0b600640 1 -- 172.21.15.47:0/1941762132 wait complete. 2024-04-26T23:48:25.280 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:48:25.280 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:48:25.280 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-04-26T23:48:25.281 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T23:48:25.281 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T23:48:25.281 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:48:25.281 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:48:25.281 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:48:25.281 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:48:25.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:25.281 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-04-26T23:48:25.291 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42229sec preferred_lft 42229sec 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-04-26T23:48:25.292 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 02:42:b5:29:54:0a brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:48:25.293 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:48:25.294 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:25.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:25.295 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:48:25.359 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-04-26T23:48:25.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:25.362 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-04-26T23:48:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-04-26T23:48:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:48:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-26T23:48:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:48:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-26T23:48:25.416 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:48:25.416 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:48:25.416 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-04-26T23:48:25.416 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T23:48:25.416 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T23:48:25.417 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T23:48:25.417 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-04-26T23:48:25.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:48:25.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:48:25.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:25.554 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-26T23:48:25.606 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:48:25.606 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:48:25.607 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:48:25.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:25.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-04-26T23:48:25.669 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T23:48:25.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:48:25.670 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T23:48:25.722 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T23:48:25.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:48:25.723 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:48:25.773 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:48:25.834 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:48:25.887 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:48:25.887 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:48:25.887 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:48:25.887 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:48:25.887 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:48:25.888 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:48:25.889 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:48:25.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:25.890 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:48:25.942 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:48:25.942 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T23:48:25.988 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:48:26.009 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:48:26.059 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:48:26.059 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:48:26.060 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:48:26.061 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:48:26.062 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:48:26.062 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:48:26.062 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:48:26.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:26.063 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:48:26.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-04-26T23:48:26.078+0000 7fb297bc7580 -1 init, newargv = 0x556651b4cc50 newargc=15 2024-04-26T23:48:26.084 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[39532]: starting ceph client 2024-04-26T23:48:26.092 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[39532]: starting fuse 2024-04-26T23:48:27.193 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-04-26T23:48:27.218 DEBUG:teuthology.orchestra.run.smithi047:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:48:27.272 INFO:teuthology.orchestra.run.smithi047.stdout:/sys 2024-04-26T23:48:27.272 INFO:teuthology.orchestra.run.smithi047.stdout:/proc 2024-04-26T23:48:27.272 INFO:teuthology.orchestra.run.smithi047.stdout:/dev 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/pts 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/run 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/ 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/security 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/shm 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/run/lock 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/cgroup 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/pstore 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/bpf 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/hugepages 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/dev/mqueue 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/debug 2024-04-26T23:48:27.273 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/tracing 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/proc/fs/nfsd 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/fs/fuse/connections 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/sys/kernel/config 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/run/rpc_pipefs 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/run/user/1000 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:48:27.274 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:48:27.275 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:48:27.275 INFO:teuthology.orchestra.run.smithi047.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:48:27.275 INFO:teuthology.orchestra.run.smithi047.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-26T23:48:27.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:27.276 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-04-26T23:48:27.327 INFO:teuthology.orchestra.run.smithi047.stdout:44 2024-04-26T23:48:27.327 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-04-26T23:48:27.327 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-04-26T23:48:27.328 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:48:27.329 DEBUG:teuthology.orchestra.run.smithi047:> 2024-04-26T23:48:27.329 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-04-26T23:48:27.329 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-04-26T23:48:27.462 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.39532.asok 2024-04-26T23:48:27.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:48:27.474 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39532.asok 2024-04-26T23:48:27.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:27.474 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39532.asok status 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "39532", 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-04-26T23:48:27.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 6153, 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 6153 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 169537825 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:27.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 169537825 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.6153 172.21.15.47:0/169537825", 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "172.21.15.47:0/169537825", 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 27, 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 51, 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-04-26T23:48:27.658 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-04-26T23:48:27.659 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:48:27.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:27.672 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-04-26T23:48:27.672 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T23:48:27.681 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-04-26T23:48:27.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T23:48:27.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:27.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T23:48:27.742 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T23:48:27.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.914+0000 7f5c18e00640 1 Processor -- start 2024-04-26T23:48:27.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.914+0000 7f5c18e00640 1 -- start start 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c18e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140b4360 0x7f5c140cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c18e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5c1415d5b0 0x7f5c1415da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c18e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5c140cdc00 0x7f5c140ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c18e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5c140ce580 con 0x7f5c140cdc00 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c18e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1415e050 con 0x7f5c1415d5b0 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c18e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1415e330 con 0x7f5c140b4360 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5c140cdc00 0x7f5c140ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5c140cdc00 0x7f5c140ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38848/0 (socket says 172.21.15.47:38848) 2024-04-26T23:48:27.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 -- 172.21.15.47:0/4197303410 learned_addr learned my addr 172.21.15.47:0/4197303410 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:27.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c09400640 1 --2- 172.21.15.47:0/4197303410 >> v2:172.21.15.203:3300/0 conn(0x7f5c1415d5b0 0x7f5c1415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:27.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c11e00640 1 --2- 172.21.15.47:0/4197303410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140b4360 0x7f5c140cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:27.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 -- 172.21.15.47:0/4197303410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140b4360 msgr2=0x7f5c140cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:27.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 --2- 172.21.15.47:0/4197303410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140b4360 0x7f5c140cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:27.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 -- 172.21.15.47:0/4197303410 >> v2:172.21.15.203:3300/0 conn(0x7f5c1415d5b0 msgr2=0x7f5c1415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:27.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 --2- 172.21.15.47:0/4197303410 >> v2:172.21.15.203:3300/0 conn(0x7f5c1415d5b0 0x7f5c1415da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:27.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 -- 172.21.15.47:0/4197303410 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c140ceda0 con 0x7f5c140cdc00 2024-04-26T23:48:27.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c09400640 1 --2- 172.21.15.47:0/4197303410 >> v2:172.21.15.203:3300/0 conn(0x7f5c1415d5b0 0x7f5c1415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:27.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c11e00640 1 --2- 172.21.15.47:0/4197303410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140b4360 0x7f5c140cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:48:27.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.918+0000 7f5c12800640 1 --2- 172.21.15.47:0/4197303410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140cdc00 0x7f5c140ce040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5c140ce7b0 tx=0x7f5c0c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de59c3ec35381c6e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c11400640 1 -- 172.21.15.47:0/4197303410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0b2070 con 0x7f5c140cdc00 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c11400640 1 -- 172.21.15.47:0/4197303410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0a9070 con 0x7f5c140cdc00 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c11400640 1 -- 172.21.15.47:0/4197303410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0ad880 con 0x7f5c140cdc00 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- 172.21.15.47:0/4197303410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140cdc00 msgr2=0x7f5c140ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 --2- 172.21.15.47:0/4197303410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140cdc00 0x7f5c140ce040 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5c140ce7b0 tx=0x7f5c0c01c520 comp rx=0 tx=0).stop 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- 172.21.15.47:0/4197303410 shutdown_connections 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 --2- 172.21.15.47:0/4197303410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140cdc00 0x7f5c140ce040 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:27.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 --2- 172.21.15.47:0/4197303410 >> v2:172.21.15.203:3300/0 conn(0x7f5c1415d5b0 0x7f5c1415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:27.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 --2- 172.21.15.47:0/4197303410 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140b4360 0x7f5c140cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:27.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- 172.21.15.47:0/4197303410 >> 172.21.15.47:0/4197303410 conn(0x7f5c1406c800 msgr2=0x7f5c1406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:27.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- 172.21.15.47:0/4197303410 shutdown_connections 2024-04-26T23:48:27.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- 172.21.15.47:0/4197303410 wait complete. 2024-04-26T23:48:27.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 Processor -- start 2024-04-26T23:48:27.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- start start 2024-04-26T23:48:27.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140b4360 0x7f5c141533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140cdc00 0x7f5c141405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1415d5b0 0x7f5c14073c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5c140b60f0 con 0x7f5c140b4360 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5c140b5f70 con 0x7f5c1415d5b0 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c18e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1415ef80 con 0x7f5c140cdc00 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c11e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140b4360 0x7f5c141533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c11e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140b4360 0x7f5c141533a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:38856/0 (socket says 172.21.15.47:38856) 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c11e00640 1 -- 172.21.15.47:0/2285437035 learned_addr learned my addr 172.21.15.47:0/2285437035 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c12800640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1415d5b0 0x7f5c14073c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.922+0000 7f5c09400640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140cdc00 0x7f5c141405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c11e00640 1 -- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140cdc00 msgr2=0x7f5c141405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c11e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140cdc00 0x7f5c141405c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:27.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c11e00640 1 -- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1415d5b0 msgr2=0x7f5c14073c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c11e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1415d5b0 0x7f5c14073c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c11e00640 1 -- 172.21.15.47:0/2285437035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c14140b00 con 0x7f5c140b4360 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c11e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140b4360 0x7f5c141533a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400cf10 tx=0x7f5c0400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c0aa00640 1 -- 172.21.15.47:0/2285437035 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0401a070 con 0x7f5c140b4360 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c0aa00640 1 -- 172.21.15.47:0/2285437035 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c0400d840 con 0x7f5c140b4360 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c141611e0 con 0x7f5c140b4360 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c0aa00640 1 -- 172.21.15.47:0/2285437035 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400dc10 con 0x7f5c140b4360 2024-04-26T23:48:27.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c14074180 con 0x7f5c140b4360 2024-04-26T23:48:27.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c14161690 con 0x7f5c140b4360 2024-04-26T23:48:27.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c0aa00640 1 -- 172.21.15.47:0/2285437035 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f5c0401d070 con 0x7f5c140b4360 2024-04-26T23:48:27.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c0aa00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bf0068650 0x7f5bf006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:27.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.926+0000 7f5c0aa00640 1 -- 172.21.15.47:0/2285437035 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f5c04087610 con 0x7f5c140b4360 2024-04-26T23:48:27.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.930+0000 7f5c09400640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bf0068650 0x7f5bf006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:27.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.930+0000 7f5c09400640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bf0068650 0x7f5bf006ab10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c14073a30 tx=0x7f5bfc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:27.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:27.934+0000 7f5c0aa00640 1 -- 172.21.15.47:0/2285437035 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5c14161690 con 0x7f5c140b4360 2024-04-26T23:48:28.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.134+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5c14069700 con 0x7f5c140b4360 2024-04-26T23:48:28.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c0aa00640 1 -- 172.21.15.47:0/2285437035 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f5c04057270 con 0x7f5c140b4360 2024-04-26T23:48:28.143 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bf0068650 msgr2=0x7f5bf006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bf0068650 0x7f5bf006ab10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5c14073a30 tx=0x7f5bfc008040 comp rx=0 tx=0).stop 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140b4360 msgr2=0x7f5c141533a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140b4360 0x7f5c141533a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400cf10 tx=0x7f5c0400a710 comp rx=0 tx=0).stop 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 shutdown_connections 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bf0068650 0x7f5bf006ab10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5c1415d5b0 0x7f5c14073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5c140cdc00 0x7f5c141405c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 --2- 172.21.15.47:0/2285437035 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c140b4360 0x7f5c141533a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 >> 172.21.15.47:0/2285437035 conn(0x7f5c1406c800 msgr2=0x7f5c1406cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:28.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 shutdown_connections 2024-04-26T23:48:28.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:28.138+0000 7f5c18e00640 1 -- 172.21.15.47:0/2285437035 wait complete. 2024-04-26T23:48:28.164 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T23:48:28.165 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:48:28.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:28.165 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2024-04-26T23:48:28.175 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2024-04-26T23:48:28.176 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42232sec preferred_lft 42232sec 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 02:42:b9:62:ce:ce brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.177 INFO:teuthology.orchestra.run.smithi203.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-26T23:48:28.178 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-26T23:48:28.179 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2024-04-26T23:48:28.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:28.180 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T23:48:28.246 INFO:teuthology.orchestra.run.smithi203.stdout:1 2024-04-26T23:48:28.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:28.249 DEBUG:teuthology.orchestra.run.smithi203:> route 2024-04-26T23:48:28.301 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T23:48:28.302 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T23:48:28.303 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T23:48:28.303 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2024-04-26T23:48:28.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T23:48:28.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T23:48:28.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T23:48:28.303 DEBUG:teuthology.orchestra.run.smithi203:> ') 2024-04-26T23:48:28.394 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:48:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T23:48:28.437 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:48:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:48:28.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:28.444 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-26T23:48:28.453 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:48:28.453 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:48:28.454 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:48:28.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:28.454 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2024-04-26T23:48:28.515 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-26T23:48:28.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:48:28.515 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-26T23:48:28.566 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-26T23:48:28.566 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T23:48:28.566 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:48:28.613 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:48:28.674 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:48:28.727 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:48:28.728 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:48:28.729 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:48:28.730 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:48:28.730 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:48:28.730 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:48:28.730 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:48:28.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:28.731 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:48:28.786 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T23:48:28.786 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-26T23:48:28.837 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:48:28.858 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:48:28.911 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:48:28.911 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:48:28.912 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:48:28.913 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:48:28.914 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:48:28.914 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:48:28.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:28.915 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:48:28.934 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:2024-04-26T23:48:28.929+0000 7fb19d646580 -1 init, newargv = 0x55cfa6315c00 newargc=15 2024-04-26T23:48:28.934 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33894]: starting ceph client 2024-04-26T23:48:28.942 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33894]: starting fuse 2024-04-26T23:48:30.043 DEBUG:teuthology.orchestra.run.smithi203:> sudo modprobe fuse 2024-04-26T23:48:30.065 DEBUG:teuthology.orchestra.run.smithi203:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T23:48:30.116 INFO:teuthology.orchestra.run.smithi203.stdout:/sys 2024-04-26T23:48:30.116 INFO:teuthology.orchestra.run.smithi203.stdout:/proc 2024-04-26T23:48:30.116 INFO:teuthology.orchestra.run.smithi203.stdout:/dev 2024-04-26T23:48:30.116 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/pts 2024-04-26T23:48:30.116 INFO:teuthology.orchestra.run.smithi203.stdout:/run 2024-04-26T23:48:30.116 INFO:teuthology.orchestra.run.smithi203.stdout:/ 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/security 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/shm 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/run/lock 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/cgroup 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/pstore 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/bpf 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/hugepages 2024-04-26T23:48:30.117 INFO:teuthology.orchestra.run.smithi203.stdout:/dev/mqueue 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/debug 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/tracing 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/proc/fs/nfsd 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/fs/fuse/connections 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/sys/kernel/config 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/run/rpc_pipefs 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/run/user/1000 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph 2024-04-26T23:48:30.118 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-4 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-5 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-6 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/var/lib/ceph/osd/ceph-7 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:48:30.119 INFO:teuthology.orchestra.run.smithi203.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-26T23:48:30.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:30.121 DEBUG:teuthology.orchestra.run.smithi203:> ls /sys/fs/fuse/connections 2024-04-26T23:48:30.170 INFO:teuthology.orchestra.run.smithi203.stdout:44 2024-04-26T23:48:30.170 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> sudo stdin-killer -- python3 -c ' 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> import glob 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> import re 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> import os 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> import subprocess 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> def _find_admin_socket(client_name): 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> files = glob.glob(asok_path) 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:48:30.171 DEBUG:teuthology.orchestra.run.smithi203:> # Given a non-glob path, it better be there 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> if "*" not in asok_path: 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> assert(len(files) == 1) 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> return files[0] 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> for f in files: 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> contents = proc_f.read() 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> if mountpoint in contents: 2024-04-26T23:48:30.172 DEBUG:teuthology.orchestra.run.smithi203:> return f 2024-04-26T23:48:30.173 DEBUG:teuthology.orchestra.run.smithi203:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T23:48:30.173 DEBUG:teuthology.orchestra.run.smithi203:> 2024-04-26T23:48:30.173 DEBUG:teuthology.orchestra.run.smithi203:> print(_find_admin_socket("client.1")) 2024-04-26T23:48:30.173 DEBUG:teuthology.orchestra.run.smithi203:> ' 2024-04-26T23:48:30.303 INFO:teuthology.orchestra.run.smithi203.stdout:/var/run/ceph/ceph-client.1.33894.asok 2024-04-26T23:48:30.307 INFO:teuthology.orchestra.run.smithi203.stderr:2024-04-26T23:48:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T23:48:30.315 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33894.asok 2024-04-26T23:48:30.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:30.315 DEBUG:teuthology.orchestra.run.smithi203:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33894.asok status 2024-04-26T23:48:30.485 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "metadata": { 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_sha1": "bc612ffb9c1d5bc27536bc917a705262a36d4387", 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.0.0-3306-gbc612ffb (bc612ffb9c1d5bc27536bc917a705262a36d4387) squid (dev)", 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "entity_id": "1", 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "hostname": "smithi203", 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "pid": "33894", 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "root": "/" 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_count": 0, 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "dentry_pinned_count": 0, 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "id": 5869, 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "inst": { 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "name": { 2024-04-26T23:48:30.486 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "client", 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "num": 5869 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 3480548602 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": { 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "type": "v1", 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "addr": "192.168.0.1:0", 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "nonce": 3480548602 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "inst_str": "client.5869 192.168.0.1:0/3480548602", 2024-04-26T23:48:30.487 INFO:teuthology.orchestra.run.smithi203.stdout: "addr_str": "192.168.0.1:0/3480548602", 2024-04-26T23:48:30.488 INFO:teuthology.orchestra.run.smithi203.stdout: "inode_count": 1, 2024-04-26T23:48:30.488 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_epoch": 27, 2024-04-26T23:48:30.488 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch": 51, 2024-04-26T23:48:30.488 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_epoch_barrier": 0, 2024-04-26T23:48:30.488 INFO:teuthology.orchestra.run.smithi203.stdout: "blocklisted": false, 2024-04-26T23:48:30.488 INFO:teuthology.orchestra.run.smithi203.stdout: "fs_name": "cephfs" 2024-04-26T23:48:30.488 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-04-26T23:48:30.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:30.502 DEBUG:teuthology.orchestra.run.smithi203:> stat --file-system '--printf=%T 2024-04-26T23:48:30.502 DEBUG:teuthology.orchestra.run.smithi203:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-26T23:48:30.511 INFO:teuthology.orchestra.run.smithi203.stdout:fuseblk 2024-04-26T23:48:30.511 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-26T23:48:30.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:48:30.511 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-26T23:48:30.577 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-04-26T23:48:30.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.726+0000 7f32b6200640 1 Processor -- start 2024-04-26T23:48:30.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.726+0000 7f32b6200640 1 -- start start 2024-04-26T23:48:30.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.726+0000 7f32b6200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b0072960 0x7f32b0160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.726+0000 7f32b6200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f32b006fc10 0x7f32b0163500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.726+0000 7f32b6200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b0073960 con 0x7f32b0072d40 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.726+0000 7f32b6200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f32b00b62e0 con 0x7f32b006fc10 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.726+0000 7f32b6200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f32b01607c0 con 0x7f32b0072960 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32afe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f32b006fc10 0x7f32b0163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32a6a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f32b0072d40 0x7f32b0162df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55148/0 (socket says 172.21.15.47:55148) 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32afe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f32b006fc10 0x7f32b0163500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35820/0 (socket says 172.21.15.47:35820) 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32a6a00640 1 -- 172.21.15.47:0/3828212131 learned_addr learned my addr 172.21.15.47:0/3828212131 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32af400640 1 --2- 172.21.15.47:0/3828212131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b0072960 0x7f32b0160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32afe00640 1 -- 172.21.15.47:0/3828212131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b0072960 msgr2=0x7f32b0160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32afe00640 1 --2- 172.21.15.47:0/3828212131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b0072960 0x7f32b0160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32afe00640 1 -- 172.21.15.47:0/3828212131 >> v1:172.21.15.47:6789/0 conn(0x7f32b0072d40 legacy=0x7f32b0162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32aea00640 1 -- 172.21.15.47:0/3828212131 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115028161 0 0) 0x7f32b0073960 con 0x7f32b0072d40 2024-04-26T23:48:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32afe00640 1 -- 172.21.15.47:0/3828212131 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b00b56d0 con 0x7f32b006fc10 2024-04-26T23:48:30.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32afe00640 1 --2- 172.21.15.47:0/3828212131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b006fc10 0x7f32b0163500 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009d90 tx=0x7f32a801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14516f1f0b675274 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32aea00640 1 -- 172.21.15.47:0/3828212131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80b2070 con 0x7f32b006fc10 2024-04-26T23:48:30.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32aea00640 1 -- 172.21.15.47:0/3828212131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a80a5970 con 0x7f32b006fc10 2024-04-26T23:48:30.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.730+0000 7f32aea00640 1 -- 172.21.15.47:0/3828212131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a80a5d40 con 0x7f32b006fc10 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- 172.21.15.47:0/3828212131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b006fc10 msgr2=0x7f32b0163500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 --2- 172.21.15.47:0/3828212131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b006fc10 0x7f32b0163500 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009d90 tx=0x7f32a801c8b0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- 172.21.15.47:0/3828212131 shutdown_connections 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 --2- 172.21.15.47:0/3828212131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b006fc10 0x7f32b0163500 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 --2- 172.21.15.47:0/3828212131 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b0072960 0x7f32b0160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- 172.21.15.47:0/3828212131 >> 172.21.15.47:0/3828212131 conn(0x7f32b0070bc0 msgr2=0x7f32b006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- 172.21.15.47:0/3828212131 shutdown_connections 2024-04-26T23:48:30.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- 172.21.15.47:0/3828212131 wait complete. 2024-04-26T23:48:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 Processor -- start 2024-04-26T23:48:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- start start 2024-04-26T23:48:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b006fc10 0x7f32b00cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b0072960 0x7f32b015dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f32b0072d40 0x7f32b014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00732e0 con 0x7f32b0072960 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f32b0073160 con 0x7f32b0072d40 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32b6200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f32b015d0b0 con 0x7f32b006fc10 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b0072960 0x7f32b015dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b0072960 0x7f32b015dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35828/0 (socket says 172.21.15.47:35828) 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 -- 172.21.15.47:0/2976310317 learned_addr learned my addr 172.21.15.47:0/2976310317 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 -- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b006fc10 msgr2=0x7f32b00cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b006fc10 0x7f32b00cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 -- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f32b0072d40 msgr2=0x7f32b014cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f32b0072d40 0x7f32b014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.734+0000 7f32a6a00640 1 -- 172.21.15.47:0/2976310317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b00cc770 con 0x7f32b0072960 2024-04-26T23:48:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32a6a00640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b0072960 0x7f32b015dfa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f32980011f0 tx=0x7f329800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32a7e00640 1 -- 172.21.15.47:0/2976310317 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298018070 con 0x7f32b0072960 2024-04-26T23:48:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32a7e00640 1 -- 172.21.15.47:0/2976310317 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32980074e0 con 0x7f32b0072960 2024-04-26T23:48:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32a7e00640 1 -- 172.21.15.47:0/2976310317 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298004a10 con 0x7f32b0072960 2024-04-26T23:48:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b00cca50 con 0x7f32b0072960 2024-04-26T23:48:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b015e4e0 con 0x7f32b0072960 2024-04-26T23:48:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b00cce40 con 0x7f32b0072960 2024-04-26T23:48:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32a7e00640 1 -- 172.21.15.47:0/2976310317 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f329801b070 con 0x7f32b0072960 2024-04-26T23:48:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32a7e00640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f328c068650 0x7f328c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32a7e00640 1 -- 172.21.15.47:0/2976310317 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f32980861c0 con 0x7f32b0072960 2024-04-26T23:48:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.738+0000 7f32af400640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f328c068650 0x7f328c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:30.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.742+0000 7f32af400640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f328c068650 0x7f328c06ab10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32a0006aa0 tx=0x7f32a0006a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:30.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.742+0000 7f32a7e00640 1 -- 172.21.15.47:0/2976310317 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f32980563a0 con 0x7f32b0072960 2024-04-26T23:48:30.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:30.946+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f32b00695f0 con 0x7f32b0072960 2024-04-26T23:48:31.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.902+0000 7f32a7e00640 1 -- 172.21.15.47:0/2976310317 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v28) ==== 136+0+0 (secure 0 0 0) 0x7f3298055ca0 con 0x7f32b0072960 2024-04-26T23:48:31.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f328c068650 msgr2=0x7f328c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f328c068650 0x7f328c06ab10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f32a0006aa0 tx=0x7f32a0006a30 comp rx=0 tx=0).stop 2024-04-26T23:48:31.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b0072960 msgr2=0x7f32b015dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:31.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b0072960 0x7f32b015dfa0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f32980011f0 tx=0x7f329800c9b0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 shutdown_connections 2024-04-26T23:48:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f328c068650 0x7f328c06ab10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f32b0072d40 0x7f32b014cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f32b0072960 0x7f32b015dfa0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 --2- 172.21.15.47:0/2976310317 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f32b006fc10 0x7f32b00cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 >> 172.21.15.47:0/2976310317 conn(0x7f32b0070bc0 msgr2=0x7f32b00cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 shutdown_connections 2024-04-26T23:48:31.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:31.906+0000 7f32b6200640 1 -- 172.21.15.47:0/2976310317 wait complete. 2024-04-26T23:48:31.935 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-04-26T23:48:32.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.074+0000 7f4113e00640 1 Processor -- start 2024-04-26T23:48:32.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.074+0000 7f4113e00640 1 -- start start 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4113e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f410c072d80 0x7f410c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4113e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f410c0739a0 con 0x7f410c06f180 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4113e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f410c0b56d0 con 0x7f410c0729a0 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4113e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f410c0b62e0 con 0x7f410c072d80 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4110a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f410c072d80 0x7f410c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4111e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f410c06f180 0x7f410c06f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55150/0 (socket says 172.21.15.47:55150) 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4111e00640 1 -- 172.21.15.47:0/4242307739 learned_addr learned my addr 172.21.15.47:0/4242307739 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:32.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4110a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f410c072d80 0x7f410c06ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35844/0 (socket says 172.21.15.47:35844) 2024-04-26T23:48:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4110a00640 1 -- 172.21.15.47:0/4242307739 >> v1:172.21.15.203:6789/0 conn(0x7f410c0729a0 legacy=0x7f410c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4110a00640 1 -- 172.21.15.47:0/4242307739 >> v1:172.21.15.47:6789/0 conn(0x7f410c06f180 legacy=0x7f410c06f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f410be00640 1 -- 172.21.15.47:0/4242307739 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851484511 0 0) 0x7f410c0739a0 con 0x7f410c06f180 2024-04-26T23:48:32.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.078+0000 7f4110a00640 1 -- 172.21.15.47:0/4242307739 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c0b59b0 con 0x7f410c072d80 2024-04-26T23:48:32.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4110a00640 1 --2- 172.21.15.47:0/4242307739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c072d80 0x7f410c06ec40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f40f80097c0 tx=0x7f40f801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7d47d7e3fafb52 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f410be00640 1 -- 172.21.15.47:0/4242307739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f80b1070 con 0x7f410c072d80 2024-04-26T23:48:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f410be00640 1 -- 172.21.15.47:0/4242307739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f80a8050 con 0x7f410c072d80 2024-04-26T23:48:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f410be00640 1 -- 172.21.15.47:0/4242307739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f80ac860 con 0x7f410c072d80 2024-04-26T23:48:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- 172.21.15.47:0/4242307739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c072d80 msgr2=0x7f410c06ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 --2- 172.21.15.47:0/4242307739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c072d80 0x7f410c06ec40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f40f80097c0 tx=0x7f40f801c3e0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- 172.21.15.47:0/4242307739 shutdown_connections 2024-04-26T23:48:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 --2- 172.21.15.47:0/4242307739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c072d80 0x7f410c06ec40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- 172.21.15.47:0/4242307739 >> 172.21.15.47:0/4242307739 conn(0x7f410c070c00 msgr2=0x7f410c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- 172.21.15.47:0/4242307739 shutdown_connections 2024-04-26T23:48:32.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- 172.21.15.47:0/4242307739 wait complete. 2024-04-26T23:48:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 Processor -- start 2024-04-26T23:48:32.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- start start 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f410c06f180 0x7f410c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c0729a0 0x7f410c14d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410c072d80 0x7f410c161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f410c15d230 con 0x7f410c0729a0 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f410c15d0b0 con 0x7f410c072d80 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4113e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f410c0b5280 con 0x7f410c06f180 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4110a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c0729a0 0x7f410c14d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4110a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c0729a0 0x7f410c14d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35852/0 (socket says 172.21.15.47:35852) 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.082+0000 7f4110a00640 1 -- 172.21.15.47:0/1071285558 learned_addr learned my addr 172.21.15.47:0/1071285558 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4111400640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f410c06f180 0x7f410c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4111e00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410c072d80 0x7f410c161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4110a00640 1 -- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f410c06f180 msgr2=0x7f410c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4110a00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f410c06f180 0x7f410c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4110a00640 1 -- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410c072d80 msgr2=0x7f410c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4110a00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410c072d80 0x7f410c161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4110a00640 1 -- 172.21.15.47:0/1071285558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c15d530 con 0x7f410c0729a0 2024-04-26T23:48:32.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4110a00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c0729a0 0x7f410c14d3b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f40f80af040 tx=0x7f40f8019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4109600640 1 -- 172.21.15.47:0/1071285558 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f80c0070 con 0x7f410c0729a0 2024-04-26T23:48:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4109600640 1 -- 172.21.15.47:0/1071285558 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f80ace20 con 0x7f410c0729a0 2024-04-26T23:48:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410c15d810 con 0x7f410c0729a0 2024-04-26T23:48:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4109600640 1 -- 172.21.15.47:0/1071285558 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f80b1040 con 0x7f410c0729a0 2024-04-26T23:48:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410c15c880 con 0x7f410c0729a0 2024-04-26T23:48:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f410c160600 con 0x7f410c0729a0 2024-04-26T23:48:32.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4109600640 1 -- 172.21.15.47:0/1071285558 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f40f80c3070 con 0x7f410c0729a0 2024-04-26T23:48:32.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4109600640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f40ec068650 0x7f40ec06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.086+0000 7f4109600640 1 -- 172.21.15.47:0/1071285558 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f40f8120a70 con 0x7f410c0729a0 2024-04-26T23:48:32.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.090+0000 7f4111400640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f40ec068650 0x7f40ec06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.090+0000 7f4111400640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f40ec068650 0x7f40ec06ab10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f410c0b3750 tx=0x7f4100009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.094+0000 7f4109600640 1 -- 172.21.15.47:0/1071285558 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f40f8016090 con 0x7f410c0729a0 2024-04-26T23:48:32.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.278+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f410c15d9e0 con 0x7f40ec068650 2024-04-26T23:48:32.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4109600640 1 -- 172.21.15.47:0/1071285558 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f410c15d9e0 con 0x7f40ec068650 2024-04-26T23:48:32.287 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-04-26T23:48:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-04-26T23:48:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "name": "cephfs" 2024-04-26T23:48:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-04-26T23:48:32.287 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f40ec068650 msgr2=0x7f40ec06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f40ec068650 0x7f40ec06ab10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f410c0b3750 tx=0x7f4100009040 comp rx=0 tx=0).stop 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c0729a0 msgr2=0x7f410c14d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c0729a0 0x7f410c14d3b0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f40f80af040 tx=0x7f40f8019180 comp rx=0 tx=0).stop 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 shutdown_connections 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f40ec068650 0x7f40ec06ab10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410c072d80 0x7f410c161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f410c0729a0 0x7f410c14d3b0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 --2- 172.21.15.47:0/1071285558 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f410c06f180 0x7f410c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 >> 172.21.15.47:0/1071285558 conn(0x7f410c070c00 msgr2=0x7f410c1578f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 shutdown_connections 2024-04-26T23:48:32.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.282+0000 7f4113e00640 1 -- 172.21.15.47:0/1071285558 wait complete. 2024-04-26T23:48:32.308 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-26T23:48:32.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 Processor -- start 2024-04-26T23:48:32.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 -- start start 2024-04-26T23:48:32.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc15cf50 0x7f11cc0cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f11cc0d04b0 0x7f11cc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11cc06cb70 0x7f11cc0720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc0af7a0 con 0x7f11cc06cb70 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc06d000 con 0x7f11cc0d04b0 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d4200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc0ae030 con 0x7f11cc15cf50 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11cc06cb70 0x7f11cc0720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11cc06cb70 0x7f11cc0720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35864/0 (socket says 172.21.15.47:35864) 2024-04-26T23:48:32.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 -- 172.21.15.47:0/1821146291 learned_addr learned my addr 172.21.15.47:0/1821146291 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d1800640 1 --2- 172.21.15.47:0/1821146291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc15cf50 0x7f11cc0cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d0e00640 1 --2- 172.21.15.47:0/1821146291 >> v2:172.21.15.203:3300/0 conn(0x7f11cc0d04b0 0x7f11cc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 -- 172.21.15.47:0/1821146291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc15cf50 msgr2=0x7f11cc0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 --2- 172.21.15.47:0/1821146291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc15cf50 0x7f11cc0cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 -- 172.21.15.47:0/1821146291 >> v2:172.21.15.203:3300/0 conn(0x7f11cc0d04b0 msgr2=0x7f11cc06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 --2- 172.21.15.47:0/1821146291 >> v2:172.21.15.203:3300/0 conn(0x7f11cc0d04b0 0x7f11cc06c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.446+0000 7f11d2200640 1 -- 172.21.15.47:0/1821146291 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc0d0ae0 con 0x7f11cc06cb70 2024-04-26T23:48:32.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d2200640 1 --2- 172.21.15.47:0/1821146291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc0720c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f11cc070410 tx=0x7f11c401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227db0c7c9cbd6d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11cbe00640 1 -- 172.21.15.47:0/1821146291 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c40ac070 con 0x7f11cc06cb70 2024-04-26T23:48:32.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11cbe00640 1 -- 172.21.15.47:0/1821146291 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c40a8420 con 0x7f11cc06cb70 2024-04-26T23:48:32.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11cbe00640 1 -- 172.21.15.47:0/1821146291 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c40a87f0 con 0x7f11cc06cb70 2024-04-26T23:48:32.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 -- 172.21.15.47:0/1821146291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 msgr2=0x7f11cc0720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 --2- 172.21.15.47:0/1821146291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc0720c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f11cc070410 tx=0x7f11c401c730 comp rx=0 tx=0).stop 2024-04-26T23:48:32.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 -- 172.21.15.47:0/1821146291 shutdown_connections 2024-04-26T23:48:32.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 --2- 172.21.15.47:0/1821146291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc0720c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 --2- 172.21.15.47:0/1821146291 >> v2:172.21.15.203:3300/0 conn(0x7f11cc0d04b0 0x7f11cc06c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 --2- 172.21.15.47:0/1821146291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc15cf50 0x7f11cc0cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 -- 172.21.15.47:0/1821146291 >> 172.21.15.47:0/1821146291 conn(0x7f11cc0b2b70 msgr2=0x7f11cc0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 -- 172.21.15.47:0/1821146291 shutdown_connections 2024-04-26T23:48:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.450+0000 7f11d4200640 1 -- 172.21.15.47:0/1821146291 wait complete. 2024-04-26T23:48:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 Processor -- start 2024-04-26T23:48:32.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 -- start start 2024-04-26T23:48:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc09d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc0d04b0 0x7f11cc14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11cc15cf50 0x7f11cc15b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0b3c40 con 0x7f11cc06cb70 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc15d330 con 0x7f11cc15cf50 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc0b3dc0 con 0x7f11cc0d04b0 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc09d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc09d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35874/0 (socket says 172.21.15.47:35874) 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 -- 172.21.15.47:0/2571221118 learned_addr learned my addr 172.21.15.47:0/2571221118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d0e00640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc0d04b0 0x7f11cc14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d2200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11cc15cf50 0x7f11cc15b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 -- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc0d04b0 msgr2=0x7f11cc14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc0d04b0 0x7f11cc14eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 -- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11cc15cf50 msgr2=0x7f11cc15b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11cc15cf50 0x7f11cc15b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 -- 172.21.15.47:0/2571221118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc09c510 con 0x7f11cc06cb70 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d2200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11cc15cf50 0x7f11cc15b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:32.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d0e00640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc0d04b0 0x7f11cc14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:48:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d1800640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc09d5b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f11c000d800 tx=0x7f11c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11c9600640 1 -- 172.21.15.47:0/2571221118 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c000b6c0 con 0x7f11cc06cb70 2024-04-26T23:48:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11c9600640 1 -- 172.21.15.47:0/2571221118 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c0019070 con 0x7f11cc06cb70 2024-04-26T23:48:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11cc09c7f0 con 0x7f11cc06cb70 2024-04-26T23:48:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11c9600640 1 -- 172.21.15.47:0/2571221118 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c000ba60 con 0x7f11cc06cb70 2024-04-26T23:48:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.454+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11cc09cdb0 con 0x7f11cc06cb70 2024-04-26T23:48:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.458+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11cc069700 con 0x7f11cc06cb70 2024-04-26T23:48:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.458+0000 7f11c9600640 1 -- 172.21.15.47:0/2571221118 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f11c000bc00 con 0x7f11cc06cb70 2024-04-26T23:48:32.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.458+0000 7f11c9600640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f11ac068680 0x7f11ac06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.458+0000 7f11c9600640 1 -- 172.21.15.47:0/2571221118 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f11c0087280 con 0x7f11cc06cb70 2024-04-26T23:48:32.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.458+0000 7f11d0e00640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f11ac068680 0x7f11ac06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.458+0000 7f11d0e00640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f11ac068680 0x7f11ac06ab40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11b8004660 tx=0x7f11b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.462+0000 7f11c9600640 1 -- 172.21.15.47:0/2571221118 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f11c0057500 con 0x7f11cc06cb70 2024-04-26T23:48:32.509 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:32.512 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:48:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f11cc073d50 con 0x7f11cc06cb70 2024-04-26T23:48:32.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11c9600640 1 -- 172.21.15.47:0/2571221118 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f11c0056e00 con 0x7f11cc06cb70 2024-04-26T23:48:32.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f11ac068680 msgr2=0x7f11ac06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f11ac068680 0x7f11ac06ab40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11b8004660 tx=0x7f11b8008040 comp rx=0 tx=0).stop 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 msgr2=0x7f11cc09d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc09d5b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f11c000d800 tx=0x7f11c000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 shutdown_connections 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f11ac068680 0x7f11ac06ab40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11cc15cf50 0x7f11cc15b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f11cc0d04b0 0x7f11cc14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 --2- 172.21.15.47:0/2571221118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11cc06cb70 0x7f11cc09d5b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 >> 172.21.15.47:0/2571221118 conn(0x7f11cc0b2b70 msgr2=0x7f11cc0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 shutdown_connections 2024-04-26T23:48:32.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.634+0000 7f11d4200640 1 -- 172.21.15.47:0/2571221118 wait complete. 2024-04-26T23:48:32.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol85370 --mode=777 2024-04-26T23:48:32.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.798+0000 7f58ed000640 1 Processor -- start 2024-04-26T23:48:32.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58ed000640 1 -- start start 2024-04-26T23:48:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58ed000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f58e815d2f0 0x7f58e8073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58ed000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e80b46a0 con 0x7f58e80cd6e0 2024-04-26T23:48:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58ed000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e80b4980 con 0x7f58e80b41e0 2024-04-26T23:48:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58ed000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f58e80b4c60 con 0x7f58e815d2f0 2024-04-26T23:48:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f58e80cd6e0 0x7f58e80cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:55158/0 (socket says 172.21.15.47:55158) 2024-04-26T23:48:32.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 -- 172.21.15.47:0/600750574 learned_addr learned my addr 172.21.15.47:0/600750574 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e6800640 1 --2- 172.21.15.47:0/600750574 >> v2:172.21.15.203:3300/0 conn(0x7f58e815d2f0 0x7f58e8073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861758623 0 0) 0x7f58e80b46a0 con 0x7f58e80cd6e0 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58cc003530 con 0x7f58e80cd6e0 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1080204344 0 0) 0x7f58cc003530 con 0x7f58e80cd6e0 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 >> v2:172.21.15.203:3300/0 conn(0x7f58e815d2f0 msgr2=0x7f58e8073cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 --2- 172.21.15.47:0/600750574 >> v2:172.21.15.203:3300/0 conn(0x7f58e815d2f0 0x7f58e8073cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 >> v1:172.21.15.203:6789/0 conn(0x7f58e80b41e0 legacy=0x7f58e80ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e80b4f40 con 0x7f58e80cd6e0 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f58d8001680 con 0x7f58e80cd6e0 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 >> v1:172.21.15.47:6789/0 conn(0x7f58e80cd6e0 legacy=0x7f58e80cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58cc0039c0 0x7f58cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f58cc004810 0x7f58cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58cc0051d0 0x7f58cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58e80b4c60 con 0x7f58cc0039c0 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc00c070 con 0x7f58cc0051d0 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f58cc00c270 con 0x7f58cc004810 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58cc0039c0 0x7f58cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e6800640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58cc0051d0 0x7f58cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58dfe00640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f58cc004810 0x7f58cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 -- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f58cc004810 msgr2=0x7f58cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f58cc004810 0x7f58cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 -- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58cc0051d0 msgr2=0x7f58cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58cc0051d0 0x7f58cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e5e00640 1 -- 172.21.15.47:0/600750574 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc003530 con 0x7f58cc0039c0 2024-04-26T23:48:32.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.802+0000 7f58e6800640 1 -- 172.21.15.47:0/600750574 reap_dead start 2024-04-26T23:48:32.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58e5e00640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58cc0039c0 0x7f58cc003de0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f58d800c210 tx=0x7f58d801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36d5e983508db5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8007d40 con 0x7f58cc0039c0 2024-04-26T23:48:32.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d80a9070 con 0x7f58cc0039c0 2024-04-26T23:48:32.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58e5400640 1 -- 172.21.15.47:0/600750574 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8005d80 con 0x7f58cc0039c0 2024-04-26T23:48:32.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58ed000640 1 -- 172.21.15.47:0/600750574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58cc0039c0 msgr2=0x7f58cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58ed000640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58cc0039c0 0x7f58cc003de0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f58d800c210 tx=0x7f58d801cc20 comp rx=0 tx=0).stop 2024-04-26T23:48:32.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58ed000640 1 -- 172.21.15.47:0/600750574 shutdown_connections 2024-04-26T23:48:32.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58ed000640 1 --2- 172.21.15.47:0/600750574 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58cc0039c0 0x7f58cc003de0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58ed000640 1 -- 172.21.15.47:0/600750574 >> 172.21.15.47:0/600750574 conn(0x7f58e80d0c90 msgr2=0x7f58e80d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:48:32.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58ed000640 1 -- 172.21.15.47:0/600750574 shutdown_connections 2024-04-26T23:48:32.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.806+0000 7f58ed000640 1 -- 172.21.15.47:0/600750574 wait complete. 2024-04-26T23:48:32.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 Processor -- start 2024-04-26T23:48:32.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 -- start start 2024-04-26T23:48:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f58cc0039c0 0x7f58e81537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58e815e0e0 0x7f58e8148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58e815ba20 0x7f58e815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f58e80cde50 con 0x7f58e815ba20 2024-04-26T23:48:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f58e80cdcd0 con 0x7f58e815e0e0 2024-04-26T23:48:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f58e80cdfd0 con 0x7f58cc0039c0 2024-04-26T23:48:32.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58e815ba20 0x7f58e815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58e815ba20 0x7f58e815bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35888/0 (socket says 172.21.15.47:35888) 2024-04-26T23:48:32.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 -- 172.21.15.47:0/2912165124 learned_addr learned my addr 172.21.15.47:0/2912165124 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:48:32.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 -- 172.21.15.47:0/2912165124 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f58cc0039c0 msgr2=0x7f58e81537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 --2- 172.21.15.47:0/2912165124 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f58cc0039c0 0x7f58e81537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 -- 172.21.15.47:0/2912165124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58e815e0e0 msgr2=0x7f58e8148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:48:32.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 --2- 172.21.15.47:0/2912165124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58e815e0e0 0x7f58e8148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:48:32.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 -- 172.21.15.47:0/2912165124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e815e560 con 0x7f58e815ba20 2024-04-26T23:48:32.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58e6800640 1 --2- 172.21.15.47:0/2912165124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f58e815ba20 0x7f58e815bea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f58e806d430 tx=0x7f58e000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58de000640 1 -- 172.21.15.47:0/2912165124 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e000fc80 con 0x7f58e815ba20 2024-04-26T23:48:32.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58de000640 1 -- 172.21.15.47:0/2912165124 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e000fe20 con 0x7f58e815ba20 2024-04-26T23:48:32.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58de000640 1 -- 172.21.15.47:0/2912165124 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e0015670 con 0x7f58e815ba20 2024-04-26T23:48:32.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 -- 172.21.15.47:0/2912165124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e815e830 con 0x7f58e815ba20 2024-04-26T23:48:32.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 -- 172.21.15.47:0/2912165124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e815edf0 con 0x7f58e815ba20 2024-04-26T23:48:32.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.810+0000 7f58ed000640 1 -- 172.21.15.47:0/2912165124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e80695f0 con 0x7f58e815ba20 2024-04-26T23:48:32.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.814+0000 7f58de000640 1 -- 172.21.15.47:0/2912165124 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f58e0015810 con 0x7f58e815ba20 2024-04-26T23:48:32.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.814+0000 7f58de000640 1 --2- 172.21.15.47:0/2912165124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58c4068680 0x7f58c406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:48:32.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.814+0000 7f58de000640 1 -- 172.21.15.47:0/2912165124 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f58e0087a90 con 0x7f58e815ba20 2024-04-26T23:48:32.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.814+0000 7f58e5e00640 1 --2- 172.21.15.47:0/2912165124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58c4068680 0x7f58c406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:48:32.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.814+0000 7f58e5e00640 1 --2- 172.21.15.47:0/2912165124 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58c4068680 0x7f58c406ab40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f58d80ab000 tx=0x7f58d8001a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:48:32.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:32.818+0000 7f58de000640 1 -- 172.21.15.47:0/2912165124 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f58e0024030 con 0x7f58e815ba20 2024-04-26T23:48:33.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:48:33.006+0000 7f58ed000640 1 -- 172.21.15.47:0/2912165124 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol85370", "mode": "777", "target": ["mon-mgr", ""]}) -- 0x7f58e80ceb90 con 0x7f58c4068680 2024-04-26T23:49:02.564 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:02.568 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:32.619 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:49:32.623 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:02.681 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:02.685 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:32.689 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-26T23:50:32.689 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-26T23:50:32.690 DEBUG:teuthology.orchestra.run.smithi047:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:50:32.748 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:32.752 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:50:32.804 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-26T23:50:32.899 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-26T23:50:32.899 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:50:32.900 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:50:32.900 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:32.909 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:50:32.909 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:32.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:33.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.152+0000 7fdc1ca00640 1 Processor -- start 2024-04-26T23:50:33.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.152+0000 7fdc1ca00640 1 -- start start 2024-04-26T23:50:33.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.152+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 0x7fdc180cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.152+0000 7fdc1ca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fdc180d3420 0x7fdc180d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.152+0000 7fdc1ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1806df00 con 0x7fdc1806d510 2024-04-26T23:50:33.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.152+0000 7fdc1ca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fdc1806e1e0 con 0x7fdc180d3420 2024-04-26T23:50:33.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.152+0000 7fdc1ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1806e4c0 con 0x7fdc1815f290 2024-04-26T23:50:33.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fdc1806d510 0x7fdc180d2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49020/0 (socket says 172.21.15.47:49020) 2024-04-26T23:50:33.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15e00640 1 -- 172.21.15.47:0/2540142156 learned_addr learned my addr 172.21.15.47:0/2540142156 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc16800640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 0x7fdc180cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc17200640 1 --2- 172.21.15.47:0/2540142156 >> v2:172.21.15.203:3300/0 conn(0x7fdc180d3420 0x7fdc180d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230111870 0 0) 0x7fdc1806df00 con 0x7fdc1806d510 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbfc003530 con 0x7fdc1806d510 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3183561917 0 0) 0x7fdbfc003530 con 0x7fdc1806d510 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 msgr2=0x7fdc180cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 0x7fdc180cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 >> v2:172.21.15.203:3300/0 conn(0x7fdc180d3420 msgr2=0x7fdc180d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 --2- 172.21.15.47:0/2540142156 >> v2:172.21.15.203:3300/0 conn(0x7fdc180d3420 0x7fdc180d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc180d1120 con 0x7fdc1806d510 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fdc04001680 con 0x7fdc1806d510 2024-04-26T23:50:33.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 >> v1:172.21.15.47:6789/0 conn(0x7fdc1806d510 legacy=0x7fdc180d2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbfc0039c0 0x7fdbfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 0x7fdbfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbfc004d50 0x7fdbfc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1806e1e0 con 0x7fdbfc004d50 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1806e4c0 con 0x7fdbfc0039c0 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdbfc00b9d0 con 0x7fdc1815f290 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc17200640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbfc004d50 0x7fdbfc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc16800640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbfc0039c0 0x7fdbfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15e00640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 0x7fdbfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc17200640 1 -- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 msgr2=0x7fdbfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc17200640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 0x7fdbfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc17200640 1 -- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbfc0039c0 msgr2=0x7fdbfc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc17200640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbfc0039c0 0x7fdbfc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc17200640 1 -- 172.21.15.47:0/2540142156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbfc003530 con 0x7fdbfc004d50 2024-04-26T23:50:33.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.156+0000 7fdc15e00640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdc1815f290 0x7fdbfc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc17200640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbfc004d50 0x7fdbfc0051d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009f90 tx=0x7fdc1001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85accf6e121ee9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100b2070 con 0x7fdbfc004d50 2024-04-26T23:50:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc100a5c90 con 0x7fdbfc004d50 2024-04-26T23:50:33.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc15400640 1 -- 172.21.15.47:0/2540142156 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc10009c10 con 0x7fdbfc004d50 2024-04-26T23:50:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 -- 172.21.15.47:0/2540142156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbfc004d50 msgr2=0x7fdbfc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 --2- 172.21.15.47:0/2540142156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdbfc004d50 0x7fdbfc0051d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009f90 tx=0x7fdc1001cc80 comp rx=0 tx=0).stop 2024-04-26T23:50:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc17200640 1 -- 172.21.15.47:0/2540142156 reap_dead start 2024-04-26T23:50:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 -- 172.21.15.47:0/2540142156 shutdown_connections 2024-04-26T23:50:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 -- 172.21.15.47:0/2540142156 >> 172.21.15.47:0/2540142156 conn(0x7fdc1809ba60 msgr2=0x7fdc1809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 -- 172.21.15.47:0/2540142156 shutdown_connections 2024-04-26T23:50:33.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 -- 172.21.15.47:0/2540142156 wait complete. 2024-04-26T23:50:33.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 Processor -- start 2024-04-26T23:50:33.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.160+0000 7fdc1ca00640 1 -- start start 2024-04-26T23:50:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdbfc004d50 0x7fdc1815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc1815b830 0x7fdc1815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc18156330 0x7fdc181567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fdc180b4650 con 0x7fdc18156330 2024-04-26T23:50:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdc180b44d0 con 0x7fdc1815b830 2024-04-26T23:50:33.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1806d930 con 0x7fdbfc004d50 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc18156330 0x7fdc181567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc18156330 0x7fdc181567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48140/0 (socket says 172.21.15.47:48140) 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 -- 172.21.15.47:0/3638601190 learned_addr learned my addr 172.21.15.47:0/3638601190 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc16800640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdbfc004d50 0x7fdc1815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc15e00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc1815b830 0x7fdc1815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 -- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdbfc004d50 msgr2=0x7fdc1815e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdbfc004d50 0x7fdc1815e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 -- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc1815b830 msgr2=0x7fdc1815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc1815b830 0x7fdc1815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 -- 172.21.15.47:0/3638601190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc180b6e70 con 0x7fdc18156330 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc17200640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc18156330 0x7fdc181567e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009f90 tx=0x7fdc10009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc0ea00640 1 -- 172.21.15.47:0/3638601190 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100bd070 con 0x7fdc18156330 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc0ea00640 1 -- 172.21.15.47:0/3638601190 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc100a5a90 con 0x7fdc18156330 2024-04-26T23:50:33.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc18157670 con 0x7fdc18156330 2024-04-26T23:50:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc0ea00640 1 -- 172.21.15.47:0/3638601190 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc100b2040 con 0x7fdc18156330 2024-04-26T23:50:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc18157c30 con 0x7fdc18156330 2024-04-26T23:50:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc18069470 con 0x7fdc18156330 2024-04-26T23:50:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.164+0000 7fdc0ea00640 1 -- 172.21.15.47:0/3638601190 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fdc100039a0 con 0x7fdc18156330 2024-04-26T23:50:33.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.168+0000 7fdc0ea00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdbf8068680 0x7fdbf806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.168+0000 7fdc0ea00640 1 -- 172.21.15.47:0/3638601190 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fdc10120f10 con 0x7fdc18156330 2024-04-26T23:50:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.168+0000 7fdc16800640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdbf8068680 0x7fdbf806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.168+0000 7fdc16800640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdbf8068680 0x7fdbf806ab40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009aa0 tx=0x7fdc08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.172+0000 7fdc0ea00640 1 -- 172.21.15.47:0/3638601190 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fdc10016990 con 0x7fdc18156330 2024-04-26T23:50:33.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.340+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc180d2af0 con 0x7fdc18156330 2024-04-26T23:50:33.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.340+0000 7fdc0ea00640 1 -- 172.21.15.47:0/3638601190 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16752 (secure 0 0 0) 0x7fdc100f0a20 con 0x7fdc18156330 2024-04-26T23:50:33.348 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:33.348 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":51,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:14.262711+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.340+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdbf8068680 msgr2=0x7fdbf806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.340+0000 7fdc1ca00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdbf8068680 0x7fdbf806ab40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009aa0 tx=0x7fdc08008040 comp rx=0 tx=0).stop 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.340+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc18156330 msgr2=0x7fdc181567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.340+0000 7fdc1ca00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc18156330 0x7fdc181567e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdc10009f90 tx=0x7fdc10009750 comp rx=0 tx=0).stop 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 shutdown_connections 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fdbf8068680 0x7fdbf806ab40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdc18156330 0x7fdc181567e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdc1815b830 0x7fdc1815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 --2- 172.21.15.47:0/3638601190 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fdbfc004d50 0x7fdc1815e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 >> 172.21.15.47:0/3638601190 conn(0x7fdc1809ba60 msgr2=0x7fdc180b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 shutdown_connections 2024-04-26T23:50:33.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.344+0000 7fdc1ca00640 1 -- 172.21.15.47:0/3638601190 wait complete. 2024-04-26T23:50:33.369 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:48:03.004737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:48:03.560025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:50:33.370 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:50:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.504+0000 7fe7bbe00640 1 Processor -- start 2024-04-26T23:50:33.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.504+0000 7fe7bbe00640 1 -- start start 2024-04-26T23:50:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bbe00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe7bc0d2af0 0x7fe7bc06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 0x7fe7bc1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bbe00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7bc06daf0 con 0x7fe7bc0d2ed0 2024-04-26T23:50:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bbe00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe7bc0d0dc0 con 0x7fe7bc0d2af0 2024-04-26T23:50:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7bc06ddd0 con 0x7fe7bc15f280 2024-04-26T23:50:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bb400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe7bc0d2ed0 0x7fe7bc0cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49028/0 (socket says 172.21.15.47:49028) 2024-04-26T23:50:33.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bb400640 1 -- 172.21.15.47:0/3565709275 learned_addr learned my addr 172.21.15.47:0/3565709275 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7baa00640 1 --2- 172.21.15.47:0/3565709275 >> v2:172.21.15.203:3300/0 conn(0x7fe7bc0d2af0 0x7fe7bc06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7b2000640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 0x7fe7bc1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762696628 0 0) 0x7fe7bc06daf0 con 0x7fe7bc0d2ed0 2024-04-26T23:50:33.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7a0003530 con 0x7fe7bc0d2ed0 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3833854909 0 0) 0x7fe7a0003530 con 0x7fe7bc0d2ed0 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 msgr2=0x7fe7bc1600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 0x7fe7bc1600d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 >> v2:172.21.15.203:3300/0 conn(0x7fe7bc0d2af0 msgr2=0x7fe7bc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 --2- 172.21.15.47:0/3565709275 >> v2:172.21.15.203:3300/0 conn(0x7fe7bc0d2af0 0x7fe7bc06d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc06e0b0 con 0x7fe7bc0d2ed0 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fe7b4001a00 con 0x7fe7bc0d2ed0 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 >> v1:172.21.15.47:6789/0 conn(0x7fe7bc0d2ed0 legacy=0x7fe7bc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a0003a30 0x7fe7a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 0x7fe7a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0004d50 0x7fe7a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc06ddd0 con 0x7fe7a0003a30 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a000b9d0 con 0x7fe7a0004d50 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7a000bb50 con 0x7fe7bc15f280 2024-04-26T23:50:33.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7baa00640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a0003a30 0x7fe7a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7b2000640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 0x7fe7a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7bb400640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0004d50 0x7fe7a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7baa00640 1 -- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 msgr2=0x7fe7a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7baa00640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc15f280 0x7fe7a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7baa00640 1 -- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0004d50 msgr2=0x7fe7a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7baa00640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0004d50 0x7fe7a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.508+0000 7fe7baa00640 1 -- 172.21.15.47:0/3565709275 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a0003530 con 0x7fe7a0003a30 2024-04-26T23:50:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7baa00640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a0003a30 0x7fe7a0003e50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009ae0 tx=0x7fe7ac01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb51ba839814958e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0096b0 con 0x7fe7a0003a30 2024-04-26T23:50:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ac0a6490 con 0x7fe7a0003a30 2024-04-26T23:50:33.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7ba000640 1 -- 172.21.15.47:0/3565709275 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0a6880 con 0x7fe7a0003a30 2024-04-26T23:50:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 -- 172.21.15.47:0/3565709275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a0003a30 msgr2=0x7fe7a0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 --2- 172.21.15.47:0/3565709275 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7a0003a30 0x7fe7a0003e50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009ae0 tx=0x7fe7ac01cab0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bb400640 1 -- 172.21.15.47:0/3565709275 reap_dead start 2024-04-26T23:50:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 -- 172.21.15.47:0/3565709275 shutdown_connections 2024-04-26T23:50:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 -- 172.21.15.47:0/3565709275 >> 172.21.15.47:0/3565709275 conn(0x7fe7bc09ba60 msgr2=0x7fe7bc09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 -- 172.21.15.47:0/3565709275 shutdown_connections 2024-04-26T23:50:33.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 -- 172.21.15.47:0/3565709275 wait complete. 2024-04-26T23:50:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 Processor -- start 2024-04-26T23:50:33.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.512+0000 7fe7bbe00640 1 -- start start 2024-04-26T23:50:33.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0003a30 0x7fe7bc1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc165020 0x7fe7bc1654a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7bc0b0b10 0x7fe7bc0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc0b2b20 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc0b29a0 con 0x7fe7a0003a30 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7bc169c40 con 0x7fe7bc165020 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7bc0b0b10 0x7fe7bc0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7bc0b0b10 0x7fe7bc0b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48162/0 (socket says 172.21.15.47:48162) 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 -- 172.21.15.47:0/646298266 learned_addr learned my addr 172.21.15.47:0/646298266 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7baa00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0003a30 0x7fe7bc1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7b2000640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc165020 0x7fe7bc1654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 -- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc165020 msgr2=0x7fe7bc1654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc165020 0x7fe7bc1654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 -- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0003a30 msgr2=0x7fe7bc1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0003a30 0x7fe7bc1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 -- 172.21.15.47:0/646298266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc15c540 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7baa00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0003a30 0x7fe7bc1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bb400640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7bc0b0b10 0x7fe7bc0b0f90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4000f90 tx=0x7fe7b4007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7b3400640 1 -- 172.21.15.47:0/646298266 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b400eaa0 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7b3400640 1 -- 172.21.15.47:0/646298266 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b4018070 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7b3400640 1 -- 172.21.15.47:0/646298266 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b400ee80 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7bc15c820 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7bc15cde0 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.516+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7bc069470 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.520+0000 7fe7b3400640 1 -- 172.21.15.47:0/646298266 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe7b401d460 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.520+0000 7fe7b3400640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe798068650 0x7fe79806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.520+0000 7fe7b3400640 1 -- 172.21.15.47:0/646298266 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fe7b4087020 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.520+0000 7fe7baa00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe798068650 0x7fe79806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.520+0000 7fe7baa00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe798068650 0x7fe79806ab10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0ad000 tx=0x7fe7ac0b3040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.524+0000 7fe7b3400640 1 -- 172.21.15.47:0/646298266 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7b4056bc0 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe7bc154df0 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.694 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7b3400640 1 -- 172.21.15.47:0/646298266 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fe7b405aec0 con 0x7fe7bc0b0b10 2024-04-26T23:50:33.694 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:50:33.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe798068650 msgr2=0x7fe79806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe798068650 0x7fe79806ab10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0ad000 tx=0x7fe7ac0b3040 comp rx=0 tx=0).stop 2024-04-26T23:50:33.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7bc0b0b10 msgr2=0x7fe7bc0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7bc0b0b10 0x7fe7bc0b0f90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4000f90 tx=0x7fe7b4007bc0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 shutdown_connections 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe798068650 0x7fe79806ab10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7bc0b0b10 0x7fe7bc0b0f90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7bc165020 0x7fe7bc1654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 --2- 172.21.15.47:0/646298266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7a0003a30 0x7fe7bc1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 >> 172.21.15.47:0/646298266 conn(0x7fe7bc09ba60 msgr2=0x7fe7bc1686e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 shutdown_connections 2024-04-26T23:50:33.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.688+0000 7fe7bbe00640 1 -- 172.21.15.47:0/646298266 wait complete. 2024-04-26T23:50:33.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:50:33.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f052a200640 1 Processor -- start 2024-04-26T23:50:33.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f052a200640 1 -- start start 2024-04-26T23:50:33.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f052a200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05240d0390 0x7f05240af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f052a200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f052406c630 0x7f052406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f052a200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05240ae6a0 con 0x7f052415fcd0 2024-04-26T23:50:33.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f052a200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f05240ae920 con 0x7f05240d0390 2024-04-26T23:50:33.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f052a200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f05240aec00 con 0x7f052406c630 2024-04-26T23:50:33.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05240d0390 0x7f05240af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f052415fcd0 0x7f0524160110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49038/0 (socket says 172.21.15.47:49038) 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523e00640 1 -- 172.21.15.47:0/3541626855 learned_addr learned my addr 172.21.15.47:0/3541626855 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f05240d0390 0x7f05240af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48168/0 (socket says 172.21.15.47:48168) 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f051aa00640 1 --2- 172.21.15.47:0/3541626855 >> v2:172.21.15.203:3300/0 conn(0x7f052406c630 0x7f052406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523400640 1 -- 172.21.15.47:0/3541626855 >> v2:172.21.15.203:3300/0 conn(0x7f052406c630 msgr2=0x7f052406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523400640 1 --2- 172.21.15.47:0/3541626855 >> v2:172.21.15.203:3300/0 conn(0x7f052406c630 0x7f052406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523400640 1 -- 172.21.15.47:0/3541626855 >> v1:172.21.15.47:6789/0 conn(0x7f052415fcd0 legacy=0x7f0524160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.852+0000 7f0523400640 1 -- 172.21.15.47:0/3541626855 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05240aeee0 con 0x7f05240d0390 2024-04-26T23:50:33.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f0523400640 1 --2- 172.21.15.47:0/3541626855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05240d0390 0x7f05240af6e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f052406e9e0 tx=0x7f051401eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7eadfad1a5d9cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f0522a00640 1 -- 172.21.15.47:0/3541626855 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140b4070 con 0x7f05240d0390 2024-04-26T23:50:33.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f0522a00640 1 -- 172.21.15.47:0/3541626855 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05140a7990 con 0x7f05240d0390 2024-04-26T23:50:33.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f0522a00640 1 -- 172.21.15.47:0/3541626855 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140a7d60 con 0x7f05240d0390 2024-04-26T23:50:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 -- 172.21.15.47:0/3541626855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05240d0390 msgr2=0x7f05240af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 --2- 172.21.15.47:0/3541626855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05240d0390 0x7f05240af6e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f052406e9e0 tx=0x7f051401eac0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 -- 172.21.15.47:0/3541626855 shutdown_connections 2024-04-26T23:50:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 --2- 172.21.15.47:0/3541626855 >> v2:172.21.15.203:3300/0 conn(0x7f052406c630 0x7f052406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 --2- 172.21.15.47:0/3541626855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f05240d0390 0x7f05240af6e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 -- 172.21.15.47:0/3541626855 >> 172.21.15.47:0/3541626855 conn(0x7f05240b2b70 msgr2=0x7f05240b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 -- 172.21.15.47:0/3541626855 shutdown_connections 2024-04-26T23:50:33.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.856+0000 7f052a200640 1 -- 172.21.15.47:0/3541626855 wait complete. 2024-04-26T23:50:33.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 Processor -- start 2024-04-26T23:50:33.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 -- start start 2024-04-26T23:50:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052406c630 0x7f0524148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05240d0390 0x7f0524142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f052415fcd0 0x7f0524147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f052406faf0 con 0x7f052406c630 2024-04-26T23:50:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f052406f970 con 0x7f05240d0390 2024-04-26T23:50:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f052406fc70 con 0x7f052415fcd0 2024-04-26T23:50:33.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052406c630 0x7f0524148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052406c630 0x7f0524148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48182/0 (socket says 172.21.15.47:48182) 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 -- 172.21.15.47:0/3436062441 learned_addr learned my addr 172.21.15.47:0/3436062441 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f051aa00640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05240d0390 0x7f0524142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 -- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f052415fcd0 msgr2=0x7f0524147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f052415fcd0 0x7f0524147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 -- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05240d0390 msgr2=0x7f0524142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05240d0390 0x7f0524142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 -- 172.21.15.47:0/3436062441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0524150700 con 0x7f052406c630 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f051aa00640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05240d0390 0x7f0524142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f0523400640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052406c630 0x7f0524148910 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f05140b2040 tx=0x7f051401b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f051be00640 1 -- 172.21.15.47:0/3436062441 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140bf070 con 0x7f052406c630 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f051be00640 1 -- 172.21.15.47:0/3436062441 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05140af7a0 con 0x7f052406c630 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f051be00640 1 -- 172.21.15.47:0/3436062441 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05140b4040 con 0x7f052406c630 2024-04-26T23:50:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052414fb40 con 0x7f052406c630 2024-04-26T23:50:33.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05241509e0 con 0x7f052406c630 2024-04-26T23:50:33.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.860+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0524150150 con 0x7f052406c630 2024-04-26T23:50:33.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.864+0000 7f051be00640 1 -- 172.21.15.47:0/3436062441 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f05140afb90 con 0x7f052406c630 2024-04-26T23:50:33.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.864+0000 7f051be00640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0500068650 0x7f050006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:33.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.864+0000 7f051be00640 1 -- 172.21.15.47:0/3436062441 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f0514120ff0 con 0x7f052406c630 2024-04-26T23:50:33.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.864+0000 7f051aa00640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0500068650 0x7f050006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:33.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.864+0000 7f051aa00640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0500068650 0x7f050006ab10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0524148690 tx=0x7f050c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:33.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:33.868+0000 7f051be00640 1 -- 172.21.15.47:0/3436062441 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f0514018740 con 0x7f052406c630 2024-04-26T23:50:34.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.032+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0524143910 con 0x7f052406c630 2024-04-26T23:50:34.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.032+0000 7f051be00640 1 -- 172.21.15.47:0/3436062441 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7f0524143910 con 0x7f052406c630 2024-04-26T23:50:34.040 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0500068650 msgr2=0x7f050006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0500068650 0x7f050006ab10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0524148690 tx=0x7f050c008040 comp rx=0 tx=0).stop 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052406c630 msgr2=0x7f0524148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052406c630 0x7f0524148910 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f05140b2040 tx=0x7f051401b860 comp rx=0 tx=0).stop 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 shutdown_connections 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0500068650 0x7f050006ab10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f052415fcd0 0x7f0524147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05240d0390 0x7f0524142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 --2- 172.21.15.47:0/3436062441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f052406c630 0x7f0524148910 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 >> 172.21.15.47:0/3436062441 conn(0x7f05240b2b70 msgr2=0x7f05240b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:34.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 shutdown_connections 2024-04-26T23:50:34.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.036+0000 7f052a200640 1 -- 172.21.15.47:0/3436062441 wait complete. 2024-04-26T23:50:34.061 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:50:34.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.196+0000 7fcdda000640 1 Processor -- start 2024-04-26T23:50:34.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdda000640 1 -- start start 2024-04-26T23:50:34.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdda000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fcdd406cac0 0x7fcdd4161260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdda000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd40ae030 con 0x7fcdd415cf50 2024-04-26T23:50:34.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdda000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd40d0ae0 con 0x7fcdd406c630 2024-04-26T23:50:34.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdda000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd40af7a0 con 0x7fcdd406cac0 2024-04-26T23:50:34.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcdd415cf50 0x7fcdd40cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49054/0 (socket says 172.21.15.47:49054) 2024-04-26T23:50:34.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 -- 172.21.15.47:0/534757504 learned_addr learned my addr 172.21.15.47:0/534757504 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:34.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3e00640 1 --2- 172.21.15.47:0/534757504 >> v2:172.21.15.203:3300/0 conn(0x7fcdd406cac0 0x7fcdd4161260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138646716 0 0) 0x7fcdd40ae030 con 0x7fcdd415cf50 2024-04-26T23:50:34.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdb8003530 con 0x7fcdd415cf50 2024-04-26T23:50:34.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2410166486 0 0) 0x7fcdd40d0ae0 con 0x7fcdd406c630 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdd40ae030 con 0x7fcdd406c630 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2037421015 0 0) 0x7fcdb8003530 con 0x7fcdd415cf50 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 >> v2:172.21.15.203:3300/0 conn(0x7fcdd406cac0 msgr2=0x7fcdd4161260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 --2- 172.21.15.47:0/534757504 >> v2:172.21.15.203:3300/0 conn(0x7fcdd406cac0 0x7fcdd4161260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 >> v1:172.21.15.203:6789/0 conn(0x7fcdd406c630 legacy=0x7fcdd4160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd40af9d0 con 0x7fcdd415cf50 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fcdc4001680 con 0x7fcdd415cf50 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 >> v1:172.21.15.47:6789/0 conn(0x7fcdd415cf50 legacy=0x7fcdd40cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdb8003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdb8004810 0x7fcdb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdb80051d0 0x7fcdb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb800c020 con 0x7fcdb8003b50 2024-04-26T23:50:34.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb800c1d0 con 0x7fcdb80051d0 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb800c3d0 con 0x7fcdb8004810 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdb8003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdcaa00640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdb8004810 0x7fcdb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3e00640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdb80051d0 0x7fcdb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 -- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdb8004810 msgr2=0x7fcdb8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdb8004810 0x7fcdb8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 -- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdb80051d0 msgr2=0x7fcdb800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdb80051d0 0x7fcdb800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3400640 1 -- 172.21.15.47:0/534757504 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb8003530 con 0x7fcdb8003b50 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3e00640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdb80051d0 0x7fcdb800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:34.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.200+0000 7fcdd3e00640 1 -- 172.21.15.47:0/534757504 reap_dead start 2024-04-26T23:50:34.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdd3400640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdb8003f50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c1c0 tx=0x7fcdc401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d531278cc77600ee server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4007cf0 con 0x7fcdb8003b50 2024-04-26T23:50:34.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc40a9020 con 0x7fcdb8003b50 2024-04-26T23:50:34.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdd2a00640 1 -- 172.21.15.47:0/534757504 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4005ae0 con 0x7fcdb8003b50 2024-04-26T23:50:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdda000640 1 -- 172.21.15.47:0/534757504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 msgr2=0x7fcdb8003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdda000640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdb8003f50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c1c0 tx=0x7fcdc401c930 comp rx=0 tx=0).stop 2024-04-26T23:50:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdda000640 1 -- 172.21.15.47:0/534757504 shutdown_connections 2024-04-26T23:50:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdda000640 1 --2- 172.21.15.47:0/534757504 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdb8003f50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdda000640 1 -- 172.21.15.47:0/534757504 >> 172.21.15.47:0/534757504 conn(0x7fcdd40b2b70 msgr2=0x7fcdd40b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdda000640 1 -- 172.21.15.47:0/534757504 shutdown_connections 2024-04-26T23:50:34.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.204+0000 7fcdda000640 1 -- 172.21.15.47:0/534757504 wait complete. 2024-04-26T23:50:34.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 Processor -- start 2024-04-26T23:50:34.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 -- start start 2024-04-26T23:50:34.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdd414f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdd41508b0 0x7fcdd41facc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdd41e9fb0 0x7fcdd41ea440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd406cea0 con 0x7fcdb8003b50 2024-04-26T23:50:34.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd415d330 con 0x7fcdd41e9fb0 2024-04-26T23:50:34.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd406e0c0 con 0x7fcdd41508b0 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdd414f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdd414f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48200/0 (socket says 172.21.15.47:48200) 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 -- 172.21.15.47:0/3425067045 learned_addr learned my addr 172.21.15.47:0/3425067045 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdcaa00640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdd41508b0 0x7fcdd41facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3e00640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdd41e9fb0 0x7fcdd41ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 -- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdd41508b0 msgr2=0x7fcdd41facc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdd41508b0 0x7fcdd41facc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 -- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdd41e9fb0 msgr2=0x7fcdd41ea440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdd41e9fb0 0x7fcdd41ea440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 -- 172.21.15.47:0/3425067045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd4150d40 con 0x7fcdb8003b50 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdd3400640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdd414f400 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40ab040 tx=0x7fcdb8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdcbe00640 1 -- 172.21.15.47:0/3425067045 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4007cf0 con 0x7fcdb8003b50 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdcbe00640 1 -- 172.21.15.47:0/3425067045 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc4007090 con 0x7fcdb8003b50 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd4151020 con 0x7fcdb8003b50 2024-04-26T23:50:34.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdcbe00640 1 -- 172.21.15.47:0/3425067045 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4001c20 con 0x7fcdb8003b50 2024-04-26T23:50:34.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd406e5f0 con 0x7fcdb8003b50 2024-04-26T23:50:34.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.208+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd4069700 con 0x7fcdb8003b50 2024-04-26T23:50:34.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.212+0000 7fcdcbe00640 1 -- 172.21.15.47:0/3425067045 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fcdc4007440 con 0x7fcdb8003b50 2024-04-26T23:50:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.212+0000 7fcdcbe00640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcdb0068650 0x7fcdb006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.212+0000 7fcdcbe00640 1 -- 172.21.15.47:0/3425067045 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fcdc41202e0 con 0x7fcdb8003b50 2024-04-26T23:50:34.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.212+0000 7fcdcaa00640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcdb0068650 0x7fcdb006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.212+0000 7fcdcaa00640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcdb0068650 0x7fcdb006ab10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcdd41e9f60 tx=0x7fcdbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.216+0000 7fcdcbe00640 1 -- 172.21.15.47:0/3425067045 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fcdc4016930 con 0x7fcdb8003b50 2024-04-26T23:50:34.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.380+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcdd41e9700 con 0x7fcdb8003b50 2024-04-26T23:50:34.389 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.380+0000 7fcdcbe00640 1 -- 172.21.15.47:0/3425067045 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7fcdc40b6340 con 0x7fcdb8003b50 2024-04-26T23:50:34.389 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:50:34.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcdb0068650 msgr2=0x7fcdb006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcdb0068650 0x7fcdb006ab10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcdd41e9f60 tx=0x7fcdbc009040 comp rx=0 tx=0).stop 2024-04-26T23:50:34.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 msgr2=0x7fcdd414f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdd414f400 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40ab040 tx=0x7fcdb8005840 comp rx=0 tx=0).stop 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 shutdown_connections 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fcdb0068650 0x7fcdb006ab10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcdd41e9fb0 0x7fcdd41ea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fcdd41508b0 0x7fcdd41facc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 --2- 172.21.15.47:0/3425067045 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcdb8003b50 0x7fcdd414f400 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 >> 172.21.15.47:0/3425067045 conn(0x7fcdd40b2b70 msgr2=0x7fcdd40cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 shutdown_connections 2024-04-26T23:50:34.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.384+0000 7fcdda000640 1 -- 172.21.15.47:0/3425067045 wait complete. 2024-04-26T23:50:34.411 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:50:34.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.544+0000 7fa01ca00640 1 Processor -- start 2024-04-26T23:50:34.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.544+0000 7fa01ca00640 1 -- start start 2024-04-26T23:50:34.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa01ca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa018159b70 0x7fa01806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0180af7f0 0x7fa01806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa01ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0180aea30 con 0x7fa01815fca0 2024-04-26T23:50:34.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa01ca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa0180af360 con 0x7fa018159b70 2024-04-26T23:50:34.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa01ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa0180aed10 con 0x7fa0180af7f0 2024-04-26T23:50:34.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa01815fca0 0x7fa018160130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49064/0 (socket says 172.21.15.47:49064) 2024-04-26T23:50:34.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 -- 172.21.15.47:0/4271784715 learned_addr learned my addr 172.21.15.47:0/4271784715 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781230167 0 0) 0x7fa0180aea30 con 0x7fa01815fca0 2024-04-26T23:50:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ffc003530 con 0x7fa01815fca0 2024-04-26T23:50:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015e00640 1 --2- 172.21.15.47:0/4271784715 >> v2:172.21.15.203:3300/0 conn(0x7fa018159b70 0x7fa01806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa00d400640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0180af7f0 0x7fa01806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 965335796 0 0) 0x7f9ffc003530 con 0x7fa01815fca0 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0180af7f0 msgr2=0x7fa01806cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa0180af7f0 0x7fa01806cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 >> v2:172.21.15.203:3300/0 conn(0x7fa018159b70 msgr2=0x7fa01806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 --2- 172.21.15.47:0/4271784715 >> v2:172.21.15.203:3300/0 conn(0x7fa018159b70 0x7fa01806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0180aeff0 con 0x7fa01815fca0 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fa010001a20 con 0x7fa01815fca0 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 >> v1:172.21.15.47:6789/0 conn(0x7fa01815fca0 legacy=0x7fa018160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ffc0039c0 0x7f9ffc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc004810 0x7f9ffc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ffc0051d0 0x7f9ffc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa0180af360 con 0x7f9ffc0051d0 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa0180aed10 con 0x7f9ffc0039c0 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9ffc00c010 con 0x7f9ffc004810 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ffc0051d0 0x7f9ffc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa015e00640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ffc0039c0 0x7f9ffc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa00d400640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc004810 0x7f9ffc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 -- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc004810 msgr2=0x7f9ffc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc004810 0x7f9ffc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 -- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ffc0039c0 msgr2=0x7f9ffc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ffc0039c0 0x7f9ffc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.548+0000 7fa016800640 1 -- 172.21.15.47:0/4271784715 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc003530 con 0x7f9ffc0051d0 2024-04-26T23:50:34.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa016800640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ffc0051d0 0x7f9ffc00b9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa01000a8a0 tx=0x7fa01001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75be45ea66c8f64e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01000a4c0 con 0x7f9ffc0051d0 2024-04-26T23:50:34.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0100ad630 con 0x7f9ffc0051d0 2024-04-26T23:50:34.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa015400640 1 -- 172.21.15.47:0/4271784715 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0100ada20 con 0x7f9ffc0051d0 2024-04-26T23:50:34.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 -- 172.21.15.47:0/4271784715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ffc0051d0 msgr2=0x7f9ffc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 --2- 172.21.15.47:0/4271784715 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ffc0051d0 0x7f9ffc00b9d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa01000a8a0 tx=0x7fa01001d360 comp rx=0 tx=0).stop 2024-04-26T23:50:34.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa016800640 1 -- 172.21.15.47:0/4271784715 reap_dead start 2024-04-26T23:50:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 -- 172.21.15.47:0/4271784715 shutdown_connections 2024-04-26T23:50:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 -- 172.21.15.47:0/4271784715 >> 172.21.15.47:0/4271784715 conn(0x7fa0180b2d40 msgr2=0x7fa0180b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 -- 172.21.15.47:0/4271784715 shutdown_connections 2024-04-26T23:50:34.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 -- 172.21.15.47:0/4271784715 wait complete. 2024-04-26T23:50:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 Processor -- start 2024-04-26T23:50:34.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.552+0000 7fa01ca00640 1 -- start start 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc0051d0 0x7fa018147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa018146540 0x7fa01809e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa018073370 0x7fa0180b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa01806ccf0 con 0x7fa018073370 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa01806cb70 con 0x7fa018146540 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa01806ce70 con 0x7f9ffc0051d0 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa018073370 0x7fa0180b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa018073370 0x7fa0180b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48222/0 (socket says 172.21.15.47:48222) 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 -- 172.21.15.47:0/3417319413 learned_addr learned my addr 172.21.15.47:0/3417319413 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa00d400640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa018146540 0x7fa01809e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa015e00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc0051d0 0x7fa018147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 -- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc0051d0 msgr2=0x7fa018147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc0051d0 0x7fa018147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 -- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa018146540 msgr2=0x7fa01809e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa018146540 0x7fa01809e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 -- 172.21.15.47:0/3417319413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa01809e860 con 0x7fa018073370 2024-04-26T23:50:34.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa016800640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa018073370 0x7fa0180b4500 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa01001cdd0 tx=0x7f9ffc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa00ea00640 1 -- 172.21.15.47:0/3417319413 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0100bc070 con 0x7fa018073370 2024-04-26T23:50:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa00ea00640 1 -- 172.21.15.47:0/3417319413 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0100011d0 con 0x7fa018073370 2024-04-26T23:50:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa00ea00640 1 -- 172.21.15.47:0/3417319413 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0100b2040 con 0x7fa018073370 2024-04-26T23:50:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0180722d0 con 0x7fa018073370 2024-04-26T23:50:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa018072890 con 0x7fa018073370 2024-04-26T23:50:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0180695f0 con 0x7fa018073370 2024-04-26T23:50:34.565 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.556+0000 7fa00ea00640 1 -- 172.21.15.47:0/3417319413 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fa0100bf070 con 0x7fa018073370 2024-04-26T23:50:34.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.560+0000 7fa00ea00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ff4068650 0x7f9ff406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:34.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.560+0000 7fa00ea00640 1 -- 172.21.15.47:0/3417319413 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fa010120cc0 con 0x7fa018073370 2024-04-26T23:50:34.566 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.560+0000 7fa015e00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ff4068650 0x7f9ff406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:34.567 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.560+0000 7fa015e00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ff4068650 0x7f9ff406ab10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa008003730 tx=0x7fa008008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:34.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.564+0000 7fa00ea00640 1 -- 172.21.15.47:0/3417319413 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa010017070 con 0x7fa018073370 2024-04-26T23:50:34.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.740+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0180cd440 con 0x7fa018073370 2024-04-26T23:50:34.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.740+0000 7fa00ea00640 1 -- 172.21.15.47:0/3417319413 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7fa0100019e0 con 0x7fa018073370 2024-04-26T23:50:34.748 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:50:34.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ff4068650 msgr2=0x7f9ff406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ff4068650 0x7f9ff406ab10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa008003730 tx=0x7fa008008040 comp rx=0 tx=0).stop 2024-04-26T23:50:34.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa018073370 msgr2=0x7fa0180b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:34.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa018073370 0x7fa0180b4500 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa01001cdd0 tx=0x7f9ffc005840 comp rx=0 tx=0).stop 2024-04-26T23:50:34.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 shutdown_connections 2024-04-26T23:50:34.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9ff4068650 0x7f9ff406ab10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa018073370 0x7fa0180b4500 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa018146540 0x7fa01809e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 --2- 172.21.15.47:0/3417319413 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ffc0051d0 0x7fa018147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 >> 172.21.15.47:0/3417319413 conn(0x7fa0180b2d40 msgr2=0x7fa018164e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 shutdown_connections 2024-04-26T23:50:34.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:34.744+0000 7fa01ca00640 1 -- 172.21.15.47:0/3417319413 wait complete. 2024-04-26T23:50:34.769 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-04-26T23:50:34.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:34.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T23:50:34.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[39532]: fuse finished with error 0 and tester_r 0 2024-04-26T23:50:34.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:50:34.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:34.791 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T23:50:34.857 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:50:34.858 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:50:34.858 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:34.867 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:50:34.867 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:34.917 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:35.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f354ca00640 1 Processor -- start 2024-04-26T23:50:35.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f354ca00640 1 -- start start 2024-04-26T23:50:35.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f354ca00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f354815f460 0x7f35480d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f354ca00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3548076180 con 0x7f35480b5390 2024-04-26T23:50:35.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f354ca00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35480d2070 con 0x7f354815f080 2024-04-26T23:50:35.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f354ca00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f3548070340 con 0x7f354815f460 2024-04-26T23:50:35.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3547e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f35480b5390 0x7f35480cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49076/0 (socket says 172.21.15.47:49076) 2024-04-26T23:50:35.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3547e00640 1 -- 172.21.15.47:0/4087735509 learned_addr learned my addr 172.21.15.47:0/4087735509 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3546a00640 1 --2- 172.21.15.47:0/4087735509 >> v2:172.21.15.203:3300/0 conn(0x7f354815f460 0x7f35480d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3546000640 1 -- 172.21.15.47:0/4087735509 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260792392 0 0) 0x7f3548076180 con 0x7f35480b5390 2024-04-26T23:50:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3546000640 1 -- 172.21.15.47:0/4087735509 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f352c003530 con 0x7f35480b5390 2024-04-26T23:50:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3546a00640 1 -- 172.21.15.47:0/4087735509 >> v1:172.21.15.203:6789/0 conn(0x7f354815f080 legacy=0x7f3548070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3546a00640 1 -- 172.21.15.47:0/4087735509 >> v1:172.21.15.47:6789/0 conn(0x7f35480b5390 legacy=0x7f35480cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.052+0000 7f3546a00640 1 -- 172.21.15.47:0/4087735509 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3548070620 con 0x7f354815f460 2024-04-26T23:50:35.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f3546a00640 1 --2- 172.21.15.47:0/4087735509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 0x7f35480d19d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f35340097c0 tx=0x7f353401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd814dc1325ff3a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f3546000640 1 -- 172.21.15.47:0/4087735509 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35340b0070 con 0x7f354815f460 2024-04-26T23:50:35.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f3546000640 1 -- 172.21.15.47:0/4087735509 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3534004230 con 0x7f354815f460 2024-04-26T23:50:35.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f3546000640 1 -- 172.21.15.47:0/4087735509 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534003620 con 0x7f354815f460 2024-04-26T23:50:35.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f354ca00640 1 -- 172.21.15.47:0/4087735509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 msgr2=0x7f35480d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f354ca00640 1 --2- 172.21.15.47:0/4087735509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 0x7f35480d19d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f35340097c0 tx=0x7f353401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f354ca00640 1 -- 172.21.15.47:0/4087735509 shutdown_connections 2024-04-26T23:50:35.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f354ca00640 1 --2- 172.21.15.47:0/4087735509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 0x7f35480d19d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f354ca00640 1 -- 172.21.15.47:0/4087735509 >> 172.21.15.47:0/4087735509 conn(0x7f35480b4870 msgr2=0x7f35480b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f354ca00640 1 -- 172.21.15.47:0/4087735509 shutdown_connections 2024-04-26T23:50:35.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.056+0000 7f354ca00640 1 -- 172.21.15.47:0/4087735509 wait complete. 2024-04-26T23:50:35.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 Processor -- start 2024-04-26T23:50:35.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 -- start start 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35480b5390 0x7f3548151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f354815f080 0x7f35480b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 0x7f35480b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f35480cfcf0 con 0x7f354815f080 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f35480cfe70 con 0x7f354815f460 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f354816d090 con 0x7f35480b5390 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f354815f080 0x7f35480b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f354815f080 0x7f35480b6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48238/0 (socket says 172.21.15.47:48238) 2024-04-26T23:50:35.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 -- 172.21.15.47:0/78997101 learned_addr learned my addr 172.21.15.47:0/78997101 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3547400640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35480b5390 0x7f3548151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3547e00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 0x7f35480b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 -- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35480b5390 msgr2=0x7f3548151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35480b5390 0x7f3548151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 -- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 msgr2=0x7f35480b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 0x7f35480b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 -- 172.21.15.47:0/78997101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35480cfff0 con 0x7f354815f080 2024-04-26T23:50:35.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f3546a00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f354815f080 0x7f35480b6af0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f35340190b0 tx=0x7f3534019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f353f400640 1 -- 172.21.15.47:0/78997101 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35340b0040 con 0x7f354815f080 2024-04-26T23:50:35.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f353f400640 1 -- 172.21.15.47:0/78997101 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35340bb070 con 0x7f354815f080 2024-04-26T23:50:35.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f353f400640 1 -- 172.21.15.47:0/78997101 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534003e10 con 0x7f354815f080 2024-04-26T23:50:35.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3548151ac0 con 0x7f354815f080 2024-04-26T23:50:35.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.060+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3548158b90 con 0x7f354815f080 2024-04-26T23:50:35.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.064+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3548069b80 con 0x7f354815f080 2024-04-26T23:50:35.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.064+0000 7f353f400640 1 -- 172.21.15.47:0/78997101 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f35340b3070 con 0x7f354815f080 2024-04-26T23:50:35.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.064+0000 7f353f400640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3528068650 0x7f352806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.064+0000 7f353f400640 1 -- 172.21.15.47:0/78997101 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f3534120be0 con 0x7f354815f080 2024-04-26T23:50:35.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.064+0000 7f3547400640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3528068650 0x7f352806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.064+0000 7f3547400640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3528068650 0x7f352806ab10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f354806f5d0 tx=0x7f3538009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.068+0000 7f353f400640 1 -- 172.21.15.47:0/78997101 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3534016090 con 0x7f354815f080 2024-04-26T23:50:35.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.236+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35480d27f0 con 0x7f354815f080 2024-04-26T23:50:35.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.236+0000 7f353f400640 1 -- 172.21.15.47:0/78997101 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16752 (secure 0 0 0) 0x7f35340f0d00 con 0x7f354815f080 2024-04-26T23:50:35.245 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:35.245 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":51,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:14.262711+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3528068650 msgr2=0x7f352806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3528068650 0x7f352806ab10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f354806f5d0 tx=0x7f3538009040 comp rx=0 tx=0).stop 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f354815f080 msgr2=0x7f35480b6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f354815f080 0x7f35480b6af0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f35340190b0 tx=0x7f3534019240 comp rx=0 tx=0).stop 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 shutdown_connections 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3528068650 0x7f352806ab10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f354815f460 0x7f35480b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f354815f080 0x7f35480b6af0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 --2- 172.21.15.47:0/78997101 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f35480b5390 0x7f3548151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 >> 172.21.15.47:0/78997101 conn(0x7f35480b4870 msgr2=0x7f354815a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 shutdown_connections 2024-04-26T23:50:35.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.240+0000 7f354ca00640 1 -- 172.21.15.47:0/78997101 wait complete. 2024-04-26T23:50:35.267 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:48:03.004737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:48:03.560025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:50:35.268 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:50:35.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.404+0000 7fc383600640 1 Processor -- start 2024-04-26T23:50:35.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.404+0000 7fc383600640 1 -- start start 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc383600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc383600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc37c1603e0 0x7fc37c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc383600640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc37c0ae6a0 con 0x7fc37c06c630 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc383600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc37c0ae920 con 0x7fc37c1603e0 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc383600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc37c0aec00 con 0x7fc37c0d0390 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc37c1603e0 0x7fc37c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc37c1603e0 0x7fc37c06cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48240/0 (socket says 172.21.15.47:48240) 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 -- 172.21.15.47:0/2537539633 learned_addr learned my addr 172.21.15.47:0/2537539633 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:35.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc380c00640 1 --2- 172.21.15.47:0/2537539633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 -- 172.21.15.47:0/2537539633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 msgr2=0x7fc37c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:35.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 --2- 172.21.15.47:0/2537539633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c0af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 -- 172.21.15.47:0/2537539633 >> v1:172.21.15.203:6789/0 conn(0x7fc37c06c630 legacy=0x7fc37c15fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 -- 172.21.15.47:0/2537539633 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c0aeee0 con 0x7fc37c1603e0 2024-04-26T23:50:35.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.408+0000 7fc381600640 1 --2- 172.21.15.47:0/2537539633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c06cab0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc374009e50 tx=0x7fc37401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb2c124ce859a10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc37be00640 1 -- 172.21.15.47:0/2537539633 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3740a56e0 con 0x7fc37c1603e0 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc37be00640 1 -- 172.21.15.47:0/2537539633 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3740a5880 con 0x7fc37c1603e0 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc37be00640 1 -- 172.21.15.47:0/2537539633 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3740a5c50 con 0x7fc37c1603e0 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- 172.21.15.47:0/2537539633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 msgr2=0x7fc37c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 --2- 172.21.15.47:0/2537539633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c06cab0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc374009e50 tx=0x7fc37401c9a0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- 172.21.15.47:0/2537539633 shutdown_connections 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 --2- 172.21.15.47:0/2537539633 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c06cab0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 --2- 172.21.15.47:0/2537539633 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- 172.21.15.47:0/2537539633 >> 172.21.15.47:0/2537539633 conn(0x7fc37c0b2b70 msgr2=0x7fc37c0b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- 172.21.15.47:0/2537539633 shutdown_connections 2024-04-26T23:50:35.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- 172.21.15.47:0/2537539633 wait complete. 2024-04-26T23:50:35.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 Processor -- start 2024-04-26T23:50:35.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- start start 2024-04-26T23:50:35.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc37c06c630 0x7fc37c157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c09e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c06fa70 con 0x7fc37c1603e0 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc37c06f8f0 con 0x7fc37c06c630 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc383600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc37c06fbf0 con 0x7fc37c0d0390 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc381600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c09e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc380c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc37c06c630 0x7fc37c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc381600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c09e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48252/0 (socket says 172.21.15.47:48252) 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc381600640 1 -- 172.21.15.47:0/3096670216 learned_addr learned my addr 172.21.15.47:0/3096670216 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.412+0000 7fc373e00640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc381600640 1 -- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 msgr2=0x7fc37c148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc381600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc381600640 1 -- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc37c06c630 msgr2=0x7fc37c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc381600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc37c06c630 0x7fc37c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc381600640 1 -- 172.21.15.47:0/3096670216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc37c157d40 con 0x7fc37c1603e0 2024-04-26T23:50:35.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc381600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c09e020 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc374009e50 tx=0x7fc374019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc379600640 1 -- 172.21.15.47:0/3096670216 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3740bc020 con 0x7fc37c1603e0 2024-04-26T23:50:35.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc379600640 1 -- 172.21.15.47:0/3096670216 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3740b8670 con 0x7fc37c1603e0 2024-04-26T23:50:35.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc379600640 1 -- 172.21.15.47:0/3096670216 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc374009510 con 0x7fc37c1603e0 2024-04-26T23:50:35.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc37c157fe0 con 0x7fc37c1603e0 2024-04-26T23:50:35.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37c0af930 con 0x7fc37c1603e0 2024-04-26T23:50:35.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37c069700 con 0x7fc37c1603e0 2024-04-26T23:50:35.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc379600640 1 -- 172.21.15.47:0/3096670216 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fc3740bf020 con 0x7fc37c1603e0 2024-04-26T23:50:35.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc379600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc358068650 0x7fc35806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc379600640 1 -- 172.21.15.47:0/3096670216 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fc374121c20 con 0x7fc37c1603e0 2024-04-26T23:50:35.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.416+0000 7fc380c00640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc358068650 0x7fc35806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.420+0000 7fc380c00640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc358068650 0x7fc35806ab10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0079c0 tx=0x7fc36c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.420+0000 7fc379600640 1 -- 172.21.15.47:0/3096670216 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc3740c6030 con 0x7fc37c1603e0 2024-04-26T23:50:35.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.588+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc37c159d70 con 0x7fc37c1603e0 2024-04-26T23:50:35.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.588+0000 7fc379600640 1 -- 172.21.15.47:0/3096670216 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7fc374016620 con 0x7fc37c1603e0 2024-04-26T23:50:35.596 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:50:35.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc358068650 msgr2=0x7fc35806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc358068650 0x7fc35806ab10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0079c0 tx=0x7fc36c008040 comp rx=0 tx=0).stop 2024-04-26T23:50:35.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 msgr2=0x7fc37c09e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c09e020 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc374009e50 tx=0x7fc374019740 comp rx=0 tx=0).stop 2024-04-26T23:50:35.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 shutdown_connections 2024-04-26T23:50:35.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc358068650 0x7fc35806ab10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc37c1603e0 0x7fc37c09e020 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc37c0d0390 0x7fc37c148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 --2- 172.21.15.47:0/3096670216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc37c06c630 0x7fc37c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 >> 172.21.15.47:0/3096670216 conn(0x7fc37c0b2b70 msgr2=0x7fc37c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 shutdown_connections 2024-04-26T23:50:35.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.592+0000 7fc383600640 1 -- 172.21.15.47:0/3096670216 wait complete. 2024-04-26T23:50:35.617 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:50:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.752+0000 7feade000640 1 Processor -- start 2024-04-26T23:50:35.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.752+0000 7feade000640 1 -- start start 2024-04-26T23:50:35.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.752+0000 7feade000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead809c170 0x7fead80d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.752+0000 7feade000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead8071620 con 0x7fead8162ab0 2024-04-26T23:50:35.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.752+0000 7feade000640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead8162e90 con 0x7fead80b56f0 2024-04-26T23:50:35.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.752+0000 7feade000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fead80d2d40 con 0x7fead809c170 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7fead7400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fead8162ab0 0x7fead809ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49090/0 (socket says 172.21.15.47:49090) 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7fead7400640 1 -- 172.21.15.47:0/3516916514 learned_addr learned my addr 172.21.15.47:0/3516916514 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7feacfe00640 1 --2- 172.21.15.47:0/3516916514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead809c170 0x7fead80d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63639653 0 0) 0x7fead8071620 con 0x7fead8162ab0 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feabc003530 con 0x7fead8162ab0 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200330047 0 0) 0x7fead8162e90 con 0x7fead80b56f0 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead8071620 con 0x7fead80b56f0 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 519732472 0 0) 0x7feabc003530 con 0x7fead8162ab0 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7feacfe00640 1 -- 172.21.15.47:0/3516916514 >> v1:172.21.15.203:6789/0 conn(0x7fead80b56f0 legacy=0x7fead80d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7feacfe00640 1 -- 172.21.15.47:0/3516916514 >> v1:172.21.15.47:6789/0 conn(0x7fead8162ab0 legacy=0x7fead809ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7feacfe00640 1 -- 172.21.15.47:0/3516916514 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead806dfc0 con 0x7fead809c170 2024-04-26T23:50:35.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.756+0000 7feacfe00640 1 --2- 172.21.15.47:0/3516916514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead809c170 0x7fead80d1310 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feac00097f0 tx=0x7feac001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc8c17c0d0c0943 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac00b0070 con 0x7fead809c170 2024-04-26T23:50:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac00ab400 con 0x7fead809c170 2024-04-26T23:50:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7fead6a00640 1 -- 172.21.15.47:0/3516916514 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8001680 con 0x7fead809c170 2024-04-26T23:50:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- 172.21.15.47:0/3516916514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead809c170 msgr2=0x7fead80d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 --2- 172.21.15.47:0/3516916514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead809c170 0x7fead80d1310 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feac00097f0 tx=0x7feac001c370 comp rx=0 tx=0).stop 2024-04-26T23:50:35.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- 172.21.15.47:0/3516916514 shutdown_connections 2024-04-26T23:50:35.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 --2- 172.21.15.47:0/3516916514 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead809c170 0x7fead80d1310 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- 172.21.15.47:0/3516916514 >> 172.21.15.47:0/3516916514 conn(0x7fead80b4c00 msgr2=0x7fead80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- 172.21.15.47:0/3516916514 shutdown_connections 2024-04-26T23:50:35.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- 172.21.15.47:0/3516916514 wait complete. 2024-04-26T23:50:35.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 Processor -- start 2024-04-26T23:50:35.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- start start 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead809c170 0x7fead8070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead80b56f0 0x7fead80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead8162ab0 0x7fead815e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fead80721b0 con 0x7fead809c170 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fead80718e0 con 0x7fead8162ab0 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feade000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fead8072330 con 0x7fead80b56f0 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7fead7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead809c170 0x7fead8070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7fead7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead809c170 0x7fead8070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48268/0 (socket says 172.21.15.47:48268) 2024-04-26T23:50:35.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7fead7400640 1 -- 172.21.15.47:0/1663687462 learned_addr learned my addr 172.21.15.47:0/1663687462 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7feacfe00640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead80b56f0 0x7fead80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.760+0000 7fead7e00640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead8162ab0 0x7fead815e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7fead7400640 1 -- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead80b56f0 msgr2=0x7fead80c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7fead7400640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead80b56f0 0x7fead80c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7fead7400640 1 -- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead8162ab0 msgr2=0x7fead815e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7fead7400640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead8162ab0 0x7fead815e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7fead7400640 1 -- 172.21.15.47:0/1663687462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead80c95a0 con 0x7fead809c170 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7fead7e00640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead8162ab0 0x7fead815e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7fead7400640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead809c170 0x7fead8070730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7feac800c730 tx=0x7feac800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feacf400640 1 -- 172.21.15.47:0/1663687462 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8017070 con 0x7fead809c170 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feacf400640 1 -- 172.21.15.47:0/1663687462 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac8005b00 con 0x7fead809c170 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead80c9880 con 0x7fead809c170 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feacf400640 1 -- 172.21.15.47:0/1663687462 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac8007070 con 0x7fead809c170 2024-04-26T23:50:35.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead80c9e40 con 0x7fead809c170 2024-04-26T23:50:35.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead8069700 con 0x7fead809c170 2024-04-26T23:50:35.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feacf400640 1 -- 172.21.15.47:0/1663687462 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7feac801a070 con 0x7fead809c170 2024-04-26T23:50:35.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feacf400640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab4068650 0x7feab406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:35.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feacf400640 1 -- 172.21.15.47:0/1663687462 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7feac80862c0 con 0x7fead809c170 2024-04-26T23:50:35.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.764+0000 7feacfe00640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab4068650 0x7feab406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:35.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.768+0000 7feacfe00640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab4068650 0x7feab406ab10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feac00ad000 tx=0x7feac00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:35.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.768+0000 7feacf400640 1 -- 172.21.15.47:0/1663687462 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7feac8055e60 con 0x7fead809c170 2024-04-26T23:50:35.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.932+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fead80b4150 con 0x7fead809c170 2024-04-26T23:50:35.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.932+0000 7feacf400640 1 -- 172.21.15.47:0/1663687462 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7feac805a160 con 0x7fead809c170 2024-04-26T23:50:35.941 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:50:35.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab4068650 msgr2=0x7feab406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab4068650 0x7feab406ab10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feac00ad000 tx=0x7feac00a6000 comp rx=0 tx=0).stop 2024-04-26T23:50:35.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead809c170 msgr2=0x7fead8070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead809c170 0x7fead8070730 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7feac800c730 tx=0x7feac800cbf0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 shutdown_connections 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7feab4068650 0x7feab406ab10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fead8162ab0 0x7fead815e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fead80b56f0 0x7fead80c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 --2- 172.21.15.47:0/1663687462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fead809c170 0x7fead8070730 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 >> 172.21.15.47:0/1663687462 conn(0x7fead80b4c00 msgr2=0x7fead80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 shutdown_connections 2024-04-26T23:50:35.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:35.936+0000 7feade000640 1 -- 172.21.15.47:0/1663687462 wait complete. 2024-04-26T23:50:35.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:50:36.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 Processor -- start 2024-04-26T23:50:36.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 -- start start 2024-04-26T23:50:36.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59180d0390 0x7f59180af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f591806c630 0x7f591806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f591815fcd0 0x7f5918160160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f59180ae6a0 con 0x7f591815fcd0 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f59180ae920 con 0x7f591806c630 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f591da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f59180aec00 con 0x7f59180d0390 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f591815fcd0 0x7f5918160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f591815fcd0 0x7f5918160160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48276/0 (socket says 172.21.15.47:48276) 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 -- 172.21.15.47:0/1353086535 learned_addr learned my addr 172.21.15.47:0/1353086535 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5916a00640 1 --2- 172.21.15.47:0/1353086535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59180d0390 0x7f59180af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f590e000640 1 --2- 172.21.15.47:0/1353086535 >> v2:172.21.15.203:3300/0 conn(0x7f591806c630 0x7f591806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 -- 172.21.15.47:0/1353086535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59180d0390 msgr2=0x7f59180af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:36.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 --2- 172.21.15.47:0/1353086535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59180d0390 0x7f59180af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 -- 172.21.15.47:0/1353086535 >> v2:172.21.15.203:3300/0 conn(0x7f591806c630 msgr2=0x7f591806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:36.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 --2- 172.21.15.47:0/1353086535 >> v2:172.21.15.203:3300/0 conn(0x7f591806c630 0x7f591806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.100+0000 7f5917400640 1 -- 172.21.15.47:0/1353086535 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59180aeee0 con 0x7f591815fcd0 2024-04-26T23:50:36.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f5917400640 1 --2- 172.21.15.47:0/1353086535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591815fcd0 0x7f5918160160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f59180742f0 tx=0x7f591001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1a9d510a35cf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f5916000640 1 -- 172.21.15.47:0/1353086535 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100a5660 con 0x7f591815fcd0 2024-04-26T23:50:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f5916000640 1 -- 172.21.15.47:0/1353086535 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59100a5800 con 0x7f591815fcd0 2024-04-26T23:50:36.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f5916000640 1 -- 172.21.15.47:0/1353086535 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100a5bd0 con 0x7f591815fcd0 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 -- 172.21.15.47:0/1353086535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591815fcd0 msgr2=0x7f5918160160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 --2- 172.21.15.47:0/1353086535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591815fcd0 0x7f5918160160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f59180742f0 tx=0x7f591001c960 comp rx=0 tx=0).stop 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 -- 172.21.15.47:0/1353086535 shutdown_connections 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 --2- 172.21.15.47:0/1353086535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f591815fcd0 0x7f5918160160 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 --2- 172.21.15.47:0/1353086535 >> v2:172.21.15.203:3300/0 conn(0x7f591806c630 0x7f591806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 --2- 172.21.15.47:0/1353086535 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f59180d0390 0x7f59180af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 -- 172.21.15.47:0/1353086535 >> 172.21.15.47:0/1353086535 conn(0x7f59180b2b70 msgr2=0x7f59180b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 -- 172.21.15.47:0/1353086535 shutdown_connections 2024-04-26T23:50:36.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 -- 172.21.15.47:0/1353086535 wait complete. 2024-04-26T23:50:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 Processor -- start 2024-04-26T23:50:36.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.104+0000 7f591da00640 1 -- start start 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f591806c630 0x7f5918151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59180d0390 0x7f59181479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f591815fcd0 0x7f5918150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f591806f860 con 0x7f59180d0390 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f591806f6e0 con 0x7f591815fcd0 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f591806f9e0 con 0x7f591806c630 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59180d0390 0x7f59181479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59180d0390 0x7f59181479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48292/0 (socket says 172.21.15.47:48292) 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f5916a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f591806c630 0x7f5918151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 -- 172.21.15.47:0/1557409815 learned_addr learned my addr 172.21.15.47:0/1557409815 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f5917400640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f591815fcd0 0x7f5918150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 -- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f591806c630 msgr2=0x7f5918151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f591806c630 0x7f5918151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 -- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f591815fcd0 msgr2=0x7f5918150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f591815fcd0 0x7f5918150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 -- 172.21.15.47:0/1557409815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591814fc60 con 0x7f59180d0390 2024-04-26T23:50:36.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590e000640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59180d0390 0x7f59181479f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f590000d800 tx=0x7f590000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590f400640 1 -- 172.21.15.47:0/1557409815 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900018020 con 0x7f59180d0390 2024-04-26T23:50:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590f400640 1 -- 172.21.15.47:0/1557409815 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59000096a0 con 0x7f59180d0390 2024-04-26T23:50:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590f400640 1 -- 172.21.15.47:0/1557409815 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900009a50 con 0x7f59180d0390 2024-04-26T23:50:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591814ff40 con 0x7f59180d0390 2024-04-26T23:50:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5918150500 con 0x7f59180d0390 2024-04-26T23:50:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5918069700 con 0x7f59180d0390 2024-04-26T23:50:36.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.108+0000 7f590f400640 1 -- 172.21.15.47:0/1557409815 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f590001b020 con 0x7f59180d0390 2024-04-26T23:50:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.112+0000 7f590f400640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58f4068650 0x7f58f406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.112+0000 7f590f400640 1 -- 172.21.15.47:0/1557409815 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f5900087270 con 0x7f59180d0390 2024-04-26T23:50:36.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.112+0000 7f5916a00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58f4068650 0x7f58f406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.112+0000 7f5916a00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58f4068650 0x7f58f406ab10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5908007a60 tx=0x7f5908008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.116+0000 7f590f400640 1 -- 172.21.15.47:0/1557409815 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5900022020 con 0x7f59180d0390 2024-04-26T23:50:36.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f591806ecb0 con 0x7f59180d0390 2024-04-26T23:50:36.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f590f400640 1 -- 172.21.15.47:0/1557409815 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f5900056ea0 con 0x7f59180d0390 2024-04-26T23:50:36.291 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58f4068650 msgr2=0x7f58f406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58f4068650 0x7f58f406ab10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5908007a60 tx=0x7f5908008040 comp rx=0 tx=0).stop 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59180d0390 msgr2=0x7f59181479f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59180d0390 0x7f59181479f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f590000d800 tx=0x7f590000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 shutdown_connections 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f58f4068650 0x7f58f406ab10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f591815fcd0 0x7f5918150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f59180d0390 0x7f59181479f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 --2- 172.21.15.47:0/1557409815 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f591806c630 0x7f5918151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 >> 172.21.15.47:0/1557409815 conn(0x7f59180b2b70 msgr2=0x7f591815e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 shutdown_connections 2024-04-26T23:50:36.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.284+0000 7f591da00640 1 -- 172.21.15.47:0/1557409815 wait complete. 2024-04-26T23:50:36.312 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T23:50:36.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec3e200640 1 Processor -- start 2024-04-26T23:50:36.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec3e200640 1 -- start start 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec3e200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fec380729a0 0x7fec38160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec3e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38163500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec3e200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec380739a0 con 0x7fec38072d80 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec3e200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fec380b62e0 con 0x7fec380729a0 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec3e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fec381607c0 con 0x7fec3806fc50 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec37e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec37400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fec380729a0 0x7fec38160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec37400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fec380729a0 0x7fec38160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:53906/0 (socket says 172.21.15.47:53906) 2024-04-26T23:50:36.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec37e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38163500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:48296/0 (socket says 172.21.15.47:48296) 2024-04-26T23:50:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec37400640 1 -- 172.21.15.47:0/2026510546 learned_addr learned my addr 172.21.15.47:0/2026510546 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.448+0000 7fec2fe00640 1 --1- 172.21.15.47:0/2026510546 >> v1:172.21.15.203:6789/0 conn(0x7fec38072d80 0x7fec38162df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:56384/0 (socket says 172.21.15.47:56384) 2024-04-26T23:50:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec37400640 1 -- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 msgr2=0x7fec38163500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec37400640 1 --2- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38163500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec37400640 1 -- 172.21.15.47:0/2026510546 >> v1:172.21.15.203:6789/0 conn(0x7fec38072d80 legacy=0x7fec38162df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec37400640 1 -- 172.21.15.47:0/2026510546 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec380b56d0 con 0x7fec380729a0 2024-04-26T23:50:36.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec37e00640 1 --2- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38163500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:36.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec37400640 1 --2- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 0x7fec38160280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fec28009870 tx=0x7fec2801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=871910fb60f1afac server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec36a00640 1 -- 172.21.15.47:0/2026510546 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec280aa600 con 0x7fec380729a0 2024-04-26T23:50:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec36a00640 1 -- 172.21.15.47:0/2026510546 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec280af070 con 0x7fec380729a0 2024-04-26T23:50:36.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.452+0000 7fec36a00640 1 -- 172.21.15.47:0/2026510546 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec280aa9c0 con 0x7fec380729a0 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 msgr2=0x7fec38160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 --2- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 0x7fec38160280 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fec28009870 tx=0x7fec2801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- 172.21.15.47:0/2026510546 shutdown_connections 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 --2- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38163500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 --2- 172.21.15.47:0/2026510546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 0x7fec38160280 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- 172.21.15.47:0/2026510546 >> 172.21.15.47:0/2026510546 conn(0x7fec38070c00 msgr2=0x7fec3806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- 172.21.15.47:0/2026510546 shutdown_connections 2024-04-26T23:50:36.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- 172.21.15.47:0/2026510546 wait complete. 2024-04-26T23:50:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 Processor -- start 2024-04-26T23:50:36.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- start start 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 0x7fec38154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec38072d80 0x7fec38161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fec38073310 con 0x7fec38072d80 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec38073190 con 0x7fec380729a0 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec3e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fec3815d0b0 con 0x7fec3806fc50 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec38072d80 0x7fec38161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec38072d80 0x7fec38161d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48308/0 (socket says 172.21.15.47:48308) 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 -- 172.21.15.47:0/3239115679 learned_addr learned my addr 172.21.15.47:0/3239115679 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec2fe00640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 0x7fec38154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37400640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 -- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 msgr2=0x7fec38159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 -- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 msgr2=0x7fec38154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 0x7fec38154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 -- 172.21.15.47:0/3239115679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3815f060 con 0x7fec38072d80 2024-04-26T23:50:36.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec37e00640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec38072d80 0x7fec38161d20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fec3000ef90 tx=0x7fec3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.456+0000 7fec2f400640 1 -- 172.21.15.47:0/3239115679 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30018020 con 0x7fec38072d80 2024-04-26T23:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec2f400640 1 -- 172.21.15.47:0/3239115679 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec30014480 con 0x7fec38072d80 2024-04-26T23:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec2f400640 1 -- 172.21.15.47:0/3239115679 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec30014870 con 0x7fec38072d80 2024-04-26T23:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec3815f320 con 0x7fec38072d80 2024-04-26T23:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec38147a40 con 0x7fec38072d80 2024-04-26T23:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3815f840 con 0x7fec38072d80 2024-04-26T23:50:36.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec2f400640 1 -- 172.21.15.47:0/3239115679 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fec3001b020 con 0x7fec38072d80 2024-04-26T23:50:36.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec2f400640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fec14068650 0x7fec1406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:36.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec2f400640 1 -- 172.21.15.47:0/3239115679 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fec30087a70 con 0x7fec38072d80 2024-04-26T23:50:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.460+0000 7fec37400640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fec14068650 0x7fec1406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:36.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.464+0000 7fec37400640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fec14068650 0x7fec1406ab10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fec280ae000 tx=0x7fec280a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:36.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.464+0000 7fec2f400640 1 -- 172.21.15.47:0/3239115679 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fec3815f840 con 0x7fec38072d80 2024-04-26T23:50:36.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.644+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fec380695f0 con 0x7fec38072d80 2024-04-26T23:50:36.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.644+0000 7fec2f400640 1 -- 172.21.15.47:0/3239115679 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7fec30022030 con 0x7fec38072d80 2024-04-26T23:50:36.653 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-04-26T23:50:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fec14068650 msgr2=0x7fec1406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fec14068650 0x7fec1406ab10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fec280ae000 tx=0x7fec280a7000 comp rx=0 tx=0).stop 2024-04-26T23:50:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec38072d80 msgr2=0x7fec38161d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec38072d80 0x7fec38161d20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fec3000ef90 tx=0x7fec3000c490 comp rx=0 tx=0).stop 2024-04-26T23:50:36.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 shutdown_connections 2024-04-26T23:50:36.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fec14068650 0x7fec1406ab10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec38072d80 0x7fec38161d20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec380729a0 0x7fec38154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 --2- 172.21.15.47:0/3239115679 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fec3806fc50 0x7fec38159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:36.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 >> 172.21.15.47:0/3239115679 conn(0x7fec38070c00 msgr2=0x7fec38162d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:36.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 shutdown_connections 2024-04-26T23:50:36.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:36.648+0000 7fec3e200640 1 -- 172.21.15.47:0/3239115679 wait complete. 2024-04-26T23:50:36.675 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi203.front.sepia.ceph.com... 2024-04-26T23:50:36.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:36.675 DEBUG:teuthology.orchestra.run.smithi203:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-26T23:50:36.695 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi203.stderr:ceph-fuse[33894]: fuse finished with error 0 and tester_r 0 2024-04-26T23:50:36.698 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:50:36.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:36.698 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-26T23:50:36.864 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:50:36.864 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:50:36.864 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:36.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:50:36.873 INFO:tasks.cephfs.mount:Terminating background process 2024-04-26T23:50:36.873 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:50:36.873 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:36.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350228k,nr_inodes=4087557,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6713 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:50:36.914 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:37.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.048+0000 7fd3f1c00640 1 Processor -- start 2024-04-26T23:50:37.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.048+0000 7fd3f1c00640 1 -- start start 2024-04-26T23:50:37.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3f1c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd3ec0ce310 0x7fd3ec15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3f1c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ec15fc50 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3f1c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3ec15ff30 con 0x7fd3ec15c100 2024-04-26T23:50:37.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3f1c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd3ec160860 con 0x7fd3ec0ce310 2024-04-26T23:50:37.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3eb400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd3ec06fcd0 0x7fd3ec0b4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49106/0 (socket says 172.21.15.47:49106) 2024-04-26T23:50:37.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3eb400640 1 -- 172.21.15.47:0/3268204283 learned_addr learned my addr 172.21.15.47:0/3268204283 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:37.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3e3e00640 1 --2- 172.21.15.47:0/3268204283 >> v2:172.21.15.47:3300/0 conn(0x7fd3ec0ce310 0x7fd3ec15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3ea000640 1 -- 172.21.15.47:0/3268204283 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285833884 0 0) 0x7fd3ec15fc50 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3ea000640 1 -- 172.21.15.47:0/3268204283 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3d0005740 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3e3e00640 1 -- 172.21.15.47:0/3268204283 >> v1:172.21.15.203:6789/0 conn(0x7fd3ec15c100 legacy=0x7fd3ec0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3e3e00640 1 -- 172.21.15.47:0/3268204283 >> v1:172.21.15.47:6789/0 conn(0x7fd3ec06fcd0 legacy=0x7fd3ec0b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.052+0000 7fd3e3e00640 1 -- 172.21.15.47:0/3268204283 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ec160210 con 0x7fd3ec0ce310 2024-04-26T23:50:37.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3e3e00640 1 --2- 172.21.15.47:0/3268204283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec0ce310 0x7fd3ec15cf60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40097a0 tx=0x7fd3d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f021b309285f240d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3ea000640 1 -- 172.21.15.47:0/3268204283 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40b1070 con 0x7fd3ec0ce310 2024-04-26T23:50:37.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3ea000640 1 -- 172.21.15.47:0/3268204283 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d40ac5f0 con 0x7fd3ec0ce310 2024-04-26T23:50:37.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3ea000640 1 -- 172.21.15.47:0/3268204283 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40ac9c0 con 0x7fd3ec0ce310 2024-04-26T23:50:37.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 -- 172.21.15.47:0/3268204283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec0ce310 msgr2=0x7fd3ec15cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/3268204283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec0ce310 0x7fd3ec15cf60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40097a0 tx=0x7fd3d401c480 comp rx=0 tx=0).stop 2024-04-26T23:50:37.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 -- 172.21.15.47:0/3268204283 shutdown_connections 2024-04-26T23:50:37.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/3268204283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec0ce310 0x7fd3ec15cf60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 -- 172.21.15.47:0/3268204283 >> 172.21.15.47:0/3268204283 conn(0x7fd3ec06c800 msgr2=0x7fd3ec06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 -- 172.21.15.47:0/3268204283 shutdown_connections 2024-04-26T23:50:37.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 -- 172.21.15.47:0/3268204283 wait complete. 2024-04-26T23:50:37.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 Processor -- start 2024-04-26T23:50:37.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 -- start start 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.056+0000 7fd3f1c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec06fcd0 0x7fd3ec156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3ec0ce310 0x7fd3ec1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec15c100 0x7fd3ec15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec0cec00 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec0b6000 con 0x7fd3ec15c100 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd3ec0ced80 con 0x7fd3ec0ce310 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec06fcd0 0x7fd3ec156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec06fcd0 0x7fd3ec156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48330/0 (socket says 172.21.15.47:48330) 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 -- 172.21.15.47:0/404024762 learned_addr learned my addr 172.21.15.47:0/404024762 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eb400640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec15c100 0x7fd3ec15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 -- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3ec0ce310 msgr2=0x7fd3ec1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3e3e00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3ec0ce310 0x7fd3ec1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3ec0ce310 0x7fd3ec1559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 -- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec15c100 msgr2=0x7fd3ec15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec15c100 0x7fd3ec15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 -- 172.21.15.47:0/404024762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ec09d330 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eb400640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec15c100 0x7fd3ec15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3e3e00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3ec0ce310 0x7fd3ec1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3eaa00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec06fcd0 0x7fd3ec156c30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c3c0 tx=0x7fd3dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3e2a00640 1 -- 172.21.15.47:0/404024762 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc017070 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3e2a00640 1 -- 172.21.15.47:0/404024762 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc0052d0 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3ec0b0960 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3e2a00640 1 -- 172.21.15.47:0/404024762 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc003840 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3ec157fa0 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3ec069700 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.060+0000 7fd3e2a00640 1 -- 172.21.15.47:0/404024762 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fd3dc01a070 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.064+0000 7fd3e2a00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3c8068650 0x7fd3c806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.064+0000 7fd3e2a00640 1 -- 172.21.15.47:0/404024762 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fd3dc0861f0 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.064+0000 7fd3e3e00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3c8068650 0x7fd3c806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.064+0000 7fd3e3e00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3c8068650 0x7fd3c806ab10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40ae000 tx=0x7fd3d4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.068+0000 7fd3e2a00640 1 -- 172.21.15.47:0/404024762 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd3ec09d330 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.272+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3ec0d08b0 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.272+0000 7fd3e2a00640 1 -- 172.21.15.47:0/404024762 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5181 (secure 0 0 0) 0x7fd3dc005480 con 0x7fd3ec06fcd0 2024-04-26T23:50:37.281 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:37.282 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2875189318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2875189318},{"type":"v1","addr":"172.21.15.203:6836","nonce":2875189318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/629228023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":629228023},{"type":"v1","addr":"172.21.15.203:6837","nonce":629228023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5910,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/868771075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":868771075},{"type":"v1","addr":"172.21.15.47:6834","nonce":868771075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:48:04.603648+0000","modified":"2024-04-26T23:48:07.629516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5913},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5913":{"gid":5913,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/3889822755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3889822755},{"type":"v1","addr":"172.21.15.47:6835","nonce":3889822755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5913,"qdb_cluster":[5913]},"id":3}]} 2024-04-26T23:50:37.282 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3c8068650 msgr2=0x7fd3c806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3c8068650 0x7fd3c806ab10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40ae000 tx=0x7fd3d4008040 comp rx=0 tx=0).stop 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec06fcd0 msgr2=0x7fd3ec156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec06fcd0 0x7fd3ec156c30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c3c0 tx=0x7fd3dc00c880 comp rx=0 tx=0).stop 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 shutdown_connections 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd3c8068650 0x7fd3c806ab10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3ec15c100 0x7fd3ec15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd3ec0ce310 0x7fd3ec1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 --2- 172.21.15.47:0/404024762 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd3ec06fcd0 0x7fd3ec156c30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 >> 172.21.15.47:0/404024762 conn(0x7fd3ec06c800 msgr2=0x7fd3ec06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 shutdown_connections 2024-04-26T23:50:37.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.276+0000 7fd3f1c00640 1 -- 172.21.15.47:0/404024762 wait complete. 2024-04-26T23:50:37.303 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 Processor -- start 2024-04-26T23:50:37.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 -- start start 2024-04-26T23:50:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a1015f080 0x7f6a100b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6a100b6830 0x7f6a100cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6a100731e0 0x7f6a10073670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f6a100b6c90 con 0x7f6a100731e0 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6a100b4db0 con 0x7f6a100b6830 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a16e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a100b5090 con 0x7f6a1015f080 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6a100731e0 0x7f6a10073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6a100731e0 0x7f6a10073670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48346/0 (socket says 172.21.15.47:48346) 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 -- 172.21.15.47:0/1384864483 learned_addr learned my addr 172.21.15.47:0/1384864483 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a0fe00640 1 --2- 172.21.15.47:0/1384864483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a1015f080 0x7f6a100b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a07e00640 1 --2- 172.21.15.47:0/1384864483 >> v2:172.21.15.203:3300/0 conn(0x7f6a100b6830 0x7f6a100cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 -- 172.21.15.47:0/1384864483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a1015f080 msgr2=0x7f6a100b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 --2- 172.21.15.47:0/1384864483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a1015f080 0x7f6a100b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 -- 172.21.15.47:0/1384864483 >> v2:172.21.15.203:3300/0 conn(0x7f6a100b6830 msgr2=0x7f6a100cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 --2- 172.21.15.47:0/1384864483 >> v2:172.21.15.203:3300/0 conn(0x7f6a100b6830 0x7f6a100cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.436+0000 7f6a14e00640 1 -- 172.21.15.47:0/1384864483 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a100ce210 con 0x7f6a100731e0 2024-04-26T23:50:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a14e00640 1 --2- 172.21.15.47:0/1384864483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a10073670 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6a100cf230 tx=0x7f6a0801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f563e6830deec19 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a0f400640 1 -- 172.21.15.47:0/1384864483 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080a5670 con 0x7f6a100731e0 2024-04-26T23:50:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a0f400640 1 -- 172.21.15.47:0/1384864483 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a080a5810 con 0x7f6a100731e0 2024-04-26T23:50:37.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a0f400640 1 -- 172.21.15.47:0/1384864483 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080a5be0 con 0x7f6a100731e0 2024-04-26T23:50:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 -- 172.21.15.47:0/1384864483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 msgr2=0x7f6a10073670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 --2- 172.21.15.47:0/1384864483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a10073670 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6a100cf230 tx=0x7f6a0801c9f0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 -- 172.21.15.47:0/1384864483 shutdown_connections 2024-04-26T23:50:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 --2- 172.21.15.47:0/1384864483 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a10073670 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 --2- 172.21.15.47:0/1384864483 >> v2:172.21.15.203:3300/0 conn(0x7f6a100b6830 0x7f6a100cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 --2- 172.21.15.47:0/1384864483 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a1015f080 0x7f6a100b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 -- 172.21.15.47:0/1384864483 >> 172.21.15.47:0/1384864483 conn(0x7f6a10075c20 msgr2=0x7f6a10076030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 -- 172.21.15.47:0/1384864483 shutdown_connections 2024-04-26T23:50:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.440+0000 7f6a16e00640 1 -- 172.21.15.47:0/1384864483 wait complete. 2024-04-26T23:50:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 Processor -- start 2024-04-26T23:50:37.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 -- start start 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a1015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a100b6830 0x7f6a10141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a1015f080 0x7f6a10146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1015f5e0 con 0x7f6a100731e0 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1015f460 con 0x7f6a1015f080 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1006f120 con 0x7f6a100b6830 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a1015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a1015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48354/0 (socket says 172.21.15.47:48354) 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 -- 172.21.15.47:0/3879715739 learned_addr learned my addr 172.21.15.47:0/3879715739 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:37.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a07e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a100b6830 0x7f6a10141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a14e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a1015f080 0x7f6a10146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 -- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a100b6830 msgr2=0x7f6a10141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a100b6830 0x7f6a10141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 -- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a1015f080 msgr2=0x7f6a10146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a1015f080 0x7f6a10146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 -- 172.21.15.47:0/3879715739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1015ccf0 con 0x7f6a100731e0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a07e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a100b6830 0x7f6a10141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a14e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a1015f080 0x7f6a10146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0fe00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a1015c680 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000e870 tx=0x7f6a0000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0cc00640 1 -- 172.21.15.47:0/3879715739 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00017070 con 0x7f6a100731e0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0cc00640 1 -- 172.21.15.47:0/3879715739 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0000c940 con 0x7f6a100731e0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a0cc00640 1 -- 172.21.15.47:0/3879715739 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000ccf0 con 0x7f6a100731e0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1015cfd0 con 0x7f6a100731e0 2024-04-26T23:50:37.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.444+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1015d590 con 0x7f6a100731e0 2024-04-26T23:50:37.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.448+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10069700 con 0x7f6a100731e0 2024-04-26T23:50:37.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.448+0000 7f6a0cc00640 1 -- 172.21.15.47:0/3879715739 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f6a0001a070 con 0x7f6a100731e0 2024-04-26T23:50:37.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.448+0000 7f6a0cc00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f69ec068650 0x7f69ec06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.448+0000 7f6a0cc00640 1 -- 172.21.15.47:0/3879715739 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f6a00087480 con 0x7f6a100731e0 2024-04-26T23:50:37.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.448+0000 7f6a07e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f69ec068650 0x7f69ec06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.452+0000 7f6a07e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f69ec068650 0x7f69ec06ab10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6a10157e10 tx=0x7f69f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.452+0000 7f6a0cc00640 1 -- 172.21.15.47:0/3879715739 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6a000576f0 con 0x7f6a100731e0 2024-04-26T23:50:37.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.616+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a100687b0 con 0x7f6a100731e0 2024-04-26T23:50:37.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a0cc00640 1 -- 172.21.15.47:0/3879715739 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16752 (secure 0 0 0) 0x7f6a00056ff0 con 0x7f6a100731e0 2024-04-26T23:50:37.627 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:37.627 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":51,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:14.262711+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f69ec068650 msgr2=0x7f69ec06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f69ec068650 0x7f69ec06ab10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6a10157e10 tx=0x7f69f8008040 comp rx=0 tx=0).stop 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 msgr2=0x7f6a1015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a1015c680 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000e870 tx=0x7f6a0000ec70 comp rx=0 tx=0).stop 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 shutdown_connections 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f69ec068650 0x7f69ec06ab10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a1015f080 0x7f6a10146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6a100b6830 0x7f6a10141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 --2- 172.21.15.47:0/3879715739 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6a100731e0 0x7f6a1015c680 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 >> 172.21.15.47:0/3879715739 conn(0x7f6a10075c20 msgr2=0x7f6a100d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 shutdown_connections 2024-04-26T23:50:37.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.620+0000 7f6a16e00640 1 -- 172.21.15.47:0/3879715739 wait complete. 2024-04-26T23:50:37.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T23:45:20.179058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T23:48:03.004737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T23:48:03.560025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T23:50:37.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T23:50:37.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.784+0000 7f15dde00640 1 Processor -- start 2024-04-26T23:50:37.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15dde00640 1 -- start start 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15dde00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f15d815cf50 0x7f15d80cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15dde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d806cd40 0x7f15d8160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15dde00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d80ae030 con 0x7f15d80d04b0 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15dde00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f15d80af7a0 con 0x7f15d815cf50 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15dde00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f15d80d0ae0 con 0x7f15d806cd40 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15d6a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f15d815cf50 0x7f15d80cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15cfe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f15d80d04b0 0x7f15d806c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49108/0 (socket says 172.21.15.47:49108) 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15cfe00640 1 -- 172.21.15.47:0/2403104688 learned_addr learned my addr 172.21.15.47:0/2403104688 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:37.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15d7400640 1 --2- 172.21.15.47:0/2403104688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d806cd40 0x7f15d8160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15d6a00640 1 -- 172.21.15.47:0/2403104688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d806cd40 msgr2=0x7f15d8160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:37.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15d6a00640 1 --2- 172.21.15.47:0/2403104688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d806cd40 0x7f15d8160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15d6a00640 1 -- 172.21.15.47:0/2403104688 >> v1:172.21.15.47:6789/0 conn(0x7f15d80d04b0 legacy=0x7f15d806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.788+0000 7f15d6a00640 1 -- 172.21.15.47:0/2403104688 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d80af9d0 con 0x7f15d815cf50 2024-04-26T23:50:37.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15d6a00640 1 --2- 172.21.15.47:0/2403104688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d815cf50 0x7f15d80cff70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f15c80097c0 tx=0x7f15c801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5e5d237cf282b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15d6000640 1 -- 172.21.15.47:0/2403104688 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80b2070 con 0x7f15d815cf50 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15d6000640 1 -- 172.21.15.47:0/2403104688 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c80ad680 con 0x7f15d815cf50 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15d6000640 1 -- 172.21.15.47:0/2403104688 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80ada50 con 0x7f15d815cf50 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 -- 172.21.15.47:0/2403104688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d815cf50 msgr2=0x7f15d80cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 --2- 172.21.15.47:0/2403104688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d815cf50 0x7f15d80cff70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f15c80097c0 tx=0x7f15c801c470 comp rx=0 tx=0).stop 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 -- 172.21.15.47:0/2403104688 shutdown_connections 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 --2- 172.21.15.47:0/2403104688 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d806cd40 0x7f15d8160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 --2- 172.21.15.47:0/2403104688 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d815cf50 0x7f15d80cff70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 -- 172.21.15.47:0/2403104688 >> 172.21.15.47:0/2403104688 conn(0x7f15d80b2b70 msgr2=0x7f15d80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 -- 172.21.15.47:0/2403104688 shutdown_connections 2024-04-26T23:50:37.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 -- 172.21.15.47:0/2403104688 wait complete. 2024-04-26T23:50:37.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 Processor -- start 2024-04-26T23:50:37.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.792+0000 7f15dde00640 1 -- start start 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d806cd40 0x7f15d814c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d80d04b0 0x7f15d814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d815cf50 0x7f15d8162390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f15d80b3c40 con 0x7f15d806cd40 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f15d815d330 con 0x7f15d815cf50 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f15d80b3dc0 con 0x7f15d80d04b0 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d806cd40 0x7f15d814c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d806cd40 0x7f15d814c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48376/0 (socket says 172.21.15.47:48376) 2024-04-26T23:50:37.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 -- 172.21.15.47:0/3817836881 learned_addr learned my addr 172.21.15.47:0/3817836881 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d7400640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d815cf50 0x7f15d8162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15cfe00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d80d04b0 0x7f15d814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 -- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d80d04b0 msgr2=0x7f15d814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d80d04b0 0x7f15d814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 -- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d815cf50 msgr2=0x7f15d8162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d815cf50 0x7f15d8162390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 -- 172.21.15.47:0/3817836881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d81630c0 con 0x7f15d806cd40 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d7400640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d815cf50 0x7f15d8162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15cfe00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d80d04b0 0x7f15d814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15d6a00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d806cd40 0x7f15d814c110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f15c801a0a0 tx=0x7f15c801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15cf400640 1 -- 172.21.15.47:0/3817836881 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80b2040 con 0x7f15d806cd40 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15cf400640 1 -- 172.21.15.47:0/3817836881 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c80be070 con 0x7f15d806cd40 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d8162de0 con 0x7f15d806cd40 2024-04-26T23:50:37.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15cf400640 1 -- 172.21.15.47:0/3817836881 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c80ade50 con 0x7f15d806cd40 2024-04-26T23:50:37.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d814cd60 con 0x7f15d806cd40 2024-04-26T23:50:37.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d8069700 con 0x7f15d806cd40 2024-04-26T23:50:37.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.796+0000 7f15cf400640 1 -- 172.21.15.47:0/3817836881 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f15c80c3460 con 0x7f15d806cd40 2024-04-26T23:50:37.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.800+0000 7f15cf400640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f15b40687f0 0x7f15b406acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:37.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.800+0000 7f15cf400640 1 -- 172.21.15.47:0/3817836881 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f15c81212c0 con 0x7f15d806cd40 2024-04-26T23:50:37.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.800+0000 7f15cfe00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f15b40687f0 0x7f15b406acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:37.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.800+0000 7f15cfe00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f15b40687f0 0x7f15b406acb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f15d8167e20 tx=0x7f15c0007ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:37.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.804+0000 7f15cf400640 1 -- 172.21.15.47:0/3817836881 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f15c8016090 con 0x7f15d806cd40 2024-04-26T23:50:37.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.968+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f15d809bde0 con 0x7f15d806cd40 2024-04-26T23:50:37.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.968+0000 7f15cf400640 1 -- 172.21.15.47:0/3817836881 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) ==== 93+0+10 (secure 0 0 0) 0x7f15c80f14d0 con 0x7f15d806cd40 2024-04-26T23:50:37.977 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f15b40687f0 msgr2=0x7f15b406acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f15b40687f0 0x7f15b406acb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f15d8167e20 tx=0x7f15c0007ba0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d806cd40 msgr2=0x7f15d814c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d806cd40 0x7f15d814c110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f15c801a0a0 tx=0x7f15c801acb0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 shutdown_connections 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f15b40687f0 0x7f15b406acb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d815cf50 0x7f15d8162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f15d80d04b0 0x7f15d814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 --2- 172.21.15.47:0/3817836881 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d806cd40 0x7f15d814c110 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:37.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 >> 172.21.15.47:0/3817836881 conn(0x7f15d80b2b70 msgr2=0x7f15d80720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:37.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 shutdown_connections 2024-04-26T23:50:37.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:37.972+0000 7f15dde00640 1 -- 172.21.15.47:0/3817836881 wait complete. 2024-04-26T23:50:37.999 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T23:50:38.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb960400640 1 Processor -- start 2024-04-26T23:50:38.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb960400640 1 -- start start 2024-04-26T23:50:38.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb960400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fb95815cf50 0x7fb9580cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb960400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9580d04b0 0x7fb95806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb960400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb95806cfe0 con 0x7fb95806cb70 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb960400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fb9580af7a0 con 0x7fb9580d04b0 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb960400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fb9580ae030 con 0x7fb95815cf50 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95d000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9580d04b0 0x7fb95806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95d000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb9580d04b0 0x7fb95806c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48392/0 (socket says 172.21.15.47:48392) 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95d000640 1 -- 172.21.15.47:0/467736982 learned_addr learned my addr 172.21.15.47:0/467736982 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95da00640 1 --2- 172.21.15.47:0/467736982 >> v2:172.21.15.203:3300/0 conn(0x7fb95815cf50 0x7fb9580cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95d000640 1 -- 172.21.15.47:0/467736982 >> v2:172.21.15.203:3300/0 conn(0x7fb95815cf50 msgr2=0x7fb9580cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95d000640 1 --2- 172.21.15.47:0/467736982 >> v2:172.21.15.203:3300/0 conn(0x7fb95815cf50 0x7fb9580cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95d000640 1 -- 172.21.15.47:0/467736982 >> v1:172.21.15.203:6789/0 conn(0x7fb95806cb70 legacy=0x7fb9580720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.136+0000 7fb95d000640 1 -- 172.21.15.47:0/467736982 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9580d0ae0 con 0x7fb9580d04b0 2024-04-26T23:50:38.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb95d000640 1 --2- 172.21.15.47:0/467736982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9580d04b0 0x7fb95806c630 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb9580738d0 tx=0x7fb94401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45db89f889115996 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb957e00640 1 -- 172.21.15.47:0/467736982 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9440b0070 con 0x7fb9580d04b0 2024-04-26T23:50:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb957e00640 1 -- 172.21.15.47:0/467736982 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9440ab600 con 0x7fb9580d04b0 2024-04-26T23:50:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb957e00640 1 -- 172.21.15.47:0/467736982 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9440ab9d0 con 0x7fb9580d04b0 2024-04-26T23:50:38.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 -- 172.21.15.47:0/467736982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9580d04b0 msgr2=0x7fb95806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 --2- 172.21.15.47:0/467736982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9580d04b0 0x7fb95806c630 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb9580738d0 tx=0x7fb94401c520 comp rx=0 tx=0).stop 2024-04-26T23:50:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 -- 172.21.15.47:0/467736982 shutdown_connections 2024-04-26T23:50:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 --2- 172.21.15.47:0/467736982 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb9580d04b0 0x7fb95806c630 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 --2- 172.21.15.47:0/467736982 >> v2:172.21.15.203:3300/0 conn(0x7fb95815cf50 0x7fb9580cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 -- 172.21.15.47:0/467736982 >> 172.21.15.47:0/467736982 conn(0x7fb9580b2b70 msgr2=0x7fb9580b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 -- 172.21.15.47:0/467736982 shutdown_connections 2024-04-26T23:50:38.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 -- 172.21.15.47:0/467736982 wait complete. 2024-04-26T23:50:38.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 Processor -- start 2024-04-26T23:50:38.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.140+0000 7fb960400640 1 -- start start 2024-04-26T23:50:38.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806cb70 0x7fb95809e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580d04b0 0x7fb95809d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb95815cf50 0x7fb958149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580b3c40 con 0x7fb95815cf50 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb95815d330 con 0x7fb95806cb70 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fb9580b3dc0 con 0x7fb9580d04b0 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb95815cf50 0x7fb958149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb95815cf50 0x7fb958149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48396/0 (socket says 172.21.15.47:48396) 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 -- 172.21.15.47:0/496148470 learned_addr learned my addr 172.21.15.47:0/496148470 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95da00640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806cb70 0x7fb95809e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 -- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580d04b0 msgr2=0x7fb95809d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580d04b0 0x7fb95809d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 -- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806cb70 msgr2=0x7fb95809e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806cb70 0x7fb95809e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 -- 172.21.15.47:0/496148470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95809da70 con 0x7fb95815cf50 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb95e400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb95815cf50 0x7fb958149af0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb95000c770 tx=0x7fb95000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb955600640 1 -- 172.21.15.47:0/496148470 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950003b80 con 0x7fb95815cf50 2024-04-26T23:50:38.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb955600640 1 -- 172.21.15.47:0/496148470 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb950003d20 con 0x7fb95815cf50 2024-04-26T23:50:38.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb955600640 1 -- 172.21.15.47:0/496148470 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95000aa90 con 0x7fb95815cf50 2024-04-26T23:50:38.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb958158c50 con 0x7fb95815cf50 2024-04-26T23:50:38.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb958158ef0 con 0x7fb95815cf50 2024-04-26T23:50:38.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.144+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb958069700 con 0x7fb95815cf50 2024-04-26T23:50:38.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.148+0000 7fb955600640 1 -- 172.21.15.47:0/496148470 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fb95000ac30 con 0x7fb95815cf50 2024-04-26T23:50:38.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.148+0000 7fb955600640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb938068650 0x7fb93806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.148+0000 7fb955600640 1 -- 172.21.15.47:0/496148470 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fb950086ce0 con 0x7fb95815cf50 2024-04-26T23:50:38.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.148+0000 7fb95da00640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb938068650 0x7fb93806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.148+0000 7fb95da00640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb938068650 0x7fb93806ab10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b930 tx=0x7fb94c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.152+0000 7fb955600640 1 -- 172.21.15.47:0/496148470 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fb950056f60 con 0x7fb95815cf50 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb958076810 con 0x7fb95815cf50 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb955600640 1 -- 172.21.15.47:0/496148470 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) ==== 104+0+11 (secure 0 0 0) 0x7fb950056860 con 0x7fb95815cf50 2024-04-26T23:50:38.323 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb938068650 msgr2=0x7fb93806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb938068650 0x7fb93806ab10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b930 tx=0x7fb94c008040 comp rx=0 tx=0).stop 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb95815cf50 msgr2=0x7fb958149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb95815cf50 0x7fb958149af0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb95000c770 tx=0x7fb95000cc30 comp rx=0 tx=0).stop 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 shutdown_connections 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fb938068650 0x7fb93806ab10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb95815cf50 0x7fb958149af0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fb9580d04b0 0x7fb95809d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 --2- 172.21.15.47:0/496148470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb95806cb70 0x7fb95809e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 >> 172.21.15.47:0/496148470 conn(0x7fb9580b2b70 msgr2=0x7fb9580720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 shutdown_connections 2024-04-26T23:50:38.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.316+0000 7fb960400640 1 -- 172.21.15.47:0/496148470 wait complete. 2024-04-26T23:50:38.345 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T23:50:38.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.480+0000 7f2501600640 1 Processor -- start 2024-04-26T23:50:38.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.480+0000 7f2501600640 1 -- start start 2024-04-26T23:50:38.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f2501600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc06f430 0x7f24fc0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f2501600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f24fc06f810 0x7f24fc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f2501600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24fc0cdd00 con 0x7f24fc160ac0 2024-04-26T23:50:38.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f2501600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f24fc0cf590 con 0x7f24fc06f810 2024-04-26T23:50:38.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f2501600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc0cf870 con 0x7f24fc06f430 2024-04-26T23:50:38.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f2500c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f24fc160ac0 0x7f24fc06df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49120/0 (socket says 172.21.15.47:49120) 2024-04-26T23:50:38.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f2500c00640 1 -- 172.21.15.47:0/2294843627 learned_addr learned my addr 172.21.15.47:0/2294843627 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:38.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24f3400640 1 --2- 172.21.15.47:0/2294843627 >> v2:172.21.15.47:3300/0 conn(0x7f24fc06f810 0x7f24fc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24fbe00640 1 --2- 172.21.15.47:0/2294843627 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc06f430 0x7f24fc0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24fb400640 1 -- 172.21.15.47:0/2294843627 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776092420 0 0) 0x7f24f4001120 con 0x7f24fc160ac0 2024-04-26T23:50:38.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24fb400640 1 -- 172.21.15.47:0/2294843627 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24e0003530 con 0x7f24fc160ac0 2024-04-26T23:50:38.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24f3400640 1 -- 172.21.15.47:0/2294843627 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc06f430 msgr2=0x7f24fc0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:38.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24f3400640 1 --2- 172.21.15.47:0/2294843627 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc06f430 0x7f24fc0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24f3400640 1 -- 172.21.15.47:0/2294843627 >> v1:172.21.15.47:6789/0 conn(0x7f24fc160ac0 legacy=0x7f24fc06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.484+0000 7f24f3400640 1 -- 172.21.15.47:0/2294843627 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc0cfb50 con 0x7f24fc06f810 2024-04-26T23:50:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f24f3400640 1 --2- 172.21.15.47:0/2294843627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f810 0x7f24fc0cd7c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f24e40097c0 tx=0x7f24e401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c45b1dfb661b68 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f24fb400640 1 -- 172.21.15.47:0/2294843627 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e40a7070 con 0x7f24fc06f810 2024-04-26T23:50:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f24fb400640 1 -- 172.21.15.47:0/2294843627 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e40b0070 con 0x7f24fc06f810 2024-04-26T23:50:38.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f24fb400640 1 -- 172.21.15.47:0/2294843627 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e40ab870 con 0x7f24fc06f810 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- 172.21.15.47:0/2294843627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f810 msgr2=0x7f24fc0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 --2- 172.21.15.47:0/2294843627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f810 0x7f24fc0cd7c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f24e40097c0 tx=0x7f24e401c470 comp rx=0 tx=0).stop 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- 172.21.15.47:0/2294843627 shutdown_connections 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 --2- 172.21.15.47:0/2294843627 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f810 0x7f24fc0cd7c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 --2- 172.21.15.47:0/2294843627 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc06f430 0x7f24fc0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- 172.21.15.47:0/2294843627 >> 172.21.15.47:0/2294843627 conn(0x7f24fc0b2910 msgr2=0x7f24fc0b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- 172.21.15.47:0/2294843627 shutdown_connections 2024-04-26T23:50:38.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- 172.21.15.47:0/2294843627 wait complete. 2024-04-26T23:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 Processor -- start 2024-04-26T23:50:38.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- start start 2024-04-26T23:50:38.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f430 0x7f24fc142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24fc06f810 0x7f24fc13f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc160ac0 0x7f24fc165ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc1612e0 con 0x7f24fc06f430 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f24fc161740 con 0x7f24fc06f810 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.488+0000 7f2501600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f24fc1421a0 con 0x7f24fc160ac0 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f430 0x7f24fc142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f430 0x7f24fc142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48412/0 (socket says 172.21.15.47:48412) 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 -- 172.21.15.47:0/4079655622 learned_addr learned my addr 172.21.15.47:0/4079655622 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f2500c00640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc160ac0 0x7f24fc165ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24f3400640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24fc06f810 0x7f24fc13f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 -- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc160ac0 msgr2=0x7f24fc165ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc160ac0 0x7f24fc165ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 -- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24fc06f810 msgr2=0x7f24fc13f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24fc06f810 0x7f24fc13f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 -- 172.21.15.47:0/4079655622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24fc13fbb0 con 0x7f24fc06f430 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24fbe00640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f430 0x7f24fc142630 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007ef0 tx=0x7f24ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24f8c00640 1 -- 172.21.15.47:0/4079655622 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec014620 con 0x7f24fc06f430 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24f8c00640 1 -- 172.21.15.47:0/4079655622 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec019070 con 0x7f24fc06f430 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24fc141870 con 0x7f24fc06f430 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24f8c00640 1 -- 172.21.15.47:0/4079655622 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec014a00 con 0x7f24fc06f430 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24fc141e30 con 0x7f24fc06f430 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24fc069470 con 0x7f24fc06f430 2024-04-26T23:50:38.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.492+0000 7f24f8c00640 1 -- 172.21.15.47:0/4079655622 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f24ec014ba0 con 0x7f24fc06f430 2024-04-26T23:50:38.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.496+0000 7f24f8c00640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f24d8068650 0x7f24d806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.496+0000 7f24f8c00640 1 -- 172.21.15.47:0/4079655622 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f24ec087800 con 0x7f24fc06f430 2024-04-26T23:50:38.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.496+0000 7f24f3400640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f24d8068650 0x7f24d806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.496+0000 7f24f3400640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f24d8068650 0x7f24d806ab10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f24e40af000 tx=0x7f24e40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.500+0000 7f24f8c00640 1 -- 172.21.15.47:0/4079655622 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f24ec0579f0 con 0x7f24fc06f430 2024-04-26T23:50:38.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f24fc0cd7d0 con 0x7f24fc06f430 2024-04-26T23:50:38.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f24f8c00640 1 -- 172.21.15.47:0/4079655622 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) ==== 100+0+11 (secure 0 0 0) 0x7f24ec0572f0 con 0x7f24fc06f430 2024-04-26T23:50:38.674 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f24d8068650 msgr2=0x7f24d806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f24d8068650 0x7f24d806ab10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f24e40af000 tx=0x7f24e40a7000 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f430 msgr2=0x7f24fc142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f430 0x7f24fc142630 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f24ec007ef0 tx=0x7f24ec00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 shutdown_connections 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f24d8068650 0x7f24d806ab10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f24fc160ac0 0x7f24fc165ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24fc06f810 0x7f24fc13f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 --2- 172.21.15.47:0/4079655622 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f24fc06f430 0x7f24fc142630 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 >> 172.21.15.47:0/4079655622 conn(0x7f24fc0b2910 msgr2=0x7f24fc06df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 shutdown_connections 2024-04-26T23:50:38.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.668+0000 7f2501600640 1 -- 172.21.15.47:0/4079655622 wait complete. 2024-04-26T23:50:38.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fea400640 1 Processor -- start 2024-04-26T23:50:38.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fea400640 1 -- start start 2024-04-26T23:50:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fea400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1fe40d1860 0x7f1fe4167fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fea400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe40cd830 con 0x7f1fe4072150 2024-04-26T23:50:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fea400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fe4071080 con 0x7f1fe4160810 2024-04-26T23:50:38.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fea400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f1fe4071360 con 0x7f1fe40d1860 2024-04-26T23:50:38.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fe3e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1fe40d1860 0x7f1fe4167fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fdbe00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1fe4072150 0x7f1fe40d1150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:49134/0 (socket says 172.21.15.47:49134) 2024-04-26T23:50:38.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fdbe00640 1 -- 172.21.15.47:0/3050543359 learned_addr learned my addr 172.21.15.47:0/3050543359 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:38.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fe3e00640 1 -- 172.21.15.47:0/3050543359 >> v1:172.21.15.203:6789/0 conn(0x7f1fe4160810 legacy=0x7f1fe4071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fe3e00640 1 -- 172.21.15.47:0/3050543359 >> v1:172.21.15.47:6789/0 conn(0x7f1fe4072150 legacy=0x7f1fe40d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fe2a00640 1 -- 172.21.15.47:0/3050543359 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 329884680 0 0) 0x7f1fe40cd830 con 0x7f1fe4072150 2024-04-26T23:50:38.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.828+0000 7f1fe3e00640 1 -- 172.21.15.47:0/3050543359 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe40cdad0 con 0x7f1fe40d1860 2024-04-26T23:50:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fe3e00640 1 --2- 172.21.15.47:0/3050543359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe4167fc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009d90 tx=0x7f1fdc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cfd18ad44e1d15 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fe2a00640 1 -- 172.21.15.47:0/3050543359 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0b4070 con 0x7f1fe40d1860 2024-04-26T23:50:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fe2a00640 1 -- 172.21.15.47:0/3050543359 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc0af600 con 0x7f1fe40d1860 2024-04-26T23:50:38.840 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fe2a00640 1 -- 172.21.15.47:0/3050543359 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0af9d0 con 0x7f1fe40d1860 2024-04-26T23:50:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fea400640 1 -- 172.21.15.47:0/3050543359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 msgr2=0x7f1fe4167fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fea400640 1 --2- 172.21.15.47:0/3050543359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe4167fc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009d90 tx=0x7f1fdc01f150 comp rx=0 tx=0).stop 2024-04-26T23:50:38.841 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fea400640 1 -- 172.21.15.47:0/3050543359 shutdown_connections 2024-04-26T23:50:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fea400640 1 --2- 172.21.15.47:0/3050543359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe4167fc0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fea400640 1 -- 172.21.15.47:0/3050543359 >> 172.21.15.47:0/3050543359 conn(0x7f1fe40d2e90 msgr2=0x7f1fe40d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fea400640 1 -- 172.21.15.47:0/3050543359 shutdown_connections 2024-04-26T23:50:38.842 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.832+0000 7f1fea400640 1 -- 172.21.15.47:0/3050543359 wait complete. 2024-04-26T23:50:38.844 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 Processor -- start 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 -- start start 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fe4072150 0x7f1fe41f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe406df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fe4160810 0x7f1fe406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe4160d70 con 0x7f1fe40d1860 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe4160bf0 con 0x7f1fe4072150 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f1fe40cf000 con 0x7f1fe4160810 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe406df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:48426/0 (socket says 172.21.15.47:48426) 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 -- 172.21.15.47:0/1964807285 learned_addr learned my addr 172.21.15.47:0/1964807285 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:38.845 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fe3e00640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fe4160810 0x7f1fe406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fe3400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fe4072150 0x7f1fe41f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 -- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fe4160810 msgr2=0x7f1fe406e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fe4160810 0x7f1fe406e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 -- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fe4072150 msgr2=0x7f1fe41f5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fe4072150 0x7f1fe41f5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 -- 172.21.15.47:0/1964807285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe40b44e0 con 0x7f1fe40d1860 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fe3400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fe4072150 0x7f1fe41f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdbe00640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe406df70 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c4a0 tx=0x7f1fcc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdb400640 1 -- 172.21.15.47:0/1964807285 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc018070 con 0x7f1fe40d1860 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdb400640 1 -- 172.21.15.47:0/1964807285 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0074e0 con 0x7f1fe40d1860 2024-04-26T23:50:38.846 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fdb400640 1 -- 172.21.15.47:0/1964807285 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc004a30 con 0x7f1fe40d1860 2024-04-26T23:50:38.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe41f8930 con 0x7f1fe40d1860 2024-04-26T23:50:38.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.836+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe415b810 con 0x7f1fe40d1860 2024-04-26T23:50:38.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.840+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe4069700 con 0x7f1fe40d1860 2024-04-26T23:50:38.847 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.840+0000 7f1fdb400640 1 -- 172.21.15.47:0/1964807285 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f1fcc004bd0 con 0x7f1fe40d1860 2024-04-26T23:50:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.840+0000 7f1fdb400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1fc0068650 0x7f1fc006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.840+0000 7f1fdb400640 1 -- 172.21.15.47:0/1964807285 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f1fcc0860d0 con 0x7f1fe40d1860 2024-04-26T23:50:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.840+0000 7f1fe3400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1fc0068650 0x7f1fc006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:38.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.840+0000 7f1fe3400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1fc0068650 0x7f1fc006ab10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4000f70 tx=0x7f1fd4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:38.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:38.844+0000 7f1fdb400640 1 -- 172.21.15.47:0/1964807285 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f1fcc055d00 con 0x7f1fe40d1860 2024-04-26T23:50:39.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.040+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fe415f3e0 con 0x7f1fe40d1860 2024-04-26T23:50:39.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.040+0000 7f1fdb400640 1 -- 172.21.15.47:0/1964807285 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5181 (secure 0 0 0) 0x7f1fcc05a000 con 0x7f1fe40d1860 2024-04-26T23:50:39.049 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:39.049 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2875189318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2875189318},{"type":"v1","addr":"172.21.15.203:6836","nonce":2875189318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/629228023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":629228023},{"type":"v1","addr":"172.21.15.203:6837","nonce":629228023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5910,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/868771075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":868771075},{"type":"v1","addr":"172.21.15.47:6834","nonce":868771075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:48:04.603648+0000","modified":"2024-04-26T23:48:07.629516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5913},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5913":{"gid":5913,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/3889822755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3889822755},{"type":"v1","addr":"172.21.15.47:6835","nonce":3889822755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5913,"qdb_cluster":[5913]},"id":3}]} 2024-04-26T23:50:39.049 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1fc0068650 msgr2=0x7f1fc006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1fc0068650 0x7f1fc006ab10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4000f70 tx=0x7f1fd4009040 comp rx=0 tx=0).stop 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 msgr2=0x7f1fe406df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe406df70 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c4a0 tx=0x7f1fcc00c960 comp rx=0 tx=0).stop 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 shutdown_connections 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f1fc0068650 0x7f1fc006ab10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f1fe4160810 0x7f1fe406e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1fe40d1860 0x7f1fe406df70 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 --2- 172.21.15.47:0/1964807285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1fe4072150 0x7f1fe41f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 >> 172.21.15.47:0/1964807285 conn(0x7f1fe40d2e90 msgr2=0x7f1fe40d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 shutdown_connections 2024-04-26T23:50:39.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.044+0000 7f1fea400640 1 -- 172.21.15.47:0/1964807285 wait complete. 2024-04-26T23:50:39.071 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:39.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.212+0000 7fecd5e00640 1 Processor -- start 2024-04-26T23:50:39.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.212+0000 7fecd5e00640 1 -- start start 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.212+0000 7fecd5e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd00d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.212+0000 7fecd5e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fecd009ba60 0x7fecd009bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.212+0000 7fecd5e00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fecd00ce340 0x7fecd00ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecd5e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fecd00d2340 con 0x7fecd009ba60 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecd5e00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fecd00cd580 con 0x7fecd00ce340 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecd5e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fecd00cd860 con 0x7fecd006f0a0 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fecd009ba60 0x7fecd009bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fecd009ba60 0x7fecd009bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50676/0 (socket says 172.21.15.47:50676) 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 -- 172.21.15.47:0/1117585659 learned_addr learned my addr 172.21.15.47:0/1117585659 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7feccea00640 1 --2- 172.21.15.47:0/1117585659 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd00d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7feccf400640 1 --2- 172.21.15.47:0/1117585659 >> v2:172.21.15.203:3300/0 conn(0x7fecd00ce340 0x7fecd00ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 -- 172.21.15.47:0/1117585659 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 msgr2=0x7fecd00d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:39.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 --2- 172.21.15.47:0/1117585659 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd00d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 -- 172.21.15.47:0/1117585659 >> v2:172.21.15.203:3300/0 conn(0x7fecd00ce340 msgr2=0x7fecd00ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:39.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 --2- 172.21.15.47:0/1117585659 >> v2:172.21.15.203:3300/0 conn(0x7fecd00ce340 0x7fecd00ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 -- 172.21.15.47:0/1117585659 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd00cdb40 con 0x7fecd009ba60 2024-04-26T23:50:39.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecc6000640 1 --2- 172.21.15.47:0/1117585659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd009bee0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009870 tx=0x7fecb801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c460cfc1ce4f6c5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecce000640 1 -- 172.21.15.47:0/1117585659 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb80b0070 con 0x7fecd009ba60 2024-04-26T23:50:39.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecce000640 1 -- 172.21.15.47:0/1117585659 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb80ab600 con 0x7fecd009ba60 2024-04-26T23:50:39.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.216+0000 7fecce000640 1 -- 172.21.15.47:0/1117585659 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb80ab9d0 con 0x7fecd009ba60 2024-04-26T23:50:39.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- 172.21.15.47:0/1117585659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 msgr2=0x7fecd009bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1117585659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd009bee0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009870 tx=0x7fecb801c520 comp rx=0 tx=0).stop 2024-04-26T23:50:39.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- 172.21.15.47:0/1117585659 shutdown_connections 2024-04-26T23:50:39.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1117585659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd009bee0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1117585659 >> v2:172.21.15.203:3300/0 conn(0x7fecd00ce340 0x7fecd00ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1117585659 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd00d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- 172.21.15.47:0/1117585659 >> 172.21.15.47:0/1117585659 conn(0x7fecd00d2e90 msgr2=0x7fecd00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- 172.21.15.47:0/1117585659 shutdown_connections 2024-04-26T23:50:39.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- 172.21.15.47:0/1117585659 wait complete. 2024-04-26T23:50:39.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 Processor -- start 2024-04-26T23:50:39.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- start start 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd0154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd00c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecd00ce340 0x7fecd015e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fecd006d510 con 0x7fecd009ba60 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00cf120 con 0x7fecd00ce340 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecd5e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fecd0155450 con 0x7fecd006f0a0 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd00c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd00c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50684/0 (socket says 172.21.15.47:50684) 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 -- 172.21.15.47:0/1321053995 learned_addr learned my addr 172.21.15.47:0/1321053995 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7feccea00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd0154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7feccf400640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecd00ce340 0x7fecd015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 -- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 msgr2=0x7fecd0154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd0154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 -- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecd00ce340 msgr2=0x7fecd015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecd00ce340 0x7fecd015e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.220+0000 7fecc6000640 1 -- 172.21.15.47:0/1321053995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd0155730 con 0x7fecd009ba60 2024-04-26T23:50:39.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecc6000640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd00c91f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fecb80ae040 tx=0x7fecb80192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecc7e00640 1 -- 172.21.15.47:0/1321053995 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb80b0040 con 0x7fecd009ba60 2024-04-26T23:50:39.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecc7e00640 1 -- 172.21.15.47:0/1321053995 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb80b9070 con 0x7fecd009ba60 2024-04-26T23:50:39.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecc7e00640 1 -- 172.21.15.47:0/1321053995 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb80b4660 con 0x7fecd009ba60 2024-04-26T23:50:39.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd0155a10 con 0x7fecd009ba60 2024-04-26T23:50:39.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd00c9730 con 0x7fecd009ba60 2024-04-26T23:50:39.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd0069700 con 0x7fecd009ba60 2024-04-26T23:50:39.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecc7e00640 1 -- 172.21.15.47:0/1321053995 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fecb80b4800 con 0x7fecd009ba60 2024-04-26T23:50:39.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecc7e00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fecac068650 0x7fecac06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7fecc7e00640 1 -- 172.21.15.47:0/1321053995 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fecb8120ac0 con 0x7fecd009ba60 2024-04-26T23:50:39.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.224+0000 7feccea00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fecac068650 0x7fecac06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.228+0000 7feccea00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fecac068650 0x7fecac06ab10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007a60 tx=0x7fecc0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.228+0000 7fecc7e00640 1 -- 172.21.15.47:0/1321053995 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fecb8016110 con 0x7fecd009ba60 2024-04-26T23:50:39.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.400+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fecd00d16a0 con 0x7fecd009ba60 2024-04-26T23:50:39.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.400+0000 7fecc7e00640 1 -- 172.21.15.47:0/1321053995 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16752 (secure 0 0 0) 0x7fecb80f0550 con 0x7fecd009ba60 2024-04-26T23:50:39.408 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:39.409 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":51,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:14.262711+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:39.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fecac068650 msgr2=0x7fecac06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fecac068650 0x7fecac06ab10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fecc0007a60 tx=0x7fecc0008040 comp rx=0 tx=0).stop 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 msgr2=0x7fecd00c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd00c91f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fecb80ae040 tx=0x7fecb80192c0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 shutdown_connections 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fecac068650 0x7fecac06ab10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecd00ce340 0x7fecd015e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fecd009ba60 0x7fecd00c91f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 --2- 172.21.15.47:0/1321053995 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fecd006f0a0 0x7fecd0154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 >> 172.21.15.47:0/1321053995 conn(0x7fecd00d2e90 msgr2=0x7fecd00b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 shutdown_connections 2024-04-26T23:50:39.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.404+0000 7fecd5e00640 1 -- 172.21.15.47:0/1321053995 wait complete. 2024-04-26T23:50:39.431 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:50:39.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:39.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.568+0000 7ff2d7c00640 1 Processor -- start 2024-04-26T23:50:39.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.568+0000 7ff2d7c00640 1 -- start start 2024-04-26T23:50:39.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.568+0000 7ff2d7c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff2d015d5b0 0x7ff2d015da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.568+0000 7ff2d7c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff2d00cdc00 0x7ff2d00ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d7c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d015e050 con 0x7ff2d00b4360 2024-04-26T23:50:39.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d7c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d015e330 con 0x7ff2d00cdc00 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d7c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d00ceda0 con 0x7ff2d015d5b0 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff2d00cdc00 0x7ff2d00ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff2d00b4360 0x7ff2d00cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57012/0 (socket says 172.21.15.47:57012) 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5200640 1 -- 172.21.15.47:0/51819140 learned_addr learned my addr 172.21.15.47:0/51819140 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2c7e00640 1 --2- 172.21.15.47:0/51819140 >> v2:172.21.15.203:3300/0 conn(0x7ff2d015d5b0 0x7ff2d015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5c00640 1 -- 172.21.15.47:0/51819140 >> v2:172.21.15.203:3300/0 conn(0x7ff2d015d5b0 msgr2=0x7ff2d015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5c00640 1 --2- 172.21.15.47:0/51819140 >> v2:172.21.15.203:3300/0 conn(0x7ff2d015d5b0 0x7ff2d015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5c00640 1 -- 172.21.15.47:0/51819140 >> v1:172.21.15.47:6789/0 conn(0x7ff2d00b4360 legacy=0x7ff2d00cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2cfe00640 1 -- 172.21.15.47:0/51819140 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034455722 0 0) 0x7ff2d015e050 con 0x7ff2d00b4360 2024-04-26T23:50:39.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5c00640 1 -- 172.21.15.47:0/51819140 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d00cf080 con 0x7ff2d00cdc00 2024-04-26T23:50:39.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2c7e00640 1 --2- 172.21.15.47:0/51819140 >> v2:172.21.15.203:3300/0 conn(0x7ff2d015d5b0 0x7ff2d015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2d5c00640 1 --2- 172.21.15.47:0/51819140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00cdc00 0x7ff2d00ce090 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0070630 tx=0x7ff2c801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e0b8cbd1883440 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2cfe00640 1 -- 172.21.15.47:0/51819140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80b2070 con 0x7ff2d00cdc00 2024-04-26T23:50:39.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2cfe00640 1 -- 172.21.15.47:0/51819140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c80a57f0 con 0x7ff2d00cdc00 2024-04-26T23:50:39.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.572+0000 7ff2cfe00640 1 -- 172.21.15.47:0/51819140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c80a5bc0 con 0x7ff2d00cdc00 2024-04-26T23:50:39.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- 172.21.15.47:0/51819140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00cdc00 msgr2=0x7ff2d00ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/51819140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00cdc00 0x7ff2d00ce090 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0070630 tx=0x7ff2c801c930 comp rx=0 tx=0).stop 2024-04-26T23:50:39.583 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- 172.21.15.47:0/51819140 shutdown_connections 2024-04-26T23:50:39.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/51819140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00cdc00 0x7ff2d00ce090 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/51819140 >> v2:172.21.15.203:3300/0 conn(0x7ff2d015d5b0 0x7ff2d015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- 172.21.15.47:0/51819140 >> 172.21.15.47:0/51819140 conn(0x7ff2d006c800 msgr2=0x7ff2d006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- 172.21.15.47:0/51819140 shutdown_connections 2024-04-26T23:50:39.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- 172.21.15.47:0/51819140 wait complete. 2024-04-26T23:50:39.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 Processor -- start 2024-04-26T23:50:39.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- start start 2024-04-26T23:50:39.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00b4360 0x7ff2d0142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d00cdc00 0x7ff2d01f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d015d5b0 0x7ff2d006f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0169f40 con 0x7ff2d00b4360 2024-04-26T23:50:39.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d015f190 con 0x7ff2d00cdc00 2024-04-26T23:50:39.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d7c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d016a0c0 con 0x7ff2d015d5b0 2024-04-26T23:50:39.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00b4360 0x7ff2d0142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00b4360 0x7ff2d0142990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50702/0 (socket says 172.21.15.47:50702) 2024-04-26T23:50:39.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 -- 172.21.15.47:0/2571703850 learned_addr learned my addr 172.21.15.47:0/2571703850 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:39.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2c7e00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d00cdc00 0x7ff2d01f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 -- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d015d5b0 msgr2=0x7ff2d006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d015d5b0 0x7ff2d006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 -- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d00cdc00 msgr2=0x7ff2d01f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d00cdc00 0x7ff2d01f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.576+0000 7ff2d5200640 1 -- 172.21.15.47:0/2571703850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d0143300 con 0x7ff2d00b4360 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2d5200640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00b4360 0x7ff2d0142990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00011f0 tx=0x7ff2c000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2cd600640 1 -- 172.21.15.47:0/2571703850 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0018070 con 0x7ff2d00b4360 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2cd600640 1 -- 172.21.15.47:0/2571703850 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c00074e0 con 0x7ff2d00b4360 2024-04-26T23:50:39.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d01435e0 con 0x7ff2d00b4360 2024-04-26T23:50:39.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2cd600640 1 -- 172.21.15.47:0/2571703850 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0004a10 con 0x7ff2d00b4360 2024-04-26T23:50:39.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d009d560 con 0x7ff2d00b4360 2024-04-26T23:50:39.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0069700 con 0x7ff2d00b4360 2024-04-26T23:50:39.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2cd600640 1 -- 172.21.15.47:0/2571703850 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff2c001b070 con 0x7ff2d00b4360 2024-04-26T23:50:39.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2cd600640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff2ac0686a0 0x7ff2ac06ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2cd600640 1 -- 172.21.15.47:0/2571703850 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7ff2c00862b0 con 0x7ff2d00b4360 2024-04-26T23:50:39.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.580+0000 7ff2c7e00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff2ac0686a0 0x7ff2ac06ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.584+0000 7ff2c7e00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff2ac0686a0 0x7ff2ac06ab60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8006fd0 tx=0x7ff2b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.584+0000 7ff2cd600640 1 -- 172.21.15.47:0/2571703850 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7ff2c00564d0 con 0x7ff2d00b4360 2024-04-26T23:50:39.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2d01572f0 con 0x7ff2d00b4360 2024-04-26T23:50:39.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2cd600640 1 -- 172.21.15.47:0/2571703850 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5181 (secure 0 0 0) 0x7ff2c0055dd0 con 0x7ff2d00b4360 2024-04-26T23:50:39.799 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:39.799 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2875189318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2875189318},{"type":"v1","addr":"172.21.15.203:6836","nonce":2875189318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/629228023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":629228023},{"type":"v1","addr":"172.21.15.203:6837","nonce":629228023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5910,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/868771075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":868771075},{"type":"v1","addr":"172.21.15.47:6834","nonce":868771075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:48:04.603648+0000","modified":"2024-04-26T23:48:07.629516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5913},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5913":{"gid":5913,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/3889822755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3889822755},{"type":"v1","addr":"172.21.15.47:6835","nonce":3889822755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5913,"qdb_cluster":[5913]},"id":3}]} 2024-04-26T23:50:39.800 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-04-26T23:50:39.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff2ac0686a0 msgr2=0x7ff2ac06ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff2ac0686a0 0x7ff2ac06ab60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8006fd0 tx=0x7ff2b8008040 comp rx=0 tx=0).stop 2024-04-26T23:50:39.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00b4360 msgr2=0x7ff2d0142990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00b4360 0x7ff2d0142990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00011f0 tx=0x7ff2c000c9b0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 shutdown_connections 2024-04-26T23:50:39.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff2ac0686a0 0x7ff2ac06ab60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff2d015d5b0 0x7ff2d006f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2d00cdc00 0x7ff2d01f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 --2- 172.21.15.47:0/2571703850 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff2d00b4360 0x7ff2d0142990 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 >> 172.21.15.47:0/2571703850 conn(0x7ff2d006c800 msgr2=0x7ff2d00aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 shutdown_connections 2024-04-26T23:50:39.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.792+0000 7ff2d7c00640 1 -- 172.21.15.47:0/2571703850 wait complete. 2024-04-26T23:50:39.820 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:50:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2ff5400640 1 Processor -- start 2024-04-26T23:50:39.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2ff5400640 1 -- start start 2024-04-26T23:50:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2ff5400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f2ff0160810 0x7f2ff0071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.964 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2ff5400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ff0072150 0x7f2ff00d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2ff5400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff00cd830 con 0x7f2ff00d1690 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2ff5400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff0071080 con 0x7f2ff0072150 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2ff5400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff0071360 con 0x7f2ff0160810 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fe7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ff0072150 0x7f2ff00d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fe7e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2ff0072150 0x7f2ff00d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50706/0 (socket says 172.21.15.47:50706) 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fe7e00640 1 -- 172.21.15.47:0/3192843632 learned_addr learned my addr 172.21.15.47:0/3192843632 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fee800640 1 --2- 172.21.15.47:0/3192843632 >> v2:172.21.15.203:3300/0 conn(0x7f2ff0160810 0x7f2ff0071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fe7e00640 1 -- 172.21.15.47:0/3192843632 >> v2:172.21.15.203:3300/0 conn(0x7f2ff0160810 msgr2=0x7f2ff0071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/3192843632 >> v2:172.21.15.203:3300/0 conn(0x7f2ff0160810 0x7f2ff0071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fe7e00640 1 -- 172.21.15.47:0/3192843632 >> v1:172.21.15.203:6789/0 conn(0x7f2ff00d1690 legacy=0x7f2ff009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.956+0000 7f2fe7e00640 1 -- 172.21.15.47:0/3192843632 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff00cdad0 con 0x7f2ff0072150 2024-04-26T23:50:39.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/3192843632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff00d1150 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00767e0 tx=0x7f2fd801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e6960a89ab5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2fede00640 1 -- 172.21.15.47:0/3192843632 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80b5070 con 0x7f2ff0072150 2024-04-26T23:50:39.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2fede00640 1 -- 172.21.15.47:0/3192843632 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd80a8a10 con 0x7f2ff0072150 2024-04-26T23:50:39.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2fede00640 1 -- 172.21.15.47:0/3192843632 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80a8de0 con 0x7f2ff0072150 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 -- 172.21.15.47:0/3192843632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 msgr2=0x7f2ff00d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 --2- 172.21.15.47:0/3192843632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff00d1150 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00767e0 tx=0x7f2fd801ed10 comp rx=0 tx=0).stop 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 -- 172.21.15.47:0/3192843632 shutdown_connections 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 --2- 172.21.15.47:0/3192843632 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff00d1150 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 --2- 172.21.15.47:0/3192843632 >> v2:172.21.15.203:3300/0 conn(0x7f2ff0160810 0x7f2ff0071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 -- 172.21.15.47:0/3192843632 >> 172.21.15.47:0/3192843632 conn(0x7f2ff00d2e90 msgr2=0x7f2ff00d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 -- 172.21.15.47:0/3192843632 shutdown_connections 2024-04-26T23:50:39.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.960+0000 7f2ff5400640 1 -- 172.21.15.47:0/3192843632 wait complete. 2024-04-26T23:50:39.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 Processor -- start 2024-04-26T23:50:39.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 -- start start 2024-04-26T23:50:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff01f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff00d1690 0x7f2ff01597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff0160810 0x7f2ff00b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0160bf0 con 0x7f2ff0072150 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0071ca0 con 0x7f2ff00d1690 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff0160d70 con 0x7f2ff0160810 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff01f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff01f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50716/0 (socket says 172.21.15.47:50716) 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 -- 172.21.15.47:0/2166605133 learned_addr learned my addr 172.21.15.47:0/2166605133 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff00d1690 0x7f2ff01597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fef200640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff0160810 0x7f2ff00b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 -- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff0160810 msgr2=0x7f2ff00b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff0160810 0x7f2ff00b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 -- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff00d1690 msgr2=0x7f2ff01597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff00d1690 0x7f2ff01597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 -- 172.21.15.47:0/2166605133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff01f5700 con 0x7f2ff0072150 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fef200640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff0160810 0x7f2ff00b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:39.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fee800640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff01f4fb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000d830 tx=0x7f2fe000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2166605133 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000b6c0 con 0x7f2ff0072150 2024-04-26T23:50:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2166605133 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0019070 con 0x7f2ff0072150 2024-04-26T23:50:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2166605133 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000bae0 con 0x7f2ff0072150 2024-04-26T23:50:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff01f59e0 con 0x7f2ff0072150 2024-04-26T23:50:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.964+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff0159ce0 con 0x7f2ff0072150 2024-04-26T23:50:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.968+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff00c6680 con 0x7f2ff0072150 2024-04-26T23:50:39.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.968+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2166605133 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f2fe001e460 con 0x7f2ff0072150 2024-04-26T23:50:39.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.968+0000 7f2fe6a00640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fcc068650 0x7f2fcc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.968+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2166605133 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7f2fe0087570 con 0x7f2ff0072150 2024-04-26T23:50:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.968+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fcc068650 0x7f2fcc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:39.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.968+0000 7f2fe7e00640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fcc068650 0x7f2fcc06ab10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80b2000 tx=0x7f2fd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:39.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:39.972+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2166605133 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2fe00577f0 con 0x7f2ff0072150 2024-04-26T23:50:40.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.168+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ff0069700 con 0x7f2ff0072150 2024-04-26T23:50:40.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.172+0000 7f2fe6a00640 1 -- 172.21.15.47:0/2166605133 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5181 (secure 0 0 0) 0x7f2fe00570f0 con 0x7f2ff0072150 2024-04-26T23:50:40.182 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:40.182 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2875189318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2875189318},{"type":"v1","addr":"172.21.15.203:6836","nonce":2875189318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/629228023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":629228023},{"type":"v1","addr":"172.21.15.203:6837","nonce":629228023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5910,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/868771075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":868771075},{"type":"v1","addr":"172.21.15.47:6834","nonce":868771075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T23:48:04.603648+0000","modified":"2024-04-26T23:48:07.629516+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5913},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5913":{"gid":5913,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.47:6835/3889822755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":3889822755},{"type":"v1","addr":"172.21.15.47:6835","nonce":3889822755}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5913,"qdb_cluster":[5913]},"id":3}]} 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 28 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fcc068650 msgr2=0x7f2fcc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fcc068650 0x7f2fcc06ab10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2fd80b2000 tx=0x7f2fd8008040 comp rx=0 tx=0).stop 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 msgr2=0x7f2ff01f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff01f4fb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000d830 tx=0x7f2fe000dcf0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 shutdown_connections 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2fcc068650 0x7f2fcc06ab10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2ff0160810 0x7f2ff00b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ff00d1690 0x7f2ff01597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 --2- 172.21.15.47:0/2166605133 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2ff0072150 0x7f2ff01f4fb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 >> 172.21.15.47:0/2166605133 conn(0x7f2ff00d2e90 msgr2=0x7f2ff00b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 shutdown_connections 2024-04-26T23:50:40.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.176+0000 7f2ff5400640 1 -- 172.21.15.47:0/2166605133 wait complete. 2024-04-26T23:50:40.202 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:40.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.336+0000 7fee11800640 1 Processor -- start 2024-04-26T23:50:40.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.336+0000 7fee11800640 1 -- start start 2024-04-26T23:50:40.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee11800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fee0c06f0a0 0x7fee0c0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee11800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 0x7fee0c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee11800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c0d2340 con 0x7fee0c09ba60 2024-04-26T23:50:40.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee11800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fee0c0cd580 con 0x7fee0c06f0a0 2024-04-26T23:50:40.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee11800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c0cd860 con 0x7fee0c0713a0 2024-04-26T23:50:40.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fee0c09ba60 0x7fee0c0ce340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57026/0 (socket says 172.21.15.47:57026) 2024-04-26T23:50:40.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 -- 172.21.15.47:0/1676550064 learned_addr learned my addr 172.21.15.47:0/1676550064 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:40.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0aa00640 1 --2- 172.21.15.47:0/1676550064 >> v2:172.21.15.203:3300/0 conn(0x7fee0c06f0a0 0x7fee0c0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0b400640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 0x7fee0c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164601636 0 0) 0x7fee0c0d2340 con 0x7fee0c09ba60 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedf0003530 con 0x7fee0c09ba60 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1258993048 0 0) 0x7fedf0003530 con 0x7fee0c09ba60 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 msgr2=0x7fee0c09bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 0x7fee0c09bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 >> v2:172.21.15.203:3300/0 conn(0x7fee0c06f0a0 msgr2=0x7fee0c0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 --2- 172.21.15.47:0/1676550064 >> v2:172.21.15.203:3300/0 conn(0x7fee0c06f0a0 0x7fee0c0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0cdb40 con 0x7fee0c09ba60 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fedf4001680 con 0x7fee0c09ba60 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 >> v1:172.21.15.47:6789/0 conn(0x7fee0c09ba60 legacy=0x7fee0c0ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 0x7fedf00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf0003f40 0x7fedf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf0004d50 0x7fedf00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0cd580 con 0x7fedf0003f40 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0cd860 con 0x7fedf0004d50 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fedf000b9d0 con 0x7fee0c0713a0 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf0003f40 0x7fedf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0aa00640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 0x7fedf00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0b400640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf0004d50 0x7fedf00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 -- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 msgr2=0x7fedf00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fee0c0713a0 0x7fedf00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 -- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf0004d50 msgr2=0x7fedf00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:40.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf0004d50 0x7fedf00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee03e00640 1 -- 172.21.15.47:0/1676550064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf0003530 con 0x7fedf0003f40 2024-04-26T23:50:40.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.340+0000 7fee0b400640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf0004d50 0x7fedf00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:40.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee03e00640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf0003f40 0x7fedf0004810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c240 tx=0x7fedf401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46265818e62b4f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4007d60 con 0x7fedf0003f40 2024-04-26T23:50:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf4005b00 con 0x7fedf0003f40 2024-04-26T23:50:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee0a000640 1 -- 172.21.15.47:0/1676550064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4007070 con 0x7fedf0003f40 2024-04-26T23:50:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee11800640 1 -- 172.21.15.47:0/1676550064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf0003f40 msgr2=0x7fedf0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee11800640 1 --2- 172.21.15.47:0/1676550064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf0003f40 0x7fedf0004810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fedf400c240 tx=0x7fedf401f3d0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee0b400640 1 -- 172.21.15.47:0/1676550064 reap_dead start 2024-04-26T23:50:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee11800640 1 -- 172.21.15.47:0/1676550064 shutdown_connections 2024-04-26T23:50:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee11800640 1 -- 172.21.15.47:0/1676550064 >> 172.21.15.47:0/1676550064 conn(0x7fee0c0d2e90 msgr2=0x7fee0c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee11800640 1 -- 172.21.15.47:0/1676550064 shutdown_connections 2024-04-26T23:50:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.344+0000 7fee11800640 1 -- 172.21.15.47:0/1676550064 wait complete. 2024-04-26T23:50:40.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 Processor -- start 2024-04-26T23:50:40.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 -- start start 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf0003f40 0x7fee0c15f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b0430 0x7fee0c0b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee0c1f8a60 0x7fee0c1f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0d1fa0 con 0x7fee0c1f8a60 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c06f480 con 0x7fee0c0b0430 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c0d2120 con 0x7fedf0003f40 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee0c1f8a60 0x7fee0c1f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee0c1f8a60 0x7fee0c1f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50730/0 (socket says 172.21.15.47:50730) 2024-04-26T23:50:40.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 -- 172.21.15.47:0/2089856010 learned_addr learned my addr 172.21.15.47:0/2089856010 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee03e00640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b0430 0x7fee0c0b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 -- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf0003f40 msgr2=0x7fee0c15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf0003f40 0x7fee0c15f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 -- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b0430 msgr2=0x7fee0c0b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b0430 0x7fee0c0b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 -- 172.21.15.47:0/2089856010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c15fa10 con 0x7fee0c1f8a60 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee03e00640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b0430 0x7fee0c0b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee0b400640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee0c1f8a60 0x7fee0c1f8ee0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fee0c073ea0 tx=0x7fee04010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee02a00640 1 -- 172.21.15.47:0/2089856010 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0401a030 con 0x7fee0c1f8a60 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee02a00640 1 -- 172.21.15.47:0/2089856010 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04010d20 con 0x7fee0c1f8a60 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee02a00640 1 -- 172.21.15.47:0/2089856010 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04003be0 con 0x7fee0c1f8a60 2024-04-26T23:50:40.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c1f9700 con 0x7fee0c1f8a60 2024-04-26T23:50:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c0ca3e0 con 0x7fee0c1f8a60 2024-04-26T23:50:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.348+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c069700 con 0x7fee0c1f8a60 2024-04-26T23:50:40.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.352+0000 7fee02a00640 1 -- 172.21.15.47:0/2089856010 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fee0401d070 con 0x7fee0c1f8a60 2024-04-26T23:50:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.352+0000 7fee02a00640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fede8068650 0x7fede806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.352+0000 7fee02a00640 1 -- 172.21.15.47:0/2089856010 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fee040873e0 con 0x7fee0c1f8a60 2024-04-26T23:50:40.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.352+0000 7fee0aa00640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fede8068650 0x7fede806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.352+0000 7fee0aa00640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fede8068650 0x7fede806ab10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fedfc006e90 tx=0x7fedfc006e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.356+0000 7fee02a00640 1 -- 172.21.15.47:0/2089856010 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fee0c15fa10 con 0x7fee0c1f8a60 2024-04-26T23:50:40.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.524+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee0c0b8a80 con 0x7fee0c1f8a60 2024-04-26T23:50:40.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.524+0000 7fee02a00640 1 -- 172.21.15.47:0/2089856010 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16752 (secure 0 0 0) 0x7fee0407ee20 con 0x7fee0c1f8a60 2024-04-26T23:50:40.533 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:40.533 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":51,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:48:14.262711+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-26T23:48:03.004737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-26T23:48:03.560025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.9","mappings":[{"from":0,"to":4}]},{"pgid":"7.12","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fede8068650 msgr2=0x7fede806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fede8068650 0x7fede806ab10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fedfc006e90 tx=0x7fedfc006e00 comp rx=0 tx=0).stop 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee0c1f8a60 msgr2=0x7fee0c1f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee0c1f8a60 0x7fee0c1f8ee0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fee0c073ea0 tx=0x7fee04010590 comp rx=0 tx=0).stop 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 shutdown_connections 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fede8068650 0x7fede806ab10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fee0c1f8a60 0x7fee0c1f8ee0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee0c0b0430 0x7fee0c0b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 --2- 172.21.15.47:0/2089856010 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf0003f40 0x7fee0c15f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 >> 172.21.15.47:0/2089856010 conn(0x7fee0c0d2e90 msgr2=0x7fee0c09be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 shutdown_connections 2024-04-26T23:50:40.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.528+0000 7fee11800640 1 -- 172.21.15.47:0/2089856010 wait complete. 2024-04-26T23:50:40.554 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T23:50:40.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 Processor -- start 2024-04-26T23:50:40.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 -- start start 2024-04-26T23:50:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00d1540 0x7fa3d00d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa3d00b21f0 0x7fa3d00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fa3d00cdae0 0x7fa3d00b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d00b46f0 con 0x7fa3d00b21f0 2024-04-26T23:50:40.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fa3d00d1e60 con 0x7fa3d00cdae0 2024-04-26T23:50:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3d4a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d00b4940 con 0x7fa3d00d1540 2024-04-26T23:50:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa3d00b21f0 0x7fa3d00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa3d00b21f0 0x7fa3d00d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50744/0 (socket says 172.21.15.47:50744) 2024-04-26T23:50:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 -- 172.21.15.47:0/658070288 learned_addr learned my addr 172.21.15.47:0/658070288 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3cde00640 1 --2- 172.21.15.47:0/658070288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00d1540 0x7fa3d00d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3ce800640 1 --2- 172.21.15.47:0/658070288 >> v2:172.21.15.203:3300/0 conn(0x7fa3d00cdae0 0x7fa3d00b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 -- 172.21.15.47:0/658070288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00d1540 msgr2=0x7fa3d00d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 --2- 172.21.15.47:0/658070288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00d1540 0x7fa3d00d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 -- 172.21.15.47:0/658070288 >> v2:172.21.15.203:3300/0 conn(0x7fa3d00cdae0 msgr2=0x7fa3d00b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 --2- 172.21.15.47:0/658070288 >> v2:172.21.15.203:3300/0 conn(0x7fa3d00cdae0 0x7fa3d00b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3c5400640 1 -- 172.21.15.47:0/658070288 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d00b4c20 con 0x7fa3d00b21f0 2024-04-26T23:50:40.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.688+0000 7fa3ce800640 1 --2- 172.21.15.47:0/658070288 >> v2:172.21.15.203:3300/0 conn(0x7fa3d00cdae0 0x7fa3d00b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:40.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3c5400640 1 --2- 172.21.15.47:0/658070288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00b21f0 0x7fa3d00d0c50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00cd530 tx=0x7fa3b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bd17410d925408 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3cd400640 1 -- 172.21.15.47:0/658070288 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80aa610 con 0x7fa3d00b21f0 2024-04-26T23:50:40.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3cd400640 1 -- 172.21.15.47:0/658070288 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b80af070 con 0x7fa3d00b21f0 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3cd400640 1 -- 172.21.15.47:0/658070288 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80aa9d0 con 0x7fa3d00b21f0 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 -- 172.21.15.47:0/658070288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00b21f0 msgr2=0x7fa3d00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/658070288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00b21f0 0x7fa3d00d0c50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00cd530 tx=0x7fa3b801c4f0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 -- 172.21.15.47:0/658070288 shutdown_connections 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/658070288 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00b21f0 0x7fa3d00d0c50 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/658070288 >> v2:172.21.15.203:3300/0 conn(0x7fa3d00cdae0 0x7fa3d00b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/658070288 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00d1540 0x7fa3d00d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 -- 172.21.15.47:0/658070288 >> 172.21.15.47:0/658070288 conn(0x7fa3d009ba60 msgr2=0x7fa3d009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 -- 172.21.15.47:0/658070288 shutdown_connections 2024-04-26T23:50:40.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.692+0000 7fa3d4a00640 1 -- 172.21.15.47:0/658070288 wait complete. 2024-04-26T23:50:40.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 Processor -- start 2024-04-26T23:50:40.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 -- start start 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00b21f0 0x7fa3d006f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00cdae0 0x7fa3d014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3d00d1540 0x7fa3d0070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d015d340 con 0x7fa3d00cdae0 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d00d1190 con 0x7fa3d00d1540 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d015d4c0 con 0x7fa3d00b21f0 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00cdae0 0x7fa3d014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00cdae0 0x7fa3d014ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50750/0 (socket says 172.21.15.47:50750) 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 -- 172.21.15.47:0/3033844213 learned_addr learned my addr 172.21.15.47:0/3033844213 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3cde00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00b21f0 0x7fa3d006f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3ce800640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3d00d1540 0x7fa3d0070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 -- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00b21f0 msgr2=0x7fa3d006f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00b21f0 0x7fa3d006f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 -- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3d00d1540 msgr2=0x7fa3d0070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3d00d1540 0x7fa3d0070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 -- 172.21.15.47:0/3033844213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d015c310 con 0x7fa3d00cdae0 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3cde00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00b21f0 0x7fa3d006f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c5400640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00cdae0 0x7fa3d014ff70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80ac040 tx=0x7fa3b801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c6a00640 1 -- 172.21.15.47:0/3033844213 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80bd5f0 con 0x7fa3d00cdae0 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c6a00640 1 -- 172.21.15.47:0/3033844213 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b80bd790 con 0x7fa3d00cdae0 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3c6a00640 1 -- 172.21.15.47:0/3033844213 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80bdb60 con 0x7fa3d00cdae0 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d01587d0 con 0x7fa3d00cdae0 2024-04-26T23:50:40.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.696+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d01504b0 con 0x7fa3d00cdae0 2024-04-26T23:50:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.700+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d0158cd0 con 0x7fa3d00cdae0 2024-04-26T23:50:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.700+0000 7fa3c6a00640 1 -- 172.21.15.47:0/3033844213 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fa3b80b33f0 con 0x7fa3d00cdae0 2024-04-26T23:50:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.700+0000 7fa3c6a00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa3ac068680 0x7fa3ac06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.700+0000 7fa3c6a00640 1 -- 172.21.15.47:0/3033844213 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5767+0+0 (secure 0 0 0) 0x7fa3b8121970 con 0x7fa3d00cdae0 2024-04-26T23:50:40.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.700+0000 7fa3cde00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa3ac068680 0x7fa3ac06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:40.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.700+0000 7fa3cde00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa3ac068680 0x7fa3ac06ab40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0003fd0 tx=0x7fa3c00039a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:40.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.704+0000 7fa3c6a00640 1 -- 172.21.15.47:0/3033844213 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa3d015c310 con 0x7fa3d00cdae0 2024-04-26T23:50:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.904+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa3d00695f0 con 0x7fa3d00cdae0 2024-04-26T23:50:40.910 INFO:tasks.ceph.mon.a.smithi047.stderr:2024-04-26T23:50:40.904+0000 7efc1ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-26T23:50:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.904+0000 7fa3c6a00640 1 -- 172.21.15.47:0/3033844213 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7fa3b80a7070 con 0x7fa3d00cdae0 2024-04-26T23:50:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa3ac068680 msgr2=0x7fa3ac06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa3ac068680 0x7fa3ac06ab40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0003fd0 tx=0x7fa3c00039a0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00cdae0 msgr2=0x7fa3d014ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00cdae0 0x7fa3d014ff70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa3b80ac040 tx=0x7fa3b801ad30 comp rx=0 tx=0).stop 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 shutdown_connections 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa3ac068680 0x7fa3ac06ab40 secure :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0003fd0 tx=0x7fa3c00039a0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3d00d1540 0x7fa3d0070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d00cdae0 0x7fa3d014ff70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 --2- 172.21.15.47:0/3033844213 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa3d00b21f0 0x7fa3d006f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 >> 172.21.15.47:0/3033844213 conn(0x7fa3d009ba60 msgr2=0x7fa3d00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 shutdown_connections 2024-04-26T23:50:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:40.908+0000 7fa3d4a00640 1 -- 172.21.15.47:0/3033844213 wait complete. 2024-04-26T23:50:40.927 INFO:tasks.ceph.mds.a.smithi047.stderr: -8603> 2024-04-26T23:48:07.190+0000 7f99f5a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T23:50:40.935 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T23:50:40.978 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-04-26T23:50:41.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.072+0000 7f5be7600640 1 Processor -- start 2024-04-26T23:50:41.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.072+0000 7f5be7600640 1 -- start start 2024-04-26T23:50:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be7600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be0162d20 0x7f5be00b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be7600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be00b2690 0x7f5be0163100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be7600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5be00b1250 0x7f5be00b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be7600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f5be0163640 con 0x7f5be0162d20 2024-04-26T23:50:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be7600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5be00b2e30 con 0x7f5be00b1250 2024-04-26T23:50:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be7600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5be00b3110 con 0x7f5be00b2690 2024-04-26T23:50:41.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be0162d20 0x7f5be00b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f5be0162d20 0x7f5be00b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50774/0 (socket says 172.21.15.47:50774) 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 -- 172.21.15.47:0/3881072415 learned_addr learned my addr 172.21.15.47:0/3881072415 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5bd7e00640 1 --2- 172.21.15.47:0/3881072415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be00b2690 0x7f5be0163100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be5600640 1 --2- 172.21.15.47:0/3881072415 >> v2:172.21.15.203:3300/0 conn(0x7f5be00b1250 0x7f5be00b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 -- 172.21.15.47:0/3881072415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be00b2690 msgr2=0x7f5be0163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 --2- 172.21.15.47:0/3881072415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be00b2690 0x7f5be0163100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 -- 172.21.15.47:0/3881072415 >> v2:172.21.15.203:3300/0 conn(0x7f5be00b1250 msgr2=0x7f5be00b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 --2- 172.21.15.47:0/3881072415 >> v2:172.21.15.203:3300/0 conn(0x7f5be00b1250 0x7f5be00b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.076+0000 7f5be4c00640 1 -- 172.21.15.47:0/3881072415 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be00b33f0 con 0x7f5be0162d20 2024-04-26T23:50:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be4c00640 1 --2- 172.21.15.47:0/3881072415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0162d20 0x7f5be00b5fa0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5be0072450 tx=0x7f5bd001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5282f87d5f056803 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5bdfe00640 1 -- 172.21.15.47:0/3881072415 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00b0070 con 0x7f5be0162d20 2024-04-26T23:50:41.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5bdfe00640 1 -- 172.21.15.47:0/3881072415 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd00ab600 con 0x7f5be0162d20 2024-04-26T23:50:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5bdfe00640 1 -- 172.21.15.47:0/3881072415 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd00ab9d0 con 0x7f5be0162d20 2024-04-26T23:50:41.086 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- 172.21.15.47:0/3881072415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0162d20 msgr2=0x7f5be00b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 --2- 172.21.15.47:0/3881072415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0162d20 0x7f5be00b5fa0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f5be0072450 tx=0x7f5bd001c3d0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- 172.21.15.47:0/3881072415 shutdown_connections 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 --2- 172.21.15.47:0/3881072415 >> v2:172.21.15.203:3300/0 conn(0x7f5be00b1250 0x7f5be00b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 --2- 172.21.15.47:0/3881072415 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be00b2690 0x7f5be0163100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 --2- 172.21.15.47:0/3881072415 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be0162d20 0x7f5be00b5fa0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- 172.21.15.47:0/3881072415 >> 172.21.15.47:0/3881072415 conn(0x7f5be0072a00 msgr2=0x7f5be00b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- 172.21.15.47:0/3881072415 shutdown_connections 2024-04-26T23:50:41.087 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- 172.21.15.47:0/3881072415 wait complete. 2024-04-26T23:50:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 Processor -- start 2024-04-26T23:50:41.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- start start 2024-04-26T23:50:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5be00b1250 0x7f5be0160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be00b2690 0x7f5be0165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be0162d20 0x7f5be01f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:41.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5be015fef0 con 0x7f5be00b2690 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0156600 con 0x7f5be00b1250 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5be7600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5be0160070 con 0x7f5be0162d20 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be00b2690 0x7f5be0165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5bd7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be00b2690 0x7f5be0165880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50780/0 (socket says 172.21.15.47:50780) 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.080+0000 7f5bd7e00640 1 -- 172.21.15.47:0/3239791669 learned_addr learned my addr 172.21.15.47:0/3239791669 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5be4c00640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5be00b1250 0x7f5be0160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5be5600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be0162d20 0x7f5be01f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bd7e00640 1 -- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be0162d20 msgr2=0x7f5be01f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bd7e00640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be0162d20 0x7f5be01f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bd7e00640 1 -- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5be00b1250 msgr2=0x7f5be0160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bd7e00640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5be00b1250 0x7f5be0160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.091 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bd7e00640 1 -- 172.21.15.47:0/3239791669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be0162170 con 0x7f5be00b2690 2024-04-26T23:50:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bd7e00640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be00b2690 0x7f5be0165880 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800e960 tx=0x7f5bc800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bdd600640 1 -- 172.21.15.47:0/3239791669 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8017070 con 0x7f5be00b2690 2024-04-26T23:50:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bdd600640 1 -- 172.21.15.47:0/3239791669 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bc800c9a0 con 0x7f5be00b2690 2024-04-26T23:50:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be01610d0 con 0x7f5be00b2690 2024-04-26T23:50:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bdd600640 1 -- 172.21.15.47:0/3239791669 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800cd50 con 0x7f5be00b2690 2024-04-26T23:50:41.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be0161690 con 0x7f5be00b2690 2024-04-26T23:50:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be0069700 con 0x7f5be00b2690 2024-04-26T23:50:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bdd600640 1 -- 172.21.15.47:0/3239791669 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f5bc801a070 con 0x7f5be00b2690 2024-04-26T23:50:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bdd600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bbc068650 0x7f5bbc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.084+0000 7f5bdd600640 1 -- 172.21.15.47:0/3239791669 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5853+0+0 (secure 0 0 0) 0x7f5bc8086ed0 con 0x7f5be00b2690 2024-04-26T23:50:41.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.088+0000 7f5be4c00640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bbc068650 0x7f5bbc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:41.094 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.088+0000 7f5be4c00640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bbc068650 0x7f5bbc06ab10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00ad000 tx=0x7f5bd0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:41.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.088+0000 7f5bdd600640 1 -- 172.21.15.47:0/3239791669 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5bc8057070 con 0x7f5be00b2690 2024-04-26T23:50:41.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.292+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5be00b3930 con 0x7f5be00b2690 2024-04-26T23:50:41.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5bdd600640 1 -- 172.21.15.47:0/3239791669 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7f5bc8056970 con 0x7f5be00b2690 2024-04-26T23:50:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bbc068650 msgr2=0x7f5bbc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bbc068650 0x7f5bbc06ab10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5bd00ad000 tx=0x7f5bd0008040 comp rx=0 tx=0).stop 2024-04-26T23:50:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be00b2690 msgr2=0x7f5be0165880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be00b2690 0x7f5be0165880 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800e960 tx=0x7f5bc800ee20 comp rx=0 tx=0).stop 2024-04-26T23:50:41.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 shutdown_connections 2024-04-26T23:50:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5bbc068650 0x7f5bbc06ab10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5be0162d20 0x7f5be01f86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5be00b2690 0x7f5be0165880 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 --2- 172.21.15.47:0/3239791669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5be00b1250 0x7f5be0160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 >> 172.21.15.47:0/3239791669 conn(0x7f5be0072a00 msgr2=0x7f5be00ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 shutdown_connections 2024-04-26T23:50:41.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:41.908+0000 7f5be7600640 1 -- 172.21.15.47:0/3239791669 wait complete. 2024-04-26T23:50:41.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T23:50:42.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5b6200640 1 Processor -- start 2024-04-26T23:50:42.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5b6200640 1 -- start start 2024-04-26T23:50:42.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5b6200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd5b0163ac0 0x7fd5b0073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5b6200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b00d0690 0x7fd5b006f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5b6200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b00d0fe0 con 0x7fd5b006c400 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5b6200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b00d12c0 con 0x7fd5b0163ac0 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5b6200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b0073330 con 0x7fd5b00d0690 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5af400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd5b006c400 0x7fd5b006c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57030/0 (socket says 172.21.15.47:57030) 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5af400640 1 -- 172.21.15.47:0/146052846 learned_addr learned my addr 172.21.15.47:0/146052846 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5a6a00640 1 --2- 172.21.15.47:0/146052846 >> v2:172.21.15.47:3300/0 conn(0x7fd5b0163ac0 0x7fd5b0073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:42.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5afe00640 1 --2- 172.21.15.47:0/146052846 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b00d0690 0x7fd5b006f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:42.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5aea00640 1 -- 172.21.15.47:0/146052846 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2312390000 0 0) 0x7fd5b00d0fe0 con 0x7fd5b006c400 2024-04-26T23:50:42.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5aea00640 1 -- 172.21.15.47:0/146052846 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd594003530 con 0x7fd5b006c400 2024-04-26T23:50:42.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5a6a00640 1 -- 172.21.15.47:0/146052846 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b00d0690 msgr2=0x7fd5b006f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:42.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5a6a00640 1 --2- 172.21.15.47:0/146052846 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b00d0690 0x7fd5b006f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:42.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5a6a00640 1 -- 172.21.15.47:0/146052846 >> v1:172.21.15.47:6789/0 conn(0x7fd5b006c400 legacy=0x7fd5b006c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:42.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.124+0000 7fd5a6a00640 1 -- 172.21.15.47:0/146052846 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b0073610 con 0x7fd5b0163ac0 2024-04-26T23:50:42.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5a6a00640 1 --2- 172.21.15.47:0/146052846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b0073e10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd5980097c0 tx=0x7fd59801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e86773501e54e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5aea00640 1 -- 172.21.15.47:0/146052846 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980b5070 con 0x7fd5b0163ac0 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5aea00640 1 -- 172.21.15.47:0/146052846 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5980a8990 con 0x7fd5b0163ac0 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5aea00640 1 -- 172.21.15.47:0/146052846 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5980a8d60 con 0x7fd5b0163ac0 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 -- 172.21.15.47:0/146052846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 msgr2=0x7fd5b0073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 --2- 172.21.15.47:0/146052846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b0073e10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd5980097c0 tx=0x7fd59801ec90 comp rx=0 tx=0).stop 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 -- 172.21.15.47:0/146052846 shutdown_connections 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 --2- 172.21.15.47:0/146052846 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b00d0690 0x7fd5b006f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 --2- 172.21.15.47:0/146052846 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b0073e10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 -- 172.21.15.47:0/146052846 >> 172.21.15.47:0/146052846 conn(0x7fd5b00d1dc0 msgr2=0x7fd5b00d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 -- 172.21.15.47:0/146052846 shutdown_connections 2024-04-26T23:50:42.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.128+0000 7fd5b6200640 1 -- 172.21.15.47:0/146052846 wait complete. 2024-04-26T23:50:42.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 Processor -- start 2024-04-26T23:50:42.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 -- start start 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b006c400 0x7fd5b015c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b00d0690 0x7fd5b01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b01426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b015f480 con 0x7fd5b0163ac0 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0074350 con 0x7fd5b00d0690 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b015f600 con 0x7fd5b006c400 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b01426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b01426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50786/0 (socket says 172.21.15.47:50786) 2024-04-26T23:50:42.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 -- 172.21.15.47:0/2011037653 learned_addr learned my addr 172.21.15.47:0/2011037653 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5af400640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b006c400 0x7fd5b015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5a6a00640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b00d0690 0x7fd5b01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 -- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b006c400 msgr2=0x7fd5b015c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b006c400 0x7fd5b015c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 -- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b00d0690 msgr2=0x7fd5b01523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b00d0690 0x7fd5b01523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 -- 172.21.15.47:0/2011037653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b0154a70 con 0x7fd5b0163ac0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5af400640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b006c400 0x7fd5b015c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5afe00640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b01426e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800efc0 tx=0x7fd5a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5a7e00640 1 -- 172.21.15.47:0/2011037653 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8018020 con 0x7fd5b0163ac0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5a7e00640 1 -- 172.21.15.47:0/2011037653 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a8014480 con 0x7fd5b0163ac0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5a7e00640 1 -- 172.21.15.47:0/2011037653 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8014870 con 0x7fd5b0163ac0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b0154d10 con 0x7fd5b0163ac0 2024-04-26T23:50:42.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b0155290 con 0x7fd5b0163ac0 2024-04-26T23:50:42.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.132+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b00695f0 con 0x7fd5b0163ac0 2024-04-26T23:50:42.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.136+0000 7fd5a7e00640 1 -- 172.21.15.47:0/2011037653 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fd5a801b020 con 0x7fd5b0163ac0 2024-04-26T23:50:42.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.136+0000 7fd5a7e00640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd58c068650 0x7fd58c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:42.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.136+0000 7fd5a7e00640 1 -- 172.21.15.47:0/2011037653 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5853+0+0 (secure 0 0 0) 0x7fd5a8087a40 con 0x7fd5b0163ac0 2024-04-26T23:50:42.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.136+0000 7fd5af400640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd58c068650 0x7fd58c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:42.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.136+0000 7fd5af400640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd58c068650 0x7fd58c06ab10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005890 tx=0x7fd5a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:42.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.140+0000 7fd5a7e00640 1 -- 172.21.15.47:0/2011037653 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fd5a8022070 con 0x7fd5b0163ac0 2024-04-26T23:50:42.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:42.308+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd5b00af150 con 0x7fd5b0163ac0 2024-04-26T23:50:43.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.184+0000 7fd5a7e00640 1 -- 172.21.15.47:0/2011037653 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7fd5a8010040 con 0x7fd5b0163ac0 2024-04-26T23:50:43.191 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-04-26T23:50:43.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd58c068650 msgr2=0x7fd58c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:43.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd58c068650 0x7fd58c06ab10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005890 tx=0x7fd5a0009040 comp rx=0 tx=0).stop 2024-04-26T23:50:43.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 msgr2=0x7fd5b01426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:43.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b01426e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800efc0 tx=0x7fd5a800c490 comp rx=0 tx=0).stop 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 shutdown_connections 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fd58c068650 0x7fd58c06ab10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5b0163ac0 0x7fd5b01426e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b00d0690 0x7fd5b01523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 --2- 172.21.15.47:0/2011037653 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fd5b006c400 0x7fd5b015c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 >> 172.21.15.47:0/2011037653 conn(0x7fd5b00d1dc0 msgr2=0x7fd5b015ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 shutdown_connections 2024-04-26T23:50:43.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.188+0000 7fd5b6200640 1 -- 172.21.15.47:0/2011037653 wait complete. 2024-04-26T23:50:43.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T23:50:43.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2c00640 1 Processor -- start 2024-04-26T23:50:43.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2c00640 1 -- start start 2024-04-26T23:50:43.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f5fec15d010 0x7f5fec161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 0x7f5fec15d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fec15def0 con 0x7f5fec0d2a10 2024-04-26T23:50:43.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f5fec0d0970 con 0x7f5fec15d010 2024-04-26T23:50:43.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5fec15e1d0 con 0x7f5fec15d3f0 2024-04-26T23:50:43.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5fec0d2a10 0x7f5fec0d2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57040/0 (socket says 172.21.15.47:57040) 2024-04-26T23:50:43.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 -- 172.21.15.47:0/3407150953 learned_addr learned my addr 172.21.15.47:0/3407150953 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff1800640 1 --2- 172.21.15.47:0/3407150953 >> v2:172.21.15.203:3300/0 conn(0x7f5fec15d010 0x7f5fec161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544734750 0 0) 0x7f5fec15def0 con 0x7f5fec0d2a10 2024-04-26T23:50:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003530 con 0x7f5fec0d2a10 2024-04-26T23:50:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff0e00640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 0x7f5fec15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:43.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2913085719 0 0) 0x7f5fd4003530 con 0x7f5fec0d2a10 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 msgr2=0x7f5fec15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 0x7f5fec15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 >> v2:172.21.15.203:3300/0 conn(0x7f5fec15d010 msgr2=0x7f5fec161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 --2- 172.21.15.47:0/3407150953 >> v2:172.21.15.203:3300/0 conn(0x7f5fec15d010 0x7f5fec161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec15e4b0 con 0x7f5fec0d2a10 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f5fe4001a00 con 0x7f5fec0d2a10 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 >> v1:172.21.15.47:6789/0 conn(0x7f5fec0d2a10 legacy=0x7f5fec0d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 0x7f5fd40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4003f40 0x7f5fd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec0d0970 con 0x7f5fd4004d50 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec15e1d0 con 0x7f5fd4003f40 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd400bad0 con 0x7f5fec15d3f0 2024-04-26T23:50:43.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff0e00640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4003f40 0x7f5fd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff1800640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 0x7f5fd40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 -- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 msgr2=0x7f5fd40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec15d3f0 0x7f5fd40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 -- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4003f40 msgr2=0x7f5fd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4003f40 0x7f5fd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.364+0000 7f5ff2200640 1 -- 172.21.15.47:0/3407150953 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd4003530 con 0x7f5fd4004d50 2024-04-26T23:50:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2200640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400a950 tx=0x7f5fe401fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef75f48c944a9fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe400a4c0 con 0x7f5fd4004d50 2024-04-26T23:50:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe40ad020 con 0x7f5fd4004d50 2024-04-26T23:50:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5febe00640 1 -- 172.21.15.47:0/3407150953 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe40a9730 con 0x7f5fd4004d50 2024-04-26T23:50:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2c00640 1 -- 172.21.15.47:0/3407150953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd4004d50 msgr2=0x7f5fd40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:43.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2c00640 1 --2- 172.21.15.47:0/3407150953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fd4004d50 0x7f5fd40051d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400a950 tx=0x7f5fe401fba0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2200640 1 -- 172.21.15.47:0/3407150953 reap_dead start 2024-04-26T23:50:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2c00640 1 -- 172.21.15.47:0/3407150953 shutdown_connections 2024-04-26T23:50:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2c00640 1 -- 172.21.15.47:0/3407150953 >> 172.21.15.47:0/3407150953 conn(0x7f5fec09ba60 msgr2=0x7f5fec09be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2c00640 1 -- 172.21.15.47:0/3407150953 shutdown_connections 2024-04-26T23:50:43.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.368+0000 7f5ff2c00640 1 -- 172.21.15.47:0/3407150953 wait complete. 2024-04-26T23:50:43.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 Processor -- start 2024-04-26T23:50:43.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 -- start start 2024-04-26T23:50:43.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4004d50 0x7f5fec0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fec0c94b0 0x7f5fec06d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec0c8840 0x7f5fec151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec15d9b0 con 0x7f5fec0c94b0 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec15d830 con 0x7f5fd4004d50 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f5fec15db30 con 0x7f5fec0c8840 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fec0c94b0 0x7f5fec06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fec0c94b0 0x7f5fec06d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50802/0 (socket says 172.21.15.47:50802) 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 -- 172.21.15.47:0/1311071287 learned_addr learned my addr 172.21.15.47:0/1311071287 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 -- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec0c8840 msgr2=0x7f5fec151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec0c8840 0x7f5fec151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 -- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4004d50 msgr2=0x7f5fec0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4004d50 0x7f5fec0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 -- 172.21.15.47:0/1311071287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec15de50 con 0x7f5fec0c94b0 2024-04-26T23:50:43.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff0e00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fec0c94b0 0x7f5fec06d510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800b7f0 tx=0x7f5fd800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:43.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5fe9600640 1 -- 172.21.15.47:0/1311071287 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8018070 con 0x7f5fec0c94b0 2024-04-26T23:50:43.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5fe9600640 1 -- 172.21.15.47:0/1311071287 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd80107b0 con 0x7f5fec0c94b0 2024-04-26T23:50:43.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5fe9600640 1 -- 172.21.15.47:0/1311071287 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8010b80 con 0x7f5fec0c94b0 2024-04-26T23:50:43.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fec0b5570 con 0x7f5fec0c94b0 2024-04-26T23:50:43.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fec0c6c50 con 0x7f5fec0c94b0 2024-04-26T23:50:43.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.372+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fec069470 con 0x7f5fec0c94b0 2024-04-26T23:50:43.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.376+0000 7f5fe9600640 1 -- 172.21.15.47:0/1311071287 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f5fd801b070 con 0x7f5fec0c94b0 2024-04-26T23:50:43.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.376+0000 7f5fe9600640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5fcc068650 0x7f5fcc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:43.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.376+0000 7f5fe9600640 1 -- 172.21.15.47:0/1311071287 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5415+0+0 (secure 0 0 0) 0x7f5fd80871c0 con 0x7f5fec0c94b0 2024-04-26T23:50:43.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.376+0000 7f5ff1800640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5fcc068650 0x7f5fcc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:43.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.376+0000 7f5ff1800640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5fcc068650 0x7f5fcc06ab10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0006e90 tx=0x7f5fe0006e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:43.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.380+0000 7f5fe9600640 1 -- 172.21.15.47:0/1311071287 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f5fd80575a0 con 0x7f5fec0c94b0 2024-04-26T23:50:43.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:43.544+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5fec0b8d20 con 0x7f5fec0c94b0 2024-04-26T23:50:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.184+0000 7f5fe9600640 1 -- 172.21.15.47:0/1311071287 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7f5fd8056ea0 con 0x7f5fec0c94b0 2024-04-26T23:50:44.192 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-04-26T23:50:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5fcc068650 msgr2=0x7f5fcc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5fcc068650 0x7f5fcc06ab10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0006e90 tx=0x7f5fe0006e00 comp rx=0 tx=0).stop 2024-04-26T23:50:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fec0c94b0 msgr2=0x7f5fec06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fec0c94b0 0x7f5fec06d510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800b7f0 tx=0x7f5fd800bcb0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 shutdown_connections 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f5fcc068650 0x7f5fcc06ab10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f5fec0c8840 0x7f5fec151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5fec0c94b0 0x7f5fec06d510 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 --2- 172.21.15.47:0/1311071287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd4004d50 0x7f5fec0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 >> 172.21.15.47:0/1311071287 conn(0x7f5fec09ba60 msgr2=0x7f5fec0ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 shutdown_connections 2024-04-26T23:50:44.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.188+0000 7f5ff2c00640 1 -- 172.21.15.47:0/1311071287 wait complete. 2024-04-26T23:50:44.220 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-26T23:50:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e91e00640 1 Processor -- start 2024-04-26T23:50:44.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e91e00640 1 -- start start 2024-04-26T23:50:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e91e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e8c0d09e0 0x7f3e8c167f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e91e00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8c0cde20 con 0x7f3e8c154280 2024-04-26T23:50:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e91e00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e8c073370 con 0x7f3e8c0b0a50 2024-04-26T23:50:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e91e00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f3e8c0ce0c0 con 0x7f3e8c0d09e0 2024-04-26T23:50:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e91400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3e8c0d09e0 0x7f3e8c167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e90a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f3e8c154280 0x7f3e8c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57042/0 (socket says 172.21.15.47:57042) 2024-04-26T23:50:44.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.360+0000 7f3e90a00640 1 -- 172.21.15.47:0/350799140 learned_addr learned my addr 172.21.15.47:0/350799140 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e91400640 1 -- 172.21.15.47:0/350799140 >> v1:172.21.15.203:6789/0 conn(0x7f3e8c0b0a50 legacy=0x7f3e8c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e91400640 1 -- 172.21.15.47:0/350799140 >> v1:172.21.15.47:6789/0 conn(0x7f3e8c154280 legacy=0x7f3e8c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e91400640 1 -- 172.21.15.47:0/350799140 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c073650 con 0x7f3e8c0d09e0 2024-04-26T23:50:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e8be00640 1 -- 172.21.15.47:0/350799140 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590388393 0 0) 0x7f3e8c0cde20 con 0x7f3e8c154280 2024-04-26T23:50:44.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e91400640 1 --2- 172.21.15.47:0/350799140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c0d09e0 0x7f3e8c167f50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e8401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4cd183e96c7f61 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:44.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e8be00640 1 -- 172.21.15.47:0/350799140 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840b2070 con 0x7f3e8c0d09e0 2024-04-26T23:50:44.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e8be00640 1 -- 172.21.15.47:0/350799140 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e840a58c0 con 0x7f3e8c0d09e0 2024-04-26T23:50:44.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e8be00640 1 -- 172.21.15.47:0/350799140 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840a5c90 con 0x7f3e8c0d09e0 2024-04-26T23:50:44.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e91e00640 1 -- 172.21.15.47:0/350799140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c0d09e0 msgr2=0x7f3e8c167f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.364+0000 7f3e91e00640 1 --2- 172.21.15.47:0/350799140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c0d09e0 0x7f3e8c167f50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e8401c8e0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- 172.21.15.47:0/350799140 shutdown_connections 2024-04-26T23:50:44.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 --2- 172.21.15.47:0/350799140 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c0d09e0 0x7f3e8c167f50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- 172.21.15.47:0/350799140 >> 172.21.15.47:0/350799140 conn(0x7f3e8c0b3120 msgr2=0x7f3e8c0b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:44.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- 172.21.15.47:0/350799140 shutdown_connections 2024-04-26T23:50:44.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- 172.21.15.47:0/350799140 wait complete. 2024-04-26T23:50:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 Processor -- start 2024-04-26T23:50:44.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- start start 2024-04-26T23:50:44.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e8c0b0a50 0x7f3e8c06f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e8c0d09e0 0x7f3e8c1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c154280 0x7f3e8c15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c16b040 con 0x7f3e8c154280 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c16aec0 con 0x7f3e8c0b0a50 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91e00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8c16b1c0 con 0x7f3e8c0d09e0 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c154280 0x7f3e8c15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c154280 0x7f3e8c15e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50824/0 (socket says 172.21.15.47:50824) 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 -- 172.21.15.47:0/3542032369 learned_addr learned my addr 172.21.15.47:0/3542032369 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 -- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e8c0d09e0 msgr2=0x7f3e8c1525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e83e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e8c0d09e0 0x7f3e8c1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e90a00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e8c0b0a50 0x7f3e8c06f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e8c0d09e0 0x7f3e8c1525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 -- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e8c0b0a50 msgr2=0x7f3e8c06f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e8c0b0a50 0x7f3e8c06f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 -- 172.21.15.47:0/3542032369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c152db0 con 0x7f3e8c154280 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e83e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e8c0d09e0 0x7f3e8c1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:44.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e90a00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e8c0b0a50 0x7f3e8c06f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.368+0000 7f3e91400640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c154280 0x7f3e8c15e700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e84019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e89600640 1 -- 172.21.15.47:0/3542032369 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840bd070 con 0x7f3e8c154280 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e89600640 1 -- 172.21.15.47:0/3542032369 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e84003ba0 con 0x7f3e8c154280 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e89600640 1 -- 172.21.15.47:0/3542032369 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e840b2040 con 0x7f3e8c154280 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8c0aea70 con 0x7f3e8c154280 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8c0aed10 con 0x7f3e8c154280 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8c069470 con 0x7f3e8c154280 2024-04-26T23:50:44.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e89600640 1 -- 172.21.15.47:0/3542032369 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f3e84004030 con 0x7f3e8c154280 2024-04-26T23:50:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e89600640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3e68068680 0x7f3e6806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e89600640 1 -- 172.21.15.47:0/3542032369 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f3e84121b40 con 0x7f3e8c154280 2024-04-26T23:50:44.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e90a00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3e68068680 0x7f3e6806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.372+0000 7f3e90a00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3e68068680 0x7f3e6806ab40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c000f70 tx=0x7f3e7c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:44.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.376+0000 7f3e89600640 1 -- 172.21.15.47:0/3542032369 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f3e84016560 con 0x7f3e8c154280 2024-04-26T23:50:44.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.540+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3e8c15aef0 con 0x7f3e8c154280 2024-04-26T23:50:44.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.544+0000 7f3e89600640 1 -- 172.21.15.47:0/3542032369 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f3e840f2100 con 0x7f3e8c154280 2024-04-26T23:50:44.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3e68068680 msgr2=0x7f3e6806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3e68068680 0x7f3e6806ab40 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c000f70 tx=0x7f3e7c009040 comp rx=0 tx=0).stop 2024-04-26T23:50:44.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c154280 msgr2=0x7f3e8c15e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c154280 0x7f3e8c15e700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e84019680 comp rx=0 tx=0).stop 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 shutdown_connections 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f3e68068680 0x7f3e6806ab40 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3e8c154280 0x7f3e8c15e700 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f3e8c0d09e0 0x7f3e8c1525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 --2- 172.21.15.47:0/3542032369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e8c0b0a50 0x7f3e8c06f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 >> 172.21.15.47:0/3542032369 conn(0x7f3e8c0b3120 msgr2=0x7f3e8c15c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 shutdown_connections 2024-04-26T23:50:44.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.548+0000 7f3e91e00640 1 -- 172.21.15.47:0/3542032369 wait complete. 2024-04-26T23:50:44.574 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled' 2024-04-26T23:50:44.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 Processor -- start 2024-04-26T23:50:44.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 -- start start 2024-04-26T23:50:44.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c15c100 0x7fad8c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fad8c06fcd0 0x7fad8c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fad8c0ce140 0x7fad8c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fad8c160860 con 0x7fad8c0ce140 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fad8c15d4a0 con 0x7fad8c06fcd0 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad92200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c15fc50 con 0x7fad8c15c100 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fad8c0ce140 0x7fad8c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fad8c0ce140 0x7fad8c06ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50826/0 (socket says 172.21.15.47:50826) 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 -- 172.21.15.47:0/3496232563 learned_addr learned my addr 172.21.15.47:0/3496232563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad82a00640 1 --2- 172.21.15.47:0/3496232563 >> v2:172.21.15.203:3300/0 conn(0x7fad8c06fcd0 0x7fad8c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8b400640 1 --2- 172.21.15.47:0/3496232563 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c15c100 0x7fad8c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 -- 172.21.15.47:0/3496232563 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c15c100 msgr2=0x7fad8c15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 --2- 172.21.15.47:0/3496232563 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c15c100 0x7fad8c15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 -- 172.21.15.47:0/3496232563 >> v2:172.21.15.203:3300/0 conn(0x7fad8c06fcd0 msgr2=0x7fad8c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:44.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 --2- 172.21.15.47:0/3496232563 >> v2:172.21.15.203:3300/0 conn(0x7fad8c06fcd0 0x7fad8c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8be00640 1 -- 172.21.15.47:0/3496232563 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c15ff30 con 0x7fad8c0ce140 2024-04-26T23:50:44.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.708+0000 7fad8b400640 1 --2- 172.21.15.47:0/3496232563 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c15c100 0x7fad8c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:44.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad8be00640 1 --2- 172.21.15.47:0/3496232563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c0ce140 0x7fad8c06ded0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0703d0 tx=0x7fad8401e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a383b21babe003 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:44.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad8aa00640 1 -- 172.21.15.47:0/3496232563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8400b2d0 con 0x7fad8c0ce140 2024-04-26T23:50:44.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad8aa00640 1 -- 172.21.15.47:0/3496232563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad8400b470 con 0x7fad8c0ce140 2024-04-26T23:50:44.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad8aa00640 1 -- 172.21.15.47:0/3496232563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad840a78f0 con 0x7fad8c0ce140 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 -- 172.21.15.47:0/3496232563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c0ce140 msgr2=0x7fad8c06ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 --2- 172.21.15.47:0/3496232563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c0ce140 0x7fad8c06ded0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0703d0 tx=0x7fad8401e930 comp rx=0 tx=0).stop 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 -- 172.21.15.47:0/3496232563 shutdown_connections 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 --2- 172.21.15.47:0/3496232563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c0ce140 0x7fad8c06ded0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 --2- 172.21.15.47:0/3496232563 >> v2:172.21.15.203:3300/0 conn(0x7fad8c06fcd0 0x7fad8c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 --2- 172.21.15.47:0/3496232563 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c15c100 0x7fad8c15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 -- 172.21.15.47:0/3496232563 >> 172.21.15.47:0/3496232563 conn(0x7fad8c06c800 msgr2=0x7fad8c06cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 -- 172.21.15.47:0/3496232563 shutdown_connections 2024-04-26T23:50:44.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.712+0000 7fad92200640 1 -- 172.21.15.47:0/3496232563 wait complete. 2024-04-26T23:50:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 Processor -- start 2024-04-26T23:50:44.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 -- start start 2024-04-26T23:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c06fcd0 0x7fad8c15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c0ce140 0x7fad8c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c15c100 0x7fad8c0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0cef90 con 0x7fad8c06fcd0 2024-04-26T23:50:44.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0cee10 con 0x7fad8c15c100 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c0cf110 con 0x7fad8c0ce140 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c06fcd0 0x7fad8c15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c06fcd0 0x7fad8c15e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50830/0 (socket says 172.21.15.47:50830) 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 -- 172.21.15.47:0/4225315476 learned_addr learned my addr 172.21.15.47:0/4225315476 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8be00640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c15c100 0x7fad8c0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad82a00640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c0ce140 0x7fad8c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 -- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c0ce140 msgr2=0x7fad8c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c0ce140 0x7fad8c0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 -- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c15c100 msgr2=0x7fad8c0b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c15c100 0x7fad8c0b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 -- 172.21.15.47:0/4225315476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c1650b0 con 0x7fad8c06fcd0 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad8b400640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c06fcd0 0x7fad8c15e0c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00d800 tx=0x7fad7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad83e00640 1 -- 172.21.15.47:0/4225315476 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c018020 con 0x7fad8c06fcd0 2024-04-26T23:50:44.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad83e00640 1 -- 172.21.15.47:0/4225315476 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7c0096c0 con 0x7fad8c06fcd0 2024-04-26T23:50:44.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad83e00640 1 -- 172.21.15.47:0/4225315476 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7c009ab0 con 0x7fad8c06fcd0 2024-04-26T23:50:44.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8c165320 con 0x7fad8c06fcd0 2024-04-26T23:50:44.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.716+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8c1658e0 con 0x7fad8c06fcd0 2024-04-26T23:50:44.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.720+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad8c142520 con 0x7fad8c06fcd0 2024-04-26T23:50:44.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.720+0000 7fad83e00640 1 -- 172.21.15.47:0/4225315476 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fad7c01b020 con 0x7fad8c06fcd0 2024-04-26T23:50:44.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.720+0000 7fad83e00640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad68068650 0x7fad6806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:44.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.720+0000 7fad83e00640 1 -- 172.21.15.47:0/4225315476 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fad7c086ef0 con 0x7fad8c06fcd0 2024-04-26T23:50:44.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.720+0000 7fad82a00640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad68068650 0x7fad6806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:44.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.720+0000 7fad82a00640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad68068650 0x7fad6806ab10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0b39f0 tx=0x7fad74006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:44.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.724+0000 7fad83e00640 1 -- 172.21.15.47:0/4225315476 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fad7c022020 con 0x7fad8c06fcd0 2024-04-26T23:50:44.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:44.956+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]} v 0) -- 0x7fad8c069700 con 0x7fad8c06fcd0 2024-04-26T23:50:45.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.188+0000 7fad83e00640 1 -- 172.21.15.47:0/4225315476 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones.test_clone_failure_status_in_progress_cancelled"]}]=0 v243) ==== 180+0+0 (secure 0 0 0) 0x7fad7c056dd0 con 0x7fad8c06fcd0 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad68068650 msgr2=0x7fad6806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad68068650 0x7fad6806ab10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0b39f0 tx=0x7fad74006f90 comp rx=0 tx=0).stop 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c06fcd0 msgr2=0x7fad8c15e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c06fcd0 0x7fad8c15e0c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fad7c00d800 tx=0x7fad7c00dcc0 comp rx=0 tx=0).stop 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 shutdown_connections 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fad68068650 0x7fad6806ab10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad8c15c100 0x7fad8c0b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fad8c0ce140 0x7fad8c0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 --2- 172.21.15.47:0/4225315476 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fad8c06fcd0 0x7fad8c15e0c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 >> 172.21.15.47:0/4225315476 conn(0x7fad8c06c800 msgr2=0x7fad8c06cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 shutdown_connections 2024-04-26T23:50:45.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:45.192+0000 7fad92200640 1 -- 172.21.15.47:0/4225315476 wait complete. 2024-04-26T23:50:45.223 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during in-progress state and validate the reason ... ERROR 2024-04-26T23:50:45.223 INFO:tasks.cephfs_test_runner: 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during in-progress state and validate the reason 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 6690, in test_clone_failure_status_in_progress_cancelled 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "create", self.volname, subvolume, "--mode=777") 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue().strip() 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-04-26T23:50:45.224 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi047 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol85370 --mode=777' 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner:Ran 2 tests in 282.703s 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner: 2024-04-26T23:50:45.225 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner:ERROR: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner:ensure failure status is shown when clone is cancelled during in-progress state and validate the reason 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 6690, in test_clone_failure_status_in_progress_cancelled 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: self._fs_cmd("subvolume", "create", self.volname, subvolume, "--mode=777") 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs/test_volumes.py", line 33, in _fs_cmd 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue().strip() 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run 2024-04-26T23:50:45.226 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi047 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol85370 --mode=777' 2024-04-26T23:50:45.227 INFO:tasks.cephfs_test_runner: 2024-04-26T23:50:45.227 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-26T23:50:45.435 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ab83492ef7a348acbb0ac8eea6ed3813 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc612ffb9c1d5bc27536bc917a705262a36d4387/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones) 2024-04-26T23:50:45.437 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-26T23:50:45.448 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T23:50:45.624 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T23:50:45.624 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:50:45.625 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:45.642 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:50:45.643 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-04-26T23:50:45.643 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:45.693 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2554 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-26T23:50:45.693 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:50:45.693 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:45.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350228k,nr_inodes=4087557,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6713 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:50:45.703 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-04-26T23:50:45.703 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T23:50:45.753 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350228k,nr_inodes=4087557,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6713 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274976k,nr_inodes=818744,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-26T23:50:45.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:45.753 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-04-26T23:50:45.764 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T23:50:45.764 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-26T23:50:45.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:45.765 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T23:50:45.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:45.832 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-26T23:50:45.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:45.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-04-26T23:50:46.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:46.076 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2024-04-26T23:50:46.085 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-26T23:50:46.086 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-26T23:50:46.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:46.086 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-26T23:50:46.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:46.152 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-26T23:50:46.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T23:50:46.220 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2024-04-26T23:50:46.363 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T23:50:46.373 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T23:50:46.373 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:50:46.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28c800640 1 Processor -- start 2024-04-26T23:50:46.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28c800640 1 -- start start 2024-04-26T23:50:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28c800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe28415d5b0 0x7fe28415da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28c800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe2840cdc00 0x7fe2840ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28c800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28415e050 con 0x7fe2840b4360 2024-04-26T23:50:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28c800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe28415e330 con 0x7fe2840cdc00 2024-04-26T23:50:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28c800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe2840ceda0 con 0x7fe28415d5b0 2024-04-26T23:50:46.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe28415d5b0 0x7fe28415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe28415d5b0 0x7fe28415da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3301/0 says I am v2:172.21.15.47:45604/0 (socket says 172.21.15.47:45604) 2024-04-26T23:50:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289400640 1 -- 172.21.15.47:0/3465011055 learned_addr learned my addr 172.21.15.47:0/3465011055 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289e00640 1 --1- 172.21.15.47:0/3465011055 >> v1:172.21.15.203:6789/0 conn(0x7fe2840b4360 0x7fe2840cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:51564/0 (socket says 172.21.15.47:51564) 2024-04-26T23:50:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe28a800640 1 --2- 172.21.15.47:0/3465011055 >> v2:172.21.15.203:3300/0 conn(0x7fe2840cdc00 0x7fe2840ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289400640 1 -- 172.21.15.47:0/3465011055 >> v2:172.21.15.203:3300/0 conn(0x7fe2840cdc00 msgr2=0x7fe2840ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289400640 1 --2- 172.21.15.47:0/3465011055 >> v2:172.21.15.203:3300/0 conn(0x7fe2840cdc00 0x7fe2840ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289400640 1 -- 172.21.15.47:0/3465011055 >> v1:172.21.15.203:6789/0 conn(0x7fe2840b4360 legacy=0x7fe2840cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.508+0000 7fe289400640 1 -- 172.21.15.47:0/3465011055 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2840cf080 con 0x7fe28415d5b0 2024-04-26T23:50:46.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe289400640 1 --2- 172.21.15.47:0/3465011055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe28415d5b0 0x7fe28415da40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe274006fd0 tx=0x7fe27401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d39ff7520d06f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe288a00640 1 -- 172.21.15.47:0/3465011055 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2740b0070 con 0x7fe28415d5b0 2024-04-26T23:50:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe288a00640 1 -- 172.21.15.47:0/3465011055 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2740ab600 con 0x7fe28415d5b0 2024-04-26T23:50:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe288a00640 1 -- 172.21.15.47:0/3465011055 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2740ab9d0 con 0x7fe28415d5b0 2024-04-26T23:50:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 -- 172.21.15.47:0/3465011055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe28415d5b0 msgr2=0x7fe28415da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 --2- 172.21.15.47:0/3465011055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe28415d5b0 0x7fe28415da40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe274006fd0 tx=0x7fe27401c540 comp rx=0 tx=0).stop 2024-04-26T23:50:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 -- 172.21.15.47:0/3465011055 shutdown_connections 2024-04-26T23:50:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 --2- 172.21.15.47:0/3465011055 >> v2:172.21.15.203:3300/0 conn(0x7fe2840cdc00 0x7fe2840ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 --2- 172.21.15.47:0/3465011055 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe28415d5b0 0x7fe28415da40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 -- 172.21.15.47:0/3465011055 >> 172.21.15.47:0/3465011055 conn(0x7fe28406c800 msgr2=0x7fe28406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 -- 172.21.15.47:0/3465011055 shutdown_connections 2024-04-26T23:50:46.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.512+0000 7fe28c800640 1 -- 172.21.15.47:0/3465011055 wait complete. 2024-04-26T23:50:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 Processor -- start 2024-04-26T23:50:46.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 -- start start 2024-04-26T23:50:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2840b4360 0x7fe2840af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2840cdc00 0x7fe28409df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe28415d5b0 0x7fe28413d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe284169f40 con 0x7fe2840b4360 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe28415f190 con 0x7fe28415d5b0 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe28416a0c0 con 0x7fe2840cdc00 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2840b4360 0x7fe2840af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2840b4360 0x7fe2840af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50836/0 (socket says 172.21.15.47:50836) 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 -- 172.21.15.47:0/2911582025 learned_addr learned my addr 172.21.15.47:0/2911582025 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289400640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2840cdc00 0x7fe28409df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28a800640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe28415d5b0 0x7fe28413d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 -- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2840cdc00 msgr2=0x7fe28409df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2840cdc00 0x7fe28409df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 -- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe28415d5b0 msgr2=0x7fe28413d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe28415d5b0 0x7fe28413d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 -- 172.21.15.47:0/2911582025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe28409d470 con 0x7fe2840b4360 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289400640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2840cdc00 0x7fe28409df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe289e00640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2840b4360 0x7fe2840af4c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe27800c420 tx=0x7fe27800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe27e000640 1 -- 172.21.15.47:0/2911582025 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2780074e0 con 0x7fe2840b4360 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe27e000640 1 -- 172.21.15.47:0/2911582025 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe278007680 con 0x7fe2840b4360 2024-04-26T23:50:46.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe27e000640 1 -- 172.21.15.47:0/2911582025 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe278004a30 con 0x7fe2840b4360 2024-04-26T23:50:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe28415c4d0 con 0x7fe2840b4360 2024-04-26T23:50:46.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.516+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe28409d710 con 0x7fe2840b4360 2024-04-26T23:50:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.520+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe284069700 con 0x7fe2840b4360 2024-04-26T23:50:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.520+0000 7fe27e000640 1 -- 172.21.15.47:0/2911582025 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe27801a020 con 0x7fe2840b4360 2024-04-26T23:50:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.520+0000 7fe27e000640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe268068650 0x7fe26806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.520+0000 7fe27e000640 1 -- 172.21.15.47:0/2911582025 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fe278086160 con 0x7fe2840b4360 2024-04-26T23:50:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.520+0000 7fe289400640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe268068650 0x7fe26806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.520+0000 7fe289400640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe268068650 0x7fe26806ab10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe2840cead0 tx=0x7fe2740ad040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:46.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.524+0000 7fe27e000640 1 -- 172.21.15.47:0/2911582025 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe2780560d0 con 0x7fe2840b4360 2024-04-26T23:50:46.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.684+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe28415cbe0 con 0x7fe268068650 2024-04-26T23:50:46.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.684+0000 7fe27e000640 1 -- 172.21.15.47:0/2911582025 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13486 (secure 0 0 0) 0x7fe28415cbe0 con 0x7fe268068650 2024-04-26T23:50:46.693 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:46.693 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:50:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe268068650 msgr2=0x7fe26806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe268068650 0x7fe26806ab10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe2840cead0 tx=0x7fe2740ad040 comp rx=0 tx=0).stop 2024-04-26T23:50:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2840b4360 msgr2=0x7fe2840af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2840b4360 0x7fe2840af4c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe27800c420 tx=0x7fe27800c8e0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 shutdown_connections 2024-04-26T23:50:46.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe268068650 0x7fe26806ab10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe28415d5b0 0x7fe28413d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe2840cdc00 0x7fe28409df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 --2- 172.21.15.47:0/2911582025 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe2840b4360 0x7fe2840af4c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 >> 172.21.15.47:0/2911582025 conn(0x7fe28406c800 msgr2=0x7fe2840aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 shutdown_connections 2024-04-26T23:50:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.688+0000 7fe28c800640 1 -- 172.21.15.47:0/2911582025 wait complete. 2024-04-26T23:50:46.714 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-04-26T23:50:46.232079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238808,"kb_used_data":6008,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735912,"statfs":{"total":773094113280,"available":772849573888,"internally_reserved":0,"allocated":6152192,"data_stored":3221670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4389,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001419"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T23:50:44.197245+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:50:44.197245+0000","last_peered":"2024-04-26T23:50:44.197245+0000","last_clean":"2024-04-26T23:50:44.197245+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:50:44.197245+0000","last_undegraded":"2024-04-26T23:50:44.197245+0000","last_fullsized":"2024-04-26T23:50:44.197245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1216512,"data_stored":846916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":618496,"data_stored":251125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542213,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":840889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:50:46.715 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:50:46.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.848+0000 7fe7fe200640 1 Processor -- start 2024-04-26T23:50:46.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.848+0000 7fe7fe200640 1 -- start start 2024-04-26T23:50:46.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7fe200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe7f80b4360 0x7fe7f80cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7fe200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f815da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7fe200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f815e050 con 0x7fe7f80cdc00 2024-04-26T23:50:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7fe200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f815e330 con 0x7fe7f80b4360 2024-04-26T23:50:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7fe200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f80ceda0 con 0x7fe7f815d5b0 2024-04-26T23:50:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe7f80cdc00 0x7fe7f815e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57050/0 (socket says 172.21.15.47:57050) 2024-04-26T23:50:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7e00640 1 -- 172.21.15.47:0/794065154 learned_addr learned my addr 172.21.15.47:0/794065154 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:46.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7400640 1 --2- 172.21.15.47:0/794065154 >> v2:172.21.15.203:3300/0 conn(0x7fe7f80b4360 0x7fe7f80cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7eea00640 1 --2- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f815da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7400640 1 -- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 msgr2=0x7fe7f815da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:46.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f6a00640 1 -- 172.21.15.47:0/794065154 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861972772 0 0) 0x7fe7f815e050 con 0x7fe7f80cdc00 2024-04-26T23:50:46.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7400640 1 --2- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f815da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7400640 1 -- 172.21.15.47:0/794065154 >> v1:172.21.15.47:6789/0 conn(0x7fe7f80cdc00 legacy=0x7fe7f815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7400640 1 -- 172.21.15.47:0/794065154 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f80cf080 con 0x7fe7f80b4360 2024-04-26T23:50:46.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7eea00640 1 --2- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:46.861 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.852+0000 7fe7f7400640 1 --2- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80b4360 0x7fe7f80cf5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80097c0 tx=0x7fe7e801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d62b837e2f3250 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:46.862 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7f6a00640 1 -- 172.21.15.47:0/794065154 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80b0070 con 0x7fe7f80b4360 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7f6a00640 1 -- 172.21.15.47:0/794065154 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e80ab600 con 0x7fe7f80b4360 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7f6a00640 1 -- 172.21.15.47:0/794065154 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80ab9d0 con 0x7fe7f80b4360 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80b4360 msgr2=0x7fe7f80cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 --2- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80b4360 0x7fe7f80cf5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80097c0 tx=0x7fe7e801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- 172.21.15.47:0/794065154 shutdown_connections 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 --2- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f815da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 --2- 172.21.15.47:0/794065154 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80b4360 0x7fe7f80cf5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- 172.21.15.47:0/794065154 >> 172.21.15.47:0/794065154 conn(0x7fe7f806c800 msgr2=0x7fe7f806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:46.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- 172.21.15.47:0/794065154 shutdown_connections 2024-04-26T23:50:46.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- 172.21.15.47:0/794065154 wait complete. 2024-04-26T23:50:46.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 Processor -- start 2024-04-26T23:50:46.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- start start 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f80b4360 0x7fe7f814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80cdc00 0x7fe7f80b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f80b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80b60f0 con 0x7fe7f80b4360 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f80b5f70 con 0x7fe7f80cdc00 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7fe200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f816a750 con 0x7fe7f815d5b0 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7f7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f80b4360 0x7fe7f814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7f7400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f80b4360 0x7fe7f814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50850/0 (socket says 172.21.15.47:50850) 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.856+0000 7fe7f7400640 1 -- 172.21.15.47:0/3766669291 learned_addr learned my addr 172.21.15.47:0/3766669291 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7f7e00640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f80b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7eea00640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80cdc00 0x7fe7f80b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7f7400640 1 -- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 msgr2=0x7fe7f80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7f7400640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f80b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7f7400640 1 -- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80cdc00 msgr2=0x7fe7f80b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7f7400640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80cdc00 0x7fe7f80b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:46.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7f7400640 1 -- 172.21.15.47:0/3766669291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f80732e0 con 0x7fe7f80b4360 2024-04-26T23:50:46.868 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7f7400640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f80b4360 0x7fe7f814db50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe7e801a0d0 tx=0x7fe7e801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:46.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7efe00640 1 -- 172.21.15.47:0/3766669291 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80b0050 con 0x7fe7f80b4360 2024-04-26T23:50:46.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7efe00640 1 -- 172.21.15.47:0/3766669291 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e80bc070 con 0x7fe7f80b4360 2024-04-26T23:50:46.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f80735c0 con 0x7fe7f80b4360 2024-04-26T23:50:46.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7efe00640 1 -- 172.21.15.47:0/3766669291 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e80b5830 con 0x7fe7f80b4360 2024-04-26T23:50:46.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f8073b80 con 0x7fe7f80b4360 2024-04-26T23:50:46.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f8069700 con 0x7fe7f80b4360 2024-04-26T23:50:46.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7efe00640 1 -- 172.21.15.47:0/3766669291 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe7e80b59d0 con 0x7fe7f80b4360 2024-04-26T23:50:46.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7efe00640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7d4068650 0x7fe7d406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:46.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7efe00640 1 -- 172.21.15.47:0/3766669291 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fe7e8121350 con 0x7fe7f80b4360 2024-04-26T23:50:46.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.860+0000 7fe7eea00640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7d4068650 0x7fe7d406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:46.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.864+0000 7fe7eea00640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7d4068650 0x7fe7d406ab10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009510 tx=0x7fe7e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:46.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:46.864+0000 7fe7efe00640 1 -- 172.21.15.47:0/3766669291 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe7e8016090 con 0x7fe7f80b4360 2024-04-26T23:50:47.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.028+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7f80d06a0 con 0x7fe7d4068650 2024-04-26T23:50:47.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.028+0000 7fe7efe00640 1 -- 172.21.15.47:0/3766669291 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13486 (secure 0 0 0) 0x7fe7f80d06a0 con 0x7fe7d4068650 2024-04-26T23:50:47.037 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:47.038 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:50:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7d4068650 msgr2=0x7fe7d406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7d4068650 0x7fe7d406ab10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0009510 tx=0x7fe7e0008040 comp rx=0 tx=0).stop 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f80b4360 msgr2=0x7fe7f814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f80b4360 0x7fe7f814db50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe7e801a0d0 tx=0x7fe7e801ace0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 shutdown_connections 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe7d4068650 0x7fe7d406ab10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe7f815d5b0 0x7fe7f80b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe7f80cdc00 0x7fe7f80b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 --2- 172.21.15.47:0/3766669291 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe7f80b4360 0x7fe7f814db50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 >> 172.21.15.47:0/3766669291 conn(0x7fe7f806c800 msgr2=0x7fe7f815e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:47.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 shutdown_connections 2024-04-26T23:50:47.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.032+0000 7fe7fe200640 1 -- 172.21.15.47:0/3766669291 wait complete. 2024-04-26T23:50:47.058 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-04-26T23:50:46.232079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238808,"kb_used_data":6008,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735912,"statfs":{"total":773094113280,"available":772849573888,"internally_reserved":0,"allocated":6152192,"data_stored":3221670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4389,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001419"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T23:50:44.197245+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:50:44.197245+0000","last_peered":"2024-04-26T23:50:44.197245+0000","last_clean":"2024-04-26T23:50:44.197245+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:50:44.197245+0000","last_undegraded":"2024-04-26T23:50:44.197245+0000","last_fullsized":"2024-04-26T23:50:44.197245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1216512,"data_stored":846916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":618496,"data_stored":251125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542213,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":840889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:50:47.059 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T23:50:47.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:50:47.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe919000640 1 Processor -- start 2024-04-26T23:50:47.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe919000640 1 -- start start 2024-04-26T23:50:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe919000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe91415f1b0 0x7fe914070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe919000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fe9140b2130 0x7fe914070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe919000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91415f590 con 0x7fe9140701a0 2024-04-26T23:50:47.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe919000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fe9140d00b0 con 0x7fe91415f1b0 2024-04-26T23:50:47.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe919000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fe9140d0540 con 0x7fe9140b2130 2024-04-26T23:50:47.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe913e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe9140701a0 0x7fe914162c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57066/0 (socket says 172.21.15.47:57066) 2024-04-26T23:50:47.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe913e00640 1 -- 172.21.15.47:0/2814765897 learned_addr learned my addr 172.21.15.47:0/2814765897 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:47.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe913400640 1 --2- 172.21.15.47:0/2814765897 >> v2:172.21.15.47:3300/0 conn(0x7fe91415f1b0 0x7fe914070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe912a00640 1 --2- 172.21.15.47:0/2814765897 >> v2:172.21.15.203:3300/0 conn(0x7fe9140b2130 0x7fe914070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe913400640 1 -- 172.21.15.47:0/2814765897 >> v2:172.21.15.203:3300/0 conn(0x7fe9140b2130 msgr2=0x7fe914070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:47.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe913400640 1 --2- 172.21.15.47:0/2814765897 >> v2:172.21.15.203:3300/0 conn(0x7fe9140b2130 0x7fe914070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe913400640 1 -- 172.21.15.47:0/2814765897 >> v1:172.21.15.47:6789/0 conn(0x7fe9140701a0 legacy=0x7fe914162c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.196+0000 7fe913400640 1 -- 172.21.15.47:0/2814765897 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9140cf780 con 0x7fe91415f1b0 2024-04-26T23:50:47.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe913400640 1 --2- 172.21.15.47:0/2814765897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe91415f1b0 0x7fe914070760 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe91406ffa0 tx=0x7fe90401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2ad421ecef1973 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:47.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe912000640 1 -- 172.21.15.47:0/2814765897 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040b0070 con 0x7fe91415f1b0 2024-04-26T23:50:47.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe912000640 1 -- 172.21.15.47:0/2814765897 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9040ab600 con 0x7fe91415f1b0 2024-04-26T23:50:47.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe912000640 1 -- 172.21.15.47:0/2814765897 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040ab9d0 con 0x7fe91415f1b0 2024-04-26T23:50:47.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 -- 172.21.15.47:0/2814765897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe91415f1b0 msgr2=0x7fe914070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 --2- 172.21.15.47:0/2814765897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe91415f1b0 0x7fe914070760 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe91406ffa0 tx=0x7fe90401c480 comp rx=0 tx=0).stop 2024-04-26T23:50:47.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 -- 172.21.15.47:0/2814765897 shutdown_connections 2024-04-26T23:50:47.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 --2- 172.21.15.47:0/2814765897 >> v2:172.21.15.203:3300/0 conn(0x7fe9140b2130 0x7fe914070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 --2- 172.21.15.47:0/2814765897 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe91415f1b0 0x7fe914070760 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 -- 172.21.15.47:0/2814765897 >> 172.21.15.47:0/2814765897 conn(0x7fe91409ba60 msgr2=0x7fe91409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:47.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 -- 172.21.15.47:0/2814765897 shutdown_connections 2024-04-26T23:50:47.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.200+0000 7fe919000640 1 -- 172.21.15.47:0/2814765897 wait complete. 2024-04-26T23:50:47.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 Processor -- start 2024-04-26T23:50:47.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 -- start start 2024-04-26T23:50:47.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9140701a0 0x7fe91414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9140b2130 0x7fe914158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe91415f1b0 0x7fe9140b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fe9140d3830 con 0x7fe9140701a0 2024-04-26T23:50:47.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe9140d36b0 con 0x7fe91415f1b0 2024-04-26T23:50:47.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fe91416bfc0 con 0x7fe9140b2130 2024-04-26T23:50:47.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9140701a0 0x7fe91414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9140701a0 0x7fe91414e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50878/0 (socket says 172.21.15.47:50878) 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 -- 172.21.15.47:0/2136888119 learned_addr learned my addr 172.21.15.47:0/2136888119 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe912a00640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9140b2130 0x7fe914158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913e00640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe91415f1b0 0x7fe9140b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 -- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9140b2130 msgr2=0x7fe914158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9140b2130 0x7fe914158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 -- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe91415f1b0 msgr2=0x7fe9140b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe91415f1b0 0x7fe9140b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 -- 172.21.15.47:0/2136888119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9140b4150 con 0x7fe9140701a0 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913e00640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe91415f1b0 0x7fe9140b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe913400640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9140701a0 0x7fe91414e1a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ae040 tx=0x7fe90401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe90b400640 1 -- 172.21.15.47:0/2136888119 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040b0050 con 0x7fe9140701a0 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe90b400640 1 -- 172.21.15.47:0/2136888119 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9040bc070 con 0x7fe9140701a0 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91414e6e0 con 0x7fe9140701a0 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe90b400640 1 -- 172.21.15.47:0/2136888119 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9040b5870 con 0x7fe9140701a0 2024-04-26T23:50:47.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9140d12d0 con 0x7fe9140701a0 2024-04-26T23:50:47.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.204+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe914069470 con 0x7fe9140701a0 2024-04-26T23:50:47.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.208+0000 7fe90b400640 1 -- 172.21.15.47:0/2136888119 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fe9040b5a10 con 0x7fe9140701a0 2024-04-26T23:50:47.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.208+0000 7fe90b400640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe8f4068650 0x7fe8f406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.208+0000 7fe90b400640 1 -- 172.21.15.47:0/2136888119 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fe904121310 con 0x7fe9140701a0 2024-04-26T23:50:47.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.208+0000 7fe912a00640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe8f4068650 0x7fe8f406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.208+0000 7fe912a00640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe8f4068650 0x7fe8f406ab10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe91415e600 tx=0x7fe900009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:47.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.212+0000 7fe90b400640 1 -- 172.21.15.47:0/2136888119 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fe9140b4150 con 0x7fe9140701a0 2024-04-26T23:50:47.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.376+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe914157c50 con 0x7fe8f4068650 2024-04-26T23:50:47.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.376+0000 7fe90b400640 1 -- 172.21.15.47:0/2136888119 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13486 (secure 0 0 0) 0x7fe914157c50 con 0x7fe8f4068650 2024-04-26T23:50:47.384 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:47.384 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:50:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe8f4068650 msgr2=0x7fe8f406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe8f4068650 0x7fe8f406ab10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe91415e600 tx=0x7fe900009190 comp rx=0 tx=0).stop 2024-04-26T23:50:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9140701a0 msgr2=0x7fe91414e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9140701a0 0x7fe91414e1a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ae040 tx=0x7fe90401acc0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 shutdown_connections 2024-04-26T23:50:47.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fe8f4068650 0x7fe8f406ab10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe91415f1b0 0x7fe9140b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fe9140b2130 0x7fe914158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 --2- 172.21.15.47:0/2136888119 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe9140701a0 0x7fe91414e1a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 >> 172.21.15.47:0/2136888119 conn(0x7fe91409ba60 msgr2=0x7fe9140b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 shutdown_connections 2024-04-26T23:50:47.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.380+0000 7fe919000640 1 -- 172.21.15.47:0/2136888119 wait complete. 2024-04-26T23:50:47.405 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-04-26T23:50:46.232079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":238808,"kb_used_data":6008,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735912,"statfs":{"total":773094113280,"available":772849573888,"internally_reserved":0,"allocated":6152192,"data_stored":3221670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4389,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001419"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T23:50:44.197245+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:50:44.197245+0000","last_peered":"2024-04-26T23:50:44.197245+0000","last_clean":"2024-04-26T23:50:44.197245+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:50:44.197245+0000","last_undegraded":"2024-04-26T23:50:44.197245+0000","last_fullsized":"2024-04-26T23:50:44.197245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28208,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343632,"statfs":{"total":96636764160,"available":96607879168,"internally_reserved":0,"allocated":1216512,"data_stored":846916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509507,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":618496,"data_stored":251125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509507,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":256548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542213,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1204224,"data_stored":840889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:50:47.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T23:50:47.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedfd600640 1 Processor -- start 2024-04-26T23:50:47.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedfd600640 1 -- start start 2024-04-26T23:50:47.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedfd600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf80b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedfd600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd30 0x7fedf80ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedfd600640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf8072990 con 0x7fedf8070240 2024-04-26T23:50:47.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedfd600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80ce6d0 con 0x7fedf80cdd30 2024-04-26T23:50:47.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedfd600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fedf8072740 con 0x7fedf80affc0 2024-04-26T23:50:47.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf6a00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fedf8070240 0x7fedf806ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57074/0 (socket says 172.21.15.47:57074) 2024-04-26T23:50:47.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf6a00640 1 -- 172.21.15.47:0/872992209 learned_addr learned my addr 172.21.15.47:0/872992209 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:47.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf7400640 1 --2- 172.21.15.47:0/872992209 >> v2:172.21.15.203:3300/0 conn(0x7fedf80cdd30 0x7fedf80ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedefe00640 1 --2- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf80b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf6000640 1 -- 172.21.15.47:0/872992209 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782281673 0 0) 0x7fedf8072990 con 0x7fedf8070240 2024-04-26T23:50:47.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf6000640 1 -- 172.21.15.47:0/872992209 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feddc003530 con 0x7fedf8070240 2024-04-26T23:50:47.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf7400640 1 -- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 msgr2=0x7fedf80b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:47.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf7400640 1 --2- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf80b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf7400640 1 -- 172.21.15.47:0/872992209 >> v1:172.21.15.47:6789/0 conn(0x7fedf8070240 legacy=0x7fedf806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.540+0000 7fedf7400640 1 -- 172.21.15.47:0/872992209 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf8072c70 con 0x7fedf80cdd30 2024-04-26T23:50:47.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedf7400640 1 --2- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 0x7fedf80ce190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fedf000bfa0 tx=0x7fedf0021350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f779be4e5596fe2d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:47.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedf6000640 1 -- 172.21.15.47:0/872992209 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf00b6070 con 0x7fedf80cdd30 2024-04-26T23:50:47.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedf6000640 1 -- 172.21.15.47:0/872992209 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf00aae50 con 0x7fedf80cdd30 2024-04-26T23:50:47.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedf6000640 1 -- 172.21.15.47:0/872992209 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0009540 con 0x7fedf80cdd30 2024-04-26T23:50:47.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 -- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 msgr2=0x7fedf80ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 --2- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 0x7fedf80ce190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fedf000bfa0 tx=0x7fedf0021350 comp rx=0 tx=0).stop 2024-04-26T23:50:47.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 -- 172.21.15.47:0/872992209 shutdown_connections 2024-04-26T23:50:47.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 --2- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 0x7fedf80ce190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 --2- 172.21.15.47:0/872992209 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf80b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 -- 172.21.15.47:0/872992209 >> 172.21.15.47:0/872992209 conn(0x7fedf806c800 msgr2=0x7fedf806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:47.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 -- 172.21.15.47:0/872992209 shutdown_connections 2024-04-26T23:50:47.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.544+0000 7fedfd600640 1 -- 172.21.15.47:0/872992209 wait complete. 2024-04-26T23:50:47.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 Processor -- start 2024-04-26T23:50:47.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 -- start start 2024-04-26T23:50:47.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf8070240 0x7fedf8145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf81e6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 0x7fedf81e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806f340 con 0x7fedf8070240 2024-04-26T23:50:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fedf806e710 con 0x7fedf80cdd30 2024-04-26T23:50:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fedf815b540 con 0x7fedf80affc0 2024-04-26T23:50:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf8070240 0x7fedf8145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf8070240 0x7fedf8145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50888/0 (socket says 172.21.15.47:50888) 2024-04-26T23:50:47.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedefe00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf81e6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 -- 172.21.15.47:0/3318512859 learned_addr learned my addr 172.21.15.47:0/3318512859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf7400640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 0x7fedf81e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 -- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 msgr2=0x7fedf81e6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf81e6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 -- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 msgr2=0x7fedf81e7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 0x7fedf81e7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 -- 172.21.15.47:0/3318512859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf81464e0 con 0x7fedf8070240 2024-04-26T23:50:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedefe00640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf81e6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedf6a00640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf8070240 0x7fedf8145fa0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fede800c3f0 tx=0x7fede800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedeea00640 1 -- 172.21.15.47:0/3318512859 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8017070 con 0x7fedf8070240 2024-04-26T23:50:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedeea00640 1 -- 172.21.15.47:0/3318512859 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede8005cf0 con 0x7fedf8070240 2024-04-26T23:50:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedeea00640 1 -- 172.21.15.47:0/3318512859 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede80072f0 con 0x7fedf8070240 2024-04-26T23:50:47.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf80cc040 con 0x7fedf8070240 2024-04-26T23:50:47.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.548+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf80cc600 con 0x7fedf8070240 2024-04-26T23:50:47.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.552+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf8069700 con 0x7fedf8070240 2024-04-26T23:50:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.552+0000 7fedeea00640 1 -- 172.21.15.47:0/3318512859 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fede801a070 con 0x7fedf8070240 2024-04-26T23:50:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.552+0000 7fedeea00640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068650 0x7fedd406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.552+0000 7fedeea00640 1 -- 172.21.15.47:0/3318512859 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fede8085f10 con 0x7fedf8070240 2024-04-26T23:50:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.552+0000 7fedefe00640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068650 0x7fedd406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:47.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.552+0000 7fedefe00640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068650 0x7fedd406ab10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fedf806e040 tx=0x7fede0006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:47.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.556+0000 7fedeea00640 1 -- 172.21.15.47:0/3318512859 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fede8055d70 con 0x7fedf8070240 2024-04-26T23:50:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.720+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedf8146800 con 0x7fedf8070240 2024-04-26T23:50:47.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedeea00640 1 -- 172.21.15.47:0/3318512859 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13008 (secure 0 0 0) 0x7fede805a070 con 0x7fedf8070240 2024-04-26T23:50:47.730 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:47.730 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":54,"fsid":"b64830b3-1e32-4049-b582-6f8b5018205b","created":"2024-04-26T23:45:07.089404+0000","modified":"2024-04-26T23:50:44.189142+0000","last_up_change":"2024-04-26T23:45:18.607468+0000","last_in_change":"2024-04-26T23:45:09.580607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T23:45:20.179058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad4a8333-f9c9-4097-a99a-04750e467fc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6801","nonce":4189436008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6803","nonce":4189436008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6807","nonce":4189436008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":4189436008},{"type":"v1","addr":"172.21.15.47:6805","nonce":4189436008}]},"public_addr":"172.21.15.47:6801/4189436008","cluster_addr":"172.21.15.47:6803/4189436008","heartbeat_back_addr":"172.21.15.47:6807/4189436008","heartbeat_front_addr":"172.21.15.47:6805/4189436008","state":["exists","up"]},{"osd":1,"uuid":"f4397bbd-9a6e-44b8-ac9a-2798e7f0a8e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6815","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6817","nonce":1652104230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6819","nonce":1652104230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6823","nonce":1652104230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":1652104230},{"type":"v1","addr":"172.21.15.47:6821","nonce":1652104230}]},"public_addr":"172.21.15.47:6817/1652104230","cluster_addr":"172.21.15.47:6819/1652104230","heartbeat_back_addr":"172.21.15.47:6823/1652104230","heartbeat_front_addr":"172.21.15.47:6821/1652104230","state":["exists","up"]},{"osd":2,"uuid":"9db64f29-1ae8-4866-bdd2-a4fdbdf49a28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6809","nonce":359275893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6811","nonce":359275893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6816","nonce":359275893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":359275893},{"type":"v1","addr":"172.21.15.47:6813","nonce":359275893}]},"public_addr":"172.21.15.47:6809/359275893","cluster_addr":"172.21.15.47:6811/359275893","heartbeat_back_addr":"172.21.15.47:6816/359275893","heartbeat_front_addr":"172.21.15.47:6813/359275893","state":["exists","up"]},{"osd":3,"uuid":"7cf1e791-21a1-45ef-a793-773140236972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6825","nonce":570899367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6827","nonce":570899367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6831","nonce":570899367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":570899367},{"type":"v1","addr":"172.21.15.47:6829","nonce":570899367}]},"public_addr":"172.21.15.47:6825/570899367","cluster_addr":"172.21.15.47:6827/570899367","heartbeat_back_addr":"172.21.15.47:6831/570899367","heartbeat_front_addr":"172.21.15.47:6829/570899367","state":["exists","up"]},{"osd":4,"uuid":"d6609f82-1275-458c-a608-4fe759d5dc46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6801","nonce":1053635883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6804","nonce":1053635883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6811","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6814","nonce":1053635883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":1053635883},{"type":"v1","addr":"172.21.15.203:6808","nonce":1053635883}]},"public_addr":"172.21.15.203:6801/1053635883","cluster_addr":"172.21.15.203:6804/1053635883","heartbeat_back_addr":"172.21.15.203:6814/1053635883","heartbeat_front_addr":"172.21.15.203:6808/1053635883","state":["exists","up"]},{"osd":5,"uuid":"0c1d2340-ded0-4cf4-b77c-905bc0bb563c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6803","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6805","nonce":4078733335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6807","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6809","nonce":4078733335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6813","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6815","nonce":4078733335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":4078733335},{"type":"v1","addr":"172.21.15.203:6812","nonce":4078733335}]},"public_addr":"172.21.15.203:6805/4078733335","cluster_addr":"172.21.15.203:6809/4078733335","heartbeat_back_addr":"172.21.15.203:6815/4078733335","heartbeat_front_addr":"172.21.15.203:6812/4078733335","state":["exists","up"]},{"osd":6,"uuid":"3e4a341a-9eda-496b-b2d4-0dbceabafe52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6817","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6819","nonce":2269063813}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6821","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6823","nonce":2269063813}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6831","nonce":2269063813}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6825","nonce":2269063813},{"type":"v1","addr":"172.21.15.203:6828","nonce":2269063813}]},"public_addr":"172.21.15.203:6819/2269063813","cluster_addr":"172.21.15.203:6823/2269063813","heartbeat_back_addr":"172.21.15.203:6831/2269063813","heartbeat_front_addr":"172.21.15.203:6828/2269063813","state":["exists","up"]},{"osd":7,"uuid":"9761e1ff-aa2b-4b32-a6c5-fa532f14ddf9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6818","nonce":3653597910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6822","nonce":3653597910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6827","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6829","nonce":3653597910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":3653597910},{"type":"v1","addr":"172.21.15.203:6826","nonce":3653597910}]},"public_addr":"172.21.15.203:6818/3653597910","cluster_addr":"172.21.15.203:6822/3653597910","heartbeat_back_addr":"172.21.15.203:6829/3653597910","heartbeat_front_addr":"172.21.15.203:6826/3653597910","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.076048+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.238705+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.276505+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.257866+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.389436+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.256515+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.618107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T23:45:15.582934+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.47:6835/3889822755":"2024-04-27T23:50:40.908629+0000","172.21.15.47:6833/3889822755":"2024-04-27T23:50:40.908629+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T23:50:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068650 msgr2=0x7fedd406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068650 0x7fedd406ab10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fedf806e040 tx=0x7fede0006f90 comp rx=0 tx=0).stop 2024-04-26T23:50:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf8070240 msgr2=0x7fedf8145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf8070240 0x7fedf8145fa0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fede800c3f0 tx=0x7fede800c8b0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 shutdown_connections 2024-04-26T23:50:47.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fedd4068650 0x7fedd406ab10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedf80cdd30 0x7fedf81e7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fedf80affc0 0x7fedf81e6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 --2- 172.21.15.47:0/3318512859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fedf8070240 0x7fedf8145fa0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:47.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 >> 172.21.15.47:0/3318512859 conn(0x7fedf806c800 msgr2=0x7fedf815a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:47.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 shutdown_connections 2024-04-26T23:50:47.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:47.724+0000 7fedfd600640 1 -- 172.21.15.47:0/3318512859 wait complete. 2024-04-26T23:50:48.752 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T23:50:48.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:48.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.900+0000 7f790ba00640 1 Processor -- start 2024-04-26T23:50:48.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.900+0000 7f790ba00640 1 -- start start 2024-04-26T23:50:48.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f790ba00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f790415d2f0 0x7f7904073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:48.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f790ba00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79040b46a0 con 0x7f79040cd6e0 2024-04-26T23:50:48.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f790ba00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79040b4980 con 0x7f79040b41e0 2024-04-26T23:50:48.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f790ba00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f79040b4c60 con 0x7f790415d2f0 2024-04-26T23:50:48.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7909000640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f79040cd6e0 0x7f79040cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57088/0 (socket says 172.21.15.47:57088) 2024-04-26T23:50:48.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7909000640 1 -- 172.21.15.47:0/2086659131 learned_addr learned my addr 172.21.15.47:0/2086659131 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:48.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7909a00640 1 --2- 172.21.15.47:0/2086659131 >> v2:172.21.15.203:3300/0 conn(0x7f790415d2f0 0x7f7904073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:48.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7903400640 1 -- 172.21.15.47:0/2086659131 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 599757240 0 0) 0x7f79040b46a0 con 0x7f79040cd6e0 2024-04-26T23:50:48.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7903400640 1 -- 172.21.15.47:0/2086659131 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78ec003530 con 0x7f79040cd6e0 2024-04-26T23:50:48.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7903400640 1 -- 172.21.15.47:0/2086659131 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348912909 0 0) 0x7f79040b4980 con 0x7f79040b41e0 2024-04-26T23:50:48.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7903400640 1 -- 172.21.15.47:0/2086659131 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79040b46a0 con 0x7f79040b41e0 2024-04-26T23:50:48.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7909a00640 1 -- 172.21.15.47:0/2086659131 >> v1:172.21.15.203:6789/0 conn(0x7f79040b41e0 legacy=0x7f79040ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7909a00640 1 -- 172.21.15.47:0/2086659131 >> v1:172.21.15.47:6789/0 conn(0x7f79040cd6e0 legacy=0x7f79040cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.904+0000 7f7909a00640 1 -- 172.21.15.47:0/2086659131 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79040b4f40 con 0x7f790415d2f0 2024-04-26T23:50:48.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f7909a00640 1 --2- 172.21.15.47:0/2086659131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f790415d2f0 0x7f7904073cd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009d90 tx=0x7f78fc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a976ae3b37794912 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:48.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f7903400640 1 -- 172.21.15.47:0/2086659131 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0b2070 con 0x7f790415d2f0 2024-04-26T23:50:48.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f7903400640 1 -- 172.21.15.47:0/2086659131 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc0a5940 con 0x7f790415d2f0 2024-04-26T23:50:48.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f7903400640 1 -- 172.21.15.47:0/2086659131 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0a5d10 con 0x7f790415d2f0 2024-04-26T23:50:48.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- 172.21.15.47:0/2086659131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f790415d2f0 msgr2=0x7f7904073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 --2- 172.21.15.47:0/2086659131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f790415d2f0 0x7f7904073cd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009d90 tx=0x7f78fc01c970 comp rx=0 tx=0).stop 2024-04-26T23:50:48.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- 172.21.15.47:0/2086659131 shutdown_connections 2024-04-26T23:50:48.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 --2- 172.21.15.47:0/2086659131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f790415d2f0 0x7f7904073cd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:48.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- 172.21.15.47:0/2086659131 >> 172.21.15.47:0/2086659131 conn(0x7f79040d0c90 msgr2=0x7f79040d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:48.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- 172.21.15.47:0/2086659131 shutdown_connections 2024-04-26T23:50:48.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- 172.21.15.47:0/2086659131 wait complete. 2024-04-26T23:50:48.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 Processor -- start 2024-04-26T23:50:48.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- start start 2024-04-26T23:50:48.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79040b41e0 0x7f790406de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79040cd6e0 0x7f790414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790415d2f0 0x7f790406f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f790416b120 con 0x7f790415d2f0 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f790416afa0 con 0x7f79040b41e0 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f790ba00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f790416b2a0 con 0x7f79040cd6e0 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.908+0000 7f7909a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790415d2f0 0x7f790406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790415d2f0 0x7f790406f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50898/0 (socket says 172.21.15.47:50898) 2024-04-26T23:50:48.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 -- 172.21.15.47:0/3557055871 learned_addr learned my addr 172.21.15.47:0/3557055871 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909000640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79040b41e0 0x7f790406de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7903e00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79040cd6e0 0x7f790414f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 -- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79040cd6e0 msgr2=0x7f790414f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79040cd6e0 0x7f790414f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 -- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79040b41e0 msgr2=0x7f790406de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f79040b41e0 0x7f790406de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 -- 172.21.15.47:0/3557055871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79040cd330 con 0x7f790415d2f0 2024-04-26T23:50:48.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7903e00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f79040cd6e0 0x7f790414f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7909a00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790415d2f0 0x7f790406f550 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f78fc01a5a0 tx=0x7f78fc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0b2050 con 0x7f790415d2f0 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc0be070 con 0x7f790415d2f0 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790406e4b0 con 0x7f790415d2f0 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0ad850 con 0x7f790415d2f0 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790406ea70 con 0x7f790415d2f0 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f79040695f0 con 0x7f790415d2f0 2024-04-26T23:50:48.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.912+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f78fc0ad9f0 con 0x7f790415d2f0 2024-04-26T23:50:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7900c00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f78e4068650 0x7f78e406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f78fc122400 con 0x7f790415d2f0 2024-04-26T23:50:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7900c00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f78e406e510 0x7f78e4070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 --> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78fc0c5e70 con 0x7f78e406e510 2024-04-26T23:50:48.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f78fc1227b0 con 0x7f790415d2f0 2024-04-26T23:50:48.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7909000640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f78e4068650 0x7f78e406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:48.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7903e00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f78e406e510 0x7f78e4070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:48.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7909000640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f78e4068650 0x7f78e406ab10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f78f8007fd0 tx=0x7f78f8007d80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:48.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7903e00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f78e406e510 0x7f78e4070930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:48.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.916+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== osd.0 v2:172.21.15.47:6800/4189436008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78fc0c5e70 con 0x7f78e406e510 2024-04-26T23:50:48.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.928+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 --> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f790415c910 con 0x7f78e406e510 2024-04-26T23:50:48.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.928+0000 7f7900c00640 1 -- 172.21.15.47:0/3557055871 <== osd.0 v2:172.21.15.47:6800/4189436008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f790415c910 con 0x7f78e406e510 2024-04-26T23:50:48.937 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:48.937 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:48.937 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:48.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.928+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f78e406e510 msgr2=0x7f78e4070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.928+0000 7f790ba00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:6800/4189436008,v1:172.21.15.47:6801/4189436008] conn(0x7f78e406e510 0x7f78e4070930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:48.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f78e4068650 msgr2=0x7f78e406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f78e4068650 0x7f78e406ab10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f78f8007fd0 tx=0x7f78f8007d80 comp rx=0 tx=0).stop 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790415d2f0 msgr2=0x7f790406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 --2- 172.21.15.47:0/3557055871 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f790415d2f0 0x7f790406f550 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f78fc01a5a0 tx=0x7f78fc019710 comp rx=0 tx=0).stop 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f7909a00640 1 -- 172.21.15.47:0/3557055871 reap_dead start 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 shutdown_connections 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 >> 172.21.15.47:0/3557055871 conn(0x7f79040d0c90 msgr2=0x7f79040ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 shutdown_connections 2024-04-26T23:50:48.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:48.932+0000 7f790ba00640 1 -- 172.21.15.47:0/3557055871 wait complete. 2024-04-26T23:50:48.955 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T23:50:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.088+0000 7f7e1f400640 1 Processor -- start 2024-04-26T23:50:49.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.088+0000 7f7e1f400640 1 -- start start 2024-04-26T23:50:49.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e1f400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f7e180b21f0 0x7f7e180d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e1f400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e180b4940 con 0x7f7e180d1540 2024-04-26T23:50:49.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e1f400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e180b4c20 con 0x7f7e180cdae0 2024-04-26T23:50:49.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e1f400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f7e180b46f0 con 0x7f7e180b21f0 2024-04-26T23:50:49.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e1ca00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7e180d1540 0x7f7e180d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40444/0 (socket says 172.21.15.47:40444) 2024-04-26T23:50:49.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e1ca00640 1 -- 172.21.15.47:0/540973101 learned_addr learned my addr 172.21.15.47:0/540973101 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e17e00640 1 --2- 172.21.15.47:0/540973101 >> v2:172.21.15.203:3300/0 conn(0x7f7e180b21f0 0x7f7e180d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e17400640 1 -- 172.21.15.47:0/540973101 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178615363 0 0) 0x7f7e180b4940 con 0x7f7e180d1540 2024-04-26T23:50:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e17400640 1 -- 172.21.15.47:0/540973101 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e00003530 con 0x7f7e180d1540 2024-04-26T23:50:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e17e00640 1 -- 172.21.15.47:0/540973101 >> v1:172.21.15.203:6789/0 conn(0x7f7e180cdae0 legacy=0x7f7e18166bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e17e00640 1 -- 172.21.15.47:0/540973101 >> v1:172.21.15.47:6789/0 conn(0x7f7e180d1540 legacy=0x7f7e180d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e17e00640 1 -- 172.21.15.47:0/540973101 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e180b4f00 con 0x7f7e180b21f0 2024-04-26T23:50:49.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.092+0000 7f7e17e00640 1 --2- 172.21.15.47:0/540973101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 0x7f7e180d0c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e180b4870 tx=0x7f7e0401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=926751153092a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e17400640 1 -- 172.21.15.47:0/540973101 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040b1070 con 0x7f7e180b21f0 2024-04-26T23:50:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e17400640 1 -- 172.21.15.47:0/540973101 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e040ac5f0 con 0x7f7e180b21f0 2024-04-26T23:50:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e17400640 1 -- 172.21.15.47:0/540973101 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040ac9c0 con 0x7f7e180b21f0 2024-04-26T23:50:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- 172.21.15.47:0/540973101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 msgr2=0x7f7e180d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 --2- 172.21.15.47:0/540973101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 0x7f7e180d0c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e180b4870 tx=0x7f7e0401c4a0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- 172.21.15.47:0/540973101 shutdown_connections 2024-04-26T23:50:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 --2- 172.21.15.47:0/540973101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 0x7f7e180d0c50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- 172.21.15.47:0/540973101 >> 172.21.15.47:0/540973101 conn(0x7f7e1809ba60 msgr2=0x7f7e1809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- 172.21.15.47:0/540973101 shutdown_connections 2024-04-26T23:50:49.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- 172.21.15.47:0/540973101 wait complete. 2024-04-26T23:50:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 Processor -- start 2024-04-26T23:50:49.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- start start 2024-04-26T23:50:49.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 0x7f7e1806d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e180cdae0 0x7f7e1814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e180d1540 0x7f7e1814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1815d4c0 con 0x7f7e180d1540 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1815d340 con 0x7f7e180b21f0 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.096+0000 7f7e1f400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1816ab30 con 0x7f7e180cdae0 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e180d1540 0x7f7e1814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e180d1540 0x7f7e1814b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56908/0 (socket says 172.21.15.47:56908) 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 -- 172.21.15.47:0/3153644012 learned_addr learned my addr 172.21.15.47:0/3153644012 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:49.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1ca00640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 0x7f7e1806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e17e00640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e180cdae0 0x7f7e1814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 -- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e180cdae0 msgr2=0x7f7e1814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e180cdae0 0x7f7e1814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 -- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 msgr2=0x7f7e1806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 0x7f7e1806d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 -- 172.21.15.47:0/3153644012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1815caa0 con 0x7f7e180d1540 2024-04-26T23:50:49.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1d400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e180d1540 0x7f7e1814b1e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c7a0 tx=0x7f7e1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e14c00640 1 -- 172.21.15.47:0/3153644012 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10003b80 con 0x7f7e180d1540 2024-04-26T23:50:49.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e14c00640 1 -- 172.21.15.47:0/3153644012 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e10003d20 con 0x7f7e180d1540 2024-04-26T23:50:49.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1815bf20 con 0x7f7e180d1540 2024-04-26T23:50:49.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e14c00640 1 -- 172.21.15.47:0/3153644012 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e1000aa90 con 0x7f7e180d1540 2024-04-26T23:50:49.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1815c4e0 con 0x7f7e180d1540 2024-04-26T23:50:49.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e180695f0 con 0x7f7e180d1540 2024-04-26T23:50:49.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.100+0000 7f7e14c00640 1 -- 172.21.15.47:0/3153644012 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f7e1000ac30 con 0x7f7e180d1540 2024-04-26T23:50:49.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.104+0000 7f7e14c00640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7df8068680 0x7f7df806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.104+0000 7f7e14c00640 1 -- 172.21.15.47:0/3153644012 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f7e100868f0 con 0x7f7e180d1540 2024-04-26T23:50:49.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.104+0000 7f7e1ca00640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7df8068680 0x7f7df806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.104+0000 7f7e1ca00640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7df8068680 0x7f7df806ab40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0011f0 tx=0x7f7e0c007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.108+0000 7f7e14c00640 1 -- 172.21.15.47:0/3153644012 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f7e100567d0 con 0x7f7e180d1540 2024-04-26T23:50:49.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f7e1814bef0 con 0x7f7df8068680 2024-04-26T23:50:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e14c00640 1 -- 172.21.15.47:0/3153644012 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7e1814bef0 con 0x7f7df8068680 2024-04-26T23:50:49.282 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T23:50:49.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7df8068680 msgr2=0x7f7df806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7df8068680 0x7f7df806ab40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0011f0 tx=0x7f7e0c007d40 comp rx=0 tx=0).stop 2024-04-26T23:50:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e180d1540 msgr2=0x7f7e1814b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e180d1540 0x7f7e1814b1e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000c7a0 tx=0x7f7e1000cc60 comp rx=0 tx=0).stop 2024-04-26T23:50:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 shutdown_connections 2024-04-26T23:50:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f7df8068680 0x7f7df806ab40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7e180d1540 0x7f7e1814b1e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f7e180cdae0 0x7f7e1814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 --2- 172.21.15.47:0/3153644012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e180b21f0 0x7f7e1806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 >> 172.21.15.47:0/3153644012 conn(0x7f7e1809ba60 msgr2=0x7f7e18070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 shutdown_connections 2024-04-26T23:50:49.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.276+0000 7f7e1f400640 1 -- 172.21.15.47:0/3153644012 wait complete. 2024-04-26T23:50:49.304 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T23:50:49.304 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:49.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.440+0000 7f2d18400640 1 Processor -- start 2024-04-26T23:50:49.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d18400640 1 -- start start 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d18400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 0x7f2d100d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d18400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2d1006fca0 0x7f2d100cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d18400640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d10072140 con 0x7f2d100d01e0 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d18400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f2d10073f10 con 0x7f2d1006fca0 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d18400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d10072420 con 0x7f2d1015c1d0 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2d1006fca0 0x7f2d100cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2d1006fca0 0x7f2d100cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56920/0 (socket says 172.21.15.47:56920) 2024-04-26T23:50:49.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15000640 1 -- 172.21.15.47:0/1591744382 learned_addr learned my addr 172.21.15.47:0/1591744382 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:49.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15a00640 1 --2- 172.21.15.47:0/1591744382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 0x7f2d100d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15000640 1 -- 172.21.15.47:0/1591744382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 msgr2=0x7f2d100d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:49.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15000640 1 --2- 172.21.15.47:0/1591744382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 0x7f2d100d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15000640 1 -- 172.21.15.47:0/1591744382 >> v1:172.21.15.203:6789/0 conn(0x7f2d100d01e0 legacy=0x7f2d1006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.444+0000 7f2d15000640 1 -- 172.21.15.47:0/1591744382 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d10072700 con 0x7f2d1006fca0 2024-04-26T23:50:49.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d15000640 1 --2- 172.21.15.47:0/1591744382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d100cfca0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00bb10 tx=0x7f2cfc01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821bf6b7eb57888b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d0fe00640 1 -- 172.21.15.47:0/1591744382 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0b4070 con 0x7f2d1006fca0 2024-04-26T23:50:49.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d0fe00640 1 -- 172.21.15.47:0/1591744382 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0a7aa0 con 0x7f2d1006fca0 2024-04-26T23:50:49.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d0fe00640 1 -- 172.21.15.47:0/1591744382 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0af440 con 0x7f2d1006fca0 2024-04-26T23:50:49.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 -- 172.21.15.47:0/1591744382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 msgr2=0x7f2d100cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 --2- 172.21.15.47:0/1591744382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d100cfca0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00bb10 tx=0x7f2cfc01eba0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 -- 172.21.15.47:0/1591744382 shutdown_connections 2024-04-26T23:50:49.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 --2- 172.21.15.47:0/1591744382 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d100cfca0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 --2- 172.21.15.47:0/1591744382 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 0x7f2d100d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 -- 172.21.15.47:0/1591744382 >> 172.21.15.47:0/1591744382 conn(0x7f2d100d0c90 msgr2=0x7f2d100d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:49.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 -- 172.21.15.47:0/1591744382 shutdown_connections 2024-04-26T23:50:49.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 -- 172.21.15.47:0/1591744382 wait complete. 2024-04-26T23:50:49.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 Processor -- start 2024-04-26T23:50:49.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.448+0000 7f2d18400640 1 -- start start 2024-04-26T23:50:49.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d1015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d100d01e0 0x7f2d1015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 0x7f2d1015e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f2d100ceb90 con 0x7f2d1006fca0 2024-04-26T23:50:49.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1006f550 con 0x7f2d100d01e0 2024-04-26T23:50:49.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f2d100ced10 con 0x7f2d1015c1d0 2024-04-26T23:50:49.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d1015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d1015c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56922/0 (socket says 172.21.15.47:56922) 2024-04-26T23:50:49.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 -- 172.21.15.47:0/2891432301 learned_addr learned my addr 172.21.15.47:0/2891432301 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:49.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15000640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d100d01e0 0x7f2d1015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d16400640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 0x7f2d1015e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 -- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 msgr2=0x7f2d1015e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f2d1015c1d0 0x7f2d1015e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 -- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d100d01e0 msgr2=0x7f2d1015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d100d01e0 0x7f2d1015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 -- 172.21.15.47:0/2891432301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d10163fe0 con 0x7f2d1006fca0 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15000640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d100d01e0 0x7f2d1015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d15a00640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d1015c640 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e870 tx=0x7f2d0400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04017070 con 0x7f2d1006fca0 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0400c940 con 0x7f2d1006fca0 2024-04-26T23:50:49.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400ccf0 con 0x7f2d1006fca0 2024-04-26T23:50:49.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d101642c0 con 0x7f2d1006fca0 2024-04-26T23:50:49.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d10164880 con 0x7f2d1006fca0 2024-04-26T23:50:49.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.452+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d10164c60 con 0x7f2d1006fca0 2024-04-26T23:50:49.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f2d0401a070 con 0x7f2d1006fca0 2024-04-26T23:50:49.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d0d600640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2cf0068650 0x7f2cf006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f2d04087100 con 0x7f2d1006fca0 2024-04-26T23:50:49.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d0d600640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7f2cf006e510 0x7f2cf0070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 --> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d04013e50 con 0x7f2cf006e510 2024-04-26T23:50:49.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2d040874b0 con 0x7f2d1006fca0 2024-04-26T23:50:49.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d15000640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2cf0068650 0x7f2cf006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d16400640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7f2cf006e510 0x7f2cf0070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d16400640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7f2cf006e510 0x7f2cf0070930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d15000640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2cf0068650 0x7f2cf006ab10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0b1000 tx=0x7f2cfc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.456+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== osd.1 v2:172.21.15.47:6815/1652104230 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d04013e50 con 0x7f2cf006e510 2024-04-26T23:50:49.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 --> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2d100695f0 con 0x7f2cf006e510 2024-04-26T23:50:49.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d0d600640 1 -- 172.21.15.47:0/2891432301 <== osd.1 v2:172.21.15.47:6815/1652104230 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2d100695f0 con 0x7f2cf006e510 2024-04-26T23:50:49.478 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:49.478 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7f2cf006e510 msgr2=0x7f2cf0070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:6815/1652104230,v1:172.21.15.47:6817/1652104230] conn(0x7f2cf006e510 0x7f2cf0070930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2cf0068650 msgr2=0x7f2cf006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f2cf0068650 0x7f2cf006ab10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc0b1000 tx=0x7f2cfc008040 comp rx=0 tx=0).stop 2024-04-26T23:50:49.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 msgr2=0x7f2d1015c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 --2- 172.21.15.47:0/2891432301 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2d1006fca0 0x7f2d1015c640 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e870 tx=0x7f2d0400ec70 comp rx=0 tx=0).stop 2024-04-26T23:50:49.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d16400640 1 -- 172.21.15.47:0/2891432301 reap_dead start 2024-04-26T23:50:49.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 shutdown_connections 2024-04-26T23:50:49.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 >> 172.21.15.47:0/2891432301 conn(0x7f2d100d0c90 msgr2=0x7f2d100cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:49.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 shutdown_connections 2024-04-26T23:50:49.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.472+0000 7f2d18400640 1 -- 172.21.15.47:0/2891432301 wait complete. 2024-04-26T23:50:49.497 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T23:50:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe9e200640 1 Processor -- start 2024-04-26T23:50:49.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe9e200640 1 -- start start 2024-04-26T23:50:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe9e200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe980ade00 0x7efe980ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe9e200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe980b5a50 con 0x7efe9806c630 2024-04-26T23:50:49.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe9e200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe980b5d30 con 0x7efe9815d080 2024-04-26T23:50:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe9e200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efe9815d460 con 0x7efe980ade00 2024-04-26T23:50:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe8fe00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe980ade00 0x7efe980ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe97e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efe9806c630 0x7efe980b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40450/0 (socket says 172.21.15.47:40450) 2024-04-26T23:50:49.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe97e00640 1 -- 172.21.15.47:0/2945715823 learned_addr learned my addr 172.21.15.47:0/2945715823 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe96a00640 1 -- 172.21.15.47:0/2945715823 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125114708 0 0) 0x7efe980b5a50 con 0x7efe9806c630 2024-04-26T23:50:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe96a00640 1 -- 172.21.15.47:0/2945715823 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe7c003530 con 0x7efe9806c630 2024-04-26T23:50:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.632+0000 7efe8fe00640 1 -- 172.21.15.47:0/2945715823 >> v1:172.21.15.203:6789/0 conn(0x7efe9815d080 legacy=0x7efe980b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe8fe00640 1 -- 172.21.15.47:0/2945715823 >> v1:172.21.15.47:6789/0 conn(0x7efe9806c630 legacy=0x7efe980b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe8fe00640 1 -- 172.21.15.47:0/2945715823 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe980b6010 con 0x7efe980ade00 2024-04-26T23:50:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe8fe00640 1 --2- 172.21.15.47:0/2945715823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe980ccdb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7efe800097c0 tx=0x7efe8001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9a45a9d63fd8c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe96a00640 1 -- 172.21.15.47:0/2945715823 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800b1070 con 0x7efe980ade00 2024-04-26T23:50:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe96a00640 1 -- 172.21.15.47:0/2945715823 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe800a8050 con 0x7efe980ade00 2024-04-26T23:50:49.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe96a00640 1 -- 172.21.15.47:0/2945715823 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800ac860 con 0x7efe980ade00 2024-04-26T23:50:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe9e200640 1 -- 172.21.15.47:0/2945715823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 msgr2=0x7efe980ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe9e200640 1 --2- 172.21.15.47:0/2945715823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe980ccdb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7efe800097c0 tx=0x7efe8001c3e0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe9e200640 1 -- 172.21.15.47:0/2945715823 shutdown_connections 2024-04-26T23:50:49.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe9e200640 1 --2- 172.21.15.47:0/2945715823 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe980ccdb0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe9e200640 1 -- 172.21.15.47:0/2945715823 >> 172.21.15.47:0/2945715823 conn(0x7efe980b2d40 msgr2=0x7efe980b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe9e200640 1 -- 172.21.15.47:0/2945715823 shutdown_connections 2024-04-26T23:50:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.636+0000 7efe9e200640 1 -- 172.21.15.47:0/2945715823 wait complete. 2024-04-26T23:50:49.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 Processor -- start 2024-04-26T23:50:49.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 -- start start 2024-04-26T23:50:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe9806c630 0x7efe9813a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe9814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe9815d080 0x7efe9814d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe9806ce50 con 0x7efe980ade00 2024-04-26T23:50:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe980cd2f0 con 0x7efe9806c630 2024-04-26T23:50:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe9814de30 con 0x7efe9815d080 2024-04-26T23:50:49.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe9814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe9814d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56940/0 (socket says 172.21.15.47:56940) 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 -- 172.21.15.47:0/3195627248 learned_addr learned my addr 172.21.15.47:0/3195627248 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 -- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe9815d080 msgr2=0x7efe9814d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe9815d080 0x7efe9814d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe97400640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe9806c630 0x7efe9813a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 -- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe9806c630 msgr2=0x7efe9813a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe9806c630 0x7efe9813a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 -- 172.21.15.47:0/3195627248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9814e110 con 0x7efe980ade00 2024-04-26T23:50:49.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe97400640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe9806c630 0x7efe9813a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:49.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8fe00640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe9814d2a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efe80018ff0 tx=0x7efe80019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8f400640 1 -- 172.21.15.47:0/3195627248 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800b9070 con 0x7efe980ade00 2024-04-26T23:50:49.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8f400640 1 -- 172.21.15.47:0/3195627248 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe800ace30 con 0x7efe980ade00 2024-04-26T23:50:49.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9814e3f0 con 0x7efe980ade00 2024-04-26T23:50:49.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe8f400640 1 -- 172.21.15.47:0/3195627248 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe800b1040 con 0x7efe980ade00 2024-04-26T23:50:49.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.640+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9814e9b0 con 0x7efe980ade00 2024-04-26T23:50:49.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.644+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe980695f0 con 0x7efe980ade00 2024-04-26T23:50:49.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.644+0000 7efe8f400640 1 -- 172.21.15.47:0/3195627248 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7efe800bc070 con 0x7efe980ade00 2024-04-26T23:50:49.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.644+0000 7efe8f400640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe74068650 0x7efe7406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.644+0000 7efe8f400640 1 -- 172.21.15.47:0/3195627248 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7efe801208d0 con 0x7efe980ade00 2024-04-26T23:50:49.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.644+0000 7efe97400640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe74068650 0x7efe7406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.644+0000 7efe97400640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe74068650 0x7efe7406ab10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe88000f70 tx=0x7efe88009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.648+0000 7efe8f400640 1 -- 172.21.15.47:0/3195627248 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7efe80016090 con 0x7efe980ade00 2024-04-26T23:50:49.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7efe980b26b0 con 0x7efe74068650 2024-04-26T23:50:49.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe8f400640 1 -- 172.21.15.47:0/3195627248 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efe980b26b0 con 0x7efe74068650 2024-04-26T23:50:49.822 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T23:50:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe74068650 msgr2=0x7efe7406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe74068650 0x7efe7406ab10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7efe88000f70 tx=0x7efe88009040 comp rx=0 tx=0).stop 2024-04-26T23:50:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 msgr2=0x7efe9814d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe9814d2a0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7efe80018ff0 tx=0x7efe80019180 comp rx=0 tx=0).stop 2024-04-26T23:50:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 shutdown_connections 2024-04-26T23:50:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe74068650 0x7efe7406ab10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe9815d080 0x7efe9814d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe980ade00 0x7efe9814d2a0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 --2- 172.21.15.47:0/3195627248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe9806c630 0x7efe9813a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 >> 172.21.15.47:0/3195627248 conn(0x7efe980b2d40 msgr2=0x7efe98072950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:49.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 shutdown_connections 2024-04-26T23:50:49.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.816+0000 7efe9e200640 1 -- 172.21.15.47:0/3195627248 wait complete. 2024-04-26T23:50:49.845 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T23:50:49.845 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:49.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3413400640 1 Processor -- start 2024-04-26T23:50:49.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3413400640 1 -- start start 2024-04-26T23:50:49.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3413400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f340c06c400 0x7f340c06c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3413400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c0d0690 0x7f340c06f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:49.992 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3413400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c06cd20 con 0x7f340c163ac0 2024-04-26T23:50:49.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3413400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f340c0d12c0 con 0x7f340c06c400 2024-04-26T23:50:49.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3413400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f340c0d0fe0 con 0x7f340c0d0690 2024-04-26T23:50:49.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3403e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f340c163ac0 0x7f340c073e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40466/0 (socket says 172.21.15.47:40466) 2024-04-26T23:50:49.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3403e00640 1 -- 172.21.15.47:0/206367123 learned_addr learned my addr 172.21.15.47:0/206367123 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:49.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3410a00640 1 --2- 172.21.15.47:0/206367123 >> v2:172.21.15.47:3300/0 conn(0x7f340c06c400 0x7f340c06c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.993 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3411400640 1 --2- 172.21.15.47:0/206367123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c0d0690 0x7f340c06f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:49.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f340be00640 1 -- 172.21.15.47:0/206367123 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365883730 0 0) 0x7f340c06cd20 con 0x7f340c163ac0 2024-04-26T23:50:49.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f340be00640 1 -- 172.21.15.47:0/206367123 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33f0003530 con 0x7f340c163ac0 2024-04-26T23:50:49.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3410a00640 1 -- 172.21.15.47:0/206367123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c0d0690 msgr2=0x7f340c06f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:49.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3410a00640 1 --2- 172.21.15.47:0/206367123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c0d0690 0x7f340c06f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3410a00640 1 -- 172.21.15.47:0/206367123 >> v1:172.21.15.47:6789/0 conn(0x7f340c163ac0 legacy=0x7f340c073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.984+0000 7f3410a00640 1 -- 172.21.15.47:0/206367123 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c073330 con 0x7f340c06c400 2024-04-26T23:50:49.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3410a00640 1 --2- 172.21.15.47:0/206367123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c06c400 0x7f340c06c7e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0097c0 tx=0x7f33fc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a65e792c6f68cd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:49.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f340be00640 1 -- 172.21.15.47:0/206367123 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0b5070 con 0x7f340c06c400 2024-04-26T23:50:49.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f340be00640 1 -- 172.21.15.47:0/206367123 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33fc0a8990 con 0x7f340c06c400 2024-04-26T23:50:49.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f340be00640 1 -- 172.21.15.47:0/206367123 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc0a8d60 con 0x7f340c06c400 2024-04-26T23:50:49.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 -- 172.21.15.47:0/206367123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c06c400 msgr2=0x7f340c06c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:49.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 --2- 172.21.15.47:0/206367123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c06c400 0x7f340c06c7e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0097c0 tx=0x7f33fc01ec90 comp rx=0 tx=0).stop 2024-04-26T23:50:49.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 -- 172.21.15.47:0/206367123 shutdown_connections 2024-04-26T23:50:49.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 --2- 172.21.15.47:0/206367123 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c0d0690 0x7f340c06f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 --2- 172.21.15.47:0/206367123 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c06c400 0x7f340c06c7e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:49.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 -- 172.21.15.47:0/206367123 >> 172.21.15.47:0/206367123 conn(0x7f340c0d1dc0 msgr2=0x7f340c0d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:49.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 -- 172.21.15.47:0/206367123 shutdown_connections 2024-04-26T23:50:49.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.988+0000 7f3413400640 1 -- 172.21.15.47:0/206367123 wait complete. 2024-04-26T23:50:49.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 Processor -- start 2024-04-26T23:50:49.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 -- start start 2024-04-26T23:50:50.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c06c400 0x7f340c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f340c0d0690 0x7f340c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c163ac0 0x7f340c15d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f340c15f480 con 0x7f340c163ac0 2024-04-26T23:50:50.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f340c0738f0 con 0x7f340c0d0690 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f340c15f600 con 0x7f340c06c400 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c163ac0 0x7f340c15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c163ac0 0x7f340c15d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56958/0 (socket says 172.21.15.47:56958) 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 -- 172.21.15.47:0/1378701395 learned_addr learned my addr 172.21.15.47:0/1378701395 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3410a00640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c06c400 0x7f340c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3403e00640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f340c0d0690 0x7f340c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 -- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c06c400 msgr2=0x7f340c149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f340c06c400 0x7f340c149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 -- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f340c0d0690 msgr2=0x7f340c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f340c0d0690 0x7f340c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 -- 172.21.15.47:0/1378701395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c14d6d0 con 0x7f340c163ac0 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3411400640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c163ac0 0x7f340c15d920 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f340400efc0 tx=0x7f340400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404018020 con 0x7f340c163ac0 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3404014480 con 0x7f340c163ac0 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c1f88a0 con 0x7f340c163ac0 2024-04-26T23:50:50.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404014870 con 0x7f340c163ac0 2024-04-26T23:50:50.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.992+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c1f8e60 con 0x7f340c163ac0 2024-04-26T23:50:50.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f340c0695f0 con 0x7f340c163ac0 2024-04-26T23:50:50.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f340401b020 con 0x7f340c163ac0 2024-04-26T23:50:50.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3409600640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f33e8068650 0x7f33e806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f3404087e50 con 0x7f340c163ac0 2024-04-26T23:50:50.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3409600640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f33e806e510 0x7f33e8070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 --> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f340401ae50 con 0x7f33e806e510 2024-04-26T23:50:50.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f3404088200 con 0x7f340c163ac0 2024-04-26T23:50:50.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3410a00640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f33e8068650 0x7f33e806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3403e00640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f33e806e510 0x7f33e8070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3403e00640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f33e806e510 0x7f33e8070930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:49.996+0000 7f3410a00640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f33e8068650 0x7f33e806ab10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0b2000 tx=0x7f33fc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.000+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== osd.2 v2:172.21.15.47:6808/359275893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f340401ae50 con 0x7f33e806e510 2024-04-26T23:50:50.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 --> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f340c06d240 con 0x7f33e806e510 2024-04-26T23:50:50.019 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3409600640 1 -- 172.21.15.47:0/1378701395 <== osd.2 v2:172.21.15.47:6808/359275893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f340c06d240 con 0x7f33e806e510 2024-04-26T23:50:50.019 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:50.020 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:50.020 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f33e806e510 msgr2=0x7f33e8070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:6808/359275893,v1:172.21.15.47:6809/359275893] conn(0x7f33e806e510 0x7f33e8070930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f33e8068650 msgr2=0x7f33e806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f33e8068650 0x7f33e806ab10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0b2000 tx=0x7f33fc008040 comp rx=0 tx=0).stop 2024-04-26T23:50:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c163ac0 msgr2=0x7f340c15d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 --2- 172.21.15.47:0/1378701395 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f340c163ac0 0x7f340c15d920 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f340400efc0 tx=0x7f340400c490 comp rx=0 tx=0).stop 2024-04-26T23:50:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3411400640 1 -- 172.21.15.47:0/1378701395 reap_dead start 2024-04-26T23:50:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 shutdown_connections 2024-04-26T23:50:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 >> 172.21.15.47:0/1378701395 conn(0x7f340c0d1dc0 msgr2=0x7f340c0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 shutdown_connections 2024-04-26T23:50:50.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.012+0000 7f3413400640 1 -- 172.21.15.47:0/1378701395 wait complete. 2024-04-26T23:50:50.039 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T23:50:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 Processor -- start 2024-04-26T23:50:50.183 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 -- start start 2024-04-26T23:50:50.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 0x7fc6580b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fc6580d08e0 0x7fc6580d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc6580b2de0 0x7fc6580b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fc6580b2300 con 0x7fc6580b2de0 2024-04-26T23:50:50.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fc6580d0e30 con 0x7fc6580d08e0 2024-04-26T23:50:50.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65e600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc6580b2bb0 con 0x7fc6580d1140 2024-04-26T23:50:50.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc6580b2de0 0x7fc6580b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc6580b2de0 0x7fc6580b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56972/0 (socket says 172.21.15.47:56972) 2024-04-26T23:50:50.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 -- 172.21.15.47:0/2967554583 learned_addr learned my addr 172.21.15.47:0/2967554583 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:50.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65d200640 1 --2- 172.21.15.47:0/2967554583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 0x7fc6580b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc64fe00640 1 --2- 172.21.15.47:0/2967554583 >> v2:172.21.15.203:3300/0 conn(0x7fc6580d08e0 0x7fc6580d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 -- 172.21.15.47:0/2967554583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 msgr2=0x7fc6580b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:50.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 --2- 172.21.15.47:0/2967554583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 0x7fc6580b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 -- 172.21.15.47:0/2967554583 >> v2:172.21.15.203:3300/0 conn(0x7fc6580d08e0 msgr2=0x7fc6580d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:50.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 --2- 172.21.15.47:0/2967554583 >> v2:172.21.15.203:3300/0 conn(0x7fc6580d08e0 0x7fc6580d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.176+0000 7fc65dc00640 1 -- 172.21.15.47:0/2967554583 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6580d1a60 con 0x7fc6580b2de0 2024-04-26T23:50:50.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65dc00640 1 --2- 172.21.15.47:0/2967554583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580b2de0 0x7fc6580b3230 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc6580d07f0 tx=0x7fc65001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ed27e5bff99418 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc657e00640 1 -- 172.21.15.47:0/2967554583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6500a5760 con 0x7fc6580b2de0 2024-04-26T23:50:50.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc657e00640 1 -- 172.21.15.47:0/2967554583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6500a5900 con 0x7fc6580b2de0 2024-04-26T23:50:50.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc657e00640 1 -- 172.21.15.47:0/2967554583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6500a5cd0 con 0x7fc6580b2de0 2024-04-26T23:50:50.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 -- 172.21.15.47:0/2967554583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580b2de0 msgr2=0x7fc6580b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 --2- 172.21.15.47:0/2967554583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580b2de0 0x7fc6580b3230 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc6580d07f0 tx=0x7fc65001c9f0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 -- 172.21.15.47:0/2967554583 shutdown_connections 2024-04-26T23:50:50.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 --2- 172.21.15.47:0/2967554583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580b2de0 0x7fc6580b3230 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 --2- 172.21.15.47:0/2967554583 >> v2:172.21.15.203:3300/0 conn(0x7fc6580d08e0 0x7fc6580d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 --2- 172.21.15.47:0/2967554583 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 0x7fc6580b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 -- 172.21.15.47:0/2967554583 >> 172.21.15.47:0/2967554583 conn(0x7fc65809ba60 msgr2=0x7fc65809be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:50.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 -- 172.21.15.47:0/2967554583 shutdown_connections 2024-04-26T23:50:50.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.180+0000 7fc65e600640 1 -- 172.21.15.47:0/2967554583 wait complete. 2024-04-26T23:50:50.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 Processor -- start 2024-04-26T23:50:50.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 -- start start 2024-04-26T23:50:50.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6580b2de0 0x7fc6580c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580d08e0 0x7fc65806e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 0x7fc6581596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580b3b80 con 0x7fc6580d08e0 2024-04-26T23:50:50.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580d0160 con 0x7fc6580b2de0 2024-04-26T23:50:50.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fc658160690 con 0x7fc6580d1140 2024-04-26T23:50:50.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580d08e0 0x7fc65806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580d08e0 0x7fc65806e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56980/0 (socket says 172.21.15.47:56980) 2024-04-26T23:50:50.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 -- 172.21.15.47:0/3761958867 learned_addr learned my addr 172.21.15.47:0/3761958867 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:50.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 -- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 msgr2=0x7fc6581596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 0x7fc6581596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 -- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6580b2de0 msgr2=0x7fc6580c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65d200640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6580b2de0 0x7fc6580c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6580b2de0 0x7fc6580c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 -- 172.21.15.47:0/3761958867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6580c76c0 con 0x7fc6580d08e0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65d200640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6580b2de0 0x7fc6580c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc64fe00640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580d08e0 0x7fc65806e780 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc64000d800 tx=0x7fc64000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc655600640 1 -- 172.21.15.47:0/3761958867 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640018030 con 0x7fc6580d08e0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc655600640 1 -- 172.21.15.47:0/3761958867 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6400096a0 con 0x7fc6580d08e0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc655600640 1 -- 172.21.15.47:0/3761958867 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640009870 con 0x7fc6580d08e0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6580c7940 con 0x7fc6580d08e0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc658158ec0 con 0x7fc6580d08e0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.184+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc658069470 con 0x7fc6580d08e0 2024-04-26T23:50:50.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.188+0000 7fc655600640 1 -- 172.21.15.47:0/3761958867 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fc64001b070 con 0x7fc6580d08e0 2024-04-26T23:50:50.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.188+0000 7fc655600640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc634068650 0x7fc63406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.188+0000 7fc655600640 1 -- 172.21.15.47:0/3761958867 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fc640086d90 con 0x7fc6580d08e0 2024-04-26T23:50:50.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.188+0000 7fc65d200640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc634068650 0x7fc63406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.188+0000 7fc65d200640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc634068650 0x7fc63406ab10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc6580b1bd0 tx=0x7fc648008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.192+0000 7fc655600640 1 -- 172.21.15.47:0/3761958867 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fc6580c76c0 con 0x7fc6580d08e0 2024-04-26T23:50:50.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc6580c7c20 con 0x7fc634068650 2024-04-26T23:50:50.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc655600640 1 -- 172.21.15.47:0/3761958867 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc6580c7c20 con 0x7fc634068650 2024-04-26T23:50:50.367 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T23:50:50.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc634068650 msgr2=0x7fc63406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc634068650 0x7fc63406ab10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc6580b1bd0 tx=0x7fc648008040 comp rx=0 tx=0).stop 2024-04-26T23:50:50.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580d08e0 msgr2=0x7fc65806e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580d08e0 0x7fc65806e780 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc64000d800 tx=0x7fc64000dcc0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 shutdown_connections 2024-04-26T23:50:50.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fc634068650 0x7fc63406ab10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fc6580d1140 0x7fc6581596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc6580d08e0 0x7fc65806e780 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 --2- 172.21.15.47:0/3761958867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6580b2de0 0x7fc6580c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 >> 172.21.15.47:0/3761958867 conn(0x7fc65809ba60 msgr2=0x7fc6580704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:50.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 shutdown_connections 2024-04-26T23:50:50.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.360+0000 7fc65e600640 1 -- 172.21.15.47:0/3761958867 wait complete. 2024-04-26T23:50:50.387 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T23:50:50.388 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:50.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ef800640 1 Processor -- start 2024-04-26T23:50:50.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ef800640 1 -- start start 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ef800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff1e81607d0 0x7ff1e80cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ef800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7ff1e8160bb0 0x7ff1e80cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ef800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e80d3c70 con 0x7ff1e80b3f20 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ef800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e80d0960 con 0x7ff1e81607d0 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ef800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e80d0680 con 0x7ff1e8160bb0 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ece00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff1e81607d0 0x7ff1e80cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ece00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ff1e81607d0 0x7ff1e80cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56994/0 (socket says 172.21.15.47:56994) 2024-04-26T23:50:50.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.524+0000 7ff1ece00640 1 -- 172.21.15.47:0/2541723256 learned_addr learned my addr 172.21.15.47:0/2541723256 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:50.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1e7e00640 1 --2- 172.21.15.47:0/2541723256 >> v2:172.21.15.203:3300/0 conn(0x7ff1e8160bb0 0x7ff1e80cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1ece00640 1 -- 172.21.15.47:0/2541723256 >> v2:172.21.15.203:3300/0 conn(0x7ff1e8160bb0 msgr2=0x7ff1e80cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:50.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1ece00640 1 --2- 172.21.15.47:0/2541723256 >> v2:172.21.15.203:3300/0 conn(0x7ff1e8160bb0 0x7ff1e80cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1ece00640 1 -- 172.21.15.47:0/2541723256 >> v1:172.21.15.203:6789/0 conn(0x7ff1e80b3f20 legacy=0x7ff1e80c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:50.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1ece00640 1 -- 172.21.15.47:0/2541723256 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e80d16d0 con 0x7ff1e81607d0 2024-04-26T23:50:50.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1ece00640 1 --2- 172.21.15.47:0/2541723256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e80cf900 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80c9fd0 tx=0x7ff1dc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2e5ea573d7738b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1e7400640 1 -- 172.21.15.47:0/2541723256 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0b0070 con 0x7ff1e81607d0 2024-04-26T23:50:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1e7400640 1 -- 172.21.15.47:0/2541723256 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc0ab600 con 0x7ff1e81607d0 2024-04-26T23:50:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1e7400640 1 -- 172.21.15.47:0/2541723256 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc0ab9d0 con 0x7ff1e81607d0 2024-04-26T23:50:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1ef800640 1 -- 172.21.15.47:0/2541723256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 msgr2=0x7ff1e80cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.528+0000 7ff1ef800640 1 --2- 172.21.15.47:0/2541723256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e80cf900 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80c9fd0 tx=0x7ff1dc01c520 comp rx=0 tx=0).stop 2024-04-26T23:50:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- 172.21.15.47:0/2541723256 shutdown_connections 2024-04-26T23:50:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 --2- 172.21.15.47:0/2541723256 >> v2:172.21.15.203:3300/0 conn(0x7ff1e8160bb0 0x7ff1e80cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 --2- 172.21.15.47:0/2541723256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e80cf900 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- 172.21.15.47:0/2541723256 >> 172.21.15.47:0/2541723256 conn(0x7ff1e80d2f50 msgr2=0x7ff1e80d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- 172.21.15.47:0/2541723256 shutdown_connections 2024-04-26T23:50:50.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- 172.21.15.47:0/2541723256 wait complete. 2024-04-26T23:50:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 Processor -- start 2024-04-26T23:50:50.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- start start 2024-04-26T23:50:50.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1e80b3f20 0x7ff1e81fb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e8154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1e8160bb0 0x7ff1e8154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e80c7cf0 con 0x7ff1e81607d0 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e80c7b70 con 0x7ff1e80b3f20 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ef800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e80c7e70 con 0x7ff1e8160bb0 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e8154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e8154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57000/0 (socket says 172.21.15.47:57000) 2024-04-26T23:50:50.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 -- 172.21.15.47:0/2677605003 learned_addr learned my addr 172.21.15.47:0/2677605003 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ece00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1e80b3f20 0x7ff1e81fb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1ed800640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1e8160bb0 0x7ff1e8154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 -- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1e8160bb0 msgr2=0x7ff1e8154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7ff1e8160bb0 0x7ff1e8154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 -- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1e80b3f20 msgr2=0x7ff1e81fb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1e80b3f20 0x7ff1e81fb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 -- 172.21.15.47:0/2677605003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e806c900 con 0x7ff1e81607d0 2024-04-26T23:50:50.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.532+0000 7ff1e7e00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e8154330 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400d7d0 tx=0x7ff1d400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4004030 con 0x7ff1e81607d0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d4004210 con 0x7ff1e81607d0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d400b6c0 con 0x7ff1e81607d0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e81fb730 con 0x7ff1e81607d0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e80b5ff0 con 0x7ff1e81607d0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1e80b6c60 con 0x7ff1e81607d0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7ff1d400b860 con 0x7ff1e81607d0 2024-04-26T23:50:50.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff1c8068650 0x7ff1c806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7ff1d4086d60 con 0x7ff1e81607d0 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7ff1c806e510 0x7ff1c8070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 --> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1d401ee50 con 0x7ff1c806e510 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff1d408c330 con 0x7ff1e81607d0 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1ed800640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7ff1c806e510 0x7ff1c8070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1ece00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff1c8068650 0x7ff1c806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.536+0000 7ff1ed800640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7ff1c806e510 0x7ff1c8070930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.540+0000 7ff1ece00640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff1c8068650 0x7ff1c806ab10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ad000 tx=0x7ff1dc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.540+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== osd.3 v2:172.21.15.47:6824/570899367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1d401ee50 con 0x7ff1c806e510 2024-04-26T23:50:50.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 --> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1e8156700 con 0x7ff1c806e510 2024-04-26T23:50:50.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1e4c00640 1 -- 172.21.15.47:0/2677605003 <== osd.3 v2:172.21.15.47:6824/570899367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1e8156700 con 0x7ff1c806e510 2024-04-26T23:50:50.560 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:50.560 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:50.560 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:50.561 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7ff1c806e510 msgr2=0x7ff1c8070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:6824/570899367,v1:172.21.15.47:6825/570899367] conn(0x7ff1c806e510 0x7ff1c8070930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff1c8068650 msgr2=0x7ff1c806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7ff1c8068650 0x7ff1c806ab10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc0ad000 tx=0x7ff1dc0a6000 comp rx=0 tx=0).stop 2024-04-26T23:50:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 msgr2=0x7ff1e8154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 --2- 172.21.15.47:0/2677605003 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff1e81607d0 0x7ff1e8154330 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff1d400d7d0 tx=0x7ff1d400dc90 comp rx=0 tx=0).stop 2024-04-26T23:50:50.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ed800640 1 -- 172.21.15.47:0/2677605003 reap_dead start 2024-04-26T23:50:50.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 shutdown_connections 2024-04-26T23:50:50.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 >> 172.21.15.47:0/2677605003 conn(0x7ff1e80d2f50 msgr2=0x7ff1e80cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:50.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 shutdown_connections 2024-04-26T23:50:50.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.552+0000 7ff1ef800640 1 -- 172.21.15.47:0/2677605003 wait complete. 2024-04-26T23:50:50.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T23:50:50.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa919c00640 1 Processor -- start 2024-04-26T23:50:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa919c00640 1 -- start start 2024-04-26T23:50:50.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa919c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa914159b70 0x7fa91406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa919c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9140af7f0 0x7fa91406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa919c00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9140aea30 con 0x7fa91415fca0 2024-04-26T23:50:50.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa919c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fa9140af360 con 0x7fa914159b70 2024-04-26T23:50:50.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa919c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa9140aed10 con 0x7fa9140af7f0 2024-04-26T23:50:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.712+0000 7fa912a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa914159b70 0x7fa91406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa914159b70 0x7fa91406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57006/0 (socket says 172.21.15.47:57006) 2024-04-26T23:50:50.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912a00640 1 -- 172.21.15.47:0/1761710041 learned_addr learned my addr 172.21.15.47:0/1761710041 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa90a000640 1 --2- 172.21.15.47:0/1761710041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9140af7f0 0x7fa91406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912a00640 1 -- 172.21.15.47:0/1761710041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9140af7f0 msgr2=0x7fa91406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912a00640 1 --2- 172.21.15.47:0/1761710041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9140af7f0 0x7fa91406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912a00640 1 -- 172.21.15.47:0/1761710041 >> v1:172.21.15.203:6789/0 conn(0x7fa91415fca0 legacy=0x7fa914160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912a00640 1 -- 172.21.15.47:0/1761710041 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9140aeff0 con 0x7fa914159b70 2024-04-26T23:50:50.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa90a000640 1 --2- 172.21.15.47:0/1761710041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9140af7f0 0x7fa91406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:50.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912a00640 1 --2- 172.21.15.47:0/1761710041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91406c630 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa91406d180 tx=0x7fa90401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae584be79469a47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912000640 1 -- 172.21.15.47:0/1761710041 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040b1070 con 0x7fa914159b70 2024-04-26T23:50:50.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912000640 1 -- 172.21.15.47:0/1761710041 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9040ac410 con 0x7fa914159b70 2024-04-26T23:50:50.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.716+0000 7fa912000640 1 -- 172.21.15.47:0/1761710041 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9040ac7e0 con 0x7fa914159b70 2024-04-26T23:50:50.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- 172.21.15.47:0/1761710041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 msgr2=0x7fa91406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 --2- 172.21.15.47:0/1761710041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91406c630 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa91406d180 tx=0x7fa90401c4e0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- 172.21.15.47:0/1761710041 shutdown_connections 2024-04-26T23:50:50.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 --2- 172.21.15.47:0/1761710041 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa9140af7f0 0x7fa91406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 --2- 172.21.15.47:0/1761710041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91406c630 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- 172.21.15.47:0/1761710041 >> 172.21.15.47:0/1761710041 conn(0x7fa9140b2d40 msgr2=0x7fa9140b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:50.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- 172.21.15.47:0/1761710041 shutdown_connections 2024-04-26T23:50:50.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- 172.21.15.47:0/1761710041 wait complete. 2024-04-26T23:50:50.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 Processor -- start 2024-04-26T23:50:50.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- start start 2024-04-26T23:50:50.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9140af7f0 0x7fa91414f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa91415fca0 0x7fa9140720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fa91406faa0 con 0x7fa914159b70 2024-04-26T23:50:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa91406f920 con 0x7fa9140af7f0 2024-04-26T23:50:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fa91406fc20 con 0x7fa91415fca0 2024-04-26T23:50:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91409ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57014/0 (socket says 172.21.15.47:57014) 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 -- 172.21.15.47:0/1883803217 learned_addr learned my addr 172.21.15.47:0/1883803217 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa912a00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9140af7f0 0x7fa91414f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa913400640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa91415fca0 0x7fa9140720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 -- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa91415fca0 msgr2=0x7fa9140720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa91415fca0 0x7fa9140720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 -- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9140af7f0 msgr2=0x7fa91414f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9140af7f0 0x7fa91414f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 -- 172.21.15.47:0/1883803217 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91414fcf0 con 0x7fa914159b70 2024-04-26T23:50:50.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90a000640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91409ba60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c7f0 tx=0x7fa8fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90b400640 1 -- 172.21.15.47:0/1883803217 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc015070 con 0x7fa914159b70 2024-04-26T23:50:50.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90b400640 1 -- 172.21.15.47:0/1883803217 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc007a30 con 0x7fa914159b70 2024-04-26T23:50:50.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa90b400640 1 -- 172.21.15.47:0/1883803217 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc007e00 con 0x7fa914159b70 2024-04-26T23:50:50.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.720+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91409c2b0 con 0x7fa914159b70 2024-04-26T23:50:50.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.724+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91409c870 con 0x7fa914159b70 2024-04-26T23:50:50.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.724+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9140695f0 con 0x7fa914159b70 2024-04-26T23:50:50.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.724+0000 7fa90b400640 1 -- 172.21.15.47:0/1883803217 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fa8fc018070 con 0x7fa914159b70 2024-04-26T23:50:50.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.724+0000 7fa90b400640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa8f0068650 0x7fa8f006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:50.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.724+0000 7fa90b400640 1 -- 172.21.15.47:0/1883803217 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fa8fc086b20 con 0x7fa914159b70 2024-04-26T23:50:50.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.724+0000 7fa912a00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa8f0068650 0x7fa8f006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:50.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.728+0000 7fa912a00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa8f0068650 0x7fa8f006ab10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa9040ae000 tx=0x7fa904008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:50.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.728+0000 7fa90b400640 1 -- 172.21.15.47:0/1883803217 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fa8fc0568f0 con 0x7fa914159b70 2024-04-26T23:50:50.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa914153cc0 con 0x7fa8f0068650 2024-04-26T23:50:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa90b400640 1 -- 172.21.15.47:0/1883803217 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa914153cc0 con 0x7fa8f0068650 2024-04-26T23:50:50.902 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T23:50:50.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa8f0068650 msgr2=0x7fa8f006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa8f0068650 0x7fa8f006ab10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa9040ae000 tx=0x7fa904008040 comp rx=0 tx=0).stop 2024-04-26T23:50:50.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 msgr2=0x7fa91409ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:50.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91409ba60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00c7f0 tx=0x7fa8fc00ccb0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 shutdown_connections 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fa8f0068650 0x7fa8f006ab10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fa91415fca0 0x7fa9140720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa914159b70 0x7fa91409ba60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 --2- 172.21.15.47:0/1883803217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9140af7f0 0x7fa91414f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 >> 172.21.15.47:0/1883803217 conn(0x7fa9140b2d40 msgr2=0x7fa9140cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 shutdown_connections 2024-04-26T23:50:50.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:50.896+0000 7fa919c00640 1 -- 172.21.15.47:0/1883803217 wait complete. 2024-04-26T23:50:50.923 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T23:50:50.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:51.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7626a00640 1 Processor -- start 2024-04-26T23:50:51.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7626a00640 1 -- start start 2024-04-26T23:50:51.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7626a00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f76200cd6e0 0x7f7620073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7626a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76200b46a0 con 0x7f76200b41e0 2024-04-26T23:50:51.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7626a00640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76200b4980 con 0x7f762015d2f0 2024-04-26T23:50:51.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7626a00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f76200b4c60 con 0x7f76200cd6e0 2024-04-26T23:50:51.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7617400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f76200b41e0 0x7f76200cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40470/0 (socket says 172.21.15.47:40470) 2024-04-26T23:50:51.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7617400640 1 -- 172.21.15.47:0/3441554128 learned_addr learned my addr 172.21.15.47:0/3441554128 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f7624a00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f762015d2f0 0x7f76200ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:52002/0 (socket says 172.21.15.47:52002) 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.060+0000 7f761fe00640 1 --2- 172.21.15.47:0/3441554128 >> v2:172.21.15.47:3300/0 conn(0x7f76200cd6e0 0x7f7620073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761f400640 1 -- 172.21.15.47:0/3441554128 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772678049 0 0) 0x7f76200b46a0 con 0x7f76200b41e0 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761f400640 1 -- 172.21.15.47:0/3441554128 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7604003530 con 0x7f76200b41e0 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761f400640 1 -- 172.21.15.47:0/3441554128 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369103697 0 0) 0x7f76200b4980 con 0x7f762015d2f0 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761fe00640 1 -- 172.21.15.47:0/3441554128 >> v1:172.21.15.203:6789/0 conn(0x7f762015d2f0 legacy=0x7f76200ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761fe00640 1 -- 172.21.15.47:0/3441554128 >> v1:172.21.15.47:6789/0 conn(0x7f76200b41e0 legacy=0x7f76200cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761fe00640 1 -- 172.21.15.47:0/3441554128 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76200b4f40 con 0x7f76200cd6e0 2024-04-26T23:50:51.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761fe00640 1 --2- 172.21.15.47:0/3441554128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f7620073cd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f76100097c0 tx=0x7f761001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a424125deaaf6f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761f400640 1 -- 172.21.15.47:0/3441554128 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100b1070 con 0x7f76200cd6e0 2024-04-26T23:50:51.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761f400640 1 -- 172.21.15.47:0/3441554128 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76100ac410 con 0x7f76200cd6e0 2024-04-26T23:50:51.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f761f400640 1 -- 172.21.15.47:0/3441554128 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100ac7e0 con 0x7f76200cd6e0 2024-04-26T23:50:51.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f7626a00640 1 -- 172.21.15.47:0/3441554128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 msgr2=0x7f7620073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f7626a00640 1 --2- 172.21.15.47:0/3441554128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f7620073cd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f76100097c0 tx=0x7f761001c4a0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f7626a00640 1 -- 172.21.15.47:0/3441554128 shutdown_connections 2024-04-26T23:50:51.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f7626a00640 1 --2- 172.21.15.47:0/3441554128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f7620073cd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.064+0000 7f7626a00640 1 -- 172.21.15.47:0/3441554128 >> 172.21.15.47:0/3441554128 conn(0x7f76200d0c90 msgr2=0x7f76200d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 -- 172.21.15.47:0/3441554128 shutdown_connections 2024-04-26T23:50:51.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 -- 172.21.15.47:0/3441554128 wait complete. 2024-04-26T23:50:51.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 Processor -- start 2024-04-26T23:50:51.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 -- start start 2024-04-26T23:50:51.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76200b41e0 0x7f762015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f762014e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762015d2f0 0x7f762006de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f762016b120 con 0x7f76200cd6e0 2024-04-26T23:50:51.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f762016afa0 con 0x7f762015d2f0 2024-04-26T23:50:51.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7626a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f762016b2a0 con 0x7f76200b41e0 2024-04-26T23:50:51.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f762014e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f762014e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57026/0 (socket says 172.21.15.47:57026) 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 -- 172.21.15.47:0/3065378469 learned_addr learned my addr 172.21.15.47:0/3065378469 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7624a00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762015d2f0 0x7f762006de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f761fe00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76200b41e0 0x7f762015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 -- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76200b41e0 msgr2=0x7f762015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f76200b41e0 0x7f762015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 -- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762015d2f0 msgr2=0x7f762006de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762015d2f0 0x7f762006de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 -- 172.21.15.47:0/3065378469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762015acb0 con 0x7f76200cd6e0 2024-04-26T23:50:51.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7624a00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f762015d2f0 0x7f762006de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:51.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.068+0000 7f7617400640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f762014e190 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f760800c480 tx=0x7f760800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608017070 con 0x7f76200cd6e0 2024-04-26T23:50:51.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7608005cf0 con 0x7f76200cd6e0 2024-04-26T23:50:51.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762015a9d0 con 0x7f76200cd6e0 2024-04-26T23:50:51.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608007290 con 0x7f76200cd6e0 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762015e8b0 con 0x7f76200cd6e0 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76200695f0 con 0x7f76200cd6e0 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f760801a070 con 0x7f76200cd6e0 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75fc068650 0x7f75fc06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f7608085f20 con 0x7f76200cd6e0 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f75fc06e510 0x7f75fc070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 --> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7608013e50 con 0x7f75fc06e510 2024-04-26T23:50:51.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f76080884e0 con 0x7f76200cd6e0 2024-04-26T23:50:51.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f761fe00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75fc068650 0x7f75fc06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.072+0000 7f7624a00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f75fc06e510 0x7f75fc070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.076+0000 7f761fe00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75fc068650 0x7f75fc06ab10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f76100ae000 tx=0x7f7610008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.076+0000 7f7624a00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f75fc06e510 0x7f75fc070930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.076+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== osd.4 v2:172.21.15.203:6800/1053635883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7608013e50 con 0x7f75fc06e510 2024-04-26T23:50:51.095 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 --> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f76200b2480 con 0x7f75fc06e510 2024-04-26T23:50:51.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f761cc00640 1 -- 172.21.15.47:0/3065378469 <== osd.4 v2:172.21.15.203:6800/1053635883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f76200b2480 con 0x7f75fc06e510 2024-04-26T23:50:51.097 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:51.097 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:51.097 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:51.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f75fc06e510 msgr2=0x7f75fc070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6800/1053635883,v1:172.21.15.203:6801/1053635883] conn(0x7f75fc06e510 0x7f75fc070930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75fc068650 msgr2=0x7f75fc06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f75fc068650 0x7f75fc06ab10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f76100ae000 tx=0x7f7610008040 comp rx=0 tx=0).stop 2024-04-26T23:50:51.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 msgr2=0x7f762014e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 --2- 172.21.15.47:0/3065378469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f76200cd6e0 0x7f762014e190 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f760800c480 tx=0x7f760800c940 comp rx=0 tx=0).stop 2024-04-26T23:50:51.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7624a00640 1 -- 172.21.15.47:0/3065378469 reap_dead start 2024-04-26T23:50:51.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 shutdown_connections 2024-04-26T23:50:51.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.088+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 >> 172.21.15.47:0/3065378469 conn(0x7f76200d0c90 msgr2=0x7f76201516b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.092+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 shutdown_connections 2024-04-26T23:50:51.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.092+0000 7f7626a00640 1 -- 172.21.15.47:0/3065378469 wait complete. 2024-04-26T23:50:51.116 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T23:50:51.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06fa000640 1 Processor -- start 2024-04-26T23:50:51.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06fa000640 1 -- start start 2024-04-26T23:50:51.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06fa000640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06f4070900 0x7f06f40aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06fa000640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f06f40af2e0 0x7f06f406c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06fa000640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f40af760 con 0x7f06f40b1480 2024-04-26T23:50:51.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06fa000640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f06f40afa40 con 0x7f06f4070900 2024-04-26T23:50:51.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06fa000640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f06f415f990 con 0x7f06f40af2e0 2024-04-26T23:50:51.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f06f40b1480 0x7f06f4159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40478/0 (socket says 172.21.15.47:40478) 2024-04-26T23:50:51.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f3e00640 1 -- 172.21.15.47:0/3557434583 learned_addr learned my addr 172.21.15.47:0/3557434583 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f3400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06f4070900 0x7f06f40aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06ebe00640 1 --2- 172.21.15.47:0/3557434583 >> v2:172.21.15.203:3300/0 conn(0x7f06f40af2e0 0x7f06f406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f2a00640 1 -- 172.21.15.47:0/3557434583 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183656538 0 0) 0x7f06f40af760 con 0x7f06f40b1480 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f3400640 1 -- 172.21.15.47:0/3557434583 >> v2:172.21.15.203:3300/0 conn(0x7f06f40af2e0 msgr2=0x7f06f406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f3400640 1 --2- 172.21.15.47:0/3557434583 >> v2:172.21.15.203:3300/0 conn(0x7f06f40af2e0 0x7f06f406c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f3400640 1 -- 172.21.15.47:0/3557434583 >> v1:172.21.15.47:6789/0 conn(0x7f06f40b1480 legacy=0x7f06f4159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06f3400640 1 -- 172.21.15.47:0/3557434583 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f415fc70 con 0x7f06f4070900 2024-04-26T23:50:51.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.252+0000 7f06ebe00640 1 --2- 172.21.15.47:0/3557434583 >> v2:172.21.15.203:3300/0 conn(0x7f06f40af2e0 0x7f06f406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:51.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06f3400640 1 --2- 172.21.15.47:0/3557434583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f4070900 0x7f06f40aeda0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f06f409ff50 tx=0x7f06e401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cafa06949f4b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06f2a00640 1 -- 172.21.15.47:0/3557434583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40b2070 con 0x7f06f4070900 2024-04-26T23:50:51.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06f2a00640 1 -- 172.21.15.47:0/3557434583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e40a9070 con 0x7f06f4070900 2024-04-26T23:50:51.264 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06f2a00640 1 -- 172.21.15.47:0/3557434583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e40ad880 con 0x7f06f4070900 2024-04-26T23:50:51.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 -- 172.21.15.47:0/3557434583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f4070900 msgr2=0x7f06f40aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 --2- 172.21.15.47:0/3557434583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f4070900 0x7f06f40aeda0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f06f409ff50 tx=0x7f06e401c450 comp rx=0 tx=0).stop 2024-04-26T23:50:51.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 -- 172.21.15.47:0/3557434583 shutdown_connections 2024-04-26T23:50:51.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 --2- 172.21.15.47:0/3557434583 >> v2:172.21.15.203:3300/0 conn(0x7f06f40af2e0 0x7f06f406c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 --2- 172.21.15.47:0/3557434583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f4070900 0x7f06f40aeda0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 -- 172.21.15.47:0/3557434583 >> 172.21.15.47:0/3557434583 conn(0x7f06f40b4470 msgr2=0x7f06f40d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 -- 172.21.15.47:0/3557434583 shutdown_connections 2024-04-26T23:50:51.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.256+0000 7f06fa000640 1 -- 172.21.15.47:0/3557434583 wait complete. 2024-04-26T23:50:51.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 Processor -- start 2024-04-26T23:50:51.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 -- start start 2024-04-26T23:50:51.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4070900 0x7f06f4154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f40af2e0 0x7f06f4155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f40b1480 0x7f06f413c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40b5d70 con 0x7f06f40b1480 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f06f40b5bf0 con 0x7f06f40af2e0 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f06f40b5ef0 con 0x7f06f4070900 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f40b1480 0x7f06f413c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f40b1480 0x7f06f413c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57044/0 (socket says 172.21.15.47:57044) 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 -- 172.21.15.47:0/2166065195 learned_addr learned my addr 172.21.15.47:0/2166065195 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06ebe00640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f40af2e0 0x7f06f4155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3400640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4070900 0x7f06f4154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 -- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4070900 msgr2=0x7f06f4154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4070900 0x7f06f4154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 -- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f40af2e0 msgr2=0x7f06f4155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f40af2e0 0x7f06f4155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 -- 172.21.15.47:0/2166065195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f4154e70 con 0x7f06f40b1480 2024-04-26T23:50:51.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06f3e00640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f40b1480 0x7f06f413c070 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c7a0 tx=0x7f06ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06eb400640 1 -- 172.21.15.47:0/2166065195 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec018070 con 0x7f06f40b1480 2024-04-26T23:50:51.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06eb400640 1 -- 172.21.15.47:0/2166065195 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec00a640 con 0x7f06f40b1480 2024-04-26T23:50:51.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f4155150 con 0x7f06f40b1480 2024-04-26T23:50:51.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06eb400640 1 -- 172.21.15.47:0/2166065195 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00aab0 con 0x7f06f40b1480 2024-04-26T23:50:51.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.260+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f4155710 con 0x7f06f40b1480 2024-04-26T23:50:51.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.264+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f40695f0 con 0x7f06f40b1480 2024-04-26T23:50:51.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.264+0000 7f06eb400640 1 -- 172.21.15.47:0/2166065195 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f06ec01b070 con 0x7f06f40b1480 2024-04-26T23:50:51.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.264+0000 7f06eb400640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06d0068650 0x7f06d006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.264+0000 7f06eb400640 1 -- 172.21.15.47:0/2166065195 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f06ec0860c0 con 0x7f06f40b1480 2024-04-26T23:50:51.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.264+0000 7f06f3400640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06d0068650 0x7f06d006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.268+0000 7f06f3400640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06d0068650 0x7f06d006ab10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f06e40af000 tx=0x7f06e40a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.268+0000 7f06eb400640 1 -- 172.21.15.47:0/2166065195 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f06ec056680 con 0x7f06f40b1480 2024-04-26T23:50:51.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f06f413c5b0 con 0x7f06d0068650 2024-04-26T23:50:51.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06eb400640 1 -- 172.21.15.47:0/2166065195 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f06f413c5b0 con 0x7f06d0068650 2024-04-26T23:50:51.443 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T23:50:51.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06d0068650 msgr2=0x7f06d006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06d0068650 0x7f06d006ab10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f06e40af000 tx=0x7f06e40a7000 comp rx=0 tx=0).stop 2024-04-26T23:50:51.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f40b1480 msgr2=0x7f06f413c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f40b1480 0x7f06f413c070 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00c7a0 tx=0x7f06ec00cc60 comp rx=0 tx=0).stop 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 shutdown_connections 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f06d0068650 0x7f06d006ab10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f06f40b1480 0x7f06f413c070 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f06f40af2e0 0x7f06f4155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 --2- 172.21.15.47:0/2166065195 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f06f4070900 0x7f06f4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 >> 172.21.15.47:0/2166065195 conn(0x7f06f40b4470 msgr2=0x7f06f40731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.436+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 shutdown_connections 2024-04-26T23:50:51.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.440+0000 7f06fa000640 1 -- 172.21.15.47:0/2166065195 wait complete. 2024-04-26T23:50:51.464 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T23:50:51.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe29200640 1 Processor -- start 2024-04-26T23:50:51.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe29200640 1 -- start start 2024-04-26T23:50:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe29200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe240b40c0 0x7efe2406de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe29200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7efe240cdd10 0x7efe240ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe29200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe240d07e0 con 0x7efe2415f630 2024-04-26T23:50:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe29200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7efe240cd5a0 con 0x7efe240b40c0 2024-04-26T23:50:51.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe29200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7efe240cd880 con 0x7efe240cdd10 2024-04-26T23:50:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe1be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe240b40c0 0x7efe2406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe1be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efe240b40c0 0x7efe2406de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57048/0 (socket says 172.21.15.47:57048) 2024-04-26T23:50:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe1be00640 1 -- 172.21.15.47:0/66079575 learned_addr learned my addr 172.21.15.47:0/66079575 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe22800640 1 --2- 172.21.15.47:0/66079575 >> v2:172.21.15.203:3300/0 conn(0x7efe240cdd10 0x7efe240ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe1be00640 1 -- 172.21.15.47:0/66079575 >> v2:172.21.15.203:3300/0 conn(0x7efe240cdd10 msgr2=0x7efe240ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe1be00640 1 --2- 172.21.15.47:0/66079575 >> v2:172.21.15.203:3300/0 conn(0x7efe240cdd10 0x7efe240ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe1be00640 1 -- 172.21.15.47:0/66079575 >> v1:172.21.15.203:6789/0 conn(0x7efe2415f630 legacy=0x7efe2406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.604+0000 7efe1be00640 1 -- 172.21.15.47:0/66079575 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe240d1db0 con 0x7efe240b40c0 2024-04-26T23:50:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe1be00640 1 --2- 172.21.15.47:0/66079575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240b40c0 0x7efe2406de30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efe240737f0 tx=0x7efe0c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b990359c6f4712a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe21400640 1 -- 172.21.15.47:0/66079575 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0b1070 con 0x7efe240b40c0 2024-04-26T23:50:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe21400640 1 -- 172.21.15.47:0/66079575 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c0ac630 con 0x7efe240b40c0 2024-04-26T23:50:51.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe21400640 1 -- 172.21.15.47:0/66079575 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0a8050 con 0x7efe240b40c0 2024-04-26T23:50:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 -- 172.21.15.47:0/66079575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240b40c0 msgr2=0x7efe2406de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 --2- 172.21.15.47:0/66079575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240b40c0 0x7efe2406de30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efe240737f0 tx=0x7efe0c01c3d0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 -- 172.21.15.47:0/66079575 shutdown_connections 2024-04-26T23:50:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 --2- 172.21.15.47:0/66079575 >> v2:172.21.15.203:3300/0 conn(0x7efe240cdd10 0x7efe240ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 --2- 172.21.15.47:0/66079575 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240b40c0 0x7efe2406de30 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 -- 172.21.15.47:0/66079575 >> 172.21.15.47:0/66079575 conn(0x7efe240d2f50 msgr2=0x7efe240d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 -- 172.21.15.47:0/66079575 shutdown_connections 2024-04-26T23:50:51.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.608+0000 7efe29200640 1 -- 172.21.15.47:0/66079575 wait complete. 2024-04-26T23:50:51.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 Processor -- start 2024-04-26T23:50:51.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 -- start start 2024-04-26T23:50:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe240b40c0 0x7efe2409cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240cdd10 0x7efe24148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe2415f630 0x7efe241564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7efe2406e4f0 con 0x7efe240cdd10 2024-04-26T23:50:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe2406e370 con 0x7efe240b40c0 2024-04-26T23:50:51.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7efe2416c200 con 0x7efe2415f630 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240cdd10 0x7efe24148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe21e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe240b40c0 0x7efe2409cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240cdd10 0x7efe24148190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57050/0 (socket says 172.21.15.47:57050) 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 -- 172.21.15.47:0/4251827259 learned_addr learned my addr 172.21.15.47:0/4251827259 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe22800640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe2415f630 0x7efe241564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe21e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe240b40c0 0x7efe2409cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.47:37710/0 (socket says 172.21.15.47:37710) 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 -- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe2415f630 msgr2=0x7efe241564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7efe2415f630 0x7efe241564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 -- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe240b40c0 msgr2=0x7efe2409cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe240b40c0 0x7efe2409cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 -- 172.21.15.47:0/4251827259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe240c9510 con 0x7efe240cdd10 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe21e00640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe240b40c0 0x7efe2409cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1be00640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240cdd10 0x7efe24148190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efe0c018fe0 tx=0x7efe0c019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0b1040 con 0x7efe240cdd10 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c0ba070 con 0x7efe240cdd10 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0b5660 con 0x7efe240cdd10 2024-04-26T23:50:51.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe240c97f0 con 0x7efe240cdd10 2024-04-26T23:50:51.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe240cac40 con 0x7efe240cdd10 2024-04-26T23:50:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.612+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe240695f0 con 0x7efe240cdd10 2024-04-26T23:50:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7efe0c0b5800 con 0x7efe240cdd10 2024-04-26T23:50:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe1a000640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe00068650 0x7efe0006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7efe0c120e50 con 0x7efe240cdd10 2024-04-26T23:50:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe1a000640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7efe0006e510 0x7efe00070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 --> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe0c0b6e50 con 0x7efe0006e510 2024-04-26T23:50:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7efe0c121200 con 0x7efe240cdd10 2024-04-26T23:50:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe21e00640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe00068650 0x7efe0006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe22800640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7efe0006e510 0x7efe00070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe21e00640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe00068650 0x7efe0006ab10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe14001b60 tx=0x7efe14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.616+0000 7efe22800640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7efe0006e510 0x7efe00070930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.620+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== osd.5 v2:172.21.15.203:6803/4078733335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efe0c0b6e50 con 0x7efe0006e510 2024-04-26T23:50:51.638 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 --> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efe240c99c0 con 0x7efe0006e510 2024-04-26T23:50:51.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe1a000640 1 -- 172.21.15.47:0/4251827259 <== osd.5 v2:172.21.15.203:6803/4078733335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efe240c99c0 con 0x7efe0006e510 2024-04-26T23:50:51.640 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:51.640 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:51.640 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:51.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7efe0006e510 msgr2=0x7efe00070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6803/4078733335,v1:172.21.15.203:6805/4078733335] conn(0x7efe0006e510 0x7efe00070930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe00068650 msgr2=0x7efe0006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7efe00068650 0x7efe0006ab10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efe14001b60 tx=0x7efe14009040 comp rx=0 tx=0).stop 2024-04-26T23:50:51.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240cdd10 msgr2=0x7efe24148190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 --2- 172.21.15.47:0/4251827259 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efe240cdd10 0x7efe24148190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7efe0c018fe0 tx=0x7efe0c019170 comp rx=0 tx=0).stop 2024-04-26T23:50:51.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe22800640 1 -- 172.21.15.47:0/4251827259 reap_dead start 2024-04-26T23:50:51.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 shutdown_connections 2024-04-26T23:50:51.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 >> 172.21.15.47:0/4251827259 conn(0x7efe240d2f50 msgr2=0x7efe240b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 shutdown_connections 2024-04-26T23:50:51.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.632+0000 7efe29200640 1 -- 172.21.15.47:0/4251827259 wait complete. 2024-04-26T23:50:51.658 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T23:50:51.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9285c00640 1 Processor -- start 2024-04-26T23:50:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9285c00640 1 -- start start 2024-04-26T23:50:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9285c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f92800d1540 0x7f92800d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9285c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 0x7f92800d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9285c00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92800d1e60 con 0x7f92800cdae0 2024-04-26T23:50:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9285c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f92800b46f0 con 0x7f92800d1540 2024-04-26T23:50:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9285c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f92800b4940 con 0x7f92800b21f0 2024-04-26T23:50:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f927f400640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f92800cdae0 0x7f92800b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40494/0 (socket says 172.21.15.47:40494) 2024-04-26T23:50:51.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f927f400640 1 -- 172.21.15.47:0/2557599316 learned_addr learned my addr 172.21.15.47:0/2557599316 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:51.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 --2- 172.21.15.47:0/2557599316 >> v2:172.21.15.203:3300/0 conn(0x7f92800d1540 0x7f92800d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.792+0000 7f9276000640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 0x7f92800d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926083891 0 0) 0x7f92800d1e60 con 0x7f92800cdae0 2024-04-26T23:50:51.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9264003530 con 0x7f92800cdae0 2024-04-26T23:50:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1040109351 0 0) 0x7f9264003530 con 0x7f92800cdae0 2024-04-26T23:50:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 msgr2=0x7f92800d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 0x7f92800d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 >> v2:172.21.15.203:3300/0 conn(0x7f92800d1540 msgr2=0x7f92800d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 --2- 172.21.15.47:0/2557599316 >> v2:172.21.15.203:3300/0 conn(0x7f92800d1540 0x7f92800d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92800b4c20 con 0x7f92800cdae0 2024-04-26T23:50:51.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 --2- 172.21.15.47:0/2557599316 >> v2:172.21.15.203:3300/0 conn(0x7f92800d1540 0x7f92800d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7f9278001a20 con 0x7f92800cdae0 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 >> v1:172.21.15.47:6789/0 conn(0x7f92800cdae0 legacy=0x7f92800b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640039c0 0x7f9264003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 0x7f9264004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9264004d50 0x7f92640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f92800b46f0 con 0x7f92640039c0 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92800b4940 con 0x7f9264004d50 2024-04-26T23:50:51.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f926400b9d0 con 0x7f92800b21f0 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640039c0 0x7f9264003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f9276000640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 0x7f9264004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927f400640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9264004d50 0x7f92640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 -- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 msgr2=0x7f9264004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92800b21f0 0x7f9264004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 -- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9264004d50 msgr2=0x7f92640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9264004d50 0x7f92640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.796+0000 7f927ea00640 1 -- 172.21.15.47:0/2557599316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264003530 con 0x7f92640039c0 2024-04-26T23:50:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f927ea00640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640039c0 0x7f9264003de0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9270009cb0 tx=0x7f927001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728680e5eed8b234 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92700b2070 con 0x7f92640039c0 2024-04-26T23:50:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92700a5900 con 0x7f92640039c0 2024-04-26T23:50:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f927e000640 1 -- 172.21.15.47:0/2557599316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9270009880 con 0x7f92640039c0 2024-04-26T23:50:51.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- 172.21.15.47:0/2557599316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640039c0 msgr2=0x7f9264003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 --2- 172.21.15.47:0/2557599316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f92640039c0 0x7f9264003de0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9270009cb0 tx=0x7f927001cc60 comp rx=0 tx=0).stop 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f927f400640 1 -- 172.21.15.47:0/2557599316 reap_dead start 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- 172.21.15.47:0/2557599316 shutdown_connections 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- 172.21.15.47:0/2557599316 >> 172.21.15.47:0/2557599316 conn(0x7f928009ba60 msgr2=0x7f928009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- 172.21.15.47:0/2557599316 shutdown_connections 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- 172.21.15.47:0/2557599316 wait complete. 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 Processor -- start 2024-04-26T23:50:51.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- start start 2024-04-26T23:50:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640039c0 0x7f9280155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f928006f2d0 0x7f92801f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f928015f810 0x7f928015fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f928015d4c0 con 0x7f928006f2d0 2024-04-26T23:50:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f928015d340 con 0x7f928015f810 2024-04-26T23:50:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.800+0000 7f9285c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f92800d1060 con 0x7f92640039c0 2024-04-26T23:50:51.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f928006f2d0 0x7f92801f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f928006f2d0 0x7f92801f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57074/0 (socket says 172.21.15.47:57074) 2024-04-26T23:50:51.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 -- 172.21.15.47:0/3604217735 learned_addr learned my addr 172.21.15.47:0/3604217735 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:51.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f927ea00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640039c0 0x7f9280155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f927f400640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f928015f810 0x7f928015fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 -- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640039c0 msgr2=0x7f9280155fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640039c0 0x7f9280155fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 -- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f928015f810 msgr2=0x7f928015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f928015f810 0x7f928015fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 -- 172.21.15.47:0/3604217735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92801f8be0 con 0x7f928006f2d0 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9276000640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f928006f2d0 0x7f92801f8240 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f92680119d0 tx=0x7f9268011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9277400640 1 -- 172.21.15.47:0/3604217735 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926800fb50 con 0x7f928006f2d0 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9277400640 1 -- 172.21.15.47:0/3604217735 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926800fcf0 con 0x7f928006f2d0 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9277400640 1 -- 172.21.15.47:0/3604217735 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926800fea0 con 0x7f928006f2d0 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92801f8ec0 con 0x7f928006f2d0 2024-04-26T23:50:51.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92800ca0d0 con 0x7f928006f2d0 2024-04-26T23:50:51.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92800695f0 con 0x7f928006f2d0 2024-04-26T23:50:51.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.804+0000 7f9277400640 1 -- 172.21.15.47:0/3604217735 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f9268012040 con 0x7f928006f2d0 2024-04-26T23:50:51.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.808+0000 7f9277400640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f925c068650 0x7f925c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:51.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.808+0000 7f9277400640 1 -- 172.21.15.47:0/3604217735 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f92680870c0 con 0x7f928006f2d0 2024-04-26T23:50:51.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.808+0000 7f927ea00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f925c068650 0x7f925c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:51.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.808+0000 7f927ea00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f925c068650 0x7f925c06ab10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f92700af000 tx=0x7f92700046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:51.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.812+0000 7f9277400640 1 -- 172.21.15.47:0/3604217735 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9268019030 con 0x7f928006f2d0 2024-04-26T23:50:51.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9280070930 con 0x7f925c068650 2024-04-26T23:50:51.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9277400640 1 -- 172.21.15.47:0/3604217735 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9280070930 con 0x7f925c068650 2024-04-26T23:50:51.982 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T23:50:51.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f925c068650 msgr2=0x7f925c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f925c068650 0x7f925c06ab10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f92700af000 tx=0x7f92700046d0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f928006f2d0 msgr2=0x7f92801f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:51.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f928006f2d0 0x7f92801f8240 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f92680119d0 tx=0x7f9268011e90 comp rx=0 tx=0).stop 2024-04-26T23:50:51.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 shutdown_connections 2024-04-26T23:50:51.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f925c068650 0x7f925c06ab10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f928015f810 0x7f928015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f928006f2d0 0x7f92801f8240 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 --2- 172.21.15.47:0/3604217735 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f92640039c0 0x7f9280155fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:51.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 >> 172.21.15.47:0/3604217735 conn(0x7f928009ba60 msgr2=0x7f92800cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:51.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 shutdown_connections 2024-04-26T23:50:51.985 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:51.976+0000 7f9285c00640 1 -- 172.21.15.47:0/3604217735 wait complete. 2024-04-26T23:50:52.003 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T23:50:52.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:52.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.140+0000 7f914e400640 1 Processor -- start 2024-04-26T23:50:52.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.140+0000 7f914e400640 1 -- start start 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f914e400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91480cd6e0 0x7f9148073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f914e400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f914815d2f0 0x7f91480ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f914e400640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91480b46a0 con 0x7f91480b41e0 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f914e400640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f91480b4980 con 0x7f91480cd6e0 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f914e400640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f91480b4c60 con 0x7f914815d2f0 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f9147400640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f91480cd6e0 0x7f9148073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f913ea00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f91480b41e0 0x7f91480cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40508/0 (socket says 172.21.15.47:40508) 2024-04-26T23:50:52.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f913ea00640 1 -- 172.21.15.47:0/2088379903 learned_addr learned my addr 172.21.15.47:0/2088379903 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f9147e00640 1 --2- 172.21.15.47:0/2088379903 >> v2:172.21.15.203:3300/0 conn(0x7f914815d2f0 0x7f91480ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f9147400640 1 -- 172.21.15.47:0/2088379903 >> v2:172.21.15.203:3300/0 conn(0x7f914815d2f0 msgr2=0x7f91480ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f9147400640 1 --2- 172.21.15.47:0/2088379903 >> v2:172.21.15.203:3300/0 conn(0x7f914815d2f0 0x7f91480ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f9147400640 1 -- 172.21.15.47:0/2088379903 >> v1:172.21.15.47:6789/0 conn(0x7f91480b41e0 legacy=0x7f91480cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f9147400640 1 -- 172.21.15.47:0/2088379903 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91480b4f40 con 0x7f91480cd6e0 2024-04-26T23:50:52.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.144+0000 7f9146a00640 1 -- 172.21.15.47:0/2088379903 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512629478 0 0) 0x7f91480b46a0 con 0x7f91480b41e0 2024-04-26T23:50:52.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f9147400640 1 --2- 172.21.15.47:0/2088379903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148073cd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f914806d4e0 tx=0x7f913801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387a56936dab3e5e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f9146a00640 1 -- 172.21.15.47:0/2088379903 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380b2070 con 0x7f91480cd6e0 2024-04-26T23:50:52.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f9146a00640 1 -- 172.21.15.47:0/2088379903 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91380a5900 con 0x7f91480cd6e0 2024-04-26T23:50:52.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f9146a00640 1 -- 172.21.15.47:0/2088379903 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91380a5cd0 con 0x7f91480cd6e0 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- 172.21.15.47:0/2088379903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 msgr2=0x7f9148073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 --2- 172.21.15.47:0/2088379903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148073cd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f914806d4e0 tx=0x7f913801c930 comp rx=0 tx=0).stop 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- 172.21.15.47:0/2088379903 shutdown_connections 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 --2- 172.21.15.47:0/2088379903 >> v2:172.21.15.203:3300/0 conn(0x7f914815d2f0 0x7f91480ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 --2- 172.21.15.47:0/2088379903 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148073cd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- 172.21.15.47:0/2088379903 >> 172.21.15.47:0/2088379903 conn(0x7f91480d0c90 msgr2=0x7f91480d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- 172.21.15.47:0/2088379903 shutdown_connections 2024-04-26T23:50:52.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- 172.21.15.47:0/2088379903 wait complete. 2024-04-26T23:50:52.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 Processor -- start 2024-04-26T23:50:52.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- start start 2024-04-26T23:50:52.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91480b41e0 0x7f914815f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f914815d2f0 0x7f91481533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f914816a110 con 0x7f91480cd6e0 2024-04-26T23:50:52.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9148169f90 con 0x7f91480b41e0 2024-04-26T23:50:52.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f914e400640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f914816a290 con 0x7f914815d2f0 2024-04-26T23:50:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f913ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f913ea00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57078/0 (socket says 172.21.15.47:57078) 2024-04-26T23:50:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.148+0000 7f913ea00640 1 -- 172.21.15.47:0/2587999705 learned_addr learned my addr 172.21.15.47:0/2587999705 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f9147400640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91480b41e0 0x7f914815f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f9147e00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f914815d2f0 0x7f91481533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913ea00640 1 -- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f914815d2f0 msgr2=0x7f91481533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913ea00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f914815d2f0 0x7f91481533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913ea00640 1 -- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91480b41e0 msgr2=0x7f914815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913ea00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91480b41e0 0x7f914815f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913ea00640 1 -- 172.21.15.47:0/2587999705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914809ba60 con 0x7f91480cd6e0 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f9147e00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f914815d2f0 0x7f91481533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f9147400640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91480b41e0 0x7f914815f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913ea00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148152e80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f91300011f0 tx=0x7f913000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130018070 con 0x7f91480cd6e0 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91300074e0 con 0x7f91480cd6e0 2024-04-26T23:50:52.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130004a10 con 0x7f91480cd6e0 2024-04-26T23:50:52.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914815ff60 con 0x7f91480cd6e0 2024-04-26T23:50:52.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9148160520 con 0x7f91480cd6e0 2024-04-26T23:50:52.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f91480695f0 con 0x7f91480cd6e0 2024-04-26T23:50:52.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.152+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f913001b070 con 0x7f91480cd6e0 2024-04-26T23:50:52.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f913fe00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9124068650 0x7f912406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f9130086440 con 0x7f91480cd6e0 2024-04-26T23:50:52.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f913fe00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f912406e510 0x7f9124070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 --> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9124070fe0 con 0x7f912406e510 2024-04-26T23:50:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f91300867f0 con 0x7f91480cd6e0 2024-04-26T23:50:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f9147400640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9124068650 0x7f912406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f9147e00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f912406e510 0x7f9124070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f9147400640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9124068650 0x7f912406ab10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f91380af000 tx=0x7f91380a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f9147e00640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f912406e510 0x7f9124070930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.156+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== osd.6 v2:172.21.15.203:6817/2269063813 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9124070fe0 con 0x7f912406e510 2024-04-26T23:50:52.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 --> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f914809bfe0 con 0x7f912406e510 2024-04-26T23:50:52.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f913fe00640 1 -- 172.21.15.47:0/2587999705 <== osd.6 v2:172.21.15.203:6817/2269063813 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f914809bfe0 con 0x7f912406e510 2024-04-26T23:50:52.178 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:52.178 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:52.178 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:52.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f912406e510 msgr2=0x7f9124070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6817/2269063813,v1:172.21.15.203:6819/2269063813] conn(0x7f912406e510 0x7f9124070930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9124068650 msgr2=0x7f912406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9124068650 0x7f912406ab10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f91380af000 tx=0x7f91380a7070 comp rx=0 tx=0).stop 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 msgr2=0x7f9148152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 --2- 172.21.15.47:0/2587999705 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f91480cd6e0 0x7f9148152e80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f91300011f0 tx=0x7f913000c9b0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f9147e00640 1 -- 172.21.15.47:0/2587999705 reap_dead start 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 shutdown_connections 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 >> 172.21.15.47:0/2587999705 conn(0x7f91480d0c90 msgr2=0x7f91480aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:52.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 shutdown_connections 2024-04-26T23:50:52.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.172+0000 7f914e400640 1 -- 172.21.15.47:0/2587999705 wait complete. 2024-04-26T23:50:52.197 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T23:50:52.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.332+0000 7f9ea9200640 1 Processor -- start 2024-04-26T23:50:52.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.332+0000 7f9ea9200640 1 -- start start 2024-04-26T23:50:52.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea9200640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9ea406cd40 0x7f9ea415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea9200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f9ea40af7f0 0x7f9ea41601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea9200640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea4160720 con 0x7f9ea4159b70 2024-04-26T23:50:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea9200640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea40af360 con 0x7f9ea406cd40 2024-04-26T23:50:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea9200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea40aea30 con 0x7f9ea40af7f0 2024-04-26T23:50:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea1e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9ea4159b70 0x7f9ea406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40510/0 (socket says 172.21.15.47:40510) 2024-04-26T23:50:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea1e00640 1 -- 172.21.15.47:0/2168575966 learned_addr learned my addr 172.21.15.47:0/2168575966 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:52.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea1400640 1 --2- 172.21.15.47:0/2168575966 >> v2:172.21.15.47:3300/0 conn(0x7f9ea406cd40 0x7f9ea415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea2800640 1 --2- 172.21.15.47:0/2168575966 >> v2:172.21.15.203:3300/0 conn(0x7f9ea40af7f0 0x7f9ea41601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea0a00640 1 -- 172.21.15.47:0/2168575966 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957069540 0 0) 0x7f9ea4160720 con 0x7f9ea4159b70 2024-04-26T23:50:52.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea0a00640 1 -- 172.21.15.47:0/2168575966 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e88003530 con 0x7f9ea4159b70 2024-04-26T23:50:52.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea1400640 1 -- 172.21.15.47:0/2168575966 >> v2:172.21.15.203:3300/0 conn(0x7f9ea40af7f0 msgr2=0x7f9ea41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:52.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea1400640 1 --2- 172.21.15.47:0/2168575966 >> v2:172.21.15.203:3300/0 conn(0x7f9ea40af7f0 0x7f9ea41601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea1400640 1 -- 172.21.15.47:0/2168575966 >> v1:172.21.15.47:6789/0 conn(0x7f9ea4159b70 legacy=0x7f9ea406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.336+0000 7f9ea1400640 1 -- 172.21.15.47:0/2168575966 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea40aed10 con 0x7f9ea406cd40 2024-04-26T23:50:52.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea1400640 1 --2- 172.21.15.47:0/2168575966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea406cd40 0x7f9ea415fca0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40af4e0 tx=0x7f9e9001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f602832fe5df4a5b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea0a00640 1 -- 172.21.15.47:0/2168575966 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e900ab650 con 0x7f9ea406cd40 2024-04-26T23:50:52.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea0a00640 1 -- 172.21.15.47:0/2168575966 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e900b0070 con 0x7f9ea406cd40 2024-04-26T23:50:52.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea0a00640 1 -- 172.21.15.47:0/2168575966 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e900aba10 con 0x7f9ea406cd40 2024-04-26T23:50:52.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- 172.21.15.47:0/2168575966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea406cd40 msgr2=0x7f9ea415fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 --2- 172.21.15.47:0/2168575966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea406cd40 0x7f9ea415fca0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40af4e0 tx=0x7f9e9001c430 comp rx=0 tx=0).stop 2024-04-26T23:50:52.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- 172.21.15.47:0/2168575966 shutdown_connections 2024-04-26T23:50:52.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 --2- 172.21.15.47:0/2168575966 >> v2:172.21.15.203:3300/0 conn(0x7f9ea40af7f0 0x7f9ea41601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 --2- 172.21.15.47:0/2168575966 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea406cd40 0x7f9ea415fca0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- 172.21.15.47:0/2168575966 >> 172.21.15.47:0/2168575966 conn(0x7f9ea40b2d40 msgr2=0x7f9ea40b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:52.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- 172.21.15.47:0/2168575966 shutdown_connections 2024-04-26T23:50:52.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- 172.21.15.47:0/2168575966 wait complete. 2024-04-26T23:50:52.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 Processor -- start 2024-04-26T23:50:52.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- start start 2024-04-26T23:50:52.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ea406cd40 0x7f9ea409c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ea40af7f0 0x7f9ea414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea4159b70 0x7f9ea415ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea406fa60 con 0x7f9ea4159b70 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea406f8e0 con 0x7f9ea40af7f0 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea9200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea406fbe0 con 0x7f9ea406cd40 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea4159b70 0x7f9ea415ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea2800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea4159b70 0x7f9ea415ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57098/0 (socket says 172.21.15.47:57098) 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.340+0000 7f9ea2800640 1 -- 172.21.15.47:0/4209504938 learned_addr learned my addr 172.21.15.47:0/4209504938 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea1400640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ea40af7f0 0x7f9ea414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea1e00640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ea406cd40 0x7f9ea409c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea2800640 1 -- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ea406cd40 msgr2=0x7f9ea409c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea2800640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ea406cd40 0x7f9ea409c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea2800640 1 -- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ea40af7f0 msgr2=0x7f9ea414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea2800640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ea40af7f0 0x7f9ea414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea2800640 1 -- 172.21.15.47:0/4209504938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea4160500 con 0x7f9ea4159b70 2024-04-26T23:50:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea1400640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ea40af7f0 0x7f9ea414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea1e00640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ea406cd40 0x7f9ea409c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea2800640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea4159b70 0x7f9ea415ea30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c007e40 tx=0x7f9e9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9e9a000640 1 -- 172.21.15.47:0/4209504938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c014620 con 0x7f9ea4159b70 2024-04-26T23:50:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9e9a000640 1 -- 172.21.15.47:0/4209504938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c019070 con 0x7f9ea4159b70 2024-04-26T23:50:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9e9a000640 1 -- 172.21.15.47:0/4209504938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c014a20 con 0x7f9ea4159b70 2024-04-26T23:50:52.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea409d310 con 0x7f9ea4159b70 2024-04-26T23:50:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea409cd50 con 0x7f9ea4159b70 2024-04-26T23:50:52.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea40695f0 con 0x7f9ea4159b70 2024-04-26T23:50:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9e9a000640 1 -- 172.21.15.47:0/4209504938 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f9e9c014bc0 con 0x7f9ea4159b70 2024-04-26T23:50:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9e9a000640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e84068680 0x7f9e8406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.344+0000 7f9e9a000640 1 -- 172.21.15.47:0/4209504938 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f9e9c087360 con 0x7f9ea4159b70 2024-04-26T23:50:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.348+0000 7f9ea1e00640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e84068680 0x7f9e8406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.348+0000 7f9ea1e00640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e84068680 0x7f9e8406ab40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e94005890 tx=0x7f9e94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.352+0000 7f9e9a000640 1 -- 172.21.15.47:0/4209504938 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f9ea409d310 con 0x7f9ea4159b70 2024-04-26T23:50:52.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.520+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f9ea406eca0 con 0x7f9e84068680 2024-04-26T23:50:52.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.520+0000 7f9e9a000640 1 -- 172.21.15.47:0/4209504938 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9ea406eca0 con 0x7f9e84068680 2024-04-26T23:50:52.527 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T23:50:52.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.520+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e84068680 msgr2=0x7f9e8406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.520+0000 7f9ea9200640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e84068680 0x7f9e8406ab40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e94005890 tx=0x7f9e94009040 comp rx=0 tx=0).stop 2024-04-26T23:50:52.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.520+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea4159b70 msgr2=0x7f9ea415ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.520+0000 7f9ea9200640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea4159b70 0x7f9ea415ea30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c007e40 tx=0x7f9e9c00e4b0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 shutdown_connections 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f9e84068680 0x7f9e8406ab40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ea4159b70 0x7f9ea415ea30 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ea40af7f0 0x7f9ea414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 --2- 172.21.15.47:0/4209504938 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f9ea406cd40 0x7f9ea409c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 >> 172.21.15.47:0/4209504938 conn(0x7f9ea40b2d40 msgr2=0x7f9ea40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:52.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 shutdown_connections 2024-04-26T23:50:52.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.524+0000 7f9ea9200640 1 -- 172.21.15.47:0/4209504938 wait complete. 2024-04-26T23:50:52.548 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T23:50:52.548 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T23:50:52.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.684+0000 7f0732c00640 1 Processor -- start 2024-04-26T23:50:52.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.684+0000 7f0732c00640 1 -- start start 2024-04-26T23:50:52.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0732c00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f072c0cd6e0 0x7f072c073cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0732c00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f072c0b41e0 0x7f072c0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0732c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c15d2f0 0x7f072c160c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0732c00640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7f072c0ce000 con 0x7f072c0cd6e0 2024-04-26T23:50:52.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0732c00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f072c0b46a0 con 0x7f072c0b41e0 2024-04-26T23:50:52.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0732c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f072c0b4980 con 0x7f072c15d2f0 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f072c0cd6e0 0x7f072c073cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f072c0cd6e0 0x7f072c073cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57102/0 (socket says 172.21.15.47:57102) 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 -- 172.21.15.47:0/3634748761 learned_addr learned my addr 172.21.15.47:0/3634748761 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0730c00640 1 --2- 172.21.15.47:0/3634748761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c15d2f0 0x7f072c160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0723e00640 1 --2- 172.21.15.47:0/3634748761 >> v2:172.21.15.203:3300/0 conn(0x7f072c0b41e0 0x7f072c0cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 -- 172.21.15.47:0/3634748761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c15d2f0 msgr2=0x7f072c160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 --2- 172.21.15.47:0/3634748761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c15d2f0 0x7f072c160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 -- 172.21.15.47:0/3634748761 >> v2:172.21.15.203:3300/0 conn(0x7f072c0b41e0 msgr2=0x7f072c0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 --2- 172.21.15.47:0/3634748761 >> v2:172.21.15.203:3300/0 conn(0x7f072c0b41e0 0x7f072c0cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f072be00640 1 -- 172.21.15.47:0/3634748761 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c0b4c60 con 0x7f072c0cd6e0 2024-04-26T23:50:52.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0730c00640 1 --2- 172.21.15.47:0/3634748761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c15d2f0 0x7f072c160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:52.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.688+0000 7f0723e00640 1 --2- 172.21.15.47:0/3634748761 >> v2:172.21.15.203:3300/0 conn(0x7f072c0b41e0 0x7f072c0cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:52.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f072be00640 1 --2- 172.21.15.47:0/3634748761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c0cd6e0 0x7f072c073cd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f072c160b70 tx=0x7f071c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9336b61e0d046138 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f072b400640 1 -- 172.21.15.47:0/3634748761 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c0b1070 con 0x7f072c0cd6e0 2024-04-26T23:50:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f072b400640 1 -- 172.21.15.47:0/3634748761 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f071c0ac630 con 0x7f072c0cd6e0 2024-04-26T23:50:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f072b400640 1 -- 172.21.15.47:0/3634748761 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f071c0a8050 con 0x7f072c0cd6e0 2024-04-26T23:50:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 -- 172.21.15.47:0/3634748761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c0cd6e0 msgr2=0x7f072c073cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 --2- 172.21.15.47:0/3634748761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c0cd6e0 0x7f072c073cd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f072c160b70 tx=0x7f071c01c520 comp rx=0 tx=0).stop 2024-04-26T23:50:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 -- 172.21.15.47:0/3634748761 shutdown_connections 2024-04-26T23:50:52.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 --2- 172.21.15.47:0/3634748761 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c15d2f0 0x7f072c160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 --2- 172.21.15.47:0/3634748761 >> v2:172.21.15.203:3300/0 conn(0x7f072c0b41e0 0x7f072c0cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 --2- 172.21.15.47:0/3634748761 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c0cd6e0 0x7f072c073cd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 -- 172.21.15.47:0/3634748761 >> 172.21.15.47:0/3634748761 conn(0x7f072c0d0c90 msgr2=0x7f072c0d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:52.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 -- 172.21.15.47:0/3634748761 shutdown_connections 2024-04-26T23:50:52.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 -- 172.21.15.47:0/3634748761 wait complete. 2024-04-26T23:50:52.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 Processor -- start 2024-04-26T23:50:52.701 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.692+0000 7f0732c00640 1 -- start start 2024-04-26T23:50:52.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f072c0b41e0 0x7f072c06de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c0cd6e0 0x7f072c0b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c15d2f0 0x7f072c06ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f072c0ced10 con 0x7f072c15d2f0 2024-04-26T23:50:52.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f072c0ceb90 con 0x7f072c0b41e0 2024-04-26T23:50:52.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f072c0cee90 con 0x7f072c0cd6e0 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c15d2f0 0x7f072c06ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c15d2f0 0x7f072c06ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57108/0 (socket says 172.21.15.47:57108) 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 -- 172.21.15.47:0/3352220091 learned_addr learned my addr 172.21.15.47:0/3352220091 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0723e00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c0cd6e0 0x7f072c0b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f072be00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f072c0b41e0 0x7f072c06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 -- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c0cd6e0 msgr2=0x7f072c0b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f072c0cd6e0 0x7f072c0b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 -- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f072c0b41e0 msgr2=0x7f072c06de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f072c0b41e0 0x7f072c06de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 -- 172.21.15.47:0/3352220091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072c15f860 con 0x7f072c15d2f0 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f072be00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f072c0b41e0 0x7f072c06de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0730c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c15d2f0 0x7f072c06ea50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0724007dc0 tx=0x7f072400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072401a070 con 0x7f072c15d2f0 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07240039a0 con 0x7f072c15d2f0 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724003d90 con 0x7f072c15d2f0 2024-04-26T23:50:52.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072c15fb40 con 0x7f072c15d2f0 2024-04-26T23:50:52.706 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072c160100 con 0x7f072c15d2f0 2024-04-26T23:50:52.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f072c0695f0 con 0x7f072c15d2f0 2024-04-26T23:50:52.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.696+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f072401d070 con 0x7f072c15d2f0 2024-04-26T23:50:52.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0728c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0708068650 0x7f070806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f0724086eb0 con 0x7f072c15d2f0 2024-04-26T23:50:52.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0728c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f070806e510 0x7f0708070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 --> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0708070fe0 con 0x7f070806e510 2024-04-26T23:50:52.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f0724089470 con 0x7f072c15d2f0 2024-04-26T23:50:52.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f072be00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0708068650 0x7f070806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0723e00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f070806e510 0x7f0708070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0723e00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f070806e510 0x7f0708070930 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f072be00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0708068650 0x7f070806ab10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f071c0ae000 tx=0x7f071c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.700+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== osd.7 v2:172.21.15.203:6816/3653597910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0708070fe0 con 0x7f070806e510 2024-04-26T23:50:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.712+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 --> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f072c160c10 con 0x7f070806e510 2024-04-26T23:50:52.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0728c00640 1 -- 172.21.15.47:0/3352220091 <== osd.7 v2:172.21.15.203:6816/3653597910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f072c160c10 con 0x7f070806e510 2024-04-26T23:50:52.722 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-04-26T23:50:52.722 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T23:50:52.722 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-04-26T23:50:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f070806e510 msgr2=0x7f0708070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6816/3653597910,v1:172.21.15.203:6818/3653597910] conn(0x7f070806e510 0x7f0708070930 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0708068650 msgr2=0x7f070806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f0708068650 0x7f070806ab10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f071c0ae000 tx=0x7f071c008040 comp rx=0 tx=0).stop 2024-04-26T23:50:52.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c15d2f0 msgr2=0x7f072c06ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 --2- 172.21.15.47:0/3352220091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f072c15d2f0 0x7f072c06ea50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0724007dc0 tx=0x7f072400d4a0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0730c00640 1 -- 172.21.15.47:0/3352220091 reap_dead start 2024-04-26T23:50:52.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 shutdown_connections 2024-04-26T23:50:52.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 >> 172.21.15.47:0/3352220091 conn(0x7f072c0d0c90 msgr2=0x7f072c0d1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:52.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 shutdown_connections 2024-04-26T23:50:52.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.716+0000 7f0732c00640 1 -- 172.21.15.47:0/3352220091 wait complete. 2024-04-26T23:50:52.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T23:50:52.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472a00640 1 Processor -- start 2024-04-26T23:50:52.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472a00640 1 -- start start 2024-04-26T23:50:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c15c470 0x7f246c0d0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472a00640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f246c15cf60 0x7f246c165a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472a00640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f246c0b4490 con 0x7f246c0b0af0 2024-04-26T23:50:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472a00640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f246c073400 con 0x7f246c15cf60 2024-04-26T23:50:52.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f246c0736e0 con 0x7f246c15c470 2024-04-26T23:50:52.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2470c00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f246c0b0af0 0x7f246c15c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:40512/0 (socket says 172.21.15.47:40512) 2024-04-26T23:50:52.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2470c00640 1 -- 172.21.15.47:0/1456613540 learned_addr learned my addr 172.21.15.47:0/1456613540 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:52.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472000640 1 --2- 172.21.15.47:0/1456613540 >> v2:172.21.15.203:3300/0 conn(0x7f246c15cf60 0x7f246c165a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2471600640 1 --2- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c15c470 0x7f246c0d0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f246be00640 1 -- 172.21.15.47:0/1456613540 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106589151 0 0) 0x7f246c0b4490 con 0x7f246c0b0af0 2024-04-26T23:50:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f246be00640 1 -- 172.21.15.47:0/1456613540 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2454003530 con 0x7f246c0b0af0 2024-04-26T23:50:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472000640 1 -- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c15c470 msgr2=0x7f246c0d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472000640 1 --2- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c15c470 0x7f246c0d0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472000640 1 -- 172.21.15.47:0/1456613540 >> v1:172.21.15.47:6789/0 conn(0x7f246c0b0af0 legacy=0x7f246c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2472000640 1 -- 172.21.15.47:0/1456613540 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246c06e850 con 0x7f246c15cf60 2024-04-26T23:50:52.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.876+0000 7f2471600640 1 --2- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c15c470 0x7f246c0d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472000640 1 --2- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15cf60 0x7f246c165a70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f246400bfa0 tx=0x7f246401eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5d5135f38a878b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f246be00640 1 -- 172.21.15.47:0/1456613540 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246400b2d0 con 0x7f246c15cf60 2024-04-26T23:50:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f246be00640 1 -- 172.21.15.47:0/1456613540 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640a7830 con 0x7f246c15cf60 2024-04-26T23:50:52.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f246be00640 1 -- 172.21.15.47:0/1456613540 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24640a7c00 con 0x7f246c15cf60 2024-04-26T23:50:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 -- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15cf60 msgr2=0x7f246c165a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 --2- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15cf60 0x7f246c165a70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f246400bfa0 tx=0x7f246401eb70 comp rx=0 tx=0).stop 2024-04-26T23:50:52.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 -- 172.21.15.47:0/1456613540 shutdown_connections 2024-04-26T23:50:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 --2- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15cf60 0x7f246c165a70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 --2- 172.21.15.47:0/1456613540 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c15c470 0x7f246c0d0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 -- 172.21.15.47:0/1456613540 >> 172.21.15.47:0/1456613540 conn(0x7f246c0d13e0 msgr2=0x7f246c0d17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 -- 172.21.15.47:0/1456613540 shutdown_connections 2024-04-26T23:50:52.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.880+0000 7f2472a00640 1 -- 172.21.15.47:0/1456613540 wait complete. 2024-04-26T23:50:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 Processor -- start 2024-04-26T23:50:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 -- start start 2024-04-26T23:50:52.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c0b0af0 0x7f246c13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15c470 0x7f246c0b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246c15cf60 0x7f246c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f246c0d0750 con 0x7f246c15cf60 2024-04-26T23:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f246c0d05d0 con 0x7f246c15c470 2024-04-26T23:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f246c06cc10 con 0x7f246c0b0af0 2024-04-26T23:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246c15cf60 0x7f246c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246c15cf60 0x7f246c0b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57118/0 (socket says 172.21.15.47:57118) 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 -- 172.21.15.47:0/1346200404 learned_addr learned my addr 172.21.15.47:0/1346200404 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2471600640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c0b0af0 0x7f246c13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2470c00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15c470 0x7f246c0b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 -- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c0b0af0 msgr2=0x7f246c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c0b0af0 0x7f246c13fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 -- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15c470 msgr2=0x7f246c0b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15c470 0x7f246c0b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:52.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 -- 172.21.15.47:0/1346200404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246c153480 con 0x7f246c15cf60 2024-04-26T23:50:52.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2470c00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15c470 0x7f246c0b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:52.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472000640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246c15cf60 0x7f246c0b2ac0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f24640b1040 tx=0x7f246401b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2469600640 1 -- 172.21.15.47:0/1346200404 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464009540 con 0x7f246c15cf60 2024-04-26T23:50:52.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2469600640 1 -- 172.21.15.47:0/1346200404 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24640be070 con 0x7f246c15cf60 2024-04-26T23:50:52.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2469600640 1 -- 172.21.15.47:0/1346200404 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464009940 con 0x7f246c15cf60 2024-04-26T23:50:52.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246c1402e0 con 0x7f246c15cf60 2024-04-26T23:50:52.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.884+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f246c15b860 con 0x7f246c15cf60 2024-04-26T23:50:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.888+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f246c069b80 con 0x7f246c15cf60 2024-04-26T23:50:52.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.888+0000 7f2469600640 1 -- 172.21.15.47:0/1346200404 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f24640b6070 con 0x7f246c15cf60 2024-04-26T23:50:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.888+0000 7f2469600640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f244c068650 0x7f244c06ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.888+0000 7f2469600640 1 -- 172.21.15.47:0/1346200404 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f2464121790 con 0x7f246c15cf60 2024-04-26T23:50:52.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.888+0000 7f2471600640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f244c068650 0x7f244c06ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.888+0000 7f2471600640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f244c068650 0x7f244c06ab10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f246c15ce80 tx=0x7f2460009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:52.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:52.892+0000 7f2469600640 1 -- 172.21.15.47:0/1346200404 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f2464018760 con 0x7f246c15cf60 2024-04-26T23:50:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.056+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f246c0d0c00 con 0x7f244c068650 2024-04-26T23:50:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2469600640 1 -- 172.21.15.47:0/1346200404 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f246c0d0c00 con 0x7f244c068650 2024-04-26T23:50:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T23:50:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f244c068650 msgr2=0x7f244c06ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f244c068650 0x7f244c06ab10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f246c15ce80 tx=0x7f2460009190 comp rx=0 tx=0).stop 2024-04-26T23:50:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246c15cf60 msgr2=0x7f246c0b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246c15cf60 0x7f246c0b2ac0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f24640b1040 tx=0x7f246401b910 comp rx=0 tx=0).stop 2024-04-26T23:50:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 shutdown_connections 2024-04-26T23:50:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f244c068650 0x7f244c06ab10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f246c15cf60 0x7f246c0b2ac0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f246c15c470 0x7f246c0b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 --2- 172.21.15.47:0/1346200404 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f246c0b0af0 0x7f246c13fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 >> 172.21.15.47:0/1346200404 conn(0x7f246c0d13e0 msgr2=0x7f246c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 shutdown_connections 2024-04-26T23:50:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.060+0000 7f2472a00640 1 -- 172.21.15.47:0/1346200404 wait complete. 2024-04-26T23:50:53.086 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:50:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.220+0000 7f4157200640 1 Processor -- start 2024-04-26T23:50:53.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.220+0000 7f4157200640 1 -- start start 2024-04-26T23:50:53.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4157200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f415815d1c0 0x7f41580d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:53.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4157200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f41580711f0 0x7f41580d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:53.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4157200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4158071770 con 0x7f415815cde0 2024-04-26T23:50:53.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4157200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f41580afa50 con 0x7f41580711f0 2024-04-26T23:50:53.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4157200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f4158071a50 con 0x7f415815d1c0 2024-04-26T23:50:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4155400640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f415815d1c0 0x7f41580d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4155e00640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f415815cde0 0x7f41580d3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:52022/0 (socket says 172.21.15.47:52022) 2024-04-26T23:50:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4156800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f41580711f0 0x7f41580d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4155e00640 1 -- 172.21.15.47:0/2724510968 learned_addr learned my addr 172.21.15.47:0/2724510968 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:50:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4156800640 1 -- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f415815d1c0 msgr2=0x7f41580d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:50:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4156800640 1 --2- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f415815d1c0 0x7f41580d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4156800640 1 -- 172.21.15.47:0/2724510968 >> v1:172.21.15.203:6789/0 conn(0x7f415815cde0 legacy=0x7f41580d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4156800640 1 -- 172.21.15.47:0/2724510968 --> v2:172.21.15.203:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158071d30 con 0x7f41580711f0 2024-04-26T23:50:53.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4155400640 1 --2- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f415815d1c0 0x7f41580d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:50:53.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.224+0000 7f4154a00640 1 -- 172.21.15.47:0/2724510968 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126836242 0 0) 0x7f4158071770 con 0x7f415815cde0 2024-04-26T23:50:53.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4156800640 1 --2- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41580711f0 0x7f41580d1690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4150009d90 tx=0x7f415001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eb9e366011a553f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:53.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4154a00640 1 -- 172.21.15.47:0/2724510968 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41500b4070 con 0x7f41580711f0 2024-04-26T23:50:53.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4154a00640 1 -- 172.21.15.47:0/2724510968 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41500af600 con 0x7f41580711f0 2024-04-26T23:50:53.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4154a00640 1 -- 172.21.15.47:0/2724510968 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41500af9d0 con 0x7f41580711f0 2024-04-26T23:50:53.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 -- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41580711f0 msgr2=0x7f41580d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 --2- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41580711f0 0x7f41580d1690 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4150009d90 tx=0x7f415001f150 comp rx=0 tx=0).stop 2024-04-26T23:50:53.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 -- 172.21.15.47:0/2724510968 shutdown_connections 2024-04-26T23:50:53.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 --2- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f41580711f0 0x7f41580d1690 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 --2- 172.21.15.47:0/2724510968 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f415815d1c0 0x7f41580d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 -- 172.21.15.47:0/2724510968 >> 172.21.15.47:0/2724510968 conn(0x7f415809ba60 msgr2=0x7f415809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:53.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 -- 172.21.15.47:0/2724510968 shutdown_connections 2024-04-26T23:50:53.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 -- 172.21.15.47:0/2724510968 wait complete. 2024-04-26T23:50:53.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 Processor -- start 2024-04-26T23:50:53.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.228+0000 7f4157200640 1 -- start start 2024-04-26T23:50:53.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41580711f0 0x7f4158152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:53.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f415815cde0 0x7f415815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:53.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f415815d1c0 0x7f415815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:53.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f41580b0060 con 0x7f415815d1c0 2024-04-26T23:50:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41580afee0 con 0x7f415815cde0 2024-04-26T23:50:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f41580b01e0 con 0x7f41580711f0 2024-04-26T23:50:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f415815d1c0 0x7f415815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f415815d1c0 0x7f415815ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:57130/0 (socket says 172.21.15.47:57130) 2024-04-26T23:50:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 -- 172.21.15.47:0/1620704380 learned_addr learned my addr 172.21.15.47:0/1620704380 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:50:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4155400640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f415815cde0 0x7f415815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:53.240 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4155e00640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41580711f0 0x7f4158152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 -- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41580711f0 msgr2=0x7f4158152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41580711f0 0x7f4158152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 -- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f415815cde0 msgr2=0x7f415815fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f415815cde0 0x7f415815fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 -- 172.21.15.47:0/1620704380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41580b7030 con 0x7f415815d1c0 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4155400640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f415815cde0 0x7f415815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4156800640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f415815d1c0 0x7f415815ac90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f41500b2040 tx=0x7f415001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:53.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f414e000640 1 -- 172.21.15.47:0/1620704380 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41500b4040 con 0x7f415815d1c0 2024-04-26T23:50:53.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f414e000640 1 -- 172.21.15.47:0/1620704380 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41500c1070 con 0x7f415815d1c0 2024-04-26T23:50:53.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f414e000640 1 -- 172.21.15.47:0/1620704380 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150009450 con 0x7f415815d1c0 2024-04-26T23:50:53.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f415815eb50 con 0x7f415815d1c0 2024-04-26T23:50:53.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f415815f580 con 0x7f415815d1c0 2024-04-26T23:50:53.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4158069470 con 0x7f415815d1c0 2024-04-26T23:50:53.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.232+0000 7f414e000640 1 -- 172.21.15.47:0/1620704380 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f41500ba6b0 con 0x7f415815d1c0 2024-04-26T23:50:53.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.236+0000 7f414e000640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4138068650 0x7f413806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:50:53.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.236+0000 7f414e000640 1 -- 172.21.15.47:0/1620704380 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f4150125550 con 0x7f415815d1c0 2024-04-26T23:50:53.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.236+0000 7f4155e00640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4138068650 0x7f413806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:50:53.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.236+0000 7f4155e00640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4138068650 0x7f413806ab10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4148000f70 tx=0x7f4148007b60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:50:53.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.240+0000 7f414e000640 1 -- 172.21.15.47:0/1620704380 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f41580b7030 con 0x7f415815d1c0 2024-04-26T23:50:53.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41580701e0 con 0x7f4138068650 2024-04-26T23:50:53.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f414e000640 1 -- 172.21.15.47:0/1620704380 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13428 (secure 0 0 0) 0x7f41580701e0 con 0x7f4138068650 2024-04-26T23:50:53.407 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:50:53.407 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:50:53.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4138068650 msgr2=0x7f413806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4138068650 0x7f413806ab10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4148000f70 tx=0x7f4148007b60 comp rx=0 tx=0).stop 2024-04-26T23:50:53.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f415815d1c0 msgr2=0x7f415815ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:50:53.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f415815d1c0 0x7f415815ac90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f41500b2040 tx=0x7f415001bef0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 shutdown_connections 2024-04-26T23:50:53.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f4138068650 0x7f413806ab10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f415815d1c0 0x7f415815ac90 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f415815cde0 0x7f415815fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 --2- 172.21.15.47:0/1620704380 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f41580711f0 0x7f4158152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:50:53.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 >> 172.21.15.47:0/1620704380 conn(0x7f415809ba60 msgr2=0x7f41580d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:50:53.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 shutdown_connections 2024-04-26T23:50:53.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:50:53.400+0000 7f4157200640 1 -- 172.21.15.47:0/1620704380 wait complete. 2024-04-26T23:50:53.428 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-04-26T23:50:52.233270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238984,"kb_used_data":6152,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735736,"statfs":{"total":773094113280,"available":772849393664,"internally_reserved":0,"allocated":6299648,"data_stored":3277912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.040155"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":228,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T23:50:44.197245+0000","last_change":"2024-04-26T23:45:22.119237+0000","last_active":"2024-04-26T23:50:44.197245+0000","last_peered":"2024-04-26T23:50:44.197245+0000","last_clean":"2024-04-26T23:50:44.197245+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:50:44.197245+0000","last_undegraded":"2024-04-26T23:50:44.197245+0000","last_fullsized":"2024-04-26T23:50:44.197245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T23:45:20.611644+0000","last_clean_scrub_stamp":"2024-04-26T23:45:20.611644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:14.899006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1232896,"data_stored":852515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542214,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1232896,"data_stored":852515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:50:53.430 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T23:45:20.611644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=45, tm_sec=20, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=23, tm_min=50, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T23:50:53.431 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T23:51:02.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:02.827 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:13.432 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T23:51:13.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.580+0000 7fafda800640 1 Processor -- start 2024-04-26T23:51:13.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafda800640 1 -- start start 2024-04-26T23:51:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafda800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fafd415d5b0 0x7fafd415da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafda800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd415e050 con 0x7fafd40cdc00 2024-04-26T23:51:13.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafda800640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd415e330 con 0x7fafd40b4360 2024-04-26T23:51:13.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafda800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fafd40ceda0 con 0x7fafd415d5b0 2024-04-26T23:51:13.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fafd40cdc00 0x7fafd415e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38450/0 (socket says 172.21.15.47:38450) 2024-04-26T23:51:13.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 -- 172.21.15.47:0/2116311475 learned_addr learned my addr 172.21.15.47:0/2116311475 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:51:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafcaa00640 1 --2- 172.21.15.47:0/2116311475 >> v2:172.21.15.203:3300/0 conn(0x7fafd415d5b0 0x7fafd415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949994464 0 0) 0x7fafd415e050 con 0x7fafd40cdc00 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafb8003530 con 0x7fafd40cdc00 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1147413017 0 0) 0x7fafb8003530 con 0x7fafd40cdc00 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 >> v2:172.21.15.203:3300/0 conn(0x7fafd415d5b0 msgr2=0x7fafd415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 --2- 172.21.15.47:0/2116311475 >> v2:172.21.15.203:3300/0 conn(0x7fafd415d5b0 0x7fafd415da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 >> v1:172.21.15.203:6789/0 conn(0x7fafd40b4360 legacy=0x7fafd40cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd40cf080 con 0x7fafd40cdc00 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1184106282 0 0) 0x7fafcc001a00 con 0x7fafd40cdc00 2024-04-26T23:51:13.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 >> v1:172.21.15.47:6789/0 conn(0x7fafd40cdc00 legacy=0x7fafd415e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb80039c0 0x7fafb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb8004810 0x7fafb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb80051d0 0x7fafb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40ceda0 con 0x7fafb80051d0 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fafb800c070 con 0x7fafb8004810 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fafb800c270 con 0x7fafb80039c0 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb80051d0 0x7fafb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3400640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb80039c0 0x7fafb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafcaa00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb8004810 0x7fafb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 -- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb80039c0 msgr2=0x7fafb8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:51:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafb80039c0 0x7fafb8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 -- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb8004810 msgr2=0x7fafb8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:51:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb8004810 0x7fafb8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.584+0000 7fafd3e00640 1 -- 172.21.15.47:0/2116311475 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb8003530 con 0x7fafb80051d0 2024-04-26T23:51:13.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafd3e00640 1 -- 172.21.15.47:0/2116311475 reap_dead start 2024-04-26T23:51:13.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafd3e00640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb80051d0 0x7fafb800b9d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00a840 tx=0x7fafcc01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeda414a3a838487 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:13.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc00a460 con 0x7fafb80051d0 2024-04-26T23:51:13.593 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc0ac640 con 0x7fafb80051d0 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafd2a00640 1 -- 172.21.15.47:0/2116311475 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0aca30 con 0x7fafb80051d0 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafda800640 1 -- 172.21.15.47:0/2116311475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb80051d0 msgr2=0x7fafb800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafda800640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb80051d0 0x7fafb800b9d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafcc00a840 tx=0x7fafcc01d360 comp rx=0 tx=0).stop 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafda800640 1 -- 172.21.15.47:0/2116311475 shutdown_connections 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafda800640 1 --2- 172.21.15.47:0/2116311475 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafb80051d0 0x7fafb800b9d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafda800640 1 -- 172.21.15.47:0/2116311475 >> 172.21.15.47:0/2116311475 conn(0x7fafd406c800 msgr2=0x7fafd406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafda800640 1 -- 172.21.15.47:0/2116311475 shutdown_connections 2024-04-26T23:51:13.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.588+0000 7fafda800640 1 -- 172.21.15.47:0/2116311475 wait complete. 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 Processor -- start 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 -- start start 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb80051d0 0x7fafd40c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafd414da20 0x7fafd406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafd406f8c0 0x7fafd40c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40b60f0 con 0x7fafd406f8c0 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40b5f70 con 0x7fafb80051d0 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fafd415da40 con 0x7fafd414da20 2024-04-26T23:51:13.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafd406f8c0 0x7fafd40c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafd406f8c0 0x7fafd40c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45092/0 (socket says 172.21.15.47:45092) 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 -- 172.21.15.47:0/3528710241 learned_addr learned my addr 172.21.15.47:0/3528710241 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3400640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb80051d0 0x7fafd40c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafcaa00640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafd414da20 0x7fafd406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 -- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafd414da20 msgr2=0x7fafd406f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafd414da20 0x7fafd406f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 -- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb80051d0 msgr2=0x7fafd40c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb80051d0 0x7fafd40c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 -- 172.21.15.47:0/3528710241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd414dea0 con 0x7fafd406f8c0 2024-04-26T23:51:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafd3e00640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafd406f8c0 0x7fafd40c77b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafcc01d190 tx=0x7fafb8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafcbe00640 1 -- 172.21.15.47:0/3528710241 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc001fc0 con 0x7fafd406f8c0 2024-04-26T23:51:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafcbe00640 1 -- 172.21.15.47:0/3528710241 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafcc0019c0 con 0x7fafd406f8c0 2024-04-26T23:51:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafcbe00640 1 -- 172.21.15.47:0/3528710241 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc0ac9f0 con 0x7fafd406f8c0 2024-04-26T23:51:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd40c5ea0 con 0x7fafd406f8c0 2024-04-26T23:51:13.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.592+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd40c6460 con 0x7fafd406f8c0 2024-04-26T23:51:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.596+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd4069700 con 0x7fafd406f8c0 2024-04-26T23:51:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.596+0000 7fafcbe00640 1 -- 172.21.15.47:0/3528710241 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fafcc0acb90 con 0x7fafd406f8c0 2024-04-26T23:51:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.596+0000 7fafcbe00640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fafb0068650 0x7fafb006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.596+0000 7fafcbe00640 1 -- 172.21.15.47:0/3528710241 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fafcc120de0 con 0x7fafd406f8c0 2024-04-26T23:51:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.596+0000 7fafd3400640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fafb0068650 0x7fafb006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.596+0000 7fafd3400640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fafb0068650 0x7fafb006ab10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001100 tx=0x7fafc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:13.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.600+0000 7fafcbe00640 1 -- 172.21.15.47:0/3528710241 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fafd414dea0 con 0x7fafd406f8c0 2024-04-26T23:51:13.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.760+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 --> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafd40ccd90 con 0x7fafb0068650 2024-04-26T23:51:13.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafcbe00640 1 -- 172.21.15.47:0/3528710241 <== mgr.4099 v2:172.21.15.203:6832/2140288453 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7fafd40ccd90 con 0x7fafb0068650 2024-04-26T23:51:13.765 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:51:13.766 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-04-26T23:51:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fafb0068650 msgr2=0x7fafb006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fafb0068650 0x7fafb006ab10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fafc4001100 tx=0x7fafc4009040 comp rx=0 tx=0).stop 2024-04-26T23:51:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafd406f8c0 msgr2=0x7fafd40c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafd406f8c0 0x7fafd40c77b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafcc01d190 tx=0x7fafb8005840 comp rx=0 tx=0).stop 2024-04-26T23:51:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 shutdown_connections 2024-04-26T23:51:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fafb0068650 0x7fafb006ab10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fafd406f8c0 0x7fafd40c77b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fafd414da20 0x7fafd406f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 --2- 172.21.15.47:0/3528710241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fafb80051d0 0x7fafd40c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 >> 172.21.15.47:0/3528710241 conn(0x7fafd406c800 msgr2=0x7fafd40b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:51:13.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 shutdown_connections 2024-04-26T23:51:13.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.764+0000 7fafda800640 1 -- 172.21.15.47:0/3528710241 wait complete. 2024-04-26T23:51:13.788 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-04-26T23:51:12.237640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238968,"kb_used_data":6152,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735752,"statfs":{"total":773094113280,"available":772849410048,"internally_reserved":0,"allocated":6299648,"data_stored":3277912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002892"},"pg_stats":[{"pgid":"1.0","version":"54'119","reported_seq":239,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-04-26T23:50:53.474461+0000","last_change":"2024-04-26T23:50:53.474498+0000","last_active":"2024-04-26T23:50:53.474461+0000","last_peered":"2024-04-26T23:50:53.474461+0000","last_clean":"2024-04-26T23:50:53.474461+0000","last_became_active":"2024-04-26T23:45:22.115692+0000","last_became_peered":"2024-04-26T23:45:22.115692+0000","last_unstale":"2024-04-26T23:50:53.474461+0000","last_undegraded":"2024-04-26T23:50:53.474461+0000","last_fullsized":"2024-04-26T23:50:53.474461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"54'119","last_scrub_stamp":"2024-04-26T23:50:53.474367+0000","last_deep_scrub":"54'119","last_deep_scrub_stamp":"2024-04-26T23:50:53.474367+0000","last_clean_scrub_stamp":"2024-04-26T23:50:53.474367+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T07:43:49.952128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509513,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1232896,"data_stored":852515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509513,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509513,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27648,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509513,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509512,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31808,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":638976,"data_stored":262147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542218,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1232896,"data_stored":852515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T23:51:13.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T23:51:13.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea57800640 1 Processor -- start 2024-04-26T23:51:13.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea57800640 1 -- start start 2024-04-26T23:51:13.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea57800640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea50162970 0x7fea500700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea57800640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7fea5006ea90 0x7fea500729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea57800640 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea5006f000 con 0x7fea500b55a0 2024-04-26T23:51:13.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea57800640 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 -- 0x7fea5006f2e0 con 0x7fea50162970 2024-04-26T23:51:13.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea57800640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7fea5006f5c0 con 0x7fea5006ea90 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea54e00640 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fea50162970 0x7fea500700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea55800640 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fea500b55a0 0x7fea500cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:38452/0 (socket says 172.21.15.47:38452) 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea55800640 1 -- 172.21.15.47:0/1171465041 learned_addr learned my addr 172.21.15.47:0/1171465041 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea4fe00640 1 --2- 172.21.15.47:0/1171465041 >> v2:172.21.15.203:3300/0 conn(0x7fea5006ea90 0x7fea500729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea54e00640 1 -- 172.21.15.47:0/1171465041 >> v2:172.21.15.203:3300/0 conn(0x7fea5006ea90 msgr2=0x7fea500729a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea54e00640 1 --2- 172.21.15.47:0/1171465041 >> v2:172.21.15.203:3300/0 conn(0x7fea5006ea90 0x7fea500729a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea54e00640 1 -- 172.21.15.47:0/1171465041 >> v1:172.21.15.47:6789/0 conn(0x7fea500b55a0 legacy=0x7fea500cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea4f400640 1 -- 172.21.15.47:0/1171465041 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419243144 0 0) 0x7fea5006f000 con 0x7fea500b55a0 2024-04-26T23:51:13.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.928+0000 7fea54e00640 1 -- 172.21.15.47:0/1171465041 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5006f8a0 con 0x7fea50162970 2024-04-26T23:51:13.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea54e00640 1 --2- 172.21.15.47:0/1171465041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50162970 0x7fea500700a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fea50071410 tx=0x7fea4401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb1613ea60c78fe server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea4f400640 1 -- 172.21.15.47:0/1171465041 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea440b2070 con 0x7fea50162970 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea4f400640 1 -- 172.21.15.47:0/1171465041 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea440a9070 con 0x7fea50162970 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea4f400640 1 -- 172.21.15.47:0/1171465041 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea440ad880 con 0x7fea50162970 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 -- 172.21.15.47:0/1171465041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50162970 msgr2=0x7fea500700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 --2- 172.21.15.47:0/1171465041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50162970 0x7fea500700a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fea50071410 tx=0x7fea4401c450 comp rx=0 tx=0).stop 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 -- 172.21.15.47:0/1171465041 shutdown_connections 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 --2- 172.21.15.47:0/1171465041 >> v2:172.21.15.203:3300/0 conn(0x7fea5006ea90 0x7fea500729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 --2- 172.21.15.47:0/1171465041 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea50162970 0x7fea500700a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 -- 172.21.15.47:0/1171465041 >> 172.21.15.47:0/1171465041 conn(0x7fea50070c00 msgr2=0x7fea5006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:51:13.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 -- 172.21.15.47:0/1171465041 shutdown_connections 2024-04-26T23:51:13.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 -- 172.21.15.47:0/1171465041 wait complete. 2024-04-26T23:51:13.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 Processor -- start 2024-04-26T23:51:13.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.932+0000 7fea57800640 1 -- start start 2024-04-26T23:51:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea5006ea90 0x7fea50165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea500b55a0 0x7fea50165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea50162970 0x7fea50156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7fea500cc080 con 0x7fea500b55a0 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea500b4840 con 0x7fea5006ea90 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7fea50157f10 con 0x7fea50162970 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea500b55a0 0x7fea50165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea500b55a0 0x7fea50165aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45112/0 (socket says 172.21.15.47:45112) 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 -- 172.21.15.47:0/4224092185 learned_addr learned my addr 172.21.15.47:0/4224092185 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea54e00640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea5006ea90 0x7fea50165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea55800640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea50162970 0x7fea50156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 -- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea50162970 msgr2=0x7fea50156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea50162970 0x7fea50156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 -- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea5006ea90 msgr2=0x7fea50165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:13.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea5006ea90 0x7fea50165560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:13.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 -- 172.21.15.47:0/4224092185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea50164720 con 0x7fea500b55a0 2024-04-26T23:51:13.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4fe00640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea500b55a0 0x7fea50165aa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00e9b0 tx=0x7fea3c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:13.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c017070 con 0x7fea500b55a0 2024-04-26T23:51:13.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3c00c9a0 con 0x7fea500b55a0 2024-04-26T23:51:13.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00cd70 con 0x7fea500b55a0 2024-04-26T23:51:13.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea50163ba0 con 0x7fea500b55a0 2024-04-26T23:51:13.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea50164440 con 0x7fea500b55a0 2024-04-26T23:51:13.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.936+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea5006d390 con 0x7fea500b55a0 2024-04-26T23:51:13.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.940+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7fea3c01a070 con 0x7fea500b55a0 2024-04-26T23:51:13.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.940+0000 7fea4cc00640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068650 0x7fea3006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:13.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.940+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7fea3c086ad0 con 0x7fea500b55a0 2024-04-26T23:51:13.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.940+0000 7fea54e00640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068650 0x7fea3006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:13.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.940+0000 7fea54e00640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068650 0x7fea3006ab10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fea440af000 tx=0x7fea440a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:13.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:13.944+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7fea3c0569b0 con 0x7fea500b55a0 2024-04-26T23:51:14.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.112+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fea5015f020 con 0x7fea500b55a0 2024-04-26T23:51:14.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7fea5015f020 con 0x7fea500b55a0 2024-04-26T23:51:14.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea4cc00640 1 -- 172.21.15.47:0/4224092185 <== mon.0 v2:172.21.15.47:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea3c08c080 con 0x7fea500b55a0 2024-04-26T23:51:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068650 msgr2=0x7fea3006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068650 0x7fea3006ab10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fea440af000 tx=0x7fea440a7000 comp rx=0 tx=0).stop 2024-04-26T23:51:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea500b55a0 msgr2=0x7fea50165aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea500b55a0 0x7fea50165aa0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00e9b0 tx=0x7fea3c00ee70 comp rx=0 tx=0).stop 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 shutdown_connections 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7fea30068650 0x7fea3006ab10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7fea50162970 0x7fea50156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fea500b55a0 0x7fea50165aa0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 --2- 172.21.15.47:0/4224092185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea5006ea90 0x7fea50165560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 >> 172.21.15.47:0/4224092185 conn(0x7fea50070c00 msgr2=0x7fea500d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 shutdown_connections 2024-04-26T23:51:14.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.116+0000 7fea57800640 1 -- 172.21.15.47:0/4224092185 wait complete. 2024-04-26T23:51:14.140 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T23:51:14.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T23:51:14.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f8d200640 1 Processor -- start 2024-04-26T23:51:14.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f8d200640 1 -- start start 2024-04-26T23:51:14.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f8d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:14.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f8d200640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6f8815d5b0 0x7f6f8815da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:14.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f8d200640 1 -- --> v1:172.21.15.203:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8815e050 con 0x7f6f880cdc00 2024-04-26T23:51:14.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f8d200640 1 -- --> v2:172.21.15.203:3300/0 -- mon_getmap magic: 0 -- 0x7f6f8815e330 con 0x7f6f8815d5b0 2024-04-26T23:51:14.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f8d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f880ceda0 con 0x7f6f880b4360 2024-04-26T23:51:14.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f85e00640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f7d400640 1 --2- >> v2:172.21.15.203:3300/0 conn(0x7f6f8815d5b0 0x7f6f8815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f86800640 1 --1- >> v1:172.21.15.203:6789/0 conn(0x7f6f880cdc00 0x7f6f8815e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.203:6789/0 says I am v1:172.21.15.47:60878/0 (socket says 172.21.15.47:60878) 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f86800640 1 -- 172.21.15.47:0/2806141033 learned_addr learned my addr 172.21.15.47:0/2806141033 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f85400640 1 -- 172.21.15.47:0/2806141033 <== mon.1 v1:172.21.15.203:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637729008 0 0) 0x7f6f8815e050 con 0x7f6f880cdc00 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f85400640 1 -- 172.21.15.47:0/2806141033 --> v1:172.21.15.203:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f6c003530 con 0x7f6f880cdc00 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f85e00640 1 -- 172.21.15.47:0/2806141033 >> v2:172.21.15.203:3300/0 conn(0x7f6f8815d5b0 msgr2=0x7f6f8815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f85e00640 1 --2- 172.21.15.47:0/2806141033 >> v2:172.21.15.203:3300/0 conn(0x7f6f8815d5b0 0x7f6f8815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f85e00640 1 -- 172.21.15.47:0/2806141033 >> v1:172.21.15.203:6789/0 conn(0x7f6f880cdc00 legacy=0x7f6f8815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f85e00640 1 -- 172.21.15.47:0/2806141033 --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f880cf080 con 0x7f6f880b4360 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.280+0000 7f6f7d400640 1 --2- 172.21.15.47:0/2806141033 >> v2:172.21.15.203:3300/0 conn(0x7f6f8815d5b0 0x7f6f8815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f85e00640 1 --2- 172.21.15.47:0/2806141033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880cf5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f780097c0 tx=0x7f6f7801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca7a4b491be37e48 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f85400640 1 -- 172.21.15.47:0/2806141033 <== mon.2 v2:172.21.15.203:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780b0070 con 0x7f6f880b4360 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f85400640 1 -- 172.21.15.47:0/2806141033 <== mon.2 v2:172.21.15.203:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f780ab600 con 0x7f6f880b4360 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f85400640 1 -- 172.21.15.47:0/2806141033 <== mon.2 v2:172.21.15.203:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780ab9b0 con 0x7f6f880b4360 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 -- 172.21.15.47:0/2806141033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 msgr2=0x7f6f880cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 --2- 172.21.15.47:0/2806141033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880cf5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f780097c0 tx=0x7f6f7801c4a0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 -- 172.21.15.47:0/2806141033 shutdown_connections 2024-04-26T23:51:14.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 --2- 172.21.15.47:0/2806141033 >> v2:172.21.15.203:3300/0 conn(0x7f6f8815d5b0 0x7f6f8815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 --2- 172.21.15.47:0/2806141033 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880cf5a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 -- 172.21.15.47:0/2806141033 >> 172.21.15.47:0/2806141033 conn(0x7f6f8806c800 msgr2=0x7f6f8806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:51:14.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 -- 172.21.15.47:0/2806141033 shutdown_connections 2024-04-26T23:51:14.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.284+0000 7f6f8d200640 1 -- 172.21.15.47:0/2806141033 wait complete. 2024-04-26T23:51:14.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 Processor -- start 2024-04-26T23:51:14.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 -- start start 2024-04-26T23:51:14.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 --2- >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f880cdc00 0x7f6f881435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f8815d5b0 0x7f6f88155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 -- 0x7f6f880ce570 con 0x7f6f880cdc00 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6f880ce3f0 con 0x7f6f8815d5b0 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 -- --> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8816a750 con 0x7f6f880b4360 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f880cdc00 0x7f6f881435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f880cdc00 0x7f6f881435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45116/0 (socket says 172.21.15.47:45116) 2024-04-26T23:51:14.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 -- 172.21.15.47:0/210136433 learned_addr learned my addr 172.21.15.47:0/210136433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f85e00640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f86800640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f8815d5b0 0x7f6f88155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 -- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 msgr2=0x7f6f880c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 -- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f8815d5b0 msgr2=0x7f6f88155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f8815d5b0 0x7f6f88155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 -- 172.21.15.47:0/210136433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f88143b30 con 0x7f6f880cdc00 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7d400640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f880cdc00 0x7f6f881435f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000ebe0 tx=0x7f6f7000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:14.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7ea00640 1 -- 172.21.15.47:0/210136433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7000cc30 con 0x7f6f880cdc00 2024-04-26T23:51:14.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7ea00640 1 -- 172.21.15.47:0/210136433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f7000cdd0 con 0x7f6f880cdc00 2024-04-26T23:51:14.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f7ea00640 1 -- 172.21.15.47:0/210136433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70005be0 con 0x7f6f880cdc00 2024-04-26T23:51:14.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f880b2c60 con 0x7f6f880cdc00 2024-04-26T23:51:14.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.288+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f880b3220 con 0x7f6f880cdc00 2024-04-26T23:51:14.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.292+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f88069700 con 0x7f6f880cdc00 2024-04-26T23:51:14.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.292+0000 7f6f7ea00640 1 -- 172.21.15.47:0/210136433 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 8) ==== 88242+0+0 (secure 0 0 0) 0x7f6f70006030 con 0x7f6f880cdc00 2024-04-26T23:51:14.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.292+0000 7f6f7ea00640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f64068650 0x7f6f6406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T23:51:14.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.292+0000 7f6f7ea00640 1 -- 172.21.15.47:0/210136433 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4943+0+0 (secure 0 0 0) 0x7f6f70087000 con 0x7f6f880cdc00 2024-04-26T23:51:14.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.292+0000 7f6f85e00640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f64068650 0x7f6f6406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T23:51:14.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.292+0000 7f6f85e00640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f64068650 0x7f6f6406ab10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f780ad000 tx=0x7f6f780a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T23:51:14.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.296+0000 7f6f7ea00640 1 -- 172.21.15.47:0/210136433 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179923 (secure 0 0 0) 0x7f6f70017020 con 0x7f6f880cdc00 2024-04-26T23:51:14.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f88167950 con 0x7f6f880cdc00 2024-04-26T23:51:14.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f7ea00640 1 -- 172.21.15.47:0/210136433 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3869 (secure 0 0 0) 0x7f6f700574a0 con 0x7f6f880cdc00 2024-04-26T23:51:14.499 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-04-26T23:51:14.499 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5635,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6836/2875189318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2875189318},{"type":"v1","addr":"172.21.15.203:6836","nonce":2875189318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5638,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/629228023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6835","nonce":629228023},{"type":"v1","addr":"172.21.15.203:6837","nonce":629228023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":5910,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6834/868771075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":868771075},{"type":"v1","addr":"172.21.15.47:6834","nonce":868771075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":6336,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/1605169797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6833","nonce":1605169797},{"type":"v1","addr":"172.21.15.47:6835","nonce":1605169797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-04-26T23:51:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 30 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f64068650 msgr2=0x7f6f6406ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f64068650 0x7f6f6406ab10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6f780ad000 tx=0x7f6f780a6000 comp rx=0 tx=0).stop 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f880cdc00 msgr2=0x7f6f881435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f880cdc00 0x7f6f881435f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000ebe0 tx=0x7f6f7000c520 comp rx=0 tx=0).stop 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 shutdown_connections 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:6832/2140288453,v1:172.21.15.203:6833/2140288453] conn(0x7f6f64068650 0x7f6f6406ab10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6f8815d5b0 0x7f6f88155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f880cdc00 0x7f6f881435f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 --2- 172.21.15.47:0/210136433 >> [v2:172.21.15.203:3301/0,v1:172.21.15.203:6790/0] conn(0x7f6f880b4360 0x7f6f880c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T23:51:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 >> 172.21.15.47:0/210136433 conn(0x7f6f8806c800 msgr2=0x7f6f880b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T23:51:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 shutdown_connections 2024-04-26T23:51:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-04-26T23:51:14.496+0000 7f6f8d200640 1 -- 172.21.15.47:0/210136433 wait complete. 2024-04-26T23:51:14.520 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-26T23:51:14.520 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T23:51:14.521 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T23:51:14.521 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:14.532 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T23:51:14.533 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T23:51:14.533 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:14.587 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T23:51:14.588 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T23:51:14.588 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:14.601 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T23:51:14.602 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T23:51:14.602 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:14.658 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T23:51:14.658 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T23:51:14.658 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T23:51:14.658 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:14.738 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T23:51:14.738 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T23:51:14.738 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:14.829 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T23:51:14.829 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T23:51:14.829 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:14.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-26T23:51:14.910 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T23:51:14.911 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T23:51:14.911 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:20.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-26T23:51:20.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-26T23:51:21.014 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T23:51:21.015 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T23:51:21.015 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:21.113 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T23:51:21.113 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T23:51:21.114 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:21.212 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T23:51:21.212 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T23:51:21.212 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:21.304 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T23:51:21.304 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T23:51:21.304 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:26.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-26T23:51:26.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-26T23:51:27.406 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T23:51:27.406 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T23:51:27.406 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T23:51:27.407 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:27.463 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T23:51:27.463 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T23:51:27.463 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:27.525 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T23:51:27.525 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T23:51:27.525 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T23:51:27.525 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:27.545 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T23:51:27.546 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T23:51:27.546 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:27.562 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T23:51:27.562 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T23:51:27.562 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T23:51:27.620 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T23:51:27.620 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T23:51:27.621 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-04-26T23:51:27.659 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:51:27.659 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T23:51:27.876 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:51:27.876 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T23:51:28.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:51:28.077 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T23:51:28.376 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:51:28.376 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T23:51:28.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:51:28.550 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T23:51:28.733 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:51:28.733 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T23:51:28.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:51:28.910 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T23:51:29.051 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:51:29.052 DEBUG:teuthology.orchestra.run.smithi203:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T23:51:29.200 INFO:tasks.ceph:Archiving mon data... 2024-04-26T23:51:29.202 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/data/mon.a.tgz 2024-04-26T23:51:29.202 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-04-26T23:51:29.211 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.uoNpk5QIjb 2024-04-26T23:51:29.212 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uoNpk5QIjb 2024-04-26T23:51:29.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.uoNpk5QIjb 2024-04-26T23:51:29.441 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.uoNpk5QIjb is 481KB 2024-04-26T23:51:29.507 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.uoNpk5QIjb 2024-04-26T23:51:29.515 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/data/mon.b.tgz 2024-04-26T23:51:29.515 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-26T23:51:29.524 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.tV9Le4bbOb 2024-04-26T23:51:29.524 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tV9Le4bbOb 2024-04-26T23:51:29.710 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.tV9Le4bbOb 2024-04-26T23:51:29.787 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.tV9Le4bbOb is 648KB 2024-04-26T23:51:29.858 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.tV9Le4bbOb 2024-04-26T23:51:29.866 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/data/mon.c.tgz 2024-04-26T23:51:29.866 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-04-26T23:51:29.915 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.i07K1wcy7V 2024-04-26T23:51:29.915 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.i07K1wcy7V 2024-04-26T23:51:30.095 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.i07K1wcy7V 2024-04-26T23:51:30.171 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.i07K1wcy7V is 648KB 2024-04-26T23:51:30.239 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.i07K1wcy7V 2024-04-26T23:51:30.248 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T23:51:30.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:51:30.252 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T23:51:30.321 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:51:30.359 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T23:51:30.359 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T23:51:30.361 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/remote/smithi047/crash 2024-04-26T23:51:30.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:51:30.385 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/remote/smithi203/crash 2024-04-26T23:51:30.385 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T23:51:30.416 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T23:51:30.416 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:30.431 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:30.508 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:30.529 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T23:51:30.548 INFO:tasks.ceph:Compressing logs... 2024-04-26T23:51:30.548 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:51:30.575 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T23:51:30.608 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36392.log 2024-04-26T23:51:30.609 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32240.log 2024-04-26T23:51:30.610 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33201.log 2024-04-26T23:51:30.610 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36392.log.gz 2024-04-26T23:51:30.611 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34864.log 2024-04-26T23:51:30.611 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32240.log.gz 2024-04-26T23:51:30.612 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31790.log 2024-04-26T23:51:30.612 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33201.log.gz 2024-04-26T23:51:30.613 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37743.log 2024-04-26T23:51:30.613 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34864.log.gz 2024-04-26T23:51:30.613 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-04-26T23:51:30.614 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31790.log.gz 2024-04-26T23:51:30.614 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37930.log 2024-04-26T23:51:30.614 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37743.log.gz 2024-04-26T23:51:30.615 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39664.log 2024-04-26T23:51:30.615 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-04-26T23:51:30.616 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-04-26T23:51:30.616 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37930.log.gz 2024-04-26T23:51:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38269.log 2024-04-26T23:51:30.617 INFO:teuthology.orchestra.run.smithi047.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39664.log.gz 2024-04-26T23:51:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38035.log 2024-04-26T23:51:30.618 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-04-26T23:51:30.620 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T23:51:30.621 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T23:51:30.621 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27701.log 2024-04-26T23:51:30.621 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27797.log 2024-04-26T23:51:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38269.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T23:51:30.623 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38269.log.gz 2024-04-26T23:51:30.623 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37386.log 2024-04-26T23:51:30.623 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38035.log.gz 2024-04-26T23:51:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36287.log 2024-04-26T23:51:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40694.log 2024-04-26T23:51:30.624 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37386.log.gz 2024-04-26T23:51:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38759.log 2024-04-26T23:51:30.624 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36287.log.gz 2024-04-26T23:51:30.624 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39870.log 2024-04-26T23:51:30.632 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33498.log 2024-04-26T23:51:30.632 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27701.log.gz 2024-04-26T23:51:30.632 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27653.log 2024-04-26T23:51:30.633 INFO:teuthology.orchestra.run.smithi203.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27797.log.gz 2024-04-26T23:51:30.633 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.3.33498.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T23:51:30.633 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27653.log: 90.7% -- replaced with /var/log/ceph/ceph-client.3.33498.log.gz 2024-04-26T23:51:30.633 INFO:teuthology.orchestra.run.smithi203.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27653.log.gz 2024-04-26T23:51:30.633 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33669.log 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.1.33669.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27773.log 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.1.33669.log.gz 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33894.log 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27749.log 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27773.log.gz 2024-04-26T23:51:30.634 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.1.33894.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:51:30.635 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27725.log 2024-04-26T23:51:30.635 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27749.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T23:51:30.635 INFO:teuthology.orchestra.run.smithi203.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27749.log.gz 2024-04-26T23:51:30.635 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27725.log: 95.3% -- replaced with /var/log/ceph/ceph-client.1.33894.log.gz 2024-04-26T23:51:30.637 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27821.log 2024-04-26T23:51:30.637 INFO:teuthology.orchestra.run.smithi203.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27725.log.gz 2024-04-26T23:51:30.637 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:51:30.638 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27821.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T23:51:30.638 INFO:teuthology.orchestra.run.smithi203.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27821.log.gz 2024-04-26T23:51:30.641 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40694.log.gz 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40928.log 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38759.log.gz 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36153.log 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39870.log.gz 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40928.log: 93.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34310.log 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40928.log.gz 2024-04-26T23:51:30.642 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35338.log 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36153.log.gz 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33175.log 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34310.log.gz 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32718.log 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35338.log.gz 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33175.log.gz 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39244.log 2024-04-26T23:51:30.643 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32718.log.gz 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37904.log 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39244.log.gz 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35520.log 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38522.log 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37904.log.gz 2024-04-26T23:51:30.644 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33071.log 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35520.log.gz 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38522.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38522.log.gz 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35468.log 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33071.log.gz 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39813.log 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34173.log 2024-04-26T23:51:30.645 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35468.log.gz 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38932.log 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39813.log.gz 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33859.log 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34173.log.gz 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32719.log 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38932.log.gz 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34362.log 2024-04-26T23:51:30.646 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33859.log.gz 2024-04-26T23:51:30.651 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T23:51:30.651 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:51:30.651 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T23:51:30.651 INFO:teuthology.orchestra.run.smithi203.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T23:51:30.652 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T23:51:30.652 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33385.log 2024-04-26T23:51:30.652 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.1.33385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27677.log 2024-04-26T23:51:30.654 INFO:teuthology.orchestra.run.smithi203.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.1.33385.log.gz 2024-04-26T23:51:30.654 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/ceph-client.admin.27677.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27677.log.gz 2024-04-26T23:51:30.659 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35598.log 2024-04-26T23:51:30.659 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32719.log.gz 2024-04-26T23:51:30.659 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40131.log 2024-04-26T23:51:30.659 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34362.log.gz 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34786.log 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35598.log.gz 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31620.log 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40131.log.gz 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32705.log 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34786.log.gz 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39638.log 2024-04-26T23:51:30.660 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31620.log.gz 2024-04-26T23:51:30.661 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-04-26T23:51:30.661 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32705.log.gz 2024-04-26T23:51:30.661 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39638.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39638.log.gz 2024-04-26T23:51:30.661 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39586.log 2024-04-26T23:51:30.661 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-04-26T23:51:30.662 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-04-26T23:51:30.662 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36183.log 2024-04-26T23:51:30.662 INFO:teuthology.orchestra.run.smithi047.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39586.log.gz 2024-04-26T23:51:30.662 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37571.log 2024-04-26T23:51:30.662 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-04-26T23:51:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40902.log 2024-04-26T23:51:30.663 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36183.log.gz 2024-04-26T23:51:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32636.log 2024-04-26T23:51:30.663 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37571.log.gz 2024-04-26T23:51:30.663 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35930.log 2024-04-26T23:51:30.663 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40902.log.gz 2024-04-26T23:51:30.664 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38165.log 2024-04-26T23:51:30.664 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32636.log.gz 2024-04-26T23:51:30.664 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39532.log 2024-04-26T23:51:30.664 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35930.log.gz 2024-04-26T23:51:30.665 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-04-26T23:51:30.665 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38165.log.gz 2024-04-26T23:51:30.665 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.39532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37983.log 2024-04-26T23:51:30.666 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37956.log 2024-04-26T23:51:30.666 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-04-26T23:51:30.666 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32888.log 2024-04-26T23:51:30.666 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37983.log.gz 2024-04-26T23:51:30.667 INFO:teuthology.orchestra.run.smithi203.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T23:51:30.672 INFO:teuthology.orchestra.run.smithi047.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.39532.log.gz 2024-04-26T23:51:30.672 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32221.log 2024-04-26T23:51:30.672 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37956.log.gz 2024-04-26T23:51:30.672 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32082.log 2024-04-26T23:51:30.672 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32888.log.gz 2024-04-26T23:51:30.672 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40616.log 2024-04-26T23:51:30.672 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32221.log.gz 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32082.log.gz 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38444.log 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40616.log.gz 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31816.log 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35442.log 2024-04-26T23:51:30.673 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38444.log.gz 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37651.log 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31816.log.gz 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32993.log 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35442.log.gz 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39922.log 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37651.log.gz 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31926.log 2024-04-26T23:51:30.674 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32993.log.gz 2024-04-26T23:51:30.675 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34225.log 2024-04-26T23:51:30.675 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39922.log.gz 2024-04-26T23:51:30.675 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35182.log 2024-04-26T23:51:30.675 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31926.log.gz 2024-04-26T23:51:30.675 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36066.log 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34225.log.gz 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33703.log 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35182.log.gz 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38113.log 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36066.log.gz 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34550.log 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33703.log.gz 2024-04-26T23:51:30.678 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38113.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T23:51:30.679 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38113.log.gz 2024-04-26T23:51:30.679 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-04-26T23:51:30.679 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34550.log.gz 2024-04-26T23:51:30.679 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34493.log 2024-04-26T23:51:30.681 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39374.log 2024-04-26T23:51:30.681 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-04-26T23:51:30.681 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34441.log 2024-04-26T23:51:30.681 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34493.log.gz 2024-04-26T23:51:30.681 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35156.log 2024-04-26T23:51:30.681 INFO:teuthology.orchestra.run.smithi047.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39374.log.gz 2024-04-26T23:51:30.681 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41032.log 2024-04-26T23:51:30.682 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34441.log.gz 2024-04-26T23:51:30.683 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34969.log 2024-04-26T23:51:30.683 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35156.log.gz 2024-04-26T23:51:30.683 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38787.log 2024-04-26T23:51:30.683 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41032.log.gz 2024-04-26T23:51:30.684 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35772.log 2024-04-26T23:51:30.684 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34969.log.gz 2024-04-26T23:51:30.684 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38876.log 2024-04-26T23:51:30.685 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38787.log.gz 2024-04-26T23:51:30.685 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39166.log 2024-04-26T23:51:30.686 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35772.log.gz 2024-04-26T23:51:30.686 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2024-04-26T23:51:30.686 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38876.log.gz 2024-04-26T23:51:30.688 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35494.log 2024-04-26T23:51:30.688 INFO:teuthology.orchestra.run.smithi047.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39166.log.gz 2024-04-26T23:51:30.688 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37878.log 2024-04-26T23:51:30.688 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2024-04-26T23:51:30.689 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37493.log 2024-04-26T23:51:30.689 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35494.log.gz 2024-04-26T23:51:30.690 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37878.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T23:51:30.690 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37878.log.gz 2024-04-26T23:51:30.690 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39787.log 2024-04-26T23:51:30.691 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37493.log.gz 2024-04-26T23:51:30.691 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38139.log 2024-04-26T23:51:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39787.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39787.log.gz 2024-04-26T23:51:30.692 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34467.log 2024-04-26T23:51:30.693 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38139.log: /var/log/ceph/ceph-client.admin.32941.log 2024-04-26T23:51:30.694 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34467.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38139.log.gz 2024-04-26T23:51:30.695 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37467.log 2024-04-26T23:51:30.695 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34467.log.gz 2024-04-26T23:51:30.696 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33480.log 2024-04-26T23:51:30.696 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-04-26T23:51:30.697 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34890.log 2024-04-26T23:51:30.698 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37467.log.gz 2024-04-26T23:51:30.698 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33123.log 2024-04-26T23:51:30.698 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33480.log.gz 2024-04-26T23:51:30.699 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40261.log 2024-04-26T23:51:30.699 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34890.log.gz 2024-04-26T23:51:30.700 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/ceph-client.admin.33123.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40209.log 2024-04-26T23:51:30.700 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40261.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33123.log.gz 2024-04-26T23:51:30.701 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40261.log.gz 2024-04-26T23:51:30.701 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39735.log 2024-04-26T23:51:30.702 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38902.log 2024-04-26T23:51:30.702 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40209.log: /var/log/ceph/ceph-client.admin.39735.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40209.log.gz 2024-04-26T23:51:30.703 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39735.log.gz 2024-04-26T23:51:30.703 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33019.log 2024-04-26T23:51:30.704 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38902.log: /var/log/ceph/ceph-client.admin.40954.log 2024-04-26T23:51:30.705 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33019.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38902.log.gz 2024-04-26T23:51:30.705 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38418.log 2024-04-26T23:51:30.705 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33019.log.gz 2024-04-26T23:51:30.706 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38652.log 2024-04-26T23:51:30.707 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gz 2024-04-26T23:51:30.707 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2024-04-26T23:51:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38652.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38418.log.gz 2024-04-26T23:51:30.708 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.33575.log 2024-04-26T23:51:30.709 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38652.log.gz 2024-04-26T23:51:30.710 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39426.log 2024-04-26T23:51:30.710 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2024-04-26T23:51:30.710 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34015.log 2024-04-26T23:51:30.712 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.2.33575.log: /var/log/ceph/ceph-client.admin.39426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34041.log 2024-04-26T23:51:30.712 INFO:teuthology.orchestra.run.smithi047.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.2.33575.log.gz 2024-04-26T23:51:30.712 INFO:teuthology.orchestra.run.smithi047.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39426.log.gz 2024-04-26T23:51:30.713 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31870.log 2024-04-26T23:51:30.713 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34015.log.gz 2024-04-26T23:51:30.714 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33807.log 2024-04-26T23:51:30.714 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34041.log.gz/var/log/ceph/ceph-client.admin.31870.log: 2024-04-26T23:51:30.715 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34706.log 2024-04-26T23:51:30.715 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31870.log.gz 2024-04-26T23:51:30.716 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32030.log 2024-04-26T23:51:30.716 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33807.log.gz 2024-04-26T23:51:30.717 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40157.log 2024-04-26T23:51:30.718 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34706.log.gz 2024-04-26T23:51:30.718 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32444.log 2024-04-26T23:51:30.719 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32030.log.gz 2024-04-26T23:51:30.719 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35078.log 2024-04-26T23:51:30.720 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40157.log.gz 2024-04-26T23:51:30.720 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5/var/log/ceph/ceph-client.admin.32444.log: --verbose -- /var/log/ceph/ceph-client.admin.38496.log 2024-04-26T23:51:30.721 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35078.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32444.log.gz 2024-04-26T23:51:30.722 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39036.log 2024-04-26T23:51:30.722 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35078.log.gz 2024-04-26T23:51:30.723 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34284.log 2024-04-26T23:51:30.723 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38496.log.gz 2024-04-26T23:51:30.724 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37769.log 2024-04-26T23:51:30.724 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39036.log: /var/log/ceph/ceph-client.admin.34284.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39036.log.gz 2024-04-26T23:51:30.725 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35650.log 2024-04-26T23:51:30.725 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34284.log.gz 2024-04-26T23:51:30.727 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39896.log 2024-04-26T23:51:30.727 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37769.log.gz 2024-04-26T23:51:30.727 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T23:51:30.728 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35650.log: /var/log/ceph/ceph-client.admin.39896.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35650.log.gz 2024-04-26T23:51:30.728 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31685.log 2024-04-26T23:51:30.728 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39896.log.gz 2024-04-26T23:51:30.729 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40798.log 2024-04-26T23:51:30.730 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36313.log 2024-04-26T23:51:30.730 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31685.log.gz 2024-04-26T23:51:30.732 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35878.log 2024-04-26T23:51:30.732 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40798.log.gz 2024-04-26T23:51:30.733 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40720.log 2024-04-26T23:51:30.733 INFO:teuthology.orchestra.run.smithi047.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36313.log.gz 2024-04-26T23:51:30.734 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39062.log 2024-04-26T23:51:30.735 INFO:teuthology.orchestra.run.smithi047.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35878.log.gz 2024-04-26T23:51:30.735 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36470.log 2024-04-26T23:51:30.735 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40720.log.gz 2024-04-26T23:51:30.736 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33149.log 2024-04-26T23:51:30.737 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39062.log.gz 2024-04-26T23:51:30.737 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32443.log 2024-04-26T23:51:30.738 INFO:teuthology.orchestra.run.smithi047.stderr: 91.4%/var/log/ceph/ceph-client.admin.33149.log: -- replaced with /var/log/ceph/ceph-client.admin.36470.log.gz 2024-04-26T23:51:30.738 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40668.log 2024-04-26T23:51:30.739 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33149.log.gz 2024-04-26T23:51:30.740 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34654.log 2024-04-26T23:51:30.740 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32443.log.gz 2024-04-26T23:51:30.741 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32700.log 2024-04-26T23:51:30.741 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40668.log.gz 2024-04-26T23:51:30.742 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36339.log 2024-04-26T23:51:30.743 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34654.log.gz 2024-04-26T23:51:30.743 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34524.log 2024-04-26T23:51:30.744 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32700.log.gz 2024-04-26T23:51:30.744 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-04-26T23:51:30.745 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36339.log.gz 2024-04-26T23:51:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37852.log 2024-04-26T23:51:30.746 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34524.log.gz 2024-04-26T23:51:30.746 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36624.log 2024-04-26T23:51:30.747 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-04-26T23:51:30.747 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39948.log 2024-04-26T23:51:30.748 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37852.log.gz 2024-04-26T23:51:30.749 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35364.log 2024-04-26T23:51:30.749 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36624.log.gz 2024-04-26T23:51:30.750 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38366.log 2024-04-26T23:51:30.750 INFO:teuthology.orchestra.run.smithi047.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39948.log.gz 2024-04-26T23:51:30.751 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35364.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T23:51:30.751 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35364.log.gz 2024-04-26T23:51:30.752 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37545.log 2024-04-26T23:51:30.752 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38366.log.gz 2024-04-26T23:51:30.753 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37599.log 2024-04-26T23:51:30.755 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36365.log 2024-04-26T23:51:30.755 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37545.log.gz 2024-04-26T23:51:30.756 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38314.log 2024-04-26T23:51:30.756 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37599.log.gz 2024-04-26T23:51:30.757 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39296.log 2024-04-26T23:51:30.757 INFO:teuthology.orchestra.run.smithi047.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36365.log.gz 2024-04-26T23:51:30.758 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38314.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38314.log.gz 2024-04-26T23:51:30.759 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36261.log 2024-04-26T23:51:30.760 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39296.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.39296.log.gz -5 2024-04-26T23:51:30.760 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40385.log 2024-04-26T23:51:30.761 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36520.log 2024-04-26T23:51:30.761 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36261.log.gz 2024-04-26T23:51:30.763 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40385.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40385.log.gz 2024-04-26T23:51:30.764 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36520.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36520.log.gz 2024-04-26T23:51:30.764 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27485.log 2024-04-26T23:51:30.765 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33755.log 2024-04-26T23:51:30.767 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-04-26T23:51:30.767 INFO:teuthology.orchestra.run.smithi047.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27485.log.gz 2024-04-26T23:51:30.768 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33755.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33755.log.gz 2024-04-26T23:51:30.768 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32708.log 2024-04-26T23:51:30.769 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40027.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-04-26T23:51:30.770 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34095.log 2024-04-26T23:51:30.771 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36650.log 2024-04-26T23:51:30.771 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32708.log.gz 2024-04-26T23:51:30.772 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35052.log 2024-04-26T23:51:30.772 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34095.log.gz 2024-04-26T23:51:30.773 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36650.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36650.log.gz 2024-04-26T23:51:30.774 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40590.log 2024-04-26T23:51:30.774 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35052.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35052.log.gz 2024-04-26T23:51:30.775 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32914.log 2024-04-26T23:51:30.777 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34336.log 2024-04-26T23:51:30.777 INFO:teuthology.orchestra.run.smithi047.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40590.log.gz 2024-04-26T23:51:30.778 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32914.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32914.log.gz 2024-04-26T23:51:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34336.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34336.log.gz 2024-04-26T23:51:30.779 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31738.log 2024-04-26T23:51:30.781 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35234.log 2024-04-26T23:51:30.782 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33645.log 2024-04-26T23:51:30.783 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31738.log.gz 2024-04-26T23:51:30.783 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35286.log 2024-04-26T23:51:30.783 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35234.log.gz 2024-04-26T23:51:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33645.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33645.log.gz 2024-04-26T23:51:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39761.log 2024-04-26T23:51:30.785 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35286.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35286.log.gz 2024-04-26T23:51:30.786 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39088.log 2024-04-26T23:51:30.788 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-04-26T23:51:30.788 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39761.log.gz 2024-04-26T23:51:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39088.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39088.log.gz 2024-04-26T23:51:30.789 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34067.log 2024-04-26T23:51:30.790 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35130.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-04-26T23:51:30.790 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37821.log 2024-04-26T23:51:30.791 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-04-26T23:51:30.791 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34067.log.gz 2024-04-26T23:51:30.793 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32435.log 2024-04-26T23:51:30.793 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37821.log.gz 2024-04-26T23:51:30.794 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40850.log 2024-04-26T23:51:30.794 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-04-26T23:51:30.795 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39400.log 2024-04-26T23:51:30.795 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32435.log.gz 2024-04-26T23:51:30.797 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40850.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40850.log.gz 2024-04-26T23:51:30.797 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32223.log 2024-04-26T23:51:30.797 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39400.log.gz 2024-04-26T23:51:30.798 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22675.log 2024-04-26T23:51:30.799 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33436.log 2024-04-26T23:51:30.800 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32223.log.gz 2024-04-26T23:51:30.800 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.tmp-client.admin.22675.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22675.log.gz 2024-04-26T23:51:30.801 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35021.log 2024-04-26T23:51:30.802 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.33436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32239.log 2024-04-26T23:51:30.802 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35021.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.33436.log.gz 2024-04-26T23:51:30.803 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35021.log.gz 2024-04-26T23:51:30.804 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32239.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32239.log.gz 2024-04-26T23:51:30.805 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32056.log 2024-04-26T23:51:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38731.log 2024-04-26T23:51:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35826.log 2024-04-26T23:51:30.807 INFO:teuthology.orchestra.run.smithi047.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32056.log.gz 2024-04-26T23:51:30.808 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32423.log 2024-04-26T23:51:30.809 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38731.log.gz 2024-04-26T23:51:30.810 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35826.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35826.log.gz 2024-04-26T23:51:30.810 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33308.log 2024-04-26T23:51:30.811 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32423.log.gz 2024-04-26T23:51:30.811 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38958.log 2024-04-26T23:51:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32628.log 2024-04-26T23:51:30.813 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33308.log.gz 2024-04-26T23:51:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38958.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T23:51:30.814 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38958.log.gz 2024-04-26T23:51:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32628.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32628.log.gz 2024-04-26T23:51:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32229.log 2024-04-26T23:51:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34732.log 2024-04-26T23:51:30.817 INFO:teuthology.orchestra.run.smithi047.stderr: 86.2%/var/log/ceph/ceph-client.admin.32229.log: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T23:51:30.817 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32229.log.gz 2024-04-26T23:51:30.818 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40746.log 2024-04-26T23:51:30.819 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34732.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34732.log.gz 2024-04-26T23:51:30.819 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32004.log 2024-04-26T23:51:30.821 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33677.log 2024-04-26T23:51:30.821 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40746.log.gz 2024-04-26T23:51:30.822 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40772.log 2024-04-26T23:51:30.822 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32004.log.gz 2024-04-26T23:51:30.822 INFO:teuthology.orchestra.run.smithi203.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T23:51:30.823 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33677.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33677.log.gz 2024-04-26T23:51:30.823 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34602.log 2024-04-26T23:51:30.824 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40772.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40772.log.gz 2024-04-26T23:51:30.824 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39322.log 2024-04-26T23:51:30.826 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34943.log 2024-04-26T23:51:30.826 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34602.log.gz 2024-04-26T23:51:30.827 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34758.log 2024-04-26T23:51:30.827 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39322.log.gz 2024-04-26T23:51:30.828 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35682.log 2024-04-26T23:51:30.828 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34943.log.gz 2024-04-26T23:51:30.829 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34758.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34758.log.gz 2024-04-26T23:51:30.830 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40053.log 2024-04-26T23:51:30.831 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35682.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35682.log.gz 2024-04-26T23:51:30.831 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39218.log 2024-04-26T23:51:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38061.log 2024-04-26T23:51:30.833 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2024-04-26T23:51:30.834 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39218.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39218.log.gz 2024-04-26T23:51:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38061.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38061.log.gz 2024-04-26T23:51:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32232.log 2024-04-26T23:51:30.837 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2024-04-26T23:51:30.838 INFO:teuthology.orchestra.run.smithi203.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T23:51:30.838 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38984.log 2024-04-26T23:51:30.838 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32232.log.gz 2024-04-26T23:51:30.839 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32431.log 2024-04-26T23:51:30.839 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2024-04-26T23:51:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38984.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38984.log.gz 2024-04-26T23:51:30.841 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35260.log 2024-04-26T23:51:30.842 INFO:teuthology.orchestra.run.smithi047.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32431.log.gz 2024-04-26T23:51:30.842 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39974.log 2024-04-26T23:51:30.843 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35572.log 2024-04-26T23:51:30.844 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35260.log.gz 2024-04-26T23:51:30.845 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38217.log 2024-04-26T23:51:30.845 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39974.log.gz 2024-04-26T23:51:30.846 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38392.log 2024-04-26T23:51:30.846 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35572.log.gz 2024-04-26T23:51:30.847 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38217.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38217.log.gz 2024-04-26T23:51:30.848 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33619.log 2024-04-26T23:51:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38392.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38392.log.gz 2024-04-26T23:51:30.849 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33781.log 2024-04-26T23:51:30.850 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33729.log 2024-04-26T23:51:30.850 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33619.log.gz 2024-04-26T23:51:30.855 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33781.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33781.log.gz 2024-04-26T23:51:30.855 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40642.log 2024-04-26T23:51:30.855 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33729.log.gz 2024-04-26T23:51:30.855 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32967.log 2024-04-26T23:51:30.856 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36235.log 2024-04-26T23:51:30.856 INFO:teuthology.orchestra.run.smithi047.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40642.log.gz 2024-04-26T23:51:30.856 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32235.log 2024-04-26T23:51:30.857 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32967.log.gz 2024-04-26T23:51:30.857 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33833.log 2024-04-26T23:51:30.857 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36235.log.gz 2024-04-26T23:51:30.858 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32235.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32235.log.gz 2024-04-26T23:51:30.859 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36444.log 2024-04-26T23:51:30.860 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33833.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.33833.log.gz -5 2024-04-26T23:51:30.860 INFO:teuthology.orchestra.run.smithi047.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34199.log 2024-04-26T23:51:30.861 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40980.log 2024-04-26T23:51:30.861 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36444.log.gz 2024-04-26T23:51:30.862 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34199.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34199.log.gz 2024-04-26T23:51:30.863 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32186.log 2024-04-26T23:51:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40980.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40980.log.gz 2024-04-26T23:51:30.864 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40079.log 2024-04-26T23:51:30.865 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32434.log 2024-04-26T23:51:30.865 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32186.log.gz 2024-04-26T23:51:30.866 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40079.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40079.log.gz 2024-04-26T23:51:30.867 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35104.log 2024-04-26T23:51:30.868 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32434.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32434.log.gz 2024-04-26T23:51:30.868 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35746.log 2024-04-26T23:51:30.869 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38087.log 2024-04-26T23:51:30.869 INFO:teuthology.orchestra.run.smithi047.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35104.log.gz 2024-04-26T23:51:30.870 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35746.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35746.log.gz 2024-04-26T23:51:30.871 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38087.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38087.log.gz 2024-04-26T23:51:30.871 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40512.log 2024-04-26T23:51:30.872 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33911.log 2024-04-26T23:51:30.874 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34147.log 2024-04-26T23:51:30.874 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40512.log.gz 2024-04-26T23:51:30.875 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33911.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33911.log.gz 2024-04-26T23:51:30.876 INFO:teuthology.orchestra.run.smithi203.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T23:51:30.876 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34147.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34147.log.gz 2024-04-26T23:51:30.877 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38850.log 2024-04-26T23:51:30.878 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36576.log 2024-04-26T23:51:30.879 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36755.log 2024-04-26T23:51:30.880 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38850.log.gz 2024-04-26T23:51:30.880 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.0.36576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36038.log 2024-04-26T23:51:30.882 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36755.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36755.log.gz 2024-04-26T23:51:30.883 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32234.log 2024-04-26T23:51:30.883 INFO:teuthology.orchestra.run.smithi047.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36038.log.gz 2024-04-26T23:51:30.883 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35312.log 2024-04-26T23:51:30.885 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32234.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32234.log.gz 2024-04-26T23:51:30.885 INFO:teuthology.orchestra.run.smithi047.stderr:gzip/var/log/ceph/ceph-client.admin.35312.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32442.log 2024-04-26T23:51:30.886 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35312.log.gz 2024-04-26T23:51:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32442.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32442.log.gz 2024-04-26T23:51:30.888 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37412.log 2024-04-26T23:51:30.890 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T23:51:30.891 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37412.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37412.log.gz 2024-04-26T23:51:30.894 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.audit.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T23:51:30.894 INFO:teuthology.orchestra.run.smithi203.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T23:51:30.895 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35956.log 2024-04-26T23:51:30.896 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34258.log 2024-04-26T23:51:30.897 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35956.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35956.log.gz 2024-04-26T23:51:30.898 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34258.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34258.log.gz 2024-04-26T23:51:30.898 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T23:51:30.899 INFO:teuthology.orchestra.run.smithi203.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T23:51:30.900 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39192.log 2024-04-26T23:51:30.903 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.39192.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39192.log.gz 2024-04-26T23:51:30.903 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34389.log 2024-04-26T23:51:30.903 INFO:teuthology.orchestra.run.smithi047.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T23:51:30.904 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40876.log 2024-04-26T23:51:30.906 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34389.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34389.log.gz 2024-04-26T23:51:30.906 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39839.log 2024-04-26T23:51:30.907 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40876.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40876.log.gz 2024-04-26T23:51:30.908 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39839.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T23:51:30.910 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39839.log.gz 2024-04-26T23:51:30.910 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35624.log 2024-04-26T23:51:30.913 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.35624.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35624.log.gz 2024-04-26T23:51:30.913 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38191.log 2024-04-26T23:51:30.915 INFO:teuthology.orchestra.run.smithi047.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T23:51:30.916 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38815.log 2024-04-26T23:51:30.916 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38191.log.gz 2024-04-26T23:51:30.917 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35852.log 2024-04-26T23:51:30.918 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38815.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38815.log.gz 2024-04-26T23:51:30.919 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27598.log 2024-04-26T23:51:30.920 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35852.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35852.log.gz 2024-04-26T23:51:30.921 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39270.log 2024-04-26T23:51:30.922 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27598.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27598.log.gz 2024-04-26T23:51:30.922 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41008.log 2024-04-26T23:51:30.924 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39270.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39270.log.gz 2024-04-26T23:51:30.924 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40183.log 2024-04-26T23:51:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.41008.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41008.log.gz 2024-04-26T23:51:30.926 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34121.log 2024-04-26T23:51:30.927 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40183.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40183.log.gz 2024-04-26T23:51:30.928 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39010.log 2024-04-26T23:51:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34121.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34121.log.gz 2024-04-26T23:51:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31531.log 2024-04-26T23:51:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39010.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39010.log.gz 2024-04-26T23:51:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37519.log 2024-04-26T23:51:30.932 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31531.log.gz 2024-04-26T23:51:30.933 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36676.log 2024-04-26T23:51:30.934 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37519.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37519.log.gz 2024-04-26T23:51:30.935 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35798.log 2024-04-26T23:51:30.936 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36676.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36676.log.gz 2024-04-26T23:51:30.936 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31587.log 2024-04-26T23:51:30.938 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35798.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35798.log.gz 2024-04-26T23:51:30.938 INFO:teuthology.orchestra.run.smithi047.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T23:51:30.938 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36008.log 2024-04-26T23:51:30.939 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31587.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31587.log.gz 2024-04-26T23:51:30.939 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32134.log 2024-04-26T23:51:30.940 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36703.log 2024-04-26T23:51:30.941 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36008.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36008.log.gz/var/log/ceph/ceph-client.admin.32134.log: 2024-04-26T23:51:30.942 INFO:teuthology.orchestra.run.smithi047.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32134.log.gz 2024-04-26T23:51:30.942 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2024-04-26T23:51:30.943 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36703.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36703.log.gz 2024-04-26T23:51:30.943 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34995.log 2024-04-26T23:51:30.944 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39476.log 2024-04-26T23:51:30.945 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36418.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gz 2024-04-26T23:51:30.946 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34995.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34995.log.gz 2024-04-26T23:51:30.946 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35390.log 2024-04-26T23:51:30.947 INFO:teuthology.orchestra.run.smithi047.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39476.log.gz 2024-04-26T23:51:30.947 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34680.log 2024-04-26T23:51:30.948 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38340.log 2024-04-26T23:51:30.949 INFO:teuthology.orchestra.run.smithi203.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T23:51:30.949 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35390.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35390.log.gz 2024-04-26T23:51:30.950 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34680.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34680.log.gz 2024-04-26T23:51:30.950 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33045.log 2024-04-26T23:51:30.951 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38340.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38340.log.gz 2024-04-26T23:51:30.951 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36209.log 2024-04-26T23:51:30.952 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32862.log 2024-04-26T23:51:30.953 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33045.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33045.log.gz/var/log/ceph/ceph-client.admin.36209.log: 2024-04-26T23:51:30.954 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36209.log.gz 2024-04-26T23:51:30.954 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27704.log 2024-04-26T23:51:30.955 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32862.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32862.log.gz 2024-04-26T23:51:30.955 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33937.log 2024-04-26T23:51:30.956 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41058.log 2024-04-26T23:51:30.957 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.27704.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27704.log.gz 2024-04-26T23:51:30.957 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33937.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33937.log.gz 2024-04-26T23:51:30.958 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.41058.log: -- /var/log/ceph/ceph-client.admin.39692.log 2024-04-26T23:51:30.959 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41058.log.gz 2024-04-26T23:51:30.959 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35416.log 2024-04-26T23:51:30.960 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-04-26T23:51:30.961 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39692.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39692.log.gz 2024-04-26T23:51:30.962 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31764.log: /var/log/ceph/ceph-client.admin.35416.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-04-26T23:51:30.963 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32448.log 2024-04-26T23:51:30.963 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35416.log.gz 2024-04-26T23:51:30.964 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40287.log 2024-04-26T23:51:30.965 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36101.log 2024-04-26T23:51:30.966 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32448.log.gz 2024-04-26T23:51:30.967 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35546.log 2024-04-26T23:51:30.967 INFO:teuthology.orchestra.run.smithi047.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40287.log.gz 2024-04-26T23:51:30.968 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36101.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36101.log.gz 2024-04-26T23:51:30.968 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-04-26T23:51:30.969 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35546.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35546.log.gz 2024-04-26T23:51:30.969 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34415.log 2024-04-26T23:51:30.971 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34628.log 2024-04-26T23:51:30.971 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31711.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz/var/log/ceph/ceph-client.admin.34415.log: 2024-04-26T23:51:30.972 INFO:teuthology.orchestra.run.smithi047.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34415.log.gz 2024-04-26T23:51:30.973 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33253.log 2024-04-26T23:51:30.973 INFO:teuthology.orchestra.run.smithi047.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34628.log.gz 2024-04-26T23:51:30.974 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38243.log 2024-04-26T23:51:30.975 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38704.log 2024-04-26T23:51:30.976 INFO:teuthology.orchestra.run.smithi047.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33253.log.gz 2024-04-26T23:51:30.976 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36127.log 2024-04-26T23:51:30.976 INFO:teuthology.orchestra.run.smithi047.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38243.log.gz 2024-04-26T23:51:30.978 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40332.log 2024-04-26T23:51:30.978 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38704.log.gz 2024-04-26T23:51:30.979 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40001.log 2024-04-26T23:51:30.979 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36127.log.gz 2024-04-26T23:51:30.980 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39348.log 2024-04-26T23:51:30.980 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40332.log.gz 2024-04-26T23:51:30.981 INFO:teuthology.orchestra.run.smithi203.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T23:51:30.981 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33097.log 2024-04-26T23:51:30.981 INFO:teuthology.orchestra.run.smithi047.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40001.log.gz 2024-04-26T23:51:30.982 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32836.log 2024-04-26T23:51:30.983 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39348.log.gz 2024-04-26T23:51:30.984 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-04-26T23:51:30.984 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m0.386s 2024-04-26T23:51:30.984 INFO:teuthology.orchestra.run.smithi203.stderr:user 0m1.786s 2024-04-26T23:51:30.984 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m0.178s 2024-04-26T23:51:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38678.log 2024-04-26T23:51:30.985 INFO:teuthology.orchestra.run.smithi047.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33097.log.gz 2024-04-26T23:51:30.985 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37438.log 2024-04-26T23:51:30.985 INFO:teuthology.orchestra.run.smithi047.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32836.log.gz 2024-04-26T23:51:30.986 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38678.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38678.log.gz 2024-04-26T23:51:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37438.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37438.log.gz 2024-04-26T23:51:30.987 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37677.log 2024-04-26T23:51:30.988 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31842.log 2024-04-26T23:51:30.990 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40411.log 2024-04-26T23:51:30.990 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37677.log.gz 2024-04-26T23:51:30.991 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31842.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31842.log.gz 2024-04-26T23:51:30.992 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40411.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40411.log.gz 2024-04-26T23:51:30.993 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34838.log 2024-04-26T23:51:30.993 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31952.log 2024-04-26T23:51:30.995 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38009.log 2024-04-26T23:51:30.995 INFO:teuthology.orchestra.run.smithi047.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34838.log.gz 2024-04-26T23:51:30.996 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31952.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31952.log.gz 2024-04-26T23:51:30.997 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.38009.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38009.log.gz 2024-04-26T23:51:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-04-26T23:51:30.998 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32635.log 2024-04-26T23:51:31.000 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39612.log 2024-04-26T23:51:31.000 INFO:teuthology.orchestra.run.smithi047.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-04-26T23:51:31.001 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32635.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32635.log.gz 2024-04-26T23:51:31.002 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.39612.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39612.log.gz 2024-04-26T23:51:31.002 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34576.log 2024-04-26T23:51:31.003 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34917.log 2024-04-26T23:51:31.005 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34812.log 2024-04-26T23:51:31.005 INFO:teuthology.orchestra.run.smithi047.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34576.log.gz 2024-04-26T23:51:31.006 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34917.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34917.log.gz 2024-04-26T23:51:31.007 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.34812.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34812.log.gz 2024-04-26T23:51:31.007 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32160.log 2024-04-26T23:51:31.008 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40486.log 2024-04-26T23:51:31.010 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40235.log 2024-04-26T23:51:31.010 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32160.log.gz 2024-04-26T23:51:31.011 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40486.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40486.log.gz 2024-04-26T23:51:31.012 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40235.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40235.log.gz 2024-04-26T23:51:31.012 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32108.log 2024-04-26T23:51:31.013 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36729.log 2024-04-26T23:51:31.015 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.32108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40359.log 2024-04-26T23:51:31.015 INFO:teuthology.orchestra.run.smithi047.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32108.log.gz 2024-04-26T23:51:31.016 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.36729.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36729.log.gz 2024-04-26T23:51:31.017 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40359.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40359.log.gz 2024-04-26T23:51:31.017 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31898.log 2024-04-26T23:51:31.018 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2024-04-26T23:51:31.020 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33963.log 2024-04-26T23:51:31.020 INFO:teuthology.orchestra.run.smithi047.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31898.log.gz 2024-04-26T23:51:31.021 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.37625.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2024-04-26T23:51:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.33963.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33963.log.gz 2024-04-26T23:51:31.022 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35904.log 2024-04-26T23:51:31.023 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40564.log 2024-04-26T23:51:31.025 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.35904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31978.log 2024-04-26T23:51:31.025 INFO:teuthology.orchestra.run.smithi047.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35904.log.gz 2024-04-26T23:51:31.026 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40564.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40564.log.gz 2024-04-26T23:51:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.31978.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31978.log.gz 2024-04-26T23:51:31.027 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40824.log 2024-04-26T23:51:31.029 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.40824.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40824.log.gz 2024-04-26T23:51:31.117 INFO:teuthology.orchestra.run.smithi047.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T23:51:31.122 INFO:teuthology.orchestra.run.smithi047.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T23:51:31.127 INFO:teuthology.orchestra.run.smithi047.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.0.36576.log.gz 2024-04-26T23:51:31.165 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T23:51:31.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-26T23:51:31.959 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T23:51:31.961 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-04-26T23:51:31.961 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m1.382s 2024-04-26T23:51:31.961 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m3.247s 2024-04-26T23:51:31.962 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.763s 2024-04-26T23:51:31.963 INFO:tasks.ceph:Archiving logs... 2024-04-26T23:51:31.963 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/remote/smithi047/log 2024-04-26T23:51:31.964 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:51:32.584 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/remote/smithi203/log 2024-04-26T23:51:32.585 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T23:51:32.810 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T23:51:32.830 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T23:51:32.830 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:51:32.833 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T23:51:32.904 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T23:51:32.913 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T23:51:32.914 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:51:32.917 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T23:51:32.929 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:51:32.929 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-04-26T23:51:32.929 INFO:teuthology.orchestra.run.smithi047.stdout:+hv01.front.sepi 67.205.162.81 3 u 48 64 377 0.077 -1.889 0.875 2024-04-26T23:51:32.929 INFO:teuthology.orchestra.run.smithi047.stdout:*hv02.front.sepi 63.231.80.2 3 u 46 64 377 0.084 -0.367 0.823 2024-04-26T23:51:32.929 INFO:teuthology.orchestra.run.smithi047.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.081 +0.121 0.917 2024-04-26T23:51:32.930 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-26T23:51:32.932 INFO:teuthology.orchestra.run.smithi203.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T23:51:32.933 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================== 2024-04-26T23:51:32.933 INFO:teuthology.orchestra.run.smithi203.stdout:+hv01.front.sepi 67.205.162.81 3 u 40 64 377 0.094 -1.911 2.011 2024-04-26T23:51:32.933 INFO:teuthology.orchestra.run.smithi203.stdout:*hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.068 -0.583 1.817 2024-04-26T23:51:32.933 INFO:teuthology.orchestra.run.smithi203.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.084 +1.281 2.081 2024-04-26T23:51:32.933 INFO:teuthology.orchestra.run.smithi203.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-26T23:51:32.934 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T23:51:33.089 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T23:51:33.090 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T23:51:33.302 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T23:51:33.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T23:51:33.722 INFO:teuthology.task.internal:Duration was 1113.001872 seconds 2024-04-26T23:51:33.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T23:51:33.779 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T23:51:33.780 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:51:33.783 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T23:51:33.898 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T23:51:33.898 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-04-26T23:51:33.899 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:51:33.920 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-04-26T23:51:33.920 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T23:51:33.942 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T23:51:33.942 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:51:33.967 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T23:51:34.024 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T23:51:34.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:51:34.051 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T23:51:34.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T23:51:34.150 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T23:51:34.151 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:51:34.171 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T23:51:34.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T23:51:34.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:51:34.215 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:51:34.229 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-04-26T23:51:34.252 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-04-26T23:51:34.270 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:51:34.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:51:34.299 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T23:51:34.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T23:51:34.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T23:51:34.389 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T23:51:34.390 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/remote/smithi047 2024-04-26T23:51:34.390 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:51:34.418 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321/remote/smithi203 2024-04-26T23:51:34.419 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T23:51:34.444 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T23:51:34.445 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:51:34.459 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T23:51:34.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T23:51:34.900 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T23:51:34.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T23:51:35.069 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T23:51:35.070 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:51:35.073 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T23:51:35.079 INFO:teuthology.orchestra.run.smithi047.stdout: 658125 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:51 /home/ubuntu/cephtest 2024-04-26T23:51:35.081 INFO:teuthology.orchestra.run.smithi203.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 23:51 /home/ubuntu/cephtest 2024-04-26T23:51:35.083 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T23:51:35.234 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T23:51:35.599 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T23:51:35.622 DEBUG:teuthology.nuke:shortname: smithi047 2024-04-26T23:51:35.622 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:51:35.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:23:09.524350', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA5vUKWQ8EM5ek5xX7qF8OCwcBDasgoxa5f58E3+oBLCXkV+L3ZvQa0JTp2ryiFAaZcFdj9QYW8mrgys8vbpjoI='} 2024-04-26T23:51:35.648 DEBUG:teuthology.nuke:shortname: smithi203 2024-04-26T23:51:35.648 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T23:51:35.671 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-26_19:30:57-fs-wip-rishabh-testing-20240426.111959-testing-default-smithi/7675321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 23:23:09.525644', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBKVTk0XfNVx/3OEdFjAImHOPYnztQmEpTyWSATIOhXbLMh6pw5RaOP6M+D4U0vpKxJZsPoqpRWhtRsEh1zWXb0='} 2024-04-26T23:51:35.705 INFO:teuthology.orchestra.console.smithi047:Power off 2024-04-26T23:51:35.706 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T23:51:35.731 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off 2024-04-26T23:51:35.732 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:35.749 INFO:teuthology.orchestra.console.smithi203:Power off 2024-04-26T23:51:35.749 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T23:51:35.763 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-26T23:51:35.775 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2024-04-26T23:51:35.775 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:35.801 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-26T23:51:39.765 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:39.803 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:39.876 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-26T23:51:39.913 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-26T23:51:43.878 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:43.914 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:43.989 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on 2024-04-26T23:51:44.025 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-26T23:51:47.992 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:48.026 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T23:51:48.103 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off 2024-04-26T23:51:48.137 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-04-26T23:51:48.205 INFO:teuthology.orchestra.console.smithi047:Power off completed 2024-04-26T23:51:48.239 INFO:teuthology.orchestra.console.smithi203:Power off completed 2024-04-26T23:51:48.344 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/clone}} duration: 1113.001871585846 failure_reason: 'Test failure: test_clone_failure_status_in_progress_cancelled (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ab83492ef7a348acbb0ac8eea6ed3813 status: fail success: false 2024-04-26T23:51:48.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T23:51:48.438 INFO:teuthology.run:FAIL